2013-05-23, 23:42:19
Stuff like this?
1363789368 4134 404 Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html) (en-US)
[loads from the baiduspider]
1364026926 4399 404 MobileSafari/8536.25 CFNetwork/609 Darwin/13.0.0 (en-us)
1362883127 3664 404 Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot)
But now I look most of the 404s are from
http://www.baidu.com/search/spider.html
Does that help?
1363789368 4134 404 Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html) (en-US)
[loads from the baiduspider]
1364026926 4399 404 MobileSafari/8536.25 CFNetwork/609 Darwin/13.0.0 (en-us)
1362883127 3664 404 Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot)
But now I look most of the 404s are from
http://www.baidu.com/search/spider.html
Does that help?