220.181.158.106 - - [06/Oct/2014:02:27:22 +0800] "GET / HTTP/1.1" 200 11259 "-" "Mozilla/5.0 (Windows NT 6.1; rv:7.0.1) Gecko/20100101 Firefox/7.0.1"
220.181.158.106 - - [06/Oct/2014:02:27:22 +0800] "GET / HTTP/1.1" 200 11259 "http://www.baidu.com/" "Baiduspider+(+http://www.baidu.com/search/spider.htm)"
220.181.158.106 - - [06/Oct/2014:02:27:22 +0800] "GET / HTTP/1.1" 200 11259 "-" "360spider(http://webscan.360.cn)"
220.181.158.106 - - [06/Oct/2014:02:27:22 +0800] "GET / HTTP/1.1" 200 11259 "http://www.baidu.com/s?wd=\xe7\x99\xbe\xe5\xae\xb6\xe4\xb9\x90|\xe5\x8d\x9a\xe5\xbd\xa9|\xe7\x9a\x87\xe5\x86\xa0\xe7\xbd\x91|\xe5\xa4\xaa\xe9\x98\xb3\xe5\x9f\x8e" "Python-urllib/2.6"
218.30.118.102 - - [06/Oct/2014:06:22:34 +0800] "GET / HTTP/1.1" 200 11268 "-" "Mozilla/5.0 (Windows NT 6.1; rv:7.0.1) Gecko/20100101 Firefox/7.0.1"
218.30.118.102 - - [06/Oct/2014:06:22:34 +0800] "GET / HTTP/1.1" 200 11268 "http://www.baidu.com/" "Baiduspider+(+http://www.baidu.com/search/spider.htm)"
218.30.118.102 - - [06/Oct/2014:06:22:34 +0800] "GET / HTTP/1.1" 200 11268 "-" "360spider(http://webscan.360.cn)"
218.30.118.102 - - [06/Oct/2014:06:22:34 +0800] "GET / HTTP/1.1" 200 11268 "http://www.baidu.com/s?wd=\xe7\x99\xbe\xe5\xae\xb6\xe4\xb9\x90|\xe5\x8d\x9a\xe5\xbd\xa9|\xe7\x9a\x87\xe5\x86\xa0\xe7\xbd\x91|\xe5\xa4\xaa\xe9\x98\xb3\xe5\x9f\x8e" "Python-urllib/2.6"
怎么回事? 同一个Ip又是百度 又是360 又是火狐
本来在教研室发的帖子。夫唯叫我发到问答上大家讨论
我先是在我的信息系统项目管理师网http://www.xmgls.net发现的
后台发现我其他网站日志都有这两个IP的记录。百度了一下,网上也有人在问。不知道怎么回事。难道360和百度共享IP???我觉得不至于吧................218段的 我倒是不是很在意,主要是前者220.181.开头的,和百度很多蜘蛛处于同一个B段。。。。。。。感觉很疑惑啊
- - [30/Jun/2016:04:45:42 +0800] "GET / HTTP/" 200 40154 "-" "Mozilla/ (Windows NT rv:) Gecko/20100101 Firefox/"
- - [30/Jun/2016:04:45:42 +0800] "GET / HTTP/" 200 40154 "" "Baiduspider+(+)"
- - [30/Jun/2016:04:45:42 +0800] "GET / HTTP/" 200 40154 "-" "360spider()"
- - [30/Jun/2016:04:46:03 +0800] "GET / HTTP/" 403 162 "\xE7\x99\xBE\xE5\xAE\xB6\xE4\xB9\x90|\xE5\x8D\x9A\xE5\xBD\xA9|\xE7\x9A\x87\xE5\x86\xA0\xE7\xBD\x91|\xE5\xA4\xAA\xE9\x98\xB3\xE5\x9F\x8E" "python-urllib/"
根据度娘提供的识别蜘蛛的方法,这是伪造的蜘蛛。直接IP封了
我今天发现我的网站也是有这样的记录哦
网址:记录如下:
- - [15/Aug/2015:02:58:55 +0800] "GET / HTTP/" 200 26506 "" "Baiduspider+(+)" -
- - [15/Aug/2015:02:58:55 +0800] "GET / HTTP/" 200 26506 "-" "360spider()" -
- - [15/Aug/2015:02:58:56 +0800] "GET //themes/default/JS/ HTTP/" 200 25071 "-" "Mozilla/ (Windows NT rv:) Gecko/20100101 Firefox/" -
- - [15/Aug/2015:02:58:56 +0800] "GET / HTTP/" 200 26506 "\xE7\x99\xBE\xE5\xAE\xB6\xE4\xB9\x90|\xE5\x8D\x9A\xE5\xBD\xA9|\xE7\x9A\x87\xE5\x86\xA0\xE7\xBD\x91|\xE5\xA4\xAA\xE9\x98\xB3\xE5\x9F\x8E" "python-urllib/" -
- - [15/Aug/2015:02:59:31 +0800] "GET /ning-xia-fa-xian-rou-shi/show_ HTTP/" 200 6638 "-" "Mozilla/ (compatible; Googlebot/ +)" -
人家在模拟spider收集你网站信息?
###用了不同的浏览器访问了同一个网址呗
###每天都有这个IP 段进来那估计进沙盒或K站或降权不远了,这是降权蜘蛛
*
*
*
你的那个站应该采集的吧,题不对容。完全乱来。
本文来自投稿,不代表微盟圈立场,如若转载,请注明出处:https://www.vm7.com/a/ask/41997.html
