log日志查出来的结果抓取了很多明奇妙的目录
蜘蛛名 |
目录 |
爬取量 |
1 |
BaiDu Spider |
 /plus/ |
31 |
2 |
|
/data/ |
12 |
3 |
|
/images/ |
11 |
4 |
|
/include/ |
10 |
5 |
|
/index.php/ |
7 |
6 |
|
/admin/ |
6 |
7 |
|
/uploads/ |
5 |
8 |
|
/wp-content/ |
5 |
9 |
|
/bbs/ |
4 |
10 |
|
/5t/ |
4 |
11 |
|
/components/ |
4 |
12 |
|
/utility/ |
4 |
13 |
|
 /utility/convert/ |
4 |
14 |
|
/modules/ |
3 |
15 |
|
/cache/ |
3 |
16 |
|
/install/ |
3 |
17 |
|
/yp/ |
3 |
18 |
|
/caches/ |
2 |
19 |
|
/templets/ |
2 |
20 |
|
/upload/ |
2 |
21 |
|
/api/ |
2 |
22 |
|
/languages/ |
2 |
23 |
|
/languages/zh_cn/ |
2 |
24 |
|
/dxyylc/ |
2 |
25 |
|
/css/ |
2 |
26 |
|
/member/ |
2 |
27 |
|
/wap/ |
1 |
28 |
|
/convert/ |
1 |
29 |
|
/convert/data/ |
1 |
30 |
|
/imgevs/ |
1 |
31 |
|
/administrator/ |
1 |
32 |
|
/administrator/components/ |
1 |
33 |
|
/nevwsps/ |
1 |
34 |
|
/book/ |
1 |
35 |
|
/lang/ |
1 |
36 |
|
/lang/cn/ |
1 |
37 |
|
/tool/ |
1 |
38 |
|
/newr/ |
1 |
39 |
|
/ads/ |
1 |
40 |
|
/ads/admin/ |
1 |
41 |
|
/index.php?s=/ |
1 |
42 |
|
/index.php?s=/module/ |
1 |
43 |
|
/mews/ |
1 |
44 |
|
/2016/ |
1 |
45 |
|
/i/ |
1 |
46 |
|
/s/ |
1 |
47 |
|
/s/5v10/ |
1 |
48 |
|
/buep/ |
1 |
49 |
|
/jkjh/ |
1 |
50 |
|
/base/ |
1 |
51 |
|
/base/install/ |
1 |
52 |
|
/home/ |
1 |
53 |
|
/home/cache/ |
1 |
54 |
|
/one/ |
1 |
55 |
|
/int/ |
1 |
56 |
|
/admin.php/ |
1 |
57 |
|
/admin.php/module/ |
1 |
58 |
|
/news/ |
1 |
59 |
|
/news/2016/ |
1 |
60 |
|
/wp-includes/ |
1 |
61 |
|
/wp-includes/SimplePie/ |
1 |
62 |
|
/inc/ |
1 |
63 |
|
/inc/miandg/ |
1 |
64 |
|
/template/ |
1 |
65 |
|
/template/red/ |
1 |
66 |
|
/plugins/ |
1 |
67 |
|
/plugins/weathermap/ |
1 |
68 |
|
/lcwm/ |
1 |
69 |
|
/fdh/ |
1 |
70 |
|
/media/ |
1 |
71 |
|
/qsjj/ |
1 |
72 |
|
/qsjj/index.php?s=/ |
1 |
73 |
|
/date/ |
1 |
74 |
|
/date/js/ |
1 |
75 |
|
/Admin/ |
1 |
76 |
|
/bbx/ |
1 |
77 |
|
/ltpnes/ |
1 |
78 |
|
/Adin/ |
1 |
79 |
|
/About/ |
1 |
80 |
|
/advs/ |
1 |
81 |
|
/dlxxy/ |
|
这是什么意思啊 我好慌啊 求懂的大神为我解答一下 谢谢了
网站是否可以正常抓取，有没有屏蔽的情况。
同时检查抓取频次是否设置了上限，分析最近网站的一些操作是否存在有被惩罚的风险。
本文来自投稿，不代表微盟圈立场，如若转载，请注明出处：https://www.vm7.com/a/ask/48644.html
