常见搜索引擎蜘蛛爬虫机器IP地址段

canca canca
2011-11-14 11:32
1
0

     各大搜索引擎蜘蛛ip地址整理  

-------------百度-------------

61.135.145.*

61.135.146.*

159.226.50.*

202.108.11.*

202.108.22.*

202.108.23.*

202.108.249.*

202.108.250.*

220.181.19.*

-------------雅虎中国-------------

66.196.90.*

66.196.91.*

68.142.249.*

68.142.250.*

68.142.251.*

72.30.101.*

72.30.102.*

72.30.103.*

72.30.104.*

72.30.107.*

72.30.110.*

72.30.111.*

72.30.128.*

 < xmlnamespace prefix ="o" ns ="urn:schemas-microsoft-com:office:office" />

72.30.129.*

72.30.131.*

72.30.133.*

72.30.134.*

72.30.135.*

72.30.216.*

72.30.226.*

72.30.252.*

72.30.97.*

72.30.98.*

72.30.99.*

74.6.74.*

202.165.102.*

202.160.178.*

202.160.179.*

202.160.180.*

202.160.181.*

202.160.183.*

 

-------------Google-------------

64.233.161.*

64.233.189.*

66.102.11.*

66.102.7.*

66.102.9.*

66.249.64.*

66.249.65.*

66.249.66.*

66.249.71.*

66.249.72.*

72.14.207.*

216.239.33.*

216.239.35.*

216.239.37.*

216.239.39.*

216.239.51.*

216.239.53.*

216.239.55.*

216.239.57.*

216.239.59.*

------------- MSN -------------

65.54.188.*

65.54.225.*

65.54.226.*

65.54.228.*

65.54.229.*

207.46.98.*

207.68.157.*

         

------------- 163 -------------         

202.106.186.*        163蜘蛛

202.108.36.*         163蜘蛛

202.108.44.*         163蜘蛛

202.108.45.*         163蜘蛛

202.108.5.*          163蜘蛛

202.108.9.*          163蜘蛛

220.181.12.*         163蜘蛛

220.181.13.*         163蜘蛛

220.181.14.*         163蜘蛛

220.181.15.*         163蜘蛛

220.181.28.*         163蜘蛛

220.181.31.*         163蜘蛛

222.185.245.*        163蜘蛛

 

------------- 3721 -------------

202.165.100.*        3721蜘蛛

 

------------- baidu -------------         

220.181.19.*        百度蜘蛛

159.226.50.*        百度蜘蛛

202.108.11.*        百度蜘蛛

202.108.22.*        百度蜘蛛

202.108.23.*        百度蜘蛛

202.108.249.*       百度蜘蛛

202.108.250.*       百度蜘蛛

61.135.145.*        百度蜘蛛

61.135.146.*        百度蜘蛛

 

64.124.85.*        become.com

 

61.151.243.*        china蜘蛛

 

202.165.96.*        gais.cs.ccu.edu.tw

 

216.239.33.*        google蜘蛛

216.239.35.*        google蜘蛛

216.239.37.*        google蜘蛛

216.239.39.*        google蜘蛛

216.239.51.*        google蜘蛛

216.239.53.*        google蜘蛛

216.239.55.*        google蜘蛛

216.239.57.*        google蜘蛛

216.239.59.*        google蜘蛛

64.233.161.*        google蜘蛛

64.233.189.*        google蜘蛛

66.102.11.*         google蜘蛛

66.102.7.*          google蜘蛛

66.102.9.*          google蜘蛛

66.249.64.*         google蜘蛛

66.249                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   .65.*         google蜘蛛

66.249.66.*         google蜘蛛

66.249.71.*         google蜘蛛

66.249.72.*         google蜘蛛

72.14.207.*         google蜘蛛

 

61.135.152.*        iask蜘蛛

 

65.54.188.*        msn蜘蛛

65.54.225.*        msn蜘蛛

65.54.226.*        msn蜘蛛

65.54.228.*        msn蜘蛛

65.54.229.*        msn蜘蛛

207.46.98.*        msn蜘蛛

207.68.157.*       msn蜘蛛

 

194.224.199.*        noxtrumbot

 

220.181.8.*          Outfox

221.239.209.*        Outfox

 

217.212.224.*        psbot

 

219.133.40.*        QQ蜘蛛

202.96.170.*        QQ蜘蛛

202.104.129.*       QQ蜘蛛

61.135.157.*        QQ蜘蛛

219.142.118.*       sina蜘蛛

219.142.78.*        sina蜘蛛

 

61.135.132.*        sohu蜘蛛

220.181.26.*        sohu蜘蛛

220.181.19.*

 

61.135.158.*        tom蜘蛛

 

66.196.90.*         yahoo蜘蛛

66.196.91.*         yahoo蜘蛛

68.142.249.*        yahoo蜘蛛

68.142.250.*        yahoo蜘蛛

68.142.251.*        yahoo蜘蛛

202.165.102.*       yahoo中国蜘蛛

202.160.178.*       yahoo中国蜘蛛

202.160.179.*       yahoo中国蜘蛛

202.160.180.*       yahoo中国蜘蛛

202.160.181.*       yahoo中国蜘蛛

202.160.183.*       yahoo中国蜘蛛

72.30.101.*        yahoo蜘蛛

72.30.102.*        yahoo蜘蛛

72.30.103.*        yahoo蜘蛛

72.30.104.*        yahoo蜘蛛

72.30.107.*        yahoo蜘蛛

72.30.110.*        yahoo蜘蛛

72.30.111.*        yahoo蜘蛛

72.30.128.*        yahoo蜘蛛

72.30.129.*        yahoo蜘蛛

72.30.131.*        yahoo蜘蛛

72.30.133.*        yahoo蜘蛛

72.30.134.*        yahoo蜘蛛

72.30.135.*        yahoo蜘蛛

72.30.216.*        yahoo蜘蛛

72.30.226.*        yahoo蜘蛛

72.30.252.*        yahoo蜘蛛

72.30.97.*        yahoo蜘蛛

72.30.98.*        yahoo蜘蛛

72.30.99.*        yahoo蜘蛛

74.6.74.*         yahoo蜘蛛

 

202.108.4.*        中搜蜘蛛

202.108.4.*        中搜蜘蛛

202.108.33.*       中搜蜘蛛

202.96.51.*        中搜蜘蛛

219.142.53.*       中搜蜘蛛

 

1 202.106.186.*  163蜘蛛

2 202.108.36.*   163蜘蛛

3 202.108.44.*   163蜘蛛

4 202.108.45.*   163蜘蛛

5 202.108.5.*    163蜘蛛

6 202.108.9.*    163蜘蛛

7 220.181.12.*   163蜘蛛

8 220.181.13.*   163蜘蛛

9 220.181.14.*   163蜘蛛

10 220.181.15.*  163蜘蛛

11 220.181.28.*  163蜘蛛

12 220.181.31.*  163蜘蛛

13 222.185.245.* 163蜘蛛

 

14 202.165.100.* 3721蜘蛛

 

15 220.181.19.*  百度蜘蛛

16 159.226.50.*  百度蜘蛛

17 202.108.11.*  百度蜘蛛

18 202.108.22.*  百度蜘蛛

19 202.108.23.*  百度蜘蛛

20 202.108.249.* 百度蜘蛛

21 202.108.250.* 百度蜘蛛

22 61.135.145.*  百度蜘蛛

23 61.135.146.*  百度蜘蛛

 

24 64.124.85.* become.com

 

25 61.151.243.* china蜘蛛

 

26 202.165.96.* gais.cs.ccu.edu.tw

 

27 216.239.33.* google蜘蛛

28 216.239.35.* google蜘蛛

29 216.239.37.* google蜘蛛

30 216.239.39.* google蜘蛛

31 216.239.51.* google蜘蛛

32 216.239.53.* google蜘蛛

33 2                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        16.239.55.* google蜘蛛

34 216.239.57.* google蜘蛛

35 216.239.59.* google蜘蛛

36 64.233.161.* google蜘蛛

37 64.233.189.* google蜘蛛

38 66.102.11.*  google蜘蛛

39 66.102.7.*  google蜘蛛

40 66.102.9.*  google蜘蛛

41 66.249.64.* google蜘蛛

42 66.249.65.* google蜘蛛

43 66.249.66.* google蜘蛛

44 66.249.71.* google蜘蛛

45 66.249.72.* google蜘蛛

46 72.14.207.* google蜘蛛

 

47 61.135.152.* iask蜘蛛

 

48 65.54.188.*  msn蜘蛛

49 65.54.225.*  msn蜘蛛

50 65.54.226.*  msn蜘蛛

51 65.54.228.*  msn蜘蛛

52 65.54.229.*  msn蜘蛛

53 207.46.98.*  msn蜘蛛

54 207.68.157.* msn蜘蛛

 

55 194.224.199.* noxtrumbot

 

56 220.181.8.* Outfox

57 221.239.209.* Outfox

 

58 217.212.224.* psbot

 

59 219.133.40.*  QQ蜘蛛

60 202.96.170.*  QQ蜘蛛

61 202.104.129.* QQ蜘蛛

62 61.135.157.*  QQ蜘蛛

63 219.142.118.* sina蜘蛛

64 219.142.78.*  sina蜘蛛

 

65 61.135.132.* sohu蜘蛛

66 220.181.26.* sohu蜘蛛

220.181.19.*

 

67 61.135.158.* tom蜘蛛

 

68 66.196.90.*  yahoo蜘蛛

69 66.196.91.*  yahoo蜘蛛

70 68.142.249.* yahoo蜘蛛

71 68.142.250.* yahoo蜘蛛

72 68.142.251.* yahoo蜘蛛

73 202.165.102.* yahoo中国蜘蛛

74 202.160.178.* yahoo中国蜘蛛

75 202.160.179.* yahoo中国蜘蛛

76 202.160.180.* yahoo中国蜘蛛

77 202.160.181.* yahoo中国蜘蛛

78 202.160.183.* yahoo中国蜘蛛

79 72.30.101.* yahoo蜘蛛

80 72.30.102.* yahoo蜘蛛

81 72.30.103.* yahoo蜘蛛

82 72.30.104.* yahoo蜘蛛

83 72.30.107.* yahoo蜘蛛

84 72.30.110.* yahoo蜘蛛

85 72.30.111.* yahoo蜘蛛

86 72.30.128.* yahoo蜘蛛

87 72.30.129.* yahoo蜘蛛

88 72.30.131.* yahoo蜘蛛

89 72.30.133.* yahoo蜘蛛

90 72.30.134.* yahoo蜘蛛

91 72.30.135.* yahoo蜘蛛

92 72.30.216.* yahoo蜘蛛

93 72.30.226.* yahoo蜘蛛

94 72.30.252.* yahoo蜘蛛

95 72.30.97.* yahoo蜘蛛

96 72.30.98.* yahoo蜘蛛

97 72.30.99.* yahoo蜘蛛

98 74.6.74.*  yahoo蜘蛛

 

99 202.108.4.*   中搜蜘蛛

100 202.108.4.*  中搜蜘蛛

101 202.108.33.* 中搜蜘蛛

102 202.96.51.*  中搜蜘蛛

103 219.142.53.* 中搜蜘蛛

 

蜘蛛名称 IP地址
Baiduspider

202.108.11.* 220.181.32.* 58.51.95.* 60.28.22.* 61.135.162.* 61.135.163.* 61.135.168.*

YodaoBot

202.108.7.215 202.108.7.220 202.108.7.221

Sogou web spider

219.234.81.* 220.181.61.*

Googlebot

203.208.60.*

Yahoo! Slurp

202.160.181.* 72.30.215.* 74.6.17.* 74.6.22.*

Yahoo ContentMatch Crawler

119.42.226.* 119.42.230.*

Sogou-Test-Spider

220.181.19.103 220.181.26.122

Twiceler

38.99.44.104 64.34.251.9

Yahoo! Slurp China

202.160.178.*

Sosospider 124.115.0.*
CollapsarWEB qihoobot

221.194.136.18

NaverBot

202.179.180.45

Sogou Orion spider

220.181.19.106 220.181.19.74

Sogou head spider

220.181.19.107

SurveyBot

216.145.5.42 64.246.165.160

Yanga WorldSearch Bot v

77.91.224.19 91.205.124.19

baiduspider-mobile-gate

220.181.5.34 61.135.166.31

discobot

208.96.54.70

ia_archiver 209.234.171.42
msnbot

65.55.104.209 65.55.209.86 65.55.209.96

sogou in spider

220.181.19.216

 

有重复在所难免,用来ctrl + F的。

                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                

发表评论