1=(*any*googlebot)
2=(*any*majestic12)
3=(compatible;PetalBot;+https://aspiegel.com/petalbot)
4=;+http://www.netseer.com/crawler.html;+crawler@netseer.com)
5=Aboundex/0.3 (http://www.aboundex.com/crawler/)
6=adidxbot/1.1 (+http://search.msn.com/msnbot.htm)
7=AdsBot-Google (+http://www.google.com/adsbot.html)
8=AdsBot-Google-Mobile (+http://www.google.com/mobile/adsbot.html) Mozilla (iPhone; U; CPU iPhone OS 3 0 like Mac OS X) AppleWebKit (KHTML, like Gecko) Mobile Safari
9=Amazon CloudFront
10=ArchitextSpider
11=ASPSeek/1.2.5
12=BacklinkCrawler (http://www.backlinktest.com/crawler.html)
13=BaiduImagespider+(+http://help.baidu.jp/system/05.html)
14=BaiduImagespider+(+http://www.baidu.jp/spider/)
15=BaiDuSpider
16=Baiduspider ( http://www.baidu.jp/spider/)
17=Baiduspider+(+http://help.baidu.jp/system/05.html)
18=Baiduspider+(+http://www.baidu.com/search/spider.htm)
19=Baiduspider+(+http://www.baidu.com/search/spider_jp.html)
20=Baiduspider+(+http://www.baidu.jp/spider/)
21=Baiduspider-image+(+http://www.baidu.com/search/spider.htm)
22=Baiduspider-image+(+http://www.baidu.com/search/spider.htm)\nReferer: http://image.baidu.com/i?ct=503316480&z=0&tn=baiduimagedetail
23=bitlybot
24=bl.uk_lddc_bot/3.1.1 (+http://www.bl.uk/aboutus/stratpolprog/digi/domresproj/index.html)
25=Bookmark Renewal Check Agent [http://www.bookmark.ne.jp/]
26=BUbiNG (+http://law.di.unimi.it/BUbiNG.html#wc)
27=Busiversebot/v1.0 (http://www.busiverse.com/bot.php)
28=CCBot/2.0 (https://commoncrawl.org/faq/)
29=checks.panopta.com
30=Cityreview Robot (+http://www.cityreview.org/crawler/)
31=Comodo-Certificates-Spider
32=compatible;Baiduspider/2.0; +http://www.baidu.com/search/spider.html
33=Confirm Domain Bot/1.0 (compatible; NZS.com mini-spider,  Local Search New Zealand; http://www.nzs.com/; bot at nzs.com)
34=Content Crawler Spider
35=ContextAd Bot 1.0
36=Crawl_Application
37=dloader(NaverRobot)
38=dloader(NaverRobot)/1.0
39=DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo; +http://search.goo.ne.jp/option/use/sub4/sub4-1/)
40=DomainCrawler/3.0 (info@domaincrawler.com; http://www.domaincrawler.com/codenewsfast.com)
41=EasouSpider
42=e-SocietyRobot(http://www.yama.info.waseda.ac.jp/~yamana/es/)
43=Eurobot/1.1 (http://eurobot.ayell.eu)
44=ExB Language Crawler 2.1.5 (+http://www.exb.de/crawler)
45=Facebook share follower
46=facebookexternalhit/1.1 ( http://www.facebook.com/externalhit_uatext.php)
47=faqs/crawler)
48=FAST-WebCrawler/3.6 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)
49=FAST-WebCrawler/3.7/FirstPage (atw-crawler at fast dot no;http://fast.no/support/crawler.asp)
50=FAST-WebCrawler/3.8 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)
51=FAST-WebCrawler/3.x Multimedia (mm dash crawler at fast dot no)
52=findlinks/2.6 (+http://wortschatz.uni-leipzig.de/findlinks/)
53=FlashGet
54=Gecko/20080109 (Charlotte/0.9t; http://www.searchme.com/support/)
55=GetRight/4.5 [Segment 0]
56=GetRight/4.5 [Segment 1]
57=GetRight/4.5a
58=GetRight/4.5b
59=GetRight/4.5b6
60=Gigabot/2.0; http://www.gigablast.com/spider.html
61=Gigabot/3.0 (http://www.gigablast.com/spider.html)
62=Gigabot/3.0+(http://www.gigablast.com/spider.html)
63=Googlebot (gocrawl v0.4)
64=Googlebot/2.1 (+http://www.google.com/bot.html)
65=Googlebot/2.1 (+http://www.googlebot.com/bot.html)
66=Googlebot-Image/1.0
67=Googlebot-richsnippets
68=Googlebot-Video/1.0
69=grub-client
70=Healthbot/Health_and_Longevity_Project_(HealthHaven.com)
71=http://www.almaden.ibm.com/cs/crawler [c01]
72=http://www.yellowpages.com/about/legal/crawl
73=HuaweiSymantecSpider/1.0+DSE-support@huaweisymantec.com+(compatible; MSIE 7.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR ; http://www.huaweisymantec.com/en/IRL/spider)
74=ia_archiver
75=ia_archiver (+http://www.alexa.com/site/help/webmasters; crawler@alexa.com)
76=ichiro/4.0 (http://help.goo.ne.jp/door/crawler.html)	
77=ichiro/5.0 (http://help.goo.ne.jp/door/crawler.html)
78=Influencebot/0.9; (Automatic classification of websites; http://www.influencebox.com/; info@influencebox.com)User-Agent: Mozilla/5.0 (X11; Linux i686; rv:9.0) Gecko/20100101 Firefox/9.0
79=Inktomi Search
80=InternetSeer.com
81=istellabot/Nutch-1.11
82=istellabot/t.1
83=istellabot/t.1.13
84=Java/1.6.0_04
85=Jetbot/1.0
86=JikeSpider Mozilla/5.0 (compatible; JikeSpider; +http://shoulu.jike.com/spider.html)
87=libwww-perl/5.65
88=Linguee Bot (http://www.linguee.com/bot; bot@linguee.com)
89=LinkLint-checkonly/2.1
90=LinkWalker
91=LinkWalker/2.0
92=LSSRocketCrawler/1.0 LightspeedSystems
93=LTI/LemurProject+Nutch+Spider/Nutch-1.0-dev+(lti+crawler+for+CMU;+http://www.lti.cs.cmu.edu;+changkuk+at+cmu+dot+edu)
94=LWNutch/Nutch-1.4 (another scientific bot - we accept your robots.txt! )
95=Lycos_Spider_(modspider)
96=Lycos_Spider_(T-Rex)
97=magpie-crawler/1.1 (U; Linux amd64; en-GB; +http://www.brandwatch.net)
98=Mail.Ru/1.0
99=MauiBot (crawler.feedback+dc@gmail.com)
100=MauiBot (crawler.feedback+wc@gmail.com)
101=Mediapartners-Google
102=MJ12bot/v1.2.5 (http://majestic12.co.uk/bot.php?+)
103=MJ12bot/v1.3.0 (http://majestic12.co.uk/bot.php?+)
104=MJ12bot/v1.3.1 (http://majestic12.co.uk/bot.php?+)
105=MLBot (www.metadatalabs.com)
106=MLBot (www.metadatalabs.com/mlbot)
107=Mozilla/2.0 (compatible; Ask Jeeves)
108=Mozilla/2.0 (compatible; Ask Jeeves/Teoma)
109=Mozilla/2.0 (compatible; Ask Jeeves/Teoma; +http://sp.ask.com/docs/about/tech_crawling.html)
110=Mozilla/3.0 (Slurp/cat; slurp@inktomi.com; http://www.inktomi.com/slurp.html)
111=Mozilla/3.0 (Slurp/si; slurp@inktomi.com; http://www.inktomi.com/slurp.html)
112=Mozilla/4.0 (Add Catalog; Windows NT 5.1; infobot.4942@yahoo.com)
113=Mozilla/4.0 (compatible: FDSE robot)
114=Mozilla/4.0 (compatible;  Vagabondo/4.0/EU; http://www.wise-guys.nl/)
115=Mozilla/4.0 (compatible;  Vagabondo/4.0; http://webagent.wise-guys.nl/)
116=Mozilla/4.0 (compatible;  Vagabondo/4.0; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/)
117=Mozilla/4.0 (compatible;  Vagabondo/4.0; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/; http://www.wise-guys.nl/)
118=Mozilla/4.0 (compatible;  Vagabondo/4.0Beta; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/; http://www.wise-guys.nl/)
119=Mozilla/4.0 (compatible; +Baiduspider/2.0;++http://www.baidu.com/search/spider.html +Googlebot/2.1;++http://www.google.com/bot.html)
120=Mozilla/4.0 (compatible; B#L#I#T#Z#B#O#T) - http://www.tricus.nl/
121=Mozilla/4.0 (compatible; grub-client-1.0.4; Crawl your own stuff with http://grub.org)
122=Mozilla/4.0 (compatible; grub-client-1.0.5; Crawl your own stuff with http://grub.org)
123=Mozilla/4.0 (compatible; grub-client-1.0.6; Crawl your own stuff with http://grub.org)
124=Mozilla/4.0 (compatible; grub-client-1.0.7; Crawl your own stuff with http://grub.org)
125=Mozilla/4.0 (compatible; grub-client-1.2.1; Crawl your own stuff with http://grub.org)
126=Mozilla/4.0 (compatible; grub-client-1.3.1; Crawl your own stuff with http://grub.org)
127=Mozilla/4.0 (compatible; grub-client-1.3.7; Crawl your own stuff with http://grub.org)
128=Mozilla/4.0 (compatible; grub-client-1.4.3; Crawl your own stuff with http://grub.org)
129=Mozilla/4.0 (compatible; grub-client-1.5.3; Crawl your own stuff with http://grub.org)
130=Mozilla/4.0 (compatible; grub-client-2.3)
131=Mozilla/4.0 (compatible; MSIE 4.01; Windows NT; MS Search 6.0 Robot)
132=Mozilla/4.0 (compatible; MSIE 5.0; www.galaxy.com; www.arbitration-forum.com; +http://www.galaxy.com/info/crawler.html)
133=Mozilla/4.0 (compatible; MSIE 5.01; Windows 98; MSIECrawler)
134=Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0) Fetch API Request
135=Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; Win 9x 4.90; Q312461; MSIECrawler)
136=Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.0.2914; MSIECrawler)
137=Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; MSIECrawler)
138=Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; MSIECrawler)
139=Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Q312461; MSIECrawler)
140=Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1;  http://www.changedetection.com/bot.html )
141=Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; http://www.changedetection.com/bot.html )
142=Mozilla/4.0 (compatible; MSIE 6.0b; Windows NT 5.1; MSIECrawler)
143=Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; MDDR; .NET4.0C; .NET4.0E; .NET CLR 1.1.4322; Tablet PC 2.0); 360Spider
144=Mozilla/4.0 compatible ZyBorg/1.0 (wn.zyborg@looksmart.net; http://www.WISEnutbot.com)
145=Mozilla/4.0 compatible ZyBorg/1.0 (wn-12.zyborg@looksmart.net; http://www.WISEnutbot.com)
146=Mozilla/4.0 compatible ZyBorg/1.0 (wn-14.zyborg@looksmart.net; http://www.WISEnutbot.com)
147=Mozilla/4.0 compatible ZyBorg/1.0 (ZyBorg@WISEnutbot.com; http://www.WISEnutbot.com)
148=Mozilla/4.0 compatible ZyBorg/1.0 Daily Refresh Beta-d03 (wn.zyborg@looksmart.net; http://www.WISEnutbot.com)
149=Mozilla/4.0 compatible ZyBorg/1.0 Dead Link Checker (wn.dlc@looksmart.net; http://www.WISEnutbot.com)
150=Mozilla/4.0 compatible ZyBorg/1.0 Dead Link Checker (wn.zyborg@looksmart.net; http://www.WISEnutbot.com)
151=Mozilla/4.0_(compatible;_MSIE_5.0;_Windows_95)_TrueRobot/1.4 libwww/5.2.8
152=Mozilla/4.0+(compatible;+MSIE+7.0;+Windows+NT+5.1;+.NET+CLR+1.1.4322;+ZangoToolbar+4.8.3;+.NET+CLR+2.0.50727)
153=Mozilla/5.0 (compatible; 007ac9 Crawler; http://crawler.007ac9.net/)
154=Mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/webcrawler.html) Gecko/2008032620
155=Mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/webcrawler.html;) Gecko/2008032620
156=Mozilla/5.0 (compatible; 008/0.85; http://www.80legs.com/webcrawler.html) Gecko/2008032620
157=Mozilla/5.0 (compatible; 200PleaseBot/1.0; +http://www.200please.com/bot)
158=Mozilla/5.0 (compatible; 4SeoHuntBot; +http://4seohunt.com/bot.html)
159=Mozilla/5.0 (compatible; AB-Downloads.com PAD crawler; http://www.ab-downloads.com)
160=Mozilla/5.0 (compatible; AcoonBot/4.11.1; +http://www.acoon.de/robot.asp)
161=Mozilla/5.0 (compatible; Adsbot/3.1)
162=Mozilla/5.0 (compatible; Adsbot/3.1; +https://seostar.co/robot/)
163=Mozilla/5.0 (compatible; AhrefsBot/3.1; +http://ahrefs.com/robot/)
164=Mozilla/5.0 (compatible; AhrefsBot/4.0; +http://ahrefs.com/robot/)
165=Mozilla/5.0 (compatible; AhrefsBot/5.0; +http://ahrefs.com/robot/)
166=Mozilla/5.0 (compatible; AhrefsBot/5.1; +http://ahrefs.com/robot/)
167=Mozilla/5.0 (compatible; AhrefsBot/5.2; +http://ahrefs.com/robot/)
168=Mozilla/5.0 (compatible; AhrefsBot/6.1; +http://ahrefs.com/robot/)
169=Mozilla/5.0 (compatible; AhrefsBot/6.1; +http://ahrefs.com/robot/)
170=Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)
171=Mozilla/5.0 (compatible; AlphaBot/3.2; +http://alphaseobot.com/bot.html)
172=Mozilla/5.0 (compatible; archive.org_bot +http://www.archive.org/details/archive.org_bot)
173=Mozilla/5.0 (compatible; archive.org_bot; Wayback Machine Live Record; +http://archive.org/details/archive.org_bot)
174=Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml)
175=Mozilla/5.0 (compatible; Baiduspider/2.0;  http://www.baidu.com/search/spider.html)
176=Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html
177=Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
178=Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html??
179=Mozilla/5.0 (compatible; Baiduspider-render/2.0; +http://www.baidu.com/search/spider.html)
180=Mozilla/5.0 (compatible; Barkrowler/0.9; +https://babbar.tech/crawler)
181=Mozilla/5.0 (compatible; Bender; http://benderthewebrobot.tumblr.com)
182=Mozilla/5.0 (compatible; Best Freeware Download PAD crawler; http://www.bestfreewaredownload.com/)
183=Mozilla/5.0 (compatible; Best Software Downloads PAD crawler; http://www.bestsoftware4download.com/)
184=Mozilla/5.0 (compatible; Best Software Downloads PAD crawler; http://www.bestsoftware4download.com/)
185=Mozilla/5.0 (compatible; bingbot/2.0 +http://www.bing.com/bingbot.htm)
186=Mozilla/5.0 (compatible; bingbot/2.0;  http://www.bing.com/bingbot.htm)
187=Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
188=Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) SitemapProbe
189=Mozilla/5.0 (compatible; bingbot/3.0-alpha; +http://www.bing.com/bingbot.htm)
190=Mozilla/5.0 (compatible; Blekkobot; ScoutJet; +http://blekko.com/about/blekkobot)
191=Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/)
192=Mozilla/5.0 (compatible; BMC/1.0 (Y!J-AGENT))
193=Mozilla/5.0 (compatible; BMI/1.0 (Y!J-AGENT; 1.0))
194=Mozilla/5.0 (compatible; Bytespider; spider-feedback@bytedance.com) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.0.0 Safari/537.36
195=Mozilla/5.0 (compatible; ca-crawler/1.0)
196=Mozilla/5.0 (compatible; CareerBot/1.1; +http://www.career-x.de/bot.html)
197=Mozilla/5.0 (compatible; Charlotte/1.2; http://www.searchme.com/support/)
198=Mozilla/5.0 (compatible; Charlotte/1.3; http://www.searchme.com/support/)
199=Mozilla/5.0 (compatible; Cliqzbot/2.0; +http://cliqz.com/company/cliqzbot)
200=Mozilla/5.0 (compatible; Cliqzbot/3.0; +http://cliqz.com/company/cliqzbot)
201=Mozilla/5.0 (compatible; coccocbot-image/1.0; +http://help.coccoc.com/searchengine)
202=Mozilla/5.0 (compatible; coccocbot-web/1.0; +http://help.coccoc.com/searchengine)
203=Mozilla/5.0 (compatible; CompSpyBot/1.0; +http://www.compspy.com/spider.html)
204=Mozilla/5.0 (compatible; CSDPADbot/1.0; http://softwarewagon.com/pad-file-bot.php)
205=Mozilla/5.0 (compatible; DataForSeoBot/1.0; +https://dataforseo.com/dataforseo-bot)
206=Mozilla/5.0 (compatible; Daum/4.1; +http://cs.daum.net/faq/15/4118.html?faqId=28966)
207=Mozilla/5.0 (compatible; DCPbot/1.2; +http://domains.checkparams.com/)
208=Mozilla/5.0 (compatible; DeuSu/5.0.2; +https://deusu.de/robot.html)
209=Mozilla/5.0 (compatible; discobot/1.1;  http://discoveryengine.com/discobot.html
210=Mozilla/5.0 (compatible; discobot/1.1; +http://discoveryengine.com/discobot.html)
211=Mozilla/5.0 (compatible; discoverybot/2.0; +http://discoveryengine.com/discoverybot.html)
212=Mozilla/5.0 (compatible; DotBot/1.1; http://www.dotnetdotcom.org/, crawler@dotnetdotcom.org)
213=Mozilla/5.0 (compatible; DotBot/1.1; http://www.opensiteexplorer.org/dotbot, help@moz.com)
214=Mozilla/5.0 (compatible; DotBot/1.2; +https://opensiteexplorer.org/dotbot; help@moz.com)
215=Mozilla/5.0 (compatible; Dow Jones Searchbot)
216=Mozilla/5.0 (compatible; EasouSpider; +http://www.easou.com/search/spider.html)
217=Mozilla/5.0 (compatible; Exabot/3.0 (BiggerBetter); +http://www.exabot.com/go/robot)
218=Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot)
219=Mozilla/5.0 (compatible; Exabot-Images/3.0; +http://www.exabot.com/go/robot)
220=Mozilla/5.0 (compatible; Ezooms/1.0; ezooms.bot@gmail.com)
221=Mozilla/5.0 (compatible; FatBot 2.0; http://www.thefind.com/crawler)
222=Mozilla/5.0 (compatible; FatBot 2.0; http://www.thefind.com/main/CrawlerFAQs.fhtml)
223=Mozilla/5.0 (compatible; GigaBot/1.0; +http://www.gigablast.com/ )
224=Mozilla/5.0 (compatible; Googlebot/2.1 +http://www.googlebot.com/bot.html)
225=Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
226=Mozilla/5.0 (compatible; Googlebot/2.1;http://www.google.com/bot.html)
227=Mozilla/5.0 (compatible; GrapeshotCrawler/2.0; +http://www.grapeshot.co.uk/crawler.php)
228=Mozilla/5.0 (compatible; GrepNetstatBot/1.0; +http://www.grepnetstat.com/bot)
229=Mozilla/5.0 (compatible; heritrix/1.14.3 +http://www.accelobot.com)
230=Mozilla/5.0 (compatible; heritrix/1.15.1-200807172326  http://www.accelobot.com)
231=Mozilla/5.0 (compatible; heritrix/3.1.2-SNAPSHOT-20121212.104133 +http://archive.org/details/archive.org_bot)
232=Mozilla/5.0 (compatible; ICATbot/1.1)
233=Mozilla/5.0 (compatible; JikeSpider; +http://shoulu.jike.com/spider.html)
234=Mozilla/5.0 (compatible; KaloogaBot; http://kalooga.com/crawler)
235=Mozilla/5.0 (compatible; kmbot-62c5/0.0;  http://knowmore.com/bots)
236=Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (like Gecko) (Exabot-Thumbnails)
237=Mozilla/5.0 (compatible; linkdexbot/2.0; +http://www.linkdex.com/about/bots/)
238=Mozilla/5.0 (compatible; linkdexbot/2.0; +http://www.linkdex.com/bots/)
239=Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots)
240=Mozilla/5.0 (compatible; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots)
241=Mozilla/5.0 (compatible; meanpathbot/1.0; +http://www.meanpath.com/meanpathbot.html)
242=Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +http://megaindex.com/crawler)
243=Mozilla/5.0 (compatible; MixrankBot; crawler@mixrank.com)
244=Mozilla/5.0 (compatible; MJ12bot/v1.2.1; http://www.majestic12.co.uk/bot.php?+)
245=Mozilla/5.0 (compatible; MJ12bot/v1.2.5; http://www.majestic12.co.uk/bot.php?+)
246=Mozilla/5.0 (compatible; MJ12bot/v1.3.0; http://www.majestic12.co.uk/bot.php?+)
247=Mozilla/5.0 (compatible; MJ12bot/v1.3.1; http://www.majestic12.co.uk/bot.php?+)
248=Mozilla/5.0 (compatible; MJ12bot/v1.3.2; http://www.majestic12.co.uk/bot.php?)
249=Mozilla/5.0 (compatible; MJ12bot/v1.3.2; http://www.majestic12.co.uk/bot.php?+)
250=Mozilla/5.0 (compatible; MJ12bot/v1.3.3; http://www.majestic12.co.uk/bot.php?+)
251=Mozilla/5.0 (compatible; MJ12bot/v1.4.0; http://www.majestic12.co.uk/bot.php?+)
252=Mozilla/5.0 (compatible; MJ12bot/v1.4.2; http://www.majestic12.co.uk/bot.php?+)
253=Mozilla/5.0 (compatible; MJ12bot/v1.4.3; http://www.majestic12.co.uk/bot.php?+)
254=Mozilla/5.0 (compatible; MJ12bot/v1.4.4; http://www.majestic12.co.uk/bot.php?+)
255=Mozilla/5.0 (compatible; MJ12bot/v1.4.5; http://www.majestic12.co.uk/bot.php?+)
256=Mozilla/5.0 (compatible; MJ12bot/v1.4.7; http://mj12bot.com/)
257=Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/)
258=Mozilla/5.0 (compatible; MojeekBot/0.10; +https://www.mojeek.com/bot.html)
259=Mozilla/5.0 (compatible; MojeekBot/0.11; +https://www.mojeek.com/bot.html)
260=Mozilla/5.0 (compatible; MojeekBot/0.6; +https://www.mojeek.com/bot.html)
261=Mozilla/5.0 (compatible; MojeekBot/0.6; http://www.mojeek.com/bot.html)
262=Mozilla/5.0 (compatible; MojeekBot/0.7; +https://www.mojeek.com/bot.html)
263=Mozilla/5.0 (compatible; monitis - premium monitoring service; http://www.monitis.com)
264=Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; Trident/5.0); 360Spider
265=Mozilla/5.0 (compatible; news bot /2.1)
266=Mozilla/5.0 (compatible; NLNZ_IAHarvester2013 +http://natlib.govt.nz/publishers-and-authors/web-harvesting/2013-nz-web-harvest)
267=Mozilla/5.0 (compatible; oBot/2.3.1; +http://filterdb.iss.net/crawler/)
268=Mozilla/5.0 (compatible; OpenindexSpider; +http://www.openindex.io/en/webmasters/spider.html)
269=Mozilla/5.0 (compatible; OrangeBot/2.0; support.orangebot@orange.com)
270=Mozilla/5.0 (compatible; Peepowbot/1.0; +http://www.peepow.com/bot.php)
271=Mozilla/5.0 (compatible; Plukkie/1.5; http://www.botje.com/plukkie.htm)
272=Mozilla/5.0 (compatible; pmoz.info ODP link checker; +http://pmoz.info/doc/botinfo.htm)
273=Mozilla/5.0 (compatible; ProCogBot/1.0; +http://www.procog.com/spider.html)
274=Mozilla/5.0 (compatible; proximic; +http://www.proximic.com/info/spider.php)
275=Mozilla/5.0 (compatible; Purebot/1.1; +http://www.puritysearch.net/)
276=Mozilla/5.0 (compatible; Qwantify/2.4w; +https://www.qwant.com/)/2.4w
277=Mozilla/5.0 (compatible; ScoutJet;  http://www.scoutjet.com/)
278=Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/)
279=Mozilla/5.0 (compatible; SearchmetricsBot; http://www.searchmetrics.com/en/searchmetrics-bot/)
280=Mozilla/5.0 (compatible; Seekport Crawler; http://seekport.com/)
281=Mozilla/5.0 (compatible; Seekport Crawler; http://seekport.com/)
282=Mozilla/5.0 (compatible; SemrushBot/1.0~bm; +http://www.semrush.com/bot.html)
283=Mozilla/5.0 (compatible; SemrushBot/1.2~bl; +http://www.semrush.com/bot.html)
284=Mozilla/5.0 (compatible; SemrushBot/2~bl; +http://www.semrush.com/bot.html)
285=Mozilla/5.0 (compatible; SemrushBot/3~bl; +http://www.semrush.com/bot.html)
286=Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html)
287=Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html)
288=Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
289=Mozilla/5.0 (compatible; SemrushBot; +http://www.semrush.com/bot.html)
290=Mozilla/5.0 (compatible; SemrushBot-BA; +http://www.semrush.com/bot.html)
291=Mozilla/5.0 (compatible; SEOkicks; +https://www.seokicks.de/robot.html)
292=Mozilla/5.0 (compatible; SEOkicks-Robot +http://www.seokicks.de/robot.html)
293=Mozilla/5.0 (compatible; SEOkicks-Robot; +http://www.seokicks.de/robot.html)
294=Mozilla/5.0 (compatible; SeznamBot/3.2; +http://fulltext.sblog.cz/)
295=Mozilla/5.0 (compatible; SeznamBot/3.2; +http://napoveda.seznam.cz/en/seznambot-intro/)
296=Mozilla/5.0 (compatible; SIBot/1.0; +http://www.profound.net/sibot.html)
297=Mozilla/5.0 (compatible; SISTRIX Crawler; http://crawler.sistrix.net/)
298=Mozilla/5.0 (compatible; SiteBot/0.1;  http://www.sitebot.org/robot/)
299=Mozilla/5.0 (compatible; SiteBot/0.1; +http://www.sitebot.org/robot/)
300=Mozilla/5.0 (compatible; SiteExplorer/1.0b; +http://siteexplorer.info/)
301=Mozilla/5.0 (compatible; SMTBot/1.0; +http://www.similartech.com/smtbot)
302=Mozilla/5.0 (compatible; Snipebot/1.0; +http://snipebot.com/bot.html)
303=Mozilla/5.0 (compatible; Sosospider/2.0; +http://help.soso.com/webspider.htm)
304=Mozilla/5.0 (compatible; spbot/4.0.4; +http://www.seoprofiler.com/bot )
305=Mozilla/5.0 (compatible; spbot/4.0.6; +http://www.seoprofiler.com/bot )
306=Mozilla/5.0 (compatible; spbot/4.1.0; +http://OpenLinkProfiler.org/bot )
307=Mozilla/5.0 (compatible; spbot/4.3.0; +http://OpenLinkProfiler.org/bot )
308=Mozilla/5.0 (compatible; spbot/5.0.1; +http://OpenLinkProfiler.org/bot )
309=Mozilla/5.0 (compatible; spbot/5.0.3; +http://OpenLinkProfiler.org/bot )
310=Mozilla/5.0 (compatible; special_archiver/3.1.1 +http://www.archive.org/details/archive.org_bot)
311=Mozilla/5.0 (compatible; SpiderLing (a SPIDER for LINGustic research); http://nlp.fi.muni.cz/projects/biwec/)
312=Mozilla/5.0 (compatible; Steeler/3.5; http://www.tkl.iis.u-tokyo.ac.jp/~crawler/)
313=Mozilla/5.0 (compatible; tracemyfile/1.0; +bot@tracemyfile.com)
314=Mozilla/5.0 (compatible; URLAppendBot/1.0; +http://www.profound.net/urlappendbot.html)
315=Mozilla/5.0 (compatible; Vagabondo/2.1; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl)
316=Mozilla/5.0 (compatible; Vagabondo/2.1; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/)
317=Mozilla/5.0 (compatible; WBSearchBot/1.1; +http://www.warebay.com/bot.html)
318=Mozilla/5.0 (compatible; WebNL; +http://www.web.nl/webmasters/spider.html; helpdesk@web.nl)
319=Mozilla/5.0 (compatible; woriobot +http://worio.com)
320=Mozilla/5.0 (compatible; woriobot support [at] worio [dot] com  http://worio.com)
321=Mozilla/5.0 (compatible; woriobot support [at] zite [dot] com +http://zite.com)
322=Mozilla/5.0 (compatible; X 64-bit Download PAD crawler; http://www.x64bitdownload.com/)
323=Mozilla/5.0 (compatible; X11; Linux x86_64; Google-StructuredDataTestingTool; +http://www.google.com/webmasters/tools/richsnippets)
324=Mozilla/5.0 (compatible; XoviBot/2.0; +http://www.xovibot.net/)
325=Mozilla/5.0 (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html)
326=Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
327=Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
328=Mozilla/5.0 (compatible; YandexAccessibilityBot/3.0; +http://yandex.com/bots)
329=Mozilla/5.0 (compatible; YandexBot/3.0;  http://yandex.com/bots)
330=Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
331=Mozilla/5.0 (compatible; YandexBot/3.0; MirrorDetector; +http://yandex.com/bots)
332=Mozilla/5.0 (compatible; YandexDirect/3.0; +http://yandex.com/bots)
333=Mozilla/5.0 (compatible; YandexFavicons/1.0; +http://yandex.com/bots)
334=Mozilla/5.0 (compatible; YandexImageResizer/2.0; +http://yandex.com/bots)
335=Mozilla/5.0 (compatible; YandexImages/3.0;  http://yandex.com/bots)
336=Mozilla/5.0 (compatible; YandexImages/3.0; +http://yandex.com/bots)
337=Mozilla/5.0 (compatible; YandexMedia/3.0; +http://yandex.com/bots)
338=Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/; )
339=Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.youdao.com/help/webmaster/spider/; )
340=Mozilla/5.0 (compatible; YoudaoBot/1.0; http://www.youdao.com/help/webmaster/spider/; )
341=Mozilla/5.0 (compatible; YYSpider; +http://www.yunyun.com/spider.html)
342=Mozilla/5.0 (compatible; ZumBot/1.0; http://help.zum.com/inquiry)
343=Mozilla/5.0 (compatible;Baiduspider/2.0;+http://www.baidu.com/search/spider.html)
344=Mozilla/5.0 (compatible;PetalBot;+https://webmaster.petalsearch.com/site/petalbot)
345=Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 (KHTML, like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
346=Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 (KHTML, like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
347=Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 (KHTML, like Gecko) Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0;  http://www.bing.com/bingbot.htm)
348=Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 (KHTML, like Gecko) Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
349=Mozilla/5.0 (iPhone; CPU iPhone OS 8_3 like Mac OS X) AppleWebKit/600.1.4 (KHTML, like Gecko) Version/8.0 Mobile/12F70 Safari/600.1.4 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
350=Mozilla/5.0 (iPhone; CPU iPhone OS 9_1 like Mac OS X) AppleWebKit/601.1.46 (KHTML, like Gecko) Version/9.0 Mobile/13B143 Safari/601.1 (compatible; AdsBot-Google-Mobile; +http://www.google.com/mobile/adsbot.html)
351=Mozilla/5.0 (iPhone; U; CPU iPhone OS 4_1 like Mac OS X; en-us) AppleWebKit/532.9 (KHTML, like Gecko) Version/4.0.5 Mobile/8B117 Safari/6531.22.7 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
352=Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; spider-feedback@bytedance.com)
353=Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.96 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
354=Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.92 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
355=Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.93 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
356=Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.96 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
357=Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.90 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
358=Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.112 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
359=Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.113 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
360=Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.153 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
361=Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.84 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
362=Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.97 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
363=Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.90 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
364=Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; AspiegelBot)
365=Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; PetalBot;+https://aspiegel.com/petalbot)
366=Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; PetalBot;+https://webmaster.petalsearch.com/site/petalbot)
367=Mozilla/5.0 (Linux;u;Android 2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; +http://www.baidu.com/search/spider.html)
368=Mozilla/5.0 (Linux;u;Android 4.2.2;zh-cn;) AppleWebKit/534.46 (KHTML,like Gecko) Version/5.1 Mobile Safari/10600.6.3 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
369=Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Applebot/0.1; +http://www.apple.com/go/applebot)
370=Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_1) AppleWebKit/601.2.4 (KHTML, like Gecko) Version/9.0.1 Safari/601.2.4 facebookexternalhit/1.1 Facebot Twitterbot/1.0
371=Mozilla/5.0 (Slurp/cat; slurp@inktomi.com; http://www.inktomi.com/slurp.html)
372=Mozilla/5.0 (Slurp/si; slurp@inktomi.com; http://www.inktomi.com/slurp.html)
373=Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html)
374=Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html)
375=Mozilla/5.0 (Windows NT 5.1) brokenlinkcheck.com/1.2
376=Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534+ (KHTML, like Gecko) BingPreview/1.0b
377=Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/27.0.1453.116 Safari/537.36 HubSpot Webcrawler
378=Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) Speedy Spider (http://www.entireweb.com/about/search_tech/speedy_spider/)
379=Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1) Gecko/20061010 Firefox/2.0 Me.dium/1.0 (http://me.dium.com)
380=Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.2) Gecko/20090729 Firefox/3.5.2 (.NET CLR 3.5.30729; Diffbot/0.1; +http://www.diffbot.com)
381=Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 (http://www.voila.com/)
382=Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 (support.voilabot@orange-ftgroup.com)
383=Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-CN; )  Firefox/1.5.0.11; 360Spider
384=Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-CN; rv:1.8.0.11)  Firefox/1.5.0.11; 360Spider
385=Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-CN; rv:1.8.0.11) Gecko/20070312 Firefox/1.5.0.11; 360Spider
386=Mozilla/5.0 (Windows; U; Windows NT 6.0; en-GB; rv:1.0; trendictionbot0.5.0; trendiction search; http://www.trendiction.de/bot; please let us know of any problems; web at trendiction.com) Gecko/20071127 Firefox/3.0.0.11
387=Mozilla/5.0 (Windows;) NimbleCrawler 2.0.1 obeys UserAgent NimbleCrawler For problems contact: crawler@healthline.com
388=Mozilla/5.0 (X11; U; Linux i686 (x86_64); en-US; rv:1.8.1.11) Gecko/20080109 (Charlotte/0.9t; http://www.searchme.com/support/)
389=Mozilla/5.0 (X11; U; Linux i686; pl; rv:1.8.0.7) Gecko/20060914 Firefox/1.5.0.7 (Swiftfox)
390=Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.19; aggregator:Spinn3r (Spinn3r 3.1); http://spinn3r.com/robot) Gecko/2010040121 Firefox/3.0.19
391=Mozilla/5.0 [en] (compatible; Gulper Web Bot 0.2.4 www.ecsl.cs.sunysb.edu/~maxim/cgi-bin/Link/GulperBot)
392=Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/100.0.4896.127 Safari/537.36
393=Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/103.0.5060.134 Safari/537.36
394=Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/116.0.1938.76 Safari/537.36
395=Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Safari/537.36
396=Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; Google Web Preview Analytics) Chrome/27.0.1453 Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
397=Mozilla/5.0(compatible; Sosospider/2.0; +http://help.soso.com/webspider.htm)
398=Mozilla/5.0+(compatible; UptimeRobot/2.0; http://www.uptimerobot.com/)
399=Mozilla/5.0+(compatible;+Googlebot/2.1;++http://www.google.com/bot.html)
400=Mozilla/5.0+(compatible;+PiplBot;++http://www.pipl.com/bot/)
401=msnbot/1.1 (+http://search.msn.com/msnbot.htm)
402=msnbot/2.0b (+http://search.msn.com/msnbot.htm)
403=msnbot/2.0b (+http://search.msn.com/msnbot.htm)._
404=msnbot-media/1.0 ( http://search.msn.com/msnbot.htm)
405=msnbot-media/1.0 (+http://search.msn.com/msnbot.htm)
406=msnbot-media/1.0+(+http://search.msn.com/msnbot.htm)
407=msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)
408=msnbot-NewsBlogs/2.0b (+http://search.msn.com/msnbot.htm)
409=NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)
410=NetResearchServer
411=Netscape 3.0 Compatible (WhatsNew Robot)
412=NextGenSearchBot 1 (for information visit http://www.zoominfo.com/About/misc/NextGenSearchBot.aspx)
413=niki-bot
414=NPBot (http://www.nameprotect.com/botinfo.html)
415=Nutch-Crawler-Manu/Nutch-1.5.1
416=NutchCVS/0.06-dev (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@lists.sourceforge.net)
417=NutchOrg/0.03-dev (Nutch; http://www.nutch.org/docs/bot.html; nutch-agent@lists.sourceforge.net)
418=oBot
419=Openfind data gatherer, Openbot
420=Openfind data gatherer, Openbot/3.0 (robot-response@openfind.com.tw; http://www.openfind.com.tw/robot.html)
421=Openfind data gatherer, Openbot/3.0+(robot-response@openfind.com.tw;+http://www.openfind.com.tw/robot.html)
422=OWR_Crawler 0.1
423=PADTube.com Crawler
424=PagePeeker.com (info: http://pagepeeker.com/robots)
425=PagesInventory (robot http://www.pagesinventory.com)
426=PagesInventory.com (robot http://www.pagesinvenotry.com)
427=panscient.com
428=PingALink Monitoring Services 1.0
429=Pita (webmaster@pita.stanford.edu)
430=psbot/0.1 (+http://www.picsearch.com/bot.html)
431=Pulseway/5.4 (http://www.pulseway.com)
432=Pulseway/6.0 (http://www.pulseway.com)
433=QBikSpider/2.0
434=rabaz (rabaz at gigabaz dot com)
435=RaBot/3.0 Agent-Admin/radardir@kies.co.kr
436=robot
437=Robozilla/1.0
438=rogerbot/1.0 (http://moz.com/help/pro/what-is-rogerbot-, rogerbot-wherecat@moz.com)
439=SafeDNSBot (https://www.safedns.com/searchbot)
440=SapphireWebCrawler/1.0 (Sapphire Web Crawler using Nutch; http://boston.lti.cs.cmu.edu/crawler/; mhoy@cs.cmu.edu)
441=SapphireWebCrawler/Nutch-1.0-dev (Sapphire Web Crawler using Nutch; http://boston.lti.cs.cmu.edu/crawler/; mhoy@cs.cmu.edu)
442=Scooter/3.3.QA
443=Scooter/3.3_SF
444=Scooter_trk20-3.0.3
445=Scooter-3.2.EX
446=Scooter-3.2.FNR
447=Sensis Web Crawler (search_comments\at\sensis\dot\com\dot\au)
448=SEOENGWorldBot/1.0 (+http://www.seoengine.com/seoengbot.htm)
449=serpstatbot/2.0 beta (advanced backlink tracking bot; http://serpstatbot.com/; abuse@serpstatbot.com)
450=Servers Alive URL check
451=SeznamBot/3.0-beta (+http://fulltext.sblog.cz/), I
452=ShopWiki/1.0 ( +http://www.shopwiki.com/wiki/Help:Bot)
453=sitecheck.internetseer.com (For more info see: http://sitecheck.internetseer.com)
454=sitechecker
455=Slurp.so/1.0 (slurp@inktomi.com; http://www.inktomi.com/slurp.html)
456=Slurp/2.0-KiteHourly (slurp@inktomi.com; http://www.inktomi.com/slurp.html)
457=Slurp/2.0-KiteWeekly (slurp@inktomi.com; http://www.inktomi.com/slurp.html)
458=Slurp/si (slurp@inktomi.com; http://www.inktomi.com/slurp.html)
459=smart.apnoti.com Robot/v1.34 (http://smart.apnoti.com/index/aboutApnotiWebCrawler)
460=Snapbot/1.0
461=SoftSearch.ru robot (adv@softsearch.ru)
462=Sogou Pic Spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
463=sogou spider
464=Sogou web spider/4.0
465=Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
466=Sosospider ( http://help.soso.com/webspider.htm)
467=Sosospider+(+http://help.soso.com/webspider.htm)
468=Speedy Spider (http://www.entireweb.com/about/search_tech/speedy_spider/)
469=S-P-I-D-E-R.suchmaschine.search-area.de
470=spider-ads
471=sproose/1.0beta (sproose bot; http://www.sproose.com/bot.html; crawler@sproose.com)
472=StatoolsBot (+http://www.statools.com/bot.html)
473=SyncBot
474=Szukacz
475=Teemer+(NetSeer,+Inc.;+http://www.netseer.com/crawler.html;+crawler@netseer.com)
476=Teemer+(NetSeer,+Inc.+is+a+Los+Angeles+based+Internet+startup+company.;+http://www.netseer.com/crawler.html;+crawlerseer.com)
477=Teleport Pro/1.29
478=Teleport Pro/1.29.1616
479=Teleport Pro/1.29.1820
480=The Knowledge AI
481=TurnitinBot/2.1 (http://www.turnitin.com/robot/crawlerinfo.html)
482=TurnitinBot/3.0 (http://www.turnitin.com/robot/crawlerinfo.html)
483=Twitterbot/1.0
484=Updownerbot (+http://www.updowner.com/bot)
485=URL_Spider_Pro/2.0
486=Vagabondo/2.0 MT (webagent at wise-guys dot nl)
487=vspider
488=WatzNew Agent 1.6 (www.watznew.com)
489=WebAlta+Crawler/2.0+(http://www.webalta.net/ru/about_webmaster.html)+(Windows;+U;+Windows+NT+5.1;+ru-RU)
490=WebCopier v3.4
491=WebEye
492=WebFetch
493=Website Quester - www.asona.org
494=Webwatch/7.3+(http://webcentre.co.nz/webwatch.htm)
495=WebZIP/4.0 (http://www.spidersoft.com)
496=Wget/1.6
497=WhatsUp_Gold/7.0
498=WillyBot/1.1 (http://www.willyfogg.com/info/willybot)
499=Woodstone Servers Alive URL check
500=Wotbox/2.01 (+http://www.wotbox.com/bot/)
501=WWW-Mechanize/1.66
502=Xaldon WebSpider 2.5.b3
503=Y!J-BRJ/YATS crawler (http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html)
504=Y!J-BRW/1.0 crawler (http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html)
505=yacybot (freeworld/global; amd64 Windows 7 6.1; java 1.7.0_25; Europe/de) http://yacy.net/bot.html
506=Yahoo! Slurp China
507=Yahoo! Slurp/Site Explorer
508=Yahoo-MMCrawler/3.x (mm dash crawler at trd dot overture dot com)
509=Yahoo-MMCrawler/3.x (mms dash mmcrawler dash support at yahoo dash inc dot com)
510=Yandex/1.01.001 (compatible; Win16; I)
511=Yanga WorldSearch Bot v1.1/beta (http://www.yanga.co.uk/) 
512=Yeti/1.0 (NHN Corp.; http://help.naver.com/robots/)
513=Yeti/1.1 (Naver Corp.; http://help.naver.com/robots/)
514=Yeti/1.1 (NHN Corp.; http://help.naver.com/robots/)
515=YisouSpider
516=ZoominfoBot (zoominfobot at zoominfo dot com)