1=(*any*Amazonbot/)
2=(*any*googlebot)
3=(*any*majestic12)
4=(*any*MJ12bot)
5=(*any*openai.com/gptbot)
6=(*any*SeznamBot/)
7=(*any*YandexBot)
8=(compatible;PetalBot;+https://aspiegel.com/petalbot)
9=;+http://www.netseer.com/crawler.html;+crawler@netseer.com)
10=Aboundex/0.3 (http://www.aboundex.com/crawler/)
11=adidxbot/1.1 (+http://search.msn.com/msnbot.htm)
12=AdsBot-Google (+http://www.google.com/adsbot.html)
13=AdsBot-Google-Mobile (+http://www.google.com/mobile/adsbot.html) Mozilla (iPhone; U; CPU iPhone OS 3 0 like Mac OS X) AppleWebKit (KHTML, like Gecko) Mobile Safari
14=Amazon CloudFront
15=ArchitextSpider
16=ASPSeek/1.2.5
17=BacklinkCrawler (http://www.backlinktest.com/crawler.html)
18=BaiduImagespider+(+http://help.baidu.jp/system/05.html)
19=BaiduImagespider+(+http://www.baidu.jp/spider/)
20=BaiDuSpider
21=Baiduspider ( http://www.baidu.jp/spider/)
22=Baiduspider+(+http://www.baidu.com/search/spider.htm)
23=Baiduspider+(+http://www.baidu.com/search/spider_jp.html)
24=Baiduspider+(+http://www.baidu.jp/spider/)
25=Baiduspider-image+(+http://www.baidu.com/search/spider.htm)
26=Baiduspider-image+(+http://www.baidu.com/search/spider.htm)\nReferer: http://image.baidu.com/i?ct=503316480&z=0&tn=baiduimagedetail
27=bitlybot
28=bl.uk_lddc_bot/3.1.1 (+http://www.bl.uk/aboutus/stratpolprog/digi/domresproj/index.html)
29=Bookmark Renewal Check Agent [http://www.bookmark.ne.jp/]
30=BUbiNG (+http://law.di.unimi.it/BUbiNG.html#wc)
31=Busiversebot/v1.0 (http://www.busiverse.com/bot.php)
32=CCBot/2.0 (https://commoncrawl.org/faq/)
33=checks.panopta.com
34=Cityreview Robot (+http://www.cityreview.org/crawler/)
35=Comodo-Certificates-Spider
36=compatible;Baiduspider/2.0; +http://www.baidu.com/search/spider.html
37=Confirm Domain Bot/1.0 (compatible; NZS.com mini-spider,  Local Search New Zealand; http://www.nzs.com/; bot at nzs.com)
38=Content Crawler Spider
39=ContextAd Bot 1.0
40=Crawl_Application
41=dloader(NaverRobot)
42=dloader(NaverRobot)/1.0
43=DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo; +http://search.goo.ne.jp/option/use/sub4/sub4-1/)
44=DomainCrawler/3.0 (info@domaincrawler.com; http://www.domaincrawler.com/codenewsfast.com)
45=EasouSpider
46=e-SocietyRobot(http://www.yama.info.waseda.ac.jp/~yamana/es/)
47=Eurobot/1.1 (http://eurobot.ayell.eu)
48=ExB Language Crawler 2.1.5 (+http://www.exb.de/crawler)
49=Facebook share follower
50=facebookexternalhit/1.1 ( http://www.facebook.com/externalhit_uatext.php)
51=facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
52=faqs/crawler)
53=FAST-WebCrawler/3.6 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)
54=FAST-WebCrawler/3.7/FirstPage (atw-crawler at fast dot no;http://fast.no/support/crawler.asp)
55=FAST-WebCrawler/3.8 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)
56=FAST-WebCrawler/3.x Multimedia (mm dash crawler at fast dot no)
57=findlinks/2.6 (+http://wortschatz.uni-leipzig.de/findlinks/)
58=Gecko/20080109 (Charlotte/0.9t; http://www.searchme.com/support/)
59=GetRight/4.5 [Segment 1]
60=GetRight/4.5a
61=GetRight/4.5b
62=GetRight/4.5b6
63=Gigabot/3.0 (http://www.gigablast.com/spider.html)
64=Gigabot/3.0+(http://www.gigablast.com/spider.html)
65=Googlebot (gocrawl v0.4)
66=Googlebot/2.1 (+http://www.google.com/bot.html)
67=Googlebot/2.1 (+http://www.googlebot.com/bot.html)
68=Googlebot-Image/1.0
69=Googlebot-richsnippets
70=Googlebot-Video/1.0
71=grub-client
72=Healthbot/Health_and_Longevity_Project_(HealthHaven.com)
73=http://www.almaden.ibm.com/cs/crawler [c01]
74=http://www.yellowpages.com/about/legal/crawl
75=HuaweiSymantecSpider/1.0+DSE-support@huaweisymantec.com+(compatible; MSIE 7.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR ; http://www.huaweisymantec.com/en/IRL/spider)
76=ia_archiver
77=ia_archiver (+http://www.alexa.com/site/help/webmasters; crawler@alexa.com)
78=ichiro/4.0 (http://help.goo.ne.jp/door/crawler.html)	
79=ichiro/5.0 (http://help.goo.ne.jp/door/crawler.html)
80=Influencebot/0.9; (Automatic classification of websites; http://www.influencebox.com/; info@influencebox.com)User-Agent: Mozilla/5.0 (X11; Linux i686; rv:9.0) Gecko/20100101 Firefox/9.0
81=Inktomi Search
82=InternetSeer.com
83=istellabot/Nutch-1.11
84=istellabot/t.1
85=istellabot/t.1.13
86=Java/1.6.0_04
87=Jetbot/1.0
88=JikeSpider Mozilla/5.0 (compatible; JikeSpider; +http://shoulu.jike.com/spider.html)
89=libwww-perl/5.65
90=Linguee Bot (http://www.linguee.com/bot; bot@linguee.com)
91=LinkLint-checkonly/2.1
92=LinkWalker
93=LinkWalker/2.0
94=LSSRocketCrawler/1.0 LightspeedSystems
95=LTI/LemurProject+Nutch+Spider/Nutch-1.0-dev+(lti+crawler+for+CMU;+http://www.lti.cs.cmu.edu;+changkuk+at+cmu+dot+edu)
96=LWNutch/Nutch-1.4 (another scientific bot - we accept your robots.txt! )
97=Lycos_Spider_(modspider)
98=Lycos_Spider_(T-Rex)
99=magpie-crawler/1.1 (U; Linux amd64; en-GB; +http://www.brandwatch.net)
100=Mail.Ru/1.0
101=MauiBot (crawler.feedback+dc@gmail.com)
102=MauiBot (crawler.feedback+wc@gmail.com)
103=Mediapartners-Google
104=meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)
105=MJ12bot/v1.3.0 (http://majestic12.co.uk/bot.php?+)
106=MJ12bot/v1.3.1 (http://majestic12.co.uk/bot.php?+)
107=MLBot (www.metadatalabs.com)
108=MLBot (www.metadatalabs.com/mlbot)
109=Mozilla/2.0 (compatible; Ask Jeeves)
110=Mozilla/2.0 (compatible; Ask Jeeves/Teoma)
111=Mozilla/2.0 (compatible; Ask Jeeves/Teoma; +http://sp.ask.com/docs/about/tech_crawling.html)
112=Mozilla/3.0 (Slurp/cat; slurp@inktomi.com; http://www.inktomi.com/slurp.html)
113=Mozilla/3.0 (Slurp/si; slurp@inktomi.com; http://www.inktomi.com/slurp.html)
114=Mozilla/4.0 (Add Catalog; Windows NT 5.1; infobot.4942@yahoo.com)
115=Mozilla/4.0 (compatible: FDSE robot)
116=Mozilla/4.0 (compatible;  Vagabondo/4.0/EU; http://www.wise-guys.nl/)
117=Mozilla/4.0 (compatible;  Vagabondo/4.0; http://webagent.wise-guys.nl/)
118=Mozilla/4.0 (compatible;  Vagabondo/4.0; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/)
119=Mozilla/4.0 (compatible;  Vagabondo/4.0; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/; http://www.wise-guys.nl/)
120=Mozilla/4.0 (compatible;  Vagabondo/4.0Beta; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/; http://www.wise-guys.nl/)
121=Mozilla/4.0 (compatible; +Baiduspider/2.0;++http://www.baidu.com/search/spider.html +Googlebot/2.1;++http://www.google.com/bot.html)
122=Mozilla/4.0 (compatible; B#L#I#T#Z#B#O#T) - http://www.tricus.nl/
123=Mozilla/4.0 (compatible; grub-client-1.0.4; Crawl your own stuff with http://grub.org)
124=Mozilla/4.0 (compatible; grub-client-1.0.5; Crawl your own stuff with http://grub.org)
125=Mozilla/4.0 (compatible; grub-client-1.0.6; Crawl your own stuff with http://grub.org)
126=Mozilla/4.0 (compatible; grub-client-1.0.7; Crawl your own stuff with http://grub.org)
127=Mozilla/4.0 (compatible; grub-client-1.2.1; Crawl your own stuff with http://grub.org)
128=Mozilla/4.0 (compatible; grub-client-1.3.1; Crawl your own stuff with http://grub.org)
129=Mozilla/4.0 (compatible; grub-client-1.3.7; Crawl your own stuff with http://grub.org)
130=Mozilla/4.0 (compatible; grub-client-1.4.3; Crawl your own stuff with http://grub.org)
131=Mozilla/4.0 (compatible; grub-client-1.5.3; Crawl your own stuff with http://grub.org)
132=Mozilla/4.0 (compatible; grub-client-2.3)
133=Mozilla/4.0 (compatible; MSIE 4.01; Windows NT; MS Search 6.0 Robot)
134=Mozilla/4.0 (compatible; MSIE 5.0; www.galaxy.com; www.arbitration-forum.com; +http://www.galaxy.com/info/crawler.html)
135=Mozilla/4.0 (compatible; MSIE 5.01; Windows 98; MSIECrawler)
136=Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0) Fetch API Request
137=Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; Win 9x 4.90; Q312461; MSIECrawler)
138=Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.0.2914; MSIECrawler)
139=Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; MSIECrawler)
140=Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; MSIECrawler)
141=Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Q312461; MSIECrawler)
142=Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1;  http://www.changedetection.com/bot.html )
143=Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; http://www.changedetection.com/bot.html )
144=Mozilla/4.0 (compatible; MSIE 6.0b; Windows NT 5.1; MSIECrawler)
145=Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; MDDR; .NET4.0C; .NET4.0E; .NET CLR 1.1.4322; Tablet PC 2.0); 360Spider
146=Mozilla/4.0 compatible ZyBorg/1.0 (wn.zyborg@looksmart.net; http://www.WISEnutbot.com)
147=Mozilla/4.0 compatible ZyBorg/1.0 (wn-12.zyborg@looksmart.net; http://www.WISEnutbot.com)
148=Mozilla/4.0 compatible ZyBorg/1.0 (wn-14.zyborg@looksmart.net; http://www.WISEnutbot.com)
149=Mozilla/4.0 compatible ZyBorg/1.0 (ZyBorg@WISEnutbot.com; http://www.WISEnutbot.com)
150=Mozilla/4.0 compatible ZyBorg/1.0 Daily Refresh Beta-d03 (wn.zyborg@looksmart.net; http://www.WISEnutbot.com)
151=Mozilla/4.0 compatible ZyBorg/1.0 Dead Link Checker (wn.dlc@looksmart.net; http://www.WISEnutbot.com)
152=Mozilla/4.0 compatible ZyBorg/1.0 Dead Link Checker (wn.zyborg@looksmart.net; http://www.WISEnutbot.com)
153=Mozilla/4.0_(compatible;_MSIE_5.0;_Windows_95)_TrueRobot/1.4 libwww/5.2.8
154=Mozilla/4.0+(compatible;+MSIE+7.0;+Windows+NT+5.1;+.NET+CLR+1.1.4322;+ZangoToolbar+4.8.3;+.NET+CLR+2.0.50727)
155=Mozilla/5.0 (compatible; 007ac9 Crawler; http://crawler.007ac9.net/)
156=Mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/webcrawler.html) Gecko/2008032620
157=Mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/webcrawler.html;) Gecko/2008032620
158=Mozilla/5.0 (compatible; 008/0.85; http://www.80legs.com/webcrawler.html) Gecko/2008032620
159=Mozilla/5.0 (compatible; 200PleaseBot/1.0; +http://www.200please.com/bot)
160=Mozilla/5.0 (compatible; 4SeoHuntBot; +http://4seohunt.com/bot.html)
161=Mozilla/5.0 (compatible; AB-Downloads.com PAD crawler; http://www.ab-downloads.com)
162=Mozilla/5.0 (compatible; AcoonBot/4.11.1; +http://www.acoon.de/robot.asp)
163=Mozilla/5.0 (compatible; Adsbot/3.1)
164=Mozilla/5.0 (compatible; Adsbot/3.1; +https://seostar.co/robot/)
165=Mozilla/5.0 (compatible; AhrefsBot/3.1; +http://ahrefs.com/robot/)
166=Mozilla/5.0 (compatible; AhrefsBot/4.0; +http://ahrefs.com/robot/)
167=Mozilla/5.0 (compatible; AhrefsBot/5.0; +http://ahrefs.com/robot/)
168=Mozilla/5.0 (compatible; AhrefsBot/5.1; +http://ahrefs.com/robot/)
169=Mozilla/5.0 (compatible; AhrefsBot/5.2; +http://ahrefs.com/robot/)
170=Mozilla/5.0 (compatible; AhrefsBot/6.1; +http://ahrefs.com/robot/)
171=Mozilla/5.0 (compatible; AhrefsBot/6.1; +http://ahrefs.com/robot/)
172=Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)
173=Mozilla/5.0 (compatible; AlphaBot/3.2; +http://alphaseobot.com/bot.html)
174=Mozilla/5.0 (compatible; archive.org_bot +http://www.archive.org/details/archive.org_bot)
175=Mozilla/5.0 (compatible; archive.org_bot; Wayback Machine Live Record; +http://archive.org/details/archive.org_bot)
176=Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml)
177=Mozilla/5.0 (compatible; Baiduspider/2.0;  http://www.baidu.com/search/spider.html)
178=Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html
179=Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
180=Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html??
181=Mozilla/5.0 (compatible; Baiduspider-render/2.0; +http://www.baidu.com/search/spider.html)
182=Mozilla/5.0 (compatible; Barkrowler/0.9; +https://babbar.tech/crawler)
183=Mozilla/5.0 (compatible; Bender; http://benderthewebrobot.tumblr.com)
184=Mozilla/5.0 (compatible; Best Freeware Download PAD crawler; http://www.bestfreewaredownload.com/)
185=Mozilla/5.0 (compatible; Best Software Downloads PAD crawler; http://www.bestsoftware4download.com/)
186=Mozilla/5.0 (compatible; Best Software Downloads PAD crawler; http://www.bestsoftware4download.com/)
187=Mozilla/5.0 (compatible; bingbot/2.0 +http://www.bing.com/bingbot.htm)
188=Mozilla/5.0 (compatible; bingbot/2.0;  http://www.bing.com/bingbot.htm)
189=Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
190=Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) SitemapProbe
191=Mozilla/5.0 (compatible; bingbot/3.0-alpha; +http://www.bing.com/bingbot.htm)
192=Mozilla/5.0 (compatible; Blekkobot; ScoutJet; +http://blekko.com/about/blekkobot)
193=Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/)
194=Mozilla/5.0 (compatible; BMC/1.0 (Y!J-AGENT))
195=Mozilla/5.0 (compatible; BMI/1.0 (Y!J-AGENT; 1.0))
196=Mozilla/5.0 (compatible; Bytespider; spider-feedback@bytedance.com) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.0.0 Safari/537.36
197=Mozilla/5.0 (compatible; ca-crawler/1.0)
198=Mozilla/5.0 (compatible; CareerBot/1.1; +http://www.career-x.de/bot.html)
199=Mozilla/5.0 (compatible; Charlotte/1.2; http://www.searchme.com/support/)
200=Mozilla/5.0 (compatible; Charlotte/1.3; http://www.searchme.com/support/)
201=Mozilla/5.0 (compatible; Cliqzbot/2.0; +http://cliqz.com/company/cliqzbot)
202=Mozilla/5.0 (compatible; Cliqzbot/3.0; +http://cliqz.com/company/cliqzbot)
203=Mozilla/5.0 (compatible; coccocbot-image/1.0; +http://help.coccoc.com/searchengine)
204=Mozilla/5.0 (compatible; coccocbot-web/1.0; +http://help.coccoc.com/searchengine)
205=Mozilla/5.0 (compatible; CompSpyBot/1.0; +http://www.compspy.com/spider.html)
206=Mozilla/5.0 (compatible; CSDPADbot/1.0; http://softwarewagon.com/pad-file-bot.php)
207=Mozilla/5.0 (compatible; DataForSeoBot/1.0; +https://dataforseo.com/dataforseo-bot)
208=Mozilla/5.0 (compatible; Daum/4.1; +http://cs.daum.net/faq/15/4118.html?faqId=28966)
209=Mozilla/5.0 (compatible; DCPbot/1.2; +http://domains.checkparams.com/)
210=Mozilla/5.0 (compatible; DeuSu/5.0.2; +https://deusu.de/robot.html)
211=Mozilla/5.0 (compatible; discobot/1.1;  http://discoveryengine.com/discobot.html
212=Mozilla/5.0 (compatible; discobot/1.1; +http://discoveryengine.com/discobot.html)
213=Mozilla/5.0 (compatible; discoverybot/2.0; +http://discoveryengine.com/discoverybot.html)
214=Mozilla/5.0 (compatible; DotBot/1.1; http://www.dotnetdotcom.org/, crawler@dotnetdotcom.org)
215=Mozilla/5.0 (compatible; DotBot/1.1; http://www.opensiteexplorer.org/dotbot, help@moz.com)
216=Mozilla/5.0 (compatible; DotBot/1.2; +https://opensiteexplorer.org/dotbot; help@moz.com)
217=Mozilla/5.0 (compatible; Dow Jones Searchbot)
218=Mozilla/5.0 (compatible; EasouSpider; +http://www.easou.com/search/spider.html)
219=Mozilla/5.0 (compatible; Exabot/3.0 (BiggerBetter); +http://www.exabot.com/go/robot)
220=Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot)
221=Mozilla/5.0 (compatible; Exabot-Images/3.0; +http://www.exabot.com/go/robot)
222=Mozilla/5.0 (compatible; Ezooms/1.0; ezooms.bot@gmail.com)
223=Mozilla/5.0 (compatible; FatBot 2.0; http://www.thefind.com/crawler)
224=Mozilla/5.0 (compatible; FatBot 2.0; http://www.thefind.com/main/CrawlerFAQs.fhtml)
225=Mozilla/5.0 (compatible; GigaBot/1.0; +http://www.gigablast.com/ )
226=Mozilla/5.0 (compatible; Googlebot/2.1 +http://www.googlebot.com/bot.html)
227=Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
228=Mozilla/5.0 (compatible; Googlebot/2.1;http://www.google.com/bot.html)
229=Mozilla/5.0 (compatible; GrapeshotCrawler/2.0; +http://www.grapeshot.co.uk/crawler.php)
230=Mozilla/5.0 (compatible; GrepNetstatBot/1.0; +http://www.grepnetstat.com/bot)
231=Mozilla/5.0 (compatible; heritrix/1.14.3 +http://www.accelobot.com)
232=Mozilla/5.0 (compatible; heritrix/1.15.1-200807172326  http://www.accelobot.com)
233=Mozilla/5.0 (compatible; heritrix/3.1.2-SNAPSHOT-20121212.104133 +http://archive.org/details/archive.org_bot)
234=Mozilla/5.0 (compatible; ICATbot/1.1)
235=Mozilla/5.0 (compatible; JikeSpider; +http://shoulu.jike.com/spider.html)
236=Mozilla/5.0 (compatible; KaloogaBot; http://kalooga.com/crawler)
237=Mozilla/5.0 (compatible; kmbot-62c5/0.0;  http://knowmore.com/bots)
238=Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (like Gecko) (Exabot-Thumbnails)
239=Mozilla/5.0 (compatible; linkdexbot/2.0; +http://www.linkdex.com/about/bots/)
240=Mozilla/5.0 (compatible; linkdexbot/2.0; +http://www.linkdex.com/bots/)
241=Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots)
242=Mozilla/5.0 (compatible; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots)
243=Mozilla/5.0 (compatible; meanpathbot/1.0; +http://www.meanpath.com/meanpathbot.html)
244=Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +http://megaindex.com/crawler)
245=Mozilla/5.0 (compatible; MixrankBot; crawler@mixrank.com)
246=Mozilla/5.0 (compatible; MJ12bot/v1.2.5; http://www.majestic12.co.uk/bot.php?+)
247=Mozilla/5.0 (compatible; MJ12bot/v1.3.0; http://www.majestic12.co.uk/bot.php?+)
248=Mozilla/5.0 (compatible; MJ12bot/v1.3.1; http://www.majestic12.co.uk/bot.php?+)
249=Mozilla/5.0 (compatible; MJ12bot/v1.3.2; http://www.majestic12.co.uk/bot.php?)
250=Mozilla/5.0 (compatible; MJ12bot/v1.3.2; http://www.majestic12.co.uk/bot.php?+)
251=Mozilla/5.0 (compatible; MJ12bot/v1.3.3; http://www.majestic12.co.uk/bot.php?+)
252=Mozilla/5.0 (compatible; MJ12bot/v1.4.0; http://www.majestic12.co.uk/bot.php?+)
253=Mozilla/5.0 (compatible; MJ12bot/v1.4.2; http://www.majestic12.co.uk/bot.php?+)
254=Mozilla/5.0 (compatible; MJ12bot/v1.4.3; http://www.majestic12.co.uk/bot.php?+)
255=Mozilla/5.0 (compatible; MJ12bot/v1.4.4; http://www.majestic12.co.uk/bot.php?+)
256=Mozilla/5.0 (compatible; MJ12bot/v1.4.5; http://www.majestic12.co.uk/bot.php?+)
257=Mozilla/5.0 (compatible; MJ12bot/v1.4.7; http://mj12bot.com/)
258=Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/)
259=Mozilla/5.0 (compatible; MJ12bot/v2.0.0; http://mj12bot.com/)
260=Mozilla/5.0 (compatible; MojeekBot/0.10; +https://www.mojeek.com/bot.html)
261=Mozilla/5.0 (compatible; MojeekBot/0.11; +https://www.mojeek.com/bot.html)
262=Mozilla/5.0 (compatible; MojeekBot/0.6; +https://www.mojeek.com/bot.html)
263=Mozilla/5.0 (compatible; MojeekBot/0.6; http://www.mojeek.com/bot.html)
264=Mozilla/5.0 (compatible; MojeekBot/0.7; +https://www.mojeek.com/bot.html)
265=Mozilla/5.0 (compatible; monitis - premium monitoring service; http://www.monitis.com)
266=Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; Trident/5.0); 360Spider
267=Mozilla/5.0 (compatible; news bot /2.1)
268=Mozilla/5.0 (compatible; NLNZ_IAHarvester2013 +http://natlib.govt.nz/publishers-and-authors/web-harvesting/2013-nz-web-harvest)
269=Mozilla/5.0 (compatible; oBot/2.3.1; +http://filterdb.iss.net/crawler/)
270=Mozilla/5.0 (compatible; OpenindexSpider; +http://www.openindex.io/en/webmasters/spider.html)
271=Mozilla/5.0 (compatible; OrangeBot/2.0; support.orangebot@orange.com)
272=Mozilla/5.0 (compatible; Peepowbot/1.0; +http://www.peepow.com/bot.php)
273=Mozilla/5.0 (compatible; Plukkie/1.5; http://www.botje.com/plukkie.htm)
274=Mozilla/5.0 (compatible; pmoz.info ODP link checker; +http://pmoz.info/doc/botinfo.htm)
275=Mozilla/5.0 (compatible; ProCogBot/1.0; +http://www.procog.com/spider.html)
276=Mozilla/5.0 (compatible; proximic; +http://www.proximic.com/info/spider.php)
277=Mozilla/5.0 (compatible; Purebot/1.1; +http://www.puritysearch.net/)
278=Mozilla/5.0 (compatible; Qwantify/2.4w; +https://www.qwant.com/)/2.4w
279=Mozilla/5.0 (compatible; RankwatchBot/1.0; https://www.rankwatch.com/bot.html)
280=Mozilla/5.0 (compatible; ScoutJet;  http://www.scoutjet.com/)
281=Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/)
282=Mozilla/5.0 (compatible; SearchmetricsBot; http://www.searchmetrics.com/en/searchmetrics-bot/)
283=Mozilla/5.0 (compatible; Seekport Crawler; http://seekport.com/)
284=Mozilla/5.0 (compatible; Seekport Crawler; http://seekport.com/)
285=Mozilla/5.0 (compatible; SemrushBot/1.0~bm; +http://www.semrush.com/bot.html)
286=Mozilla/5.0 (compatible; SemrushBot/1.2~bl; +http://www.semrush.com/bot.html)
287=Mozilla/5.0 (compatible; SemrushBot/2~bl; +http://www.semrush.com/bot.html)
288=Mozilla/5.0 (compatible; SemrushBot/3~bl; +http://www.semrush.com/bot.html)
289=Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html)
290=Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html)
291=Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
292=Mozilla/5.0 (compatible; SemrushBot; +http://www.semrush.com/bot.html)
293=Mozilla/5.0 (compatible; SemrushBot-BA; +http://www.semrush.com/bot.html)
294=Mozilla/5.0 (compatible; SEOkicks; +https://www.seokicks.de/robot.html)
295=Mozilla/5.0 (compatible; SEOkicks-Robot +http://www.seokicks.de/robot.html)
296=Mozilla/5.0 (compatible; SEOkicks-Robot; +http://www.seokicks.de/robot.html)
297=Mozilla/5.0 (compatible; SIBot/1.0; +http://www.profound.net/sibot.html)
298=Mozilla/5.0 (compatible; SISTRIX Crawler; http://crawler.sistrix.net/)
299=Mozilla/5.0 (compatible; SiteBot/0.1;  http://www.sitebot.org/robot/)
300=Mozilla/5.0 (compatible; SiteBot/0.1; +http://www.sitebot.org/robot/)
301=Mozilla/5.0 (compatible; SiteExplorer/1.0b; +http://siteexplorer.info/)
302=Mozilla/5.0 (compatible; SMTBot/1.0; +http://www.similartech.com/smtbot)
303=Mozilla/5.0 (compatible; Snipebot/1.0; +http://snipebot.com/bot.html)
304=Mozilla/5.0 (compatible; Sosospider/2.0; +http://help.soso.com/webspider.htm)
305=Mozilla/5.0 (compatible; spbot/4.0.4; +http://www.seoprofiler.com/bot )
306=Mozilla/5.0 (compatible; spbot/4.0.6; +http://www.seoprofiler.com/bot )
307=Mozilla/5.0 (compatible; spbot/4.1.0; +http://OpenLinkProfiler.org/bot )
308=Mozilla/5.0 (compatible; spbot/4.3.0; +http://OpenLinkProfiler.org/bot )
309=Mozilla/5.0 (compatible; spbot/5.0.1; +http://OpenLinkProfiler.org/bot )
310=Mozilla/5.0 (compatible; spbot/5.0.3; +http://OpenLinkProfiler.org/bot )
311=Mozilla/5.0 (compatible; special_archiver/3.1.1 +http://www.archive.org/details/archive.org_bot)
312=Mozilla/5.0 (compatible; SpiderLing (a SPIDER for LINGustic research); http://nlp.fi.muni.cz/projects/biwec/)
313=Mozilla/5.0 (compatible; Steeler/3.5; http://www.tkl.iis.u-tokyo.ac.jp/~crawler/)
314=Mozilla/5.0 (compatible; tracemyfile/1.0; +bot@tracemyfile.com)
315=Mozilla/5.0 (compatible; URLAppendBot/1.0; +http://www.profound.net/urlappendbot.html)
316=Mozilla/5.0 (compatible; Vagabondo/2.1; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl)
317=Mozilla/5.0 (compatible; Vagabondo/2.1; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/)
318=Mozilla/5.0 (compatible; WBSearchBot/1.1; +http://www.warebay.com/bot.html)
319=Mozilla/5.0 (compatible; WebNL; +http://www.web.nl/webmasters/spider.html; helpdesk@web.nl)
320=Mozilla/5.0 (compatible; woriobot +http://worio.com)
321=Mozilla/5.0 (compatible; woriobot support [at] worio [dot] com  http://worio.com)
322=Mozilla/5.0 (compatible; woriobot support [at] zite [dot] com +http://zite.com)
323=Mozilla/5.0 (compatible; X 64-bit Download PAD crawler; http://www.x64bitdownload.com/)
324=Mozilla/5.0 (compatible; X11; Linux x86_64; Google-StructuredDataTestingTool; +http://www.google.com/webmasters/tools/richsnippets)
325=Mozilla/5.0 (compatible; XoviBot/2.0; +http://www.xovibot.net/)
326=Mozilla/5.0 (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html)
327=Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
328=Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
329=Mozilla/5.0 (compatible; YandexAccessibilityBot/3.0; +http://yandex.com/bots)
330=Mozilla/5.0 (compatible; YandexBot/3.0;  http://yandex.com/bots)
331=Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
332=Mozilla/5.0 (compatible; YandexBot/3.0; MirrorDetector; +http://yandex.com/bots)
333=Mozilla/5.0 (compatible; YandexDirect/3.0; +http://yandex.com/bots)
334=Mozilla/5.0 (compatible; YandexFavicons/1.0; +http://yandex.com/bots)
335=Mozilla/5.0 (compatible; YandexImageResizer/2.0; +http://yandex.com/bots)
336=Mozilla/5.0 (compatible; YandexImages/3.0;  http://yandex.com/bots)
337=Mozilla/5.0 (compatible; YandexImages/3.0; +http://yandex.com/bots)
338=Mozilla/5.0 (compatible; YandexMedia/3.0; +http://yandex.com/bots)
339=Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/; )
340=Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.youdao.com/help/webmaster/spider/; )
341=Mozilla/5.0 (compatible; YoudaoBot/1.0; http://www.youdao.com/help/webmaster/spider/; )
342=Mozilla/5.0 (compatible; YYSpider; +http://www.yunyun.com/spider.html)
343=Mozilla/5.0 (compatible; ZumBot/1.0; http://help.zum.com/inquiry)
344=Mozilla/5.0 (compatible;Baiduspider/2.0;+http://www.baidu.com/search/spider.html)
345=Mozilla/5.0 (compatible;PetalBot;+https://webmaster.petalsearch.com/site/petalbot)
346=Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 (KHTML, like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
347=Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 (KHTML, like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
348=Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 (KHTML, like Gecko) Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0;  http://www.bing.com/bingbot.htm)
349=Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 (KHTML, like Gecko) Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
350=Mozilla/5.0 (iPhone; CPU iPhone OS 8_3 like Mac OS X) AppleWebKit/600.1.4 (KHTML, like Gecko) Version/8.0 Mobile/12F70 Safari/600.1.4 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
351=Mozilla/5.0 (iPhone; CPU iPhone OS 9_1 like Mac OS X) AppleWebKit/601.1.46 (KHTML, like Gecko) Version/9.0 Mobile/13B143 Safari/601.1 (compatible; AdsBot-Google-Mobile; +http://www.google.com/mobile/adsbot.html)
352=Mozilla/5.0 (iPhone; U; CPU iPhone OS 4_1 like Mac OS X; en-us) AppleWebKit/532.9 (KHTML, like Gecko) Version/4.0.5 Mobile/8B117 Safari/6531.22.7 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
353=Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; spider-feedback@bytedance.com)
354=Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.96 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
355=Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.92 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
356=Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.93 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
357=Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.96 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
358=Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.90 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
359=Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.112 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
360=Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.113 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
361=Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.153 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
362=Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.84 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
363=Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.97 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
364=Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.90 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
365=Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; AspiegelBot)
366=Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; PetalBot;+https://aspiegel.com/petalbot)
367=Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; PetalBot;+https://webmaster.petalsearch.com/site/petalbot)
368=Mozilla/5.0 (Linux;u;Android 2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; +http://www.baidu.com/search/spider.html)
369=Mozilla/5.0 (Linux;u;Android 4.2.2;zh-cn;) AppleWebKit/534.46 (KHTML,like Gecko) Version/5.1 Mobile Safari/10600.6.3 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
370=Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Applebot/0.1; +http://www.apple.com/go/applebot)
371=Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_1) AppleWebKit/601.2.4 (KHTML, like Gecko) Version/9.0.1 Safari/601.2.4 facebookexternalhit/1.1 Facebot Twitterbot/1.0
372=Mozilla/5.0 (Slurp/cat; slurp@inktomi.com; http://www.inktomi.com/slurp.html)
373=Mozilla/5.0 (Slurp/si; slurp@inktomi.com; http://www.inktomi.com/slurp.html)
374=Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html)
375=Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html)
376=Mozilla/5.0 (Windows NT 5.1) brokenlinkcheck.com/1.2
377=Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534+ (KHTML, like Gecko) BingPreview/1.0b
378=Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/27.0.1453.116 Safari/537.36 HubSpot Webcrawler
379=Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) Speedy Spider (http://www.entireweb.com/about/search_tech/speedy_spider/)
380=Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1) Gecko/20061010 Firefox/2.0 Me.dium/1.0 (http://me.dium.com)
381=Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.2) Gecko/20090729 Firefox/3.5.2 (.NET CLR 3.5.30729; Diffbot/0.1; +http://www.diffbot.com)
382=Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 (http://www.voila.com/)
383=Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 (support.voilabot@orange-ftgroup.com)
384=Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-CN; )  Firefox/1.5.0.11; 360Spider
385=Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-CN; rv:1.8.0.11)  Firefox/1.5.0.11; 360Spider
386=Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-CN; rv:1.8.0.11) Gecko/20070312 Firefox/1.5.0.11; 360Spider
387=Mozilla/5.0 (Windows; U; Windows NT 6.0; en-GB; rv:1.0; trendictionbot0.5.0; trendiction search; http://www.trendiction.de/bot; please let us know of any problems; web at trendiction.com) Gecko/20071127 Firefox/3.0.0.11
388=Mozilla/5.0 (Windows;) NimbleCrawler 2.0.1 obeys UserAgent NimbleCrawler For problems contact: crawler@healthline.com
389=Mozilla/5.0 (X11; U; Linux i686 (x86_64); en-US; rv:1.8.1.11) Gecko/20080109 (Charlotte/0.9t; http://www.searchme.com/support/)
390=Mozilla/5.0 (X11; U; Linux i686; pl; rv:1.8.0.7) Gecko/20060914 Firefox/1.5.0.7 (Swiftfox)
391=Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.19; aggregator:Spinn3r (Spinn3r 3.1); http://spinn3r.com/robot) Gecko/2010040121 Firefox/3.0.19
392=Mozilla/5.0 [en] (compatible; Gulper Web Bot 0.2.4 www.ecsl.cs.sunysb.edu/~maxim/cgi-bin/Link/GulperBot)
393=Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/100.0.4896.127 Safari/537.36
394=Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/103.0.5060.134 Safari/537.36
395=Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/116.0.1938.76 Safari/537.36
396=Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Safari/537.36
397=Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.2; +https://openai.com/gptbot)
398=Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; Google Web Preview Analytics) Chrome/27.0.1453 Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
399=Mozilla/5.0(compatible; Sosospider/2.0; +http://help.soso.com/webspider.htm)
400=Mozilla/5.0+(compatible; UptimeRobot/2.0; http://www.uptimerobot.com/)
401=Mozilla/5.0+(compatible;+Googlebot/2.1;++http://www.google.com/bot.html)
402=Mozilla/5.0+(compatible;+PiplBot;++http://www.pipl.com/bot/)
403=msnbot/1.1 (+http://search.msn.com/msnbot.htm)
404=msnbot/2.0b (+http://search.msn.com/msnbot.htm)
405=msnbot/2.0b (+http://search.msn.com/msnbot.htm)._
406=msnbot-media/1.0 ( http://search.msn.com/msnbot.htm)
407=msnbot-media/1.0 (+http://search.msn.com/msnbot.htm)
408=msnbot-media/1.0+(+http://search.msn.com/msnbot.htm)
409=msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)
410=msnbot-NewsBlogs/2.0b (+http://search.msn.com/msnbot.htm)
411=NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)
412=NetResearchServer
413=Netscape 3.0 Compatible (WhatsNew Robot)
414=NextGenSearchBot 1 (for information visit http://www.zoominfo.com/About/misc/NextGenSearchBot.aspx)
415=niki-bot
416=NPBot (http://www.nameprotect.com/botinfo.html)
417=Nutch-Crawler-Manu/Nutch-1.5.1
418=NutchCVS/0.06-dev (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@lists.sourceforge.net)
419=NutchOrg/0.03-dev (Nutch; http://www.nutch.org/docs/bot.html; nutch-agent@lists.sourceforge.net)
420=oBot
421=Openfind data gatherer, Openbot
422=Openfind data gatherer, Openbot/3.0 (robot-response@openfind.com.tw; http://www.openfind.com.tw/robot.html)
423=Openfind data gatherer, Openbot/3.0+(robot-response@openfind.com.tw;+http://www.openfind.com.tw/robot.html)
424=OWR_Crawler 0.1
425=PADTube.com Crawler
426=PagePeeker.com (info: http://pagepeeker.com/robots)
427=PagesInventory (robot http://www.pagesinventory.com)
428=PagesInventory.com (robot http://www.pagesinvenotry.com)
429=panscient.com
430=PhxBot/0.1 (phxbot@protonmail.com)
431=PingALink Monitoring Services 1.0
432=Pita (webmaster@pita.stanford.edu)
433=psbot/0.1 (+http://www.picsearch.com/bot.html)
434=Pulseway/5.4 (http://www.pulseway.com)
435=Pulseway/6.0 (http://www.pulseway.com)
436=QBikSpider/2.0
437=rabaz (rabaz at gigabaz dot com)
438=RaBot/3.0 Agent-Admin/radardir@kies.co.kr
439=robot
440=Robozilla/1.0
441=rogerbot/1.0 (http://moz.com/help/pro/what-is-rogerbot-, rogerbot-wherecat@moz.com)
442=SafeDNSBot (https://www.safedns.com/searchbot)
443=SapphireWebCrawler/1.0 (Sapphire Web Crawler using Nutch; http://boston.lti.cs.cmu.edu/crawler/; mhoy@cs.cmu.edu)
444=SapphireWebCrawler/Nutch-1.0-dev (Sapphire Web Crawler using Nutch; http://boston.lti.cs.cmu.edu/crawler/; mhoy@cs.cmu.edu)
445=Scooter/3.3.QA
446=Scooter/3.3_SF
447=Scooter-3.2.EX
448=Scooter-3.2.FNR
449=Sensis Web Crawler (search_comments\at\sensis\dot\com\dot\au)
450=SEOENGWorldBot/1.0 (+http://www.seoengine.com/seoengbot.htm)
451=serpstatbot/2.0 beta (advanced backlink tracking bot; http://serpstatbot.com/; abuse@serpstatbot.com)
452=Servers Alive URL check
453=SeznamBot/3.0-beta (+http://fulltext.sblog.cz/), I
454=ShopWiki/1.0 ( +http://www.shopwiki.com/wiki/Help:Bot)
455=sitecheck.internetseer.com (For more info see: http://sitecheck.internetseer.com)
456=sitechecker
457=Slurp.so/1.0 (slurp@inktomi.com; http://www.inktomi.com/slurp.html)
458=Slurp/2.0-KiteHourly (slurp@inktomi.com; http://www.inktomi.com/slurp.html)
459=Slurp/2.0-KiteWeekly (slurp@inktomi.com; http://www.inktomi.com/slurp.html)
460=Slurp/si (slurp@inktomi.com; http://www.inktomi.com/slurp.html)
461=smart.apnoti.com Robot/v1.34 (http://smart.apnoti.com/index/aboutApnotiWebCrawler)
462=Snapbot/1.0
463=SoftSearch.ru robot (adv@softsearch.ru)
464=Sogou Pic Spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
465=sogou spider
466=Sogou web spider/4.0
467=Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
468=Sosospider ( http://help.soso.com/webspider.htm)
469=Sosospider+(+http://help.soso.com/webspider.htm)
470=Speedy Spider (http://www.entireweb.com/about/search_tech/speedy_spider/)
471=S-P-I-D-E-R.suchmaschine.search-area.de
472=spider-ads
473=sproose/1.0beta (sproose bot; http://www.sproose.com/bot.html; crawler@sproose.com)
474=StatoolsBot (+http://www.statools.com/bot.html)
475=SyncBot
476=Szukacz
477=Teemer+(NetSeer,+Inc.;+http://www.netseer.com/crawler.html;+crawler@netseer.com)
478=Teemer+(NetSeer,+Inc.+is+a+Los+Angeles+based+Internet+startup+company.;+http://www.netseer.com/crawler.html;+crawlerseer.com)
479=Teleport Pro/1.29
480=Teleport Pro/1.29.1616
481=Teleport Pro/1.29.1820
482=The Knowledge AI
483=TurnitinBot/2.1 (http://www.turnitin.com/robot/crawlerinfo.html)
484=TurnitinBot/3.0 (http://www.turnitin.com/robot/crawlerinfo.html)
485=Twitterbot/1.0
486=Updownerbot (+http://www.updowner.com/bot)
487=URL_Spider_Pro/2.0
488=Vagabondo/2.0 MT (webagent at wise-guys dot nl)
489=vspider
490=WatzNew Agent 1.6 (www.watznew.com)
491=WebAlta+Crawler/2.0+(http://www.webalta.net/ru/about_webmaster.html)+(Windows;+U;+Windows+NT+5.1;+ru-RU)
492=WebCopier v3.4
493=WebEye
494=WebFetch
495=Website Quester - www.asona.org
496=Webwatch/7.3+(http://webcentre.co.nz/webwatch.htm)
497=WebZIP/4.0 (http://www.spidersoft.com)
498=Wget/1.6
499=WhatsUp_Gold/7.0
500=WillyBot/1.1 (http://www.willyfogg.com/info/willybot)
501=Woodstone Servers Alive URL check
502=Wotbox/2.01 (+http://www.wotbox.com/bot/)
503=WWW-Mechanize/1.66
504=Xaldon WebSpider 2.5.b3
505=Y!J-BRJ/YATS crawler (http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html)
506=Y!J-BRW/1.0 crawler (http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html)
507=yacybot (freeworld/global; amd64 Windows 7 6.1; java 1.7.0_25; Europe/de) http://yacy.net/bot.html
508=Yahoo! Slurp China
509=Yahoo! Slurp/Site Explorer
510=Yahoo-MMCrawler/3.x (mm dash crawler at trd dot overture dot com)
511=Yahoo-MMCrawler/3.x (mms dash mmcrawler dash support at yahoo dash inc dot com)
512=Yandex/1.01.001 (compatible; Win16; I)
513=Yanga WorldSearch Bot v1.1/beta (http://www.yanga.co.uk/) 
514=Yeti/1.0 (NHN Corp.; http://help.naver.com/robots/)
515=Yeti/1.1 (Naver Corp.; http://help.naver.com/robots/)
516=Yeti/1.1 (NHN Corp.; http://help.naver.com/robots/)
517=YisouSpider
518=ZoominfoBot (zoominfobot at zoominfo dot com)