Skocz do zawartości
Spanner

[Artykuł/Tutorial] Aktualna lista botów wyszukiwarek

Polecane posty

Tytuł: Aktualna lista botów wyszukiwarek

Opis: Aktualizacja 13.02.2009

Kategoria: Artykuły IP.Board

Data dodania: 06.01.08, 18:29

Autor: Spanner

Najnowsza lista botów wyszukiwarek znajduje się poniżej.

Lista pochodzi z dnia 13 luty 2009

0.1_hseo(at)cs.rutgers.edu=Rutgers.edu
192.comAgent=192.com
4anything.com=4Anything.com
4anything.com LinkChecker v2.0=4Anything.com
:robot/1.0=Neofonie.de
A-Online Search=Jet2Web.com
AbachoBOT=Crawler.de
AbachoBOT (Mozilla compatible)=Crawler.de
ABCdatos=ABCdatos.com
abcdatos_botlink=Abcdatos.com
Aberja Checkomat=Aberja.de Link Checking
abot/0.1=Abot.com
abot/0.1 (abot; http://www.abot.com; abot@abot.com)=Abot.com
About=About.com
About/0.1libwww-perl/5.47=About.com
Accelatech RSS=Accelatech.com
accoona=Accoona.com
Ack=Ackerm.com
AcoiRobot=Acoi Picture Robot
Acoon=Acoon.de
Acoon Robot=Accon.de
Acoon Robot v1.50.001=Acoon.de
Acoon Robot v1.52=Acoon.de
Acorn=Acorn Search
ActiveWorlds/3.xx=ActiveWorlds.com
admin@crawler.de=Crawler.de
admin@maxbot.com=maxbot.com
ADSARobot=ADSARobot
AESOP=AESOP.com
AESOP_com_SpiderMan=Aesop.com
Agadine=Agada.de
agadine/1.x.x=Agada.de
Agent-admin/=Daum.net
AgentName/0.1 libwww-perl/5.48=LinkoMatic.com Link Checker
ah-ha.com crawler=Ah-ha.com
ah-ha.com crawler (crawler@ah-ha.com)=Ah-ha.com
AIBOT=21Seek.com
AIBOT/2.1=21Seek.com
aipbot=NameProtect.com
aipbot/1.0=NameProtect.com
aipbot/1.0 (aipbot; http://www.aipbot.com; aipbot@aipbot.com)=NameProtect.com
aipbot/2-beta=NameProtect.com
aipbot/2-beta (aipbot dev; http://aipbot.com; aipbot@aipbot.com)=NameProtect.com
Aladin=Aladin.de
Aladin/3.324=Aladin.de
Aleksika=Aleksika.com
Aleksika Spider/1.0=Aleksika.de
ALink=ALink Link Checker
AlkalineBOT=AlkalineBOT
AlkalineBOT/1.3=Vestris.com
AlkalineBOT/1.4=Vestris.com
Allesklar=Allesklar.de
Allesklar/0.1 libwww-perl/5.46=Allesklar.de
AltaVista=AltaVista.com
AltaVista-Intranet=Altavista.co.uk
AMeta=AMeta Link Checker
Amfibi=Amfibi.com
AmfibiBOT=Amfibi.com
Amibot=Amidalla.com
Amiga-AWeb/3.4.167SE=AWeb.com
amzn_assoc=Amazon.com
amzn_assocamzn_assoc=Amazon
AnnoMille=Annomille.it
AnswerBus=AnswerBus.com
AnswerChase=AnswerChase.com
AnswerChase PROve x.0=AnswerChase.com
AnswerChase x.0=AnwserChase.com
Antibot=AntiSeach.net
antibot-V1.1.5/i586-linux-2.2=AntiSeach.net
AnzwersCrawl=Yahoo!7 Answers
AnzwersCrawl/2.0=Anzwers
Apexoo=Apexoo.com
Aport=Aport.ru
appie=Walhello.com
appie 1.1=Walhello.com
Arachnoidea=Euroseek.com
arachnoidea@euroseek.net=Euroseek.net
Aranha=Girafa.com
ArchitectSpider=Excite.com
ArchitextSpider=excite.com
archive.org=Archive.org
archive.org_bot=Archive.org
archive_org=Archive.org
Arikus_Spider=Arikus.com
ASAHA=Asaha.com
Asahina=Asahina Bot
ask jeeves=Ask Jeeves
ask.24x.info=Ask.24x.info
AskAboutOil=AskAboutOil.com
Asked=Asked.jp
ASPSearch URL Checker=ASPSearch Link Checker
ASPSeek=ASPSeek.org
ASPSeek/1.2.5=ASPSeek.org
ASPseek/1.2.9d=ASPSeek.com
ASPSeek/1.2.x=ASPSeek.org
ASPSeek/1.2.xa=ASPSeek.org
ASPseek/1.2.xx=ASPseek.org
ASPSeek/1.2.xxpre=ASPSeek.org
Asterias=SingingFish.com
asterias/2.0=SingingFish.com
Atlocal=Local.com
AtlocalBot=Atlocal.com
AtlocalBot/1.1 +(http://www.atlocal.com/local-web-site-owner.html)=Atlocal.com
Atomz=Atomz.com
Atomz/1.0=Atomz.com
atSpider/1.0=atSpider Email Extractor
Augurfind=Augurnet.ch
augurnfind V-1.x=Augurnet.ch
autoemailspider=Auto Email Extractor
autohttp=Elsop.com
AV Fetch 1.0=Altavista.com
AVSearch=Altavista.com
AVSearch-1.0(peter.turney@nrc.ca)=NRC-CNRC.gc.ca
AVSearch-3.0=Altavista.com
AVSearch-3.0(AltaVista/AVC)=AltaVista.com
Axadine=Axada.de
axadine/ (Axadine Crawler; http://www.axada.de/; )=Axada.de
axadine/ (Axadine Crawler; http://www.axada.de/; )=Axada.de
AxmoRobot=Axmo.com
BaboomBot=Baboom.us
BaiDuSpider=Baidu.com
Baiduspider+=Baidu.com
Balihoo=Balihoo.com
BanBots/1.2=Banbots.com
BarraHomeCrawler=BarraHome.com
Bdcindexer=Business.com
bdcindexer_2.6.2=Business.com
BDFetch=Brandimensions.com
BDNcentral Crawler v2.3=Bdncentral.com
Beautybot=Cosmoty.de
beautybot/1.0=Cosmoty.com
BebopBot=APassion4Jazz.net
BecomeBot=Become.com
BeebwareDirectory/v0.01=Beepware.co.uk Link Checker
Big Brother=Big Brother Link Checker
BigBrother/1.6e=Big Brother Network Monitor
BigCliqueBOT=BigClique.com
BigCliqueBOT/1.03-dev=BigClique.com
BIGLOTRON=Biglotron.com
Bigsearch.ca=Bigsearch.ca
Bilbo=Wise-Guys.nl
Bilbo/2.3b-UNIX=Biblo Bot
Bilgi=Bilgi.com
BilgiBetaBot=Bilgi.com
Bitacle=Bitacle.org
BlackWidow=BlackWidow Bot
Blaiz-Bee=Blaiz.net
Blaiz-Bee/1.0=Blaiz.net
Blaiz-Bee/1.0 (+http://www.blaiz.net)=Blaiz.net
BlitzBOT=Blitzsuche Bot
BlitzBOT@tricus.net=Blitzsuche.rp-online.de
BlitzBOT@tricus.net (Mozilla compatible)=Blitzsuche.rp-online.de
BlogBot=Blogdex.net
BlogBot/1.x=Blogdex.net
Bloglines=Bloglines.com
Bloglines Title Fetch/1.0 (http://www.bloglines.com)=Bloglines.com
Blogpulse=BlogPulse.com
Blogpulse (info@blogpulse.com)=BlogPulse.com
BlogSearch=IceRocket.com
BlogsNowBot=BlogsNow.com
blogWatcher_Spider=lr.pi.titech.ac.jp
blogWatcher_Spider/0.1=Blogwatcher.pi.titech.ac.jp
BlogzIce=IceRocket.com
BlogzIce/1.0=IceRocket.com
BlogzIce/1.0 (+http://icerocket.com; rhodes@icerocket.com)=IceRocket.com
BlogzIce/1.0 +http://www.icerocket.com/=IceRocket.com
BMChecker=BMLink Checker
boitho.com=Boitho.com
boitho.com-dc/0.xx=Boitho.com
boitho.com-robot/1.x=Boitho.com
Bookmark Buddy=Bookmark Buddy Link Checker
BotSeer=botseer.ist.psu.ed
BravoBrian=BravoBrian.it
BruinBot=UCLA Web Archive
BSDSeek/1.0=Inktomi.com
BTbot=BTBot.com
BuildCMS=BuildCMS.com
BullsEye=Intelliseek.com
bumblebee@relevare.com=Relevare.com
BurstFindCrawler=BurstFind.com
Buscaplus=BuscaPlus.com
Buscaplus Robi=Buscaplus.com
Buscaplus Robi/1.0=Buscaplus.com
C-PBWF-ip3000.com-crawler=IP3000.com
CanSeek=canseek.ca
CanSeek/=Cansee.ca
Carleson=CosmixCorp.com
carleson/1.0=CosmixCorp.com
Carnegie_Mellon_University=Andrew.CMU.edu
Catall Spider=Catall.de
Ccubee=Empyreum.com
cfetch/1.0=CosmixCorp.com
cg-eye interactive=HtmlHelp.com
Check&Get=Check&Get Link Checker
Checkbot/1.xx LWP/5.xx=Link Checker
CheckLinks/1.x.x=Link Checker
CheckUrl=NTL.com Link Checker
CheckWeb=CheckWeb Link Checker
ChristCRAWLER=Christcrawler.com
ChristCRAWLER 2.0=Christcrawler.com
CipinetBot=Cipinet.com
citenikbot/=Cenik.co.uk
CJ Spider/=Commision Junction Link Checker
ClariaBot/1.0=Searchscout.com
Claymont.com=Claymont.com
CLIPS-index=Cips-index.imag.fr
CloakDetect=Seznam.cz
Clushbot=Clush.com
Clushbot/3.3-BinaryFury=Clush.com
Clushbot/3.3-BinaryFury (+http://www.clush.com/bot.html)=Clush.com
Clushbot/3.xx-Hector=Clush.com
Clushbot/3.xx-Hector (+http://www.clush.com/bot.html)=Clush.com
CNET_Snoop=CNET_Snoop Link Checker
ColdFusion=Networld.com Link Checker
collage.cgi=WebCollage.com
Combine/x.0=Combine Bot
cometrics-bot=Cometrics.de
Computer_and_Automation_Research=Datamining.sztaki.hu
Computer_and_Automation_Research_Institute_Crawler=Research Bot
Comrite=ComRite.com
contact/jylee@kies.co.kr=Kies.co.kr
Convera=Convera.com
Convera Internet Spider V6.x=Convera.com
CoolBot=Suchmaschine21.de
cosmos=Xyleme.com
cosmos/0.8_(robot@xyleme.com)=Xyleme.com
cosmos/0.9_(robot@xyleme.com)=Xyleme.com
CougarSearch=CougarSearch.com
Cowbot=Naver.co.jp
CrawlConvera=Convera.com
CrawlConvera0.1=Converna.net
Crawler=Crawler.de
Crawler (cometsearch@cometsystems.com)=Findwhat.com
Crawler admin@crawler.de=Crawler.de
Crawler V 0.2.x admin@crawler.de=Crawler.de
Crawler V 0.2.x admin@crawler.de Crawler.de / Abac=Crawler.de
crawler.de=Crawler.de
crawler@ah-ha.com=Ah-ha.com
crawler@alexa.com=Alexa.com
crawler@brainbot.com=Brainbot.com
crawler@fast.no=Alltheweb.com
CrawlerBoy=Pinpoint.com
CrawlerBoy Pinpoint.com=Pinpoint.com
Crawllybot=Crawlly.com
CreativeCommons=CreativeCommons.com
CreativeCommons/0.06-dev=CreativeCommons.org
Crescent Internet ToolPak HTTP OLE Control v.1.0=Crescent Email Extractor
CrocCrawler=CrocCrawler.com
CSE HTML Validator=CSE HTML Link Checker
CurryGuide SiteScan 1.1=CurryGuide Link Checker
Custo x.x=Netwu.com Link Checker
Custom Spider www.bisnisseek.com=Bisnisseek.com
Custom Spider www.bisnisseek.com /1.0=Bisnisseek.com
CydralSpider=Cydral.com
DaAdLe.com ROBOT=daadle.com
DaAdLe.com ROBOT/=Daadle.com
DataFountains=Infomine.ucr.edu
DataparkSearch=DataParkSearch.org
DataparkSearch/4.xx=DataparkSearch.com
DataSpear=DataSpear.com
DaviesBot=Wholeweb.net
DaviesBot/1.7=Wholeweb.net
dbDig=Prairielandconsulting.com
DBrowse 1.4b=DBrowse Bot
DBrowse 1.4d=DBrowse Bot
dCSbot/1.1=Openmarket.com
de.searchengine.comBot=dr.SearchEngine.com
DeadLinkCheck/0.4.0 libwww-perl/5.xx=Dead Link Checker
DeepIndex=DeepIndex.com
DeepIndexer.ca=DeepIndex.com
deepweb=Deepweb.com
Demo Bot DOT 16b=Btopenworld.com
Denmex websearch=Denmax.com Link Checker
dev-spider2.searchpsider.com=SearchSpider.com
DiaGem/=Skyrocket.gr.jp
DiaGem/1.1=Skyrocket.gr.jp
DiaGem/1.1 (http://www.skyrocket.gr.jp/diagem.html)=Skyrocket.gr.jp
Diamond=SearchScout.com
Diamond/1.0=Searchscout.com
Digger=Diggit.com
Digger/1.0 JDK/1.3.0rc3=Diggit.com
Digimarc WebReader=Digimarc.com
DigOut4U=Arisem.com
DIIbot=Digital-Integrity.com
DIIbot/1.2=Digital-Integrity.com
DISCo Watchman=DISCo Watchman Link Checker
DittoSpyder=Ditto.com
dloader(NaverRobot)=naver.com
dloader(NaverRobot)/=Naver.com
DoCoMo=Nttdocomo.co.jp
DoctorHTML=DoctorHTML Link Checker
DreamCatcher=Idaji.com
Drecombot=Drecom.co.jp
DRKSpider=DRKSpider Link Checker
dtSearchSpider=Dtsearch.com
Dumbot=DumbFind.com
Dumbot(version 0.1 beta - dumbfind.com)=Dumbfind.com
Dumbot(version 0.1 beta)=Dumbfind.com
dumrobo(NaverRobot)=naver.com
dumrobo(NaverRobot)/=Naver.com
e-SocietyRobot=yama.info.waseda.ac.jp
EARTHCOM=EarthCom.com
EARTHCOM.info/1.4beta=Earthcom.info
EasyDL=Keywen.com
EasyDL/3.02=Keywen.com
EasyDL/3.03=Keywen.com
EasyDL/3.04=Keywen.com
EasyDL/3.xx=Keywen.com
EasyDL/3.xx http://keywen.com/Encyclopedia/Bot=Keywen.com
eBot=Elchron.cz
EchO!=Echo.fr
EchO!/2.0=Voila.com
egothor/3.0a=Xdefine.com
egothor/3.0a (+http://www.xdefine.org/robot.html)=Xdefine.com
EgotoBot/4.8=Egoto.com
ejupiter=ejupiter.com
ejupiter.com=eJupiter.com
EldoS TimelyWeb/3.x=TimelyWeb Link Checker
elfbot=uChoose.de
Email Extractor=Email Extractor
EmailSiphon=EmailSiphon Extractor
EmailWolf=EmailWolf Extractor
EmailWolf 1.00=EmailWolf Extractor
EMPAS=EMPAS.com
Enterprise_Search=Innerprise.net
Enterprise_Search/1.0=Innerprise.net
Enterprise_Search/1.0.xxx=Innerprise.net
Envolk=Envolk.com
erik@malfunction.org=Malfunction.org
EroCrawler=Erocrawler.com
ES.NET_Crawler=Innerprise.net
ES.NET_Crawler/2.0=Innerprise.net
eseek-larbin_2.6.2=Exactseek.com
ESISmartSpider=Travel-Finder.com
eStyleSearch 4=e-styleisp.ru
EuripBot=Eurip.com
EvaalSE=Evaal.com
Eventax=Eventax.de
Everest-Vulcan=Vulcan.com
Everest-Vulcan Inc./0.1=Vulcan.com
Exabot=Exabot.com
ExactSeek=ExactSeek.com
ExactSeek Crawler/0.1=Exactseek.com
exactseek-crawler-2.63=Exactseek.com
Exalead NG/MimeLive Client=Exabot.com
Excalibur Internet Spider V6.5.4=Excalib.com
excite=Excite.comExecrawl=Execrawl.com
ExperimentalHenrytheMiragoRobot=Mirago.co.uk
ExtractorPro=Email Extractor
EyeCatcher=Download-tipp.de
EyeCatcher (Download-tipp.de)/1.0=Download-tipp.de
EZResult=Ezresults.com
Factbot=FactBites.com
Fast Crawler Gold Edition=Alltheweb.com
FAST Data Search Crawler=Alltheweb.com
FAST Enterprise Crawler=AllTheWeb.com
FAST Enterprise Crawler 6=Alltheweb.com
FAST Enterprise Crawler 6 (Experimental)=Alltheweb.com
FAST Enterprise Crawler 6 used by FAST=Alltheweb.com
FAST Enterprise Crawler 6 used by FAST (FAST)=Alltheweb.com
FAST Enterprise Crawler/6=Alltheweb.com
FAST Enterprise Crawler/6 (www.fastsearch.com)=Alltheweb.com
FAST FirstPage retriever=Alltheweb.com
FAST FirstPage retriever (compatible; MSIE 5.5; Mozilla/4.0)=Alltheweb.com
FAST MetaWeb Crawler=AllTheWeb.com
Fast PartnerSite Crawler=Alltheweb.com
FAST-WebCrawler=Alltheweb.com
FAST-WebCrawler/2.2.10=Altheweb.com
FAST-WebCrawler/2.2.6=Altheweb.com
FAST-WebCrawler/2.2.7=Altheweb.com
FAST-WebCrawler/2.2.8=Altheweb.com
FAST-WebCrawler/3.2=Altheweb.com
FAST-WebCrawler/3.2 test=Altheweb.com
FAST-WebCrawler/3.3=Altheweb.com
FAST-WebCrawler/3.4/Nirvana=Altheweb.com
FAST-WebCrawler/3.4/PartnerSite=Altheweb.com
FAST-WebCrawler/3.5=Altheweb.com
FAST-WebCrawler/3.6=Altheweb.com
FAST-WebCrawler/3.6/FirstPage=Altheweb.com
FAST-WebCrawler/3.7=Altheweb.com
FAST-WebCrawler/3.7/FirstPage=Altheweb.com
FAST-WebCrawler/3.8=Altheweb.com
FAST-WebCrawler/3.8/Fresh=Altheweb.com
FAST-WebCrawler/3.x Multimedia=Altheweb.com
FAST-WebCrawler/3.x Multimedia (mm dash crawler at fast dot no)=Altheweb.com
Fastbot=FastBot.de
FastCrawler=AllTheWeb.com
FastCrawler 3.0.1=Alltheweb.com
FastCrawler 3.0.1 (crawler@1klik.dk)=Alltheweb.com
FastSearch-AllTheWeb.com
=FastSearch-AllTheWeb.com=favo.eu=Favo.eu
FavOrg=FavOrg Link Checker
Favorites Sweeper=Favorites Sweeper Link Checker
Faxobot=Faxo.com
Faxobot/1.0=FaXo.com
Feed Seeker Bot=MyNewFavoriteThing.com
Feed24.com=Feed24.com
Feedfetcher-Google=Google RSS Bot
Feedster Crawler=Feedster.com
Felix=Mixcat.com
Felix - Mixcat Crawler=Mixcat.com
FFC Trap Door Spider=Frequentfinders.com
fido/1.0 Harvest/1.4.pl2=Planet Search
Filangy=Filangy.com
FinaleRobot=expressus.com
FindAnISP.com=FindAnISP.com
FindAnISP.com_ISP_Finder_v99a=FindAnISP.com
Findexa=Findexa.no
Findexa Crawler=Findexa.no
FineBot=Finesearch.com
Firefly=Fireball.de
Firefly/1.0=Fireball.de
Firefly/1.0 (compatible; Mozilla 4.0; MSIE 5.5)=Fireball.de
FirstGov.gov=FirstGov.gov
Firstsbot=Firstsbot Link Checker
Flapbot=Flaptor.com
Flatlandbot=FlatlandIndustries.com
FlickBot 2.0 RPT-HTTPClient/0.3-3=DivX.com
Fluffy the spider=SearchHippo.com
Flunky=Metacarta.com
FocusedSampler/1.0=Almaden.IBM.com
Fooky.com=Fooky.com
Francis=Neomo.de
Francis/1.0=Neomo.de
Francis/1.0 (francis@neomo.de http://www.neomo.de/)=Neomo.de
Franklin Locator 1.8=Franklin Spam Bot
FreeFind=FreeFind.com
FreeFind.com-SiteSearchEngine/1.0=Freefind.com
FreshLinks.exe=FreshLinks Link Checker
FreshNotes=FreshNotes.com
Funnel Web Profiler=Funnel Web Profiler Link Checker
FuseBulb=FuseBulb.com
FyberSearch=Fybersearch.com
FyberSpider=Fybersearch.com
Gagglebot=Gagglebot
GAIS Robot=Seed.net.tw
GAIS Robot/1.0B2=Seed.net.tw
Gaisbot=Gais.cs.ccu.edu.tw
Gaisbot/3.0=Seed.net.tw
Gaisbot/3.0+=Seed.net.tw
GalaxyBot=Galaxy.com
GalaxyBot/1.0=Galaxy.com
GalaxyBot/1.0 (http://www.galaxy.com/galaxybot.html)=Galaxy.com
Gallent Search Spider=Gallent.co.uk
Gamekitbot=GameKit.de
GammaSpider=GammaSite.com
GammaSpider/1.0=Gammasite.com
gazz=Unknown
gazz/1.0=Infobee.ne.jp
gazz@nttrd.com=Infobee.ne.jp
Geckobot=Geckobot.com
GenCrawler=Gendoor.com
generic_crawler/01.0217/=Cmu.edu
genieBot=GenieKnows.com
GentleSpider=Research.att.com
GeonaBot=Geona.com
GeonaBot 1.0=Geona Link Checker
GigaBaz=Brainbot.com
GigaBazVStheWeb=Brainbot.com
GigaBlast=Gigablast.com
Gigabot=Gigablast.com
Gigabot/1.0=Gigablast.com
GigabotSiteSearch/2.0=Gigablast.com
GigabotSiteSearch/2.0 (sitesearch.gigablast.com)=Gigablast.com
Giskard=oralco.com
GNODSPIDER=Gnod.net
Goblin=GoGuides.org
Goblin/0.9=Goguides.org
Goblin/0.9 (http://www.goguides.org/)=Goguides.org
Goblin/0.9.x=Goguides.org
Goblin/0.9.x (http://www.goguides.org/goblin-info.html)=Goguides.org
GoForIt=GoForIt.com
GoForIt.com=Goforit.com
Gonzo=Suchen.degonzo1=Suchen.de
Goofer/0.2=Wanadoo.fr
Google=Google.com
Googlebot=Google.com
Googlebot-Image/1.0=Google.com Image Bot
Googlebot/1.0=Google.com
Googlebot/2.1=Google.com
Googlebot/Test=Google.com
googlebot@googlebot.com=Google.com
Gooru-WebSpider=Gooru.pl
griffon=navi.ocn.ne.jp
GrigorBot=Grigor.biz
GrigorBot 0.8=Grigor.biz
Gromit=Austlii.edu.au
grub crawler(http://www.grub.org)=Grub.com
grub-client=Grub.org
Gsa=crawlergsa-crawler=Google.com
gsa-crawler (Enterprise; GID-01422; jplastiras@google.com)=Google.com
gsa-crawler (Enterprise; GID-01742;gsatesting@rediffmail.com)=Google.com
Gulliver=Northernlight.com
Gulliver/1.2=Northernlight.com
Gulliver/1.3=Northernlight.com
Gulper Web Bot=Gulper Bot
Gulper Web Bot 0.2.4=Gulper Bot
GurujiBot=Guruji.com
HappyFunBot=HappyFunSearch.com
Harvest-NG=Yahoo.com
Haste/0.12=Haste Site Monitoring
Hatena=a.hatena.ne.jp
Hatena Antenna/0.4=a.hatena.ne.jp
Hatena Antenna/0.4 (http://a.hatena.ne.jp/help#robot)=a.hatena.ne.jp
Hatena RSS=R.Hatena.ne.jp
hbtronix.spider=Hbtronix.deHeinrichderMirago=Mirago.de
HeinrichderMiragoRobot=Mirago.de
Helix=SiteSearch.ca
Helix/1.x=SiteSearch.ca
HenriLeRobotMirago=Mirago.fr
HenrytheMirago=Mirago.co.uk
HenrytheMiragoRobot=Mirago.co.uk
Hippias=Hippias.Evansville.edu
Hippias/0.9 Beta=Hippias Bot
Hitwise Spider=Hitwise.com
holmes=Morfeo.cz
holmes/3.9=Szukaj.onet.pl
holmes/x.x=Morfeo.centrum.cz
HomePageSearch(hpsearch.uni-trier.de)=Hpsearch.uni-trier.de
Homerbot=Homerweb.com
Homerbot: www.homerweb.com=Homerweb.com
Honda-Search=Honda-Search.com
htdig/3.1=Htdig.org
htdig/3.1.6 (http://computerorgs.com)=Computerorgs.com
htdig/3.1.x=Htdig.org
htdig/3.1.x (root@localhost)=Htdig.org
Html Link Validator=Html Link Checker
http://Ask.24x.Info/ (http://narres.it/)=Narres.it
http://www.abcdatos.com/botlink/=Abcdatos.com
http://www.almaden.ibm.com=Almaden.IBM.com
http://www.istarthere.com=Istarthere.com
http://www.monogol.de=Monogol.de
http://www.trendtech.dk/spider.asp=Trendtech.dk
Hubater=Hubat.com
i1searchbot=i1search.com
IAArchiver-1.0=Archive.org
ia_archiver=Archive.org
ia_archiver/1.6=Archive.org
iCCrawler=ICCenter.net
ichiro=Goo.ne.jp
IconSurf=IconSurf.com
IconSurf/2.0=FavIcon Finder
ICRA_label_spider=ICRA.com
icsbot-0.1=Icseoul.org
Ideare - SignSite=Ideare.com
ideare - SignSite/1.x=Ideare.com
IEFav172Free=Favorites Link Checker
IIITBOT=Webkhoj.iiit.net
Ilial=Ilial.com
IlseBot=Ilse.nl
IlTrovatore=Iltrovatore.it
IlTrovatore-Setaccio=Iltrovatore.it
IlTrovatore-Setaccio (+http://www.iltrovatore.it)=Iltrovatore.it
Iltrovatore-Setaccio/0.3-dev=Iltrovatore.it
IlTrovatore-Setaccio/1.2=Iltrovatore.it
iltrovatore-setaccio/1.2-dev=Iltrovatore.it
ImageWalker=BDBrandProtect.com
IncyWincy=Incywincy.com
IndexTheWeb.com=IndexTheWeb.com
IndexTheWeb.com Crawler7=IndexTheWeb.com
Industry Program 1.0.x=Industry Spam Bot
Inet library=Inetlibrary.com
info@searchhippo.com=Searchhippo.com
InfoFly/1.0=Versions-project.org
InfoFly/1.0 (http://www.versions-project.org/)=Versions-project.org
InfoLink/1.x=InfoLink Link Checker
INFOMINE=Infomine.ucr.edu
InfoSeek=InfoSeek.com
InfoSeek Sidewinder=infoseek.com
InfoSeek Sidewinder/0.9=Infoseek.com
InfoSeek Sidewinder/1.0A=Infoseek.com
InfoSeek Sidewinder/1.1A=Infoseek.com
Infoseek SideWinder/1.45=Infoseek.com
Infoseek SideWinder/1.45 (Compatible; MSIE 10.0; UNIX)=Infoseek.com
Infoseek SideWinder/2.0B=Infoseek.com
Infoseek SideWinder/2.0B (Linux 2.4 i686)=Infoseek.com
INGRID/3.0 MT=ilse.nl
Inktomi=Yahoo.com
Inktomi Search=Yahoo.com
InnerpriseBot=Innerprise.net
InnerpriseBot/1.0=Innerprise.net
InnerpriseBot/1.0 (http://www.innerprise.com/)=Innerprise.net
Insitor=Insitor.com
Insitornaut=Insitor.com
InsumaScout=InsumaScout
Intelix=Microton.cz
Internet Ninja 6.0=Dti.ne.jp
Internet Ninja x.0=DTI.ne.jp
InternetArchive=Archive.org
InternetLinkAgent=Internet Link Link Checker
InternetLinkAgent/3.1=Internet Link Checker
InternetPeriscope=InternetPeriscope Link Checker
InternetSeer=InternetSeer
InternetSeer.com=InternetSeer.com
ip3000.com=ip3000.com
ip3000.com-crawler=ip3000.com
ipiumBot=Laurion.com
IPiumBot laurion(dot)com=Laurion.com
IpselonBot=Ipselon.com
IRLbot=irl.cs.tamu.edu
Iron33=Verno.ueda.info.waseda.ac.jp
IUPUI Research Bot v 1.9a=Spam Bot
Jabot=Ingrid.org
Jabot/6.x=Ingrid.org
Jabot/6.x (http://odin.ingrid.org/)=Ingrid.org
Jabot/7.x.x=Ingrid.org
Jabot/7.x.x (http://odin.ingrid.org/)=Ingrid.org
Jack=Domanova.co.uk
Jambot=JamBot.com
jan.gelin@av.com=Altavista.co.uk
Java/1.6.0-beta=Cogentco.com
Java/1.6.0-beta2=Cogentco.com
Java1.2.2=Cogentco.com
javElink=javElink Link Checker
Jayde Crawler=Jayde.com
JCheckLinks/0.1 RPT-HTTPClient/0.3-1=JCheckLinks Link Checker
jdwhatsnew.cgi=jdwhatsnew Link Checker
jeeves=Ask Jeeves
Jetbot=JetEye.com
Jetbot/1.0=Jeteye.com
JoocerBot=Joocer.com
JRTS Check Favorites Utility=Bookmark Checker
JRTwine Software Check Favorites Utility=Bookmark Checker
jyxobot=Jyxo.cz
Jyxobot/x=Jyxo.cz
Katriona=Katriona
Kenjin Spider=Kenjin.ne.jp
KE_1.0/2.0=Voila.fr
KE_1.0/2.0 libwww/5.2.8=Voila.fr
KFSW-Bot=KFSW.de
Kinja=Kinja.com
KIT-Fireball=Fireball.de
KIT-Fireball/2.0=Fireball.de
KIT-Fireball/2.0 (compatible; Mozilla 4.0; MSIE 5.5)=Fireball.de
KIT_Fireball=Fireball.de
KIT_Fireball/2.0=Fireball.de
Knowledge.com=Knowledge.com
Knowledge.com/0.x=Knowledge.com
Kototoi=s.u-tokyo.ac.jp
Kototoi/0.1=s.u-tokyo.ac.jp
Kuloko=Kuloko.com
kuloko-bot=kuloko.com
kuloko-bot/0.2=Kuloko.com
kuloko-bot/0.x=Kuloko.com
Kulokobot=Kuloko.com
kulturarw3=KB.se
kulturarw3/0.1=National Library of Sweden
Lambda LinkCheck=Lambda Link Checker
LapozzBot=Lapozz.com
LapozzBot/1.4=Lapozz.com
larbin (samualt9@bigfoot.com)=MetaCarta.com
LARBIN-EXPERIMENTAL=Email Collector
larbin_2.1.1 larbin2.1.1@somewhere.com=MERL.com
larbin_2.2.0 (crawl@compete.com)=Compete.com
larbin_2.2.1_de_Viennot (Laurent.Viennot@inria.fr)=INRIA.fr
larbin_2.2.2 (sugayama@lab7.kuis.kyoto-u.ac.jp)=Kyoto-u.ac.jp
larbin_2.2.2_guillaume (guillaume@liafa.jussieu.fr)=INRIA.fr
larbin_2.6.2 (hamasaki@grad.nii.ac.jp)=Nii.ac.jp
larbin_2.6.2 (listonATccDOTgatechDOTedu)=GaTech.edu
larbin_2.6.2 (pimenas@systems.tuc.gr)=Systems.tuc.gr
larbin_2.6.2 (tom@lemurconsulting.com)=LemurConsulting.com
larbin_2.6.3 (wgao@genieknows.com)=GenieKnows.com
larbin_2.6_basileocaml (basile.starynkevitch@cea.fr)=CEA.fr
larbin_devel (http://pauillac.inria.fr/~ailleret/prog/larbin/)=Pauillac.INRIA.fr
LEIA=Gseek.com
LEIA/=GSeek.com
LEIA/3.01pr (LEIAcrawler; [SNIP])=Gseek.com
LexiBot=Lexibot.com
Libby_1.1/libwww-perl/5.47=About.com
libWeb/clsHTTP -- hiongun@kt.co.kr=KT.co.kr
libwww-perl=client sites
Lincoln State Web Browser=Spam Bot
Link Valet Online=Link Valet Online Link Checker
LinkAlarm=LinkAlarm Link Checker
Linkbot=Linkbot Link Checker
LinkLint-checkonly=LinkLint Link Checker
Linkman=Linkman Link Checker
linknzbot=Linknz.co.nz
LinkProver=LinkProver Link Checker
Links=Link Checker
LinkScan Server=LinkScan Link Checker
LinkSonar/1.35=Link Sonar
LinkSweeper=LinkSweeper Link Checker
LinkVerify Spider=LinkVerify Link Checker
LinkWalker=LinkWalker Link Checker
LiveTrans=wkd.iis.sinica.edu.tw
Llaut=MNM.uib.es
LNSpiderguy=Lexis-nexis.com
LocalBot/1.0 ( http://www.localbot.co.uk/)=LocalBot.co.uk
LocalcomBot=Local.com
Lockstep Spider=LockStep.com
Look.com=Look.com
lookbot=look.com
lwp-trivial/1.27=Search4free.com
lwp-trivial/1.34=Search4free.com
lycos=Lycos.com
Lycos_Spider=Lycos.com
Lycos_Spider_(T-Rex)=Lycos.com
Lycos_Spider_(T-Rex)/3.0=Lycos.com
Mac Finder 1.0.xx=MacFinder Spam Bot
Mackster=Ukwizz.com
Mackster( http://www.ukwizz.com )=Ukwizz.com
Mag-Net=Wind.it
mailto:webcraft@bea.com=Beasys.com
mammoth/1.0=Sli-Systems.com
mammoth/1.0 ( http://www.sli-systems.com/)=SLI-Systems.com
mammoth/1.0 (+http://www.sli-systems.com/)=Sli-Systems.com
MantraAgent=Looksmart.com
MapoftheInternet.com=MapOfTheInternet.com
mapper@teradex.com=Mapper.teradex.com
Mariner/5.1b=Kolibri.de
Mariner/5.1b [de] (Win95; I;Kolibri gncwebbot)=Kolibri.de
Martini=Looksmart.com
Marvin v0.3=Marvin Bot
marvin-team@webseek.de=Webseek.de
marvin/infoseek=Webseek.de
MaSagool=Sagool.jp
MasterSeek=MasterSeek.com
Mata Hari/2.00=Lexibot.com
Matrix S.p.A. - FAST Enterprise Crawler 6=Alice.it
Maxomobot=Maxomo.com
MediaCrawler=MediaCrawler.de
MediaCrawler-1.0=Mediacrawler.de
MediaCrawler-1.0 (Experimental)=Mediacrawler.de
Mediapartners=Google Adsense
Mediapartners-Google/2.1=Google.com Adsense
Mediapartners-Google/2.1 (+http://www.googlebot.com/bot.html)=Google.com Adsense
MediaSearch/0.1=Www.fi
MegaSheep v1.0=SearchUK.com
MegaSheep v1.0 (www.searchuk.com internet sheep)=SearchUK.com
Megite=Megite.com
Mercator=Altavista.com
Mercator-1.x=Altavista.com
Mercator-2.0=Altavista.com
Mercator-Scrub-1.1=Altavista.com
metabot=Metabot
Metaeuro=MetaEuro.com
MetaGer-LinkChecker=Metager.de Link Checker
MetagerBot=Metager.de
Metaspinner=Meta-Spinner.de
Metaspinner/0.01=Meta-Spinner.de
Metatagsdir=MetaTagsDir.com
MFC_Tear_Sample=Microsoft.com
MFHttpScan=Email Extractor
MicroBaz=BrainBot.com
MicrosoftPrototypeCrawler=Microsoft.com
Minibot=Minibot
MiracleAlphaTest=Nec.co.jp
Missauga Locate 1.0.0=Missauga Spam Bot
Missigua Locator 1.9=Missigua Spam Bot
Missouri College Browse=Missouri Spam Bot
Misterbot=MisterBot.fr
Misterbot-Nutch/0.7.1=Misterbot.fr
Miva=Miva.com
Miva (AlgoFeedback@miva.com)=Miva.com
MJ12bot=Majestic12.co.uk
MnogoSearch=mnoGoSearch.org
MnogoSearch/3.2.xx=mNoGoSearch.org
moget=goo.ne.jp
moget/2.0=Goo.ne.jp
moget/2.1=Goo.ne.jp
moget/2.1 (moget@goo.ne.jp)=Goo.ne.jp
moget/x.x (moget@goo.ne.jp)=Goo.ne.jp
moget@goo.ne.jp=Goo.ne.jp
mogimogi=Goo.ne.jp
MojeekBot=MoJeek.com
Mole2=intags.de
Mole2/1.0=Intags.de
Morning Paper=Morning Paper Link Checker
Morris=Mixcat.com
Morris - Mixcat Crawler=Mixcat.com
Morris - Mixcat Crawler (+http://mixcat.com)=Mixcat.com
Morris – Mixcat=MixCat.com
Mouse-House/7.4=Spidermonkey.ca
MoveAnnouncer=MoveAnnouncer Link Checker
mozDex=mozdex.com
mozDex/=Mozdex.com
mozDex/0.04-dev=Mozdex.com
Mozilla (Mozilla@somewhere.com)=Somewhere.com
Mozilla/2.0 (compatible; Ask Jeeves)=Ask Jeeves
Mozilla/2.0 (compatible; EZResult -- Internet Search Engine)=DirectHit.com
Mozilla/3.0 (compatible; MuscatFerret/1.5.4; claude@euroferret.com)=Euroferret.com
Mozilla/3.0 (compatible; MuscatFerret/1.5; olly@muscat.co.uk)=Euroferret.com
Mozilla/3.0 (compatible; MuscatFerret/1.6.x; claude@euroferret.com)=Euroferret.com
Mozilla/3.01 (Compatible; Links2Go Similarity Engine)=Links2go.com
Mozilla/4.0 (compatible; FastCrawler3, support-fastcrawler3@fast.no)=AllTheWeb.com
Mozilla/4.0 (compatible; grub-client-2.x)=Grub.org
Mozilla/4.0 (compatible; MSIE 5.0; Windows 95) TrueRobot; 1.5=Echo.com
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot)=MSN.com
Mozilla/4.0 (compatible; SpeedySpider; www.entireweb.com)=EntireWeb.com
Mozilla/4.0 (compatible; www.galaxy.com)=Galaxy.com
Mozilla/4.0 [en] (Ask Jeeves Corporate Spider)=Ask Jeeves
Mozilla/4.0(compatible; Zealbot 1.0)=LookSmart.com
mozilla/5.0 (compatible; genevabot +http://www.healthdash.com)=HealthDash.com
Mozilla/5.0 (wgao@genieknows.com)=GenieKnows.com
Mozilla/5.0 wgao@genieknows.com=GenieKnows.com
MP3Bot=mp3bot.de
MQbot=MetaQuerier.cs.uiuc.edu
MSN=MSN.com
msnbot=MSN.com
MSNBOT/0.1=MSN.com
MSNPTC=MSN.com
MSRBOT (http://research.microsoft.com/research/sv/msrbot)=Microsoft MSRBot
MultiText=MultiText
MultiText/0.1=MultiText
MuscatFerret=Webtop.com
MusicWalker=SoMuscial.com
Mylinea.com=Mylinea.com
Naamah=BlogBot.de
NABOT=Naver.co.jp
NationalDirectory=NationalDirectory.com
NationalDirectory-SuperSpider=Nationaldirectory.com
NationalDirectory-WebSpider/1.3=NationalDirectory.com
NationalDirectoryAddURL/1.0=NationalDirectory.com
NaverBot=Naver.co.jp
NavissoBot=Navisso.com
Nazilla=Websmostlinked.com
NCSA=Vias.ncsa.uiuc.edu
Nebullabot=Nebulla.info
NEC Research Agent=NEC Research Agent
NetCruiser=NetCruiser
NetLookout=NetLookout Link Checker
Netluchs=Netluchs.de
NetMechanic=NetMechanic Link Checker
NetMechanic Vx.0=NetMechanic Link Checker
NetMind-Minder=NetMind Link Checker
NetMonitor=NetMonitor Link Checker
netoskop=netoskop.pl
Netprospector JavaCrawler=Netprospector Link Checker
NetResearchServer=Look.com
NetResearchServer(http://www.look.com)=Look.com
NetResearchServer/x.x(loopimprovements.com/robot.html)=LoopImprovements.com
NetSprint=netsprint.pl
NetWhatCrawler=NetWhat.com
NetZippy=Netzippy.com
NextopiaBOT=Nextopia.com
NG-Search=NG-Search.comNG/1.0NG/1.0=Exabot.com
NG/4.0.1229=Exalead.com
Noago=Noago.com
Noago Spider=Noago.com
Nokia-WAPToolkit/1.2 googlebot(at)googlebot.com=Google WAP
NokodoBot=Nokodo.com
Norbert the Spider(Burf.com)=Burf.com
Noxtrumbot=noXtrum.com
NP=NameProtect.com
NP/0.1=NameProtect.com
NP/0.1 (NP; http://www.nameprotect.com; npbot@nameprotect.com)=NameProtect.com
NPBot=NameProtect.com
NPBot-1/2.0=NameProtect.com
nttdirectory_robot=Navi.ocn.ne.jp
nuSearch=NuSearch.com
Nutch=Nutch.org
NutchCVS/0.0x-dev=Nutch.org
NutchOrg=Nutch.org
NutchOrg/0.0x-dev=Nutch.org
NZBot=NavigationZone.com
obidos-bot=OnFocus.com Bookwatch
ObjectsSearch=objectssearch.com
ObjectsSearch/0.01=ObjectsSearch.com
ObjectsSearch/0.0x=ObjectsSearch.com
oBot=Cobion.com
oBot ((compatible;Win32))=Cobion.com
Ocelli=GlobalSpec.com
Octora=Octora.com
OliverPerry=Claymont.com
omgilibot=Omgili.comOmniExplorer_Bot=Omni-Explorer.com
OmniExplorer_Bot/1.09=Omni-Explorer.com
OmniExplorer_Bot/2.0=Omni-Explorer.com
Onet.pl=Szukaj.onet.pl
Onet.pl SA, http://szukaj.onet.pl=Szukaj.onet.pl
OnetSzukaj=Onet.pl
online link validator=Link Checker
online link validator (http://www.dead-links.com/)=Dead-Links.com Link Validation
OntoSpider=Ontospider.i-n.info
OntoSpider/1.0=Ontospider.i-n.info
OntoSpider/1.0 libwww-perl/5.65=Ontospider.i-n.info
Openbot=Chinese Robot
Openbot/=Openfind.com.tw
Openbot/3.0=Openfind.com.tw
Openbot/3.0+=Openfind.com.tw
Opencola=Opencola.com
Openfind=OpenFind.com.tw
Openfind piranha=Openfind.com
Openfind Robot/1.1A2=Openfind.com.tw
OpenISearch=OpenISearch.com
OpenTaggerBot=OpenTagger.com
OpenTextSiteCrawler=OpenText.net
OpenTextSiteCrawler/2.9.2=Opentext.net
OpenWebSpider=OpenWebSpider.org
Oracle Ultra Search=Oracle.com
Overture-WebCrawler/=AllTheWeb.com
Oxxbot1=Oxxfordinfo.com
PageBites=PageBites.com
Pagebull=PageBull.com
Pansophica=Pansophica
parallelContextFocusCrawler=Garr.it
ParaSite=Ianett.com
ParaSite/1.0b=Ianett.com
ParaSite/1.0b (http://www.ianett.com/parasite/)=Ianett.com
Patwebbot=Herz-Power.de
pd02_1.0.0 pd02_1.0.0@dzimi@post.sk=Post.sk
peerbot=Peerbot.com
Phoaks=Phoaks
phortse@hanmail.net=Daum.net
PICgrabber=PICgrabber
PicoSearch=picosearch.com
PicoSearch/=PicoSearch.com
PicoSearch/1.0=PicoSearch.com
PictureOfInternet=PictureOfInternet
Piffany=Piffany.com
PingALink=Pingalink Site Monitoring
PingALink Monitoring Services 1.0=Pingalink Site Monitoring
PintaSpider=PintaSpider
pipeLiner=Pipeline-Search.com
pipeLiner/0.10=Pipeline-Search.com
Pita=Pita Bot
Pizilla++ ver 2.45=He.net
PJspider=Portaljuice.com
PJspider/3.0=Portaljuice.com
PJspider/3.0 (pjspider@portaljuice.com; http://www.portaljuice.com)=Portaljuice.com
PluckFeedCrawler=Pluck.com
PolyBot=PolyBot
polybot 1.0=PolyBot
polybot 1.0 (http://cis.poly.edu/polybot/)=PolyBot
Pompos=Illiad.fr
Pompos/1.x=Free.fr
Pompos/1.x http://dir.com/pompos.html=Dir.com
Pompos/1.x pompos@iliad.fr=Iliad.fr
Popdex=Popdex.com
Popdexter/1.0=Popdex.com
PortalBSpider/2.0=Portalb.com
PortalBSpider/2.0 (spider@portalb.com)=Portalb.com
Program Shareware 1.0.2=Spam Bot
Project XP5=XP5 Bot
Project XP5 [2.03.07-111203]=XP5 Bot
PROve AnswerBot=AnswerChase.com
PROve AnswerBot 4.0=Answerchase.com
ProWebGuide Link Checker=Prowebguide Link Checker
psbot=Picsearch.com
psbot/0.1=Picsearch.com
psbot/0.1 (+http://www.picsearch.com/bot.html)=Picsearch.com
Qango.com=Qango.com
Qango.com Web Directory=Qango.com
Qango.com Web Directory (http://www.qango.com/)=Qango.com
QPCreep Test Rig=Quepasa.com
QPCreep Test Rig ( We are not indexing, just testing )=Quepasa.com
Quepasa=QuePasa.com
QuepasaCreep=Quepasa.com
QuepasaCreep ( crawler@quepasacorp.com )=Quepasa.com
QuepasaCreep v0.9.1x=Quepasa.com
QueryN Metasearch=Queryn.com
Rabaz=Brainbot.com
rabaz (rabaz at gigabaz dot com)=Brainbot.com
RaBot=Daum.net
ramBot xtreme x.x=Intersearch.de
RAMPyBot=GiverAmp.com
Rational SiteCheck=Rational Link Checker
ReadABlog=ReadABlog.com
Reaper=Sitesearch.ca
Reaper [2.03.10-031204]=Sitesearch.ca
Reaper [2.03.10-031204] (http://www.sitesearch.ca/reaper/)=Sitesearch.ca
Reaper/2.0x=Sitesearch.ca
Reaper/2.0x (+http://www.sitesearch.ca/reaper)=Sitesearch.ca
RixBot=BabelServer.org
roach.smo.av.com-1.0=Altavista.com
RoboCrawl=CanadianContent.net
RoboCrawl (www.canadiancontent.net)=CanadianContent.net
RoboPal=FindPal.com
robot-master@expressus.com=Expressus.com
robot-response@openfind.com.tw=Openfind.com.tw
Robot/www.pj-search.com=PJ-Search.com
Robot@SuperSnooper.Com=SuperSnooper.com
robot@xyleme.com=Xyleme.com
Robozilla=Robozilla Link Checker
Robozilla/1.0=Dmoz.org
Rotondo/3.1 libwww/5.3.1=Qualigo.de
RPT-HTTPClient=Link Checker
RRC (crawler_admin@bigfoot.com)=MetaCarta.com
RSSMicro=RSSMicro.com
ru-robot=Rutgers.edu
RufusBot=Webaroo.com
SandCrawler=Microsoft.com
Savvybot=WebSavvy.cc
SBIder=SiteSell.com
Scan4Mail=Scan4Mail Email Extractor
ScanWeb=eServer.Host.sk
ScholarUniverse=ScholarUniverse.com
schwarzmann.biz=Schwarzmann.biz
ScollSpider=WebWobot.com
Scooter=Altavista.com
Scooter-3.0.EU=Altavista.com
Scooter-3.0.FS=Altavista.com
Scooter-3.0.HD=Altavista.com
Scooter-3.0.VNS=Altavista.com
Scooter-3.0QI=Altavista.com
Scooter-3.2=Altavista.com
Scooter-3.2.BT=Altavista.com
Scooter-3.2.DIL=Altavista.com
Scooter-3.2.EX=Altavista.com
Scooter-3.2.JT=Altavista.com
Scooter-3.2.NIV=Altavista.com
Scooter-3.2.SF0=Altavista.com
Scooter-3.2.snippet=Altavista.com
Scooter-3.3dev=Altavista.com
Scooter-ARS-1.1=Altavista.com
Scooter-ARS-1.1-ih=Altavista.com
scooter-venus-3.0.vns=Altavista.com
Scooter-W3-1.0=Altavista.com
Scooter-W3.1.2=Altavista.com
Scooter/1.0=Altavista.com
Scooter/1.0 scooter@pa.dec.com=Altavista.com
Scooter/1.1 (custom)=Altavista.com
Scooter/2.0 G.R.A.B. V1.1.0=Altavista.com
Scooter/2.0 G.R.A.B. X2.0=Altavista.com
Scooter/3.3=Altavista.com
Scooter/3.3.QA.pczukor=Altavista.com
Scooter/3.3.vscooter=Altavista.com
Scooter/3.3_SF=Altavista.com
Scooter2_Mercator_3-1.0=Altavista.com
Scooter2_Mercator_x-x.0=Altavista.com
Scooter_bh0-3.0.3=Altavista.com
Scooter_trk3-3.0.3=Altavista.com
ScoutAbout=ResearchRepublic.com
Scoutmaster=ScoutMaster.de
Scrubby=scrubtheweb.com
Scrubby/=Scrubtheweb.com
search.at=Search.at
search.at V1.2=Search.at
search.ch=Search.ch
search.ch V1.4=Search.ch
search.ch V1.4.2=Search.ch
SearchdayBot=SearchDay.de
SearchExpress=SearchExpress.com
SearchExpress Spider0.99=SearchExpress.com
SearchGuild=SearchGuild.com
Searchit-Now Robot/2.2=Searchit-now.co.uk
Searchit-Now Robot/2.2 (+http://www.searchit-now.co.uk)=Searchit-now.co.uk
SearchSight=SearchSight.com
Searchspider=searchspider.com
SearchSpider.com/1.1=Searchspider.com
Searchspider/=Searchspider.com
Searchspider/1.2=Searchspider.com
SearchTone=Ideare.com
sebastien.ailleret@inria.fr=Inria.fr
Seekbot=Seekbot.net
Seekbot/1.0=SeekBot.net
Seeker.lookseek.com=Lookseek.com
semanticdiscovery/0.x=Domain Checker
Sensis=Sensis.com.au
Seznam=Seznam.cz
SeznamBot=Seznam.cz
SeznamBot/1.0=Seznam.cz
SeznamBot/1.0 (+http://fulltext.seznam.cz/)=Seznam.cz
Shark=Openfind.com
sherlock_spider=Sherlock.com.cn
ShopWiki=ShopWiki.com
ShopWiki/1.0=LittleWiki.com
Shoula.com=Shoula.com
SightQuestBot=sightquest.com
SightQuestBot/=Sightquest.com
silk/1.0=Slider.com
sitecheck.internetseer.com=Internetseer.com Site Monitoring
SiteSpider=Sitespider.com
SiteSpider +(http://www.SiteSpider.com/)=Sitespider.com
SiteTruth.com=SiteTruth.com
SiteXpert=Xtreeme.com
Skampy=Skaffe.com
Skampy/0.9.x=Skaffe.com
Skimpy=Skaffe.com
Skimpy/0.x=Skaffe.com
Slarp/0.1=Only.com
Slider_Search_v1-de=Slider.com
Slurp=Yahoo.com
Slurp.so=inktomi
Slurp.so/1.0=Yahoo.com
Slurp/2.0-KiteHourly=Yahoo.com
Slurp/2.0-OwlWeekly=Yahoo.com
Slurp/2.0j=Yahoo.com
Slurp/3.0-AU=Yahoo.com
slurp@inktomi=Yahoo.com
slurp@inktomi.com=Yahoo.com
SlySearch=Turnitin.com
SlySearch/1.0=Turnitin.com
SlySearch/1.x=Turnitin.com
Snapbot/1.0=Cogentco.com
SnykeBot=Snyke.com
Speedfind=SpeedFind.de
speedfind ramBot xtreme=Speedfind.de
speedfind ramBot xtreme 8.1=Speedfind.de
Speedy Spider=EntireWeb.com
Speedy Spider (Beta/x.x; speedy@entireweb.com)=EntireWeb.com
Speedy_Spider=EntireWeb.com
Speedy_Spider (http://www.entireweb.com)=EntireWeb.com
Spida/0.1=Only.com
Spider TraficDublu=Traficdublu.ro
Spider-Sleek=Search-Info.com
spider.yellopet.com=Yellopet.com
Spider/maxbot.com=Maxbot.com
Spider/maxbot.com admin@maxbot.com=Maxbot.com
spider@aeneid.com=Yahoo.com
SpiderMan=Yahoo.com
SpiderMonkey=SpiderMonkey.ca
SpiderMonkey/7.x=Spidermonkey.ca
spider_monkey=Spidermonkey.ca
Spider_Monkey/=Spidermonkey.ca
sportsuchmaschine.de=Sportsuchmaschine.de
sproose=Sproose.com
sproose/0.1 (sproose bot; http://www.sproose.com/bot.html; crawler@sproose.com)=Cogentco.com
Sqworm=Aol.com
Sqworm/2.9.81-BETA (beta_release; 20011102-760; i686-pc-linux-gnu)=Aol.com
SrevBot=WinSrev.com
StackRambler=Rambler.ru
Steeler=Steeler Bot
Steeler/1.x=Steeler Bot
Steeler/1.x (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/)=Steeler Bot
Strategic Board Bot=StrategicBoard.com
suchbaer.de=Suchbaer.de
Suchbot=Suchbot.de
Suchknecht.at=Suchknecht.at
Suchknecht.at-Robot=Suchknecht.at
suchpad/1.0=SuchPad.de
Suchpadbot=Suchpad.de
super-robot@super.navi.ocn.ne.jp=Navi.ocn.ne.jp
support@canseek.ca=Canseek.ca
SurfMaster=SurfMaster Link Checker
Surfnomore Spider v1.1=Surfnomore.com
SwissSearch V1.2=SwissSearch
Swooglebot=Swoogle.umbc.edu
Swooglebot/2.0=Swoogle.Umbc.edu
SygolBot=Sygol.com
SyncIT=SyncIT Link Checker
SynoBot=Synomia.fr
Synoo=Synoo.com
Syntryx=Syntryx.com
Szukacz=Szukacz.pl
tags2dir=Tags2Dir.com
Talkro Web-Shot=Daumsoft.com
targetblaster.com/0.9k=Targetblaster.com Link Checker
TaWWWantula=TaWWWantula
TCDBOT=TCD.ie
TECOMAC-Crawler=Arexera.de
Tecomi Bot=Tecomi.com
Teoma=Ask.com
teoma_admin@hawkholdings.com=Teoma.com
teoma_agent1=Teoma.com
TeraCrawl=TeraCrawl
Teradex_Mapper=Mapper.teradex.com
TerrawizBot=Guruji.com
The Informant=The Informant
The Intraformant=The Intraformant Link Checker
TheSuBot=TheSuBot.de
TheSuBot/0.1=TheSuBot.de
TheSuBot/0.1 (www.thesubot.de)=TheSuBot.de
thumbshots-de=Thumbshots.de
thumbshots-de-Bot=ThumbShots.de
thumbshots-de-Bot (Version: 1.02, powered by www.thumbshots.de)=ThumbShots.de
TJG/Spider=TJGroup.com
Tkensaku=Tkensaku.com
Topodia=Topodia.com
Toutatis=Hoppa.com
Toutatis 2.5-2=Hoppa.com
Toutatis 3.3 (hoppa.com)=Hoppa.com
Toutatis 4-19.6 (hoppa.com)=Hoppa.com
Traazibot=Traazi.com
Trampelpfad=Trampelpfad.de
Tumblr=Tumblr.com
Turnitin=TurnItIn.com
TurnitinBot=Turnitin.com
TurnitinBot/x.x=Turnitin.com
TurnitinBot/x.x (http://www.turnitin.com/robot/crawlerinfo.html)=Turnitin.com
TutorGig=TutorGig.com
Tutorial Crawler=Tutorgig.com
Tv<nn>_Merc_resh_26_1_D-1.0=Altavista.com
twiceler=Cuill.comTygo=Tygo.com
TygoBot=Tygo.com
UCmore=Ucmore.com
UdmSearch=Mnogosearch.org
UK Searcher Spider=Uksearcher.co.uk
UKWizz=UKWizz.com
Ultraseek=Infoseek.com
unlostBot=Unlost.com
Updated=Updated.com
updated/0.1-alpha (updated crawler; http://www.updated.com; crawler@updated.com)=Cogentco.com
updated/0.1beta=Updated.com
updated/0.1beta (updated.com; http://www.updated.com; crawler@updated.com)=Cogentco.com
UptimeBot=UptimeBot.com
URLBlaze=Urlblaze.net
UrlScope=UrlScope
URL_Spider_Pro=Innerprise.net
USyd-NLP-Spider=It.USYD.edu.ua
Vagabondo=Wise-guys.nl
Vagabondo/1.x MT (webagent@wise-guys.nl)=Wise-guys.nl
Vagabondo/2.0 MT=Wise-guys.nl
Vagabondo/2.0 MT (webagent at wise-guys dot nl)=Wise-guys.nl
Vagabondo/2.0 MT (webagent@NOSPAMwise-guys.nl)=Wise-guys.nl
Vakes=Vakes.com
various=Multiple Robots
VeryGoodSearch=VeryGoodSearch.com
VeryGoodSearch.com.DaddyLongLegs=VeryGoodSearch.com Link Checker
verzamelgids.nl=Verzamelgids.nl
Vespa Crawler=Yahoo.com
Visbot=Visvo.com
Vivante Link Checker=vivante.com
VMBot=VerticalMatch.com
Voyager=CosmixCorp.com
voyager/1.0=Cogentco.com
VSE/1.0=Vivismo.com
vspider=Verity.com
W3CRobot/5.4.0 libwww/5.4.0=W3C Link Checker
W3SiteSearch=W3SiteSearch.de
wadaino.jp=Wadaino.jp
Watchfire WebXM=Watchfire WebXM Link Checker
WatzNew Agent=WatzNew Link Checker
Wavefire=Wavefire.com
Waypath=WayPath.com
WebAlta=WebAlta.ru
WebarooBot=Webaroo.com
Webbandit=WebBandit
webbandit/4.xx.0=WebBandit
Webclipping.com=WebClipping.com
webcollage=WebCollage.com
webcollage/1.xx=WebCollage.com
WebCompass=WebCompass
WebCorp=WebCorp.UCE.ac.uk
webcrawl.net=WebCrawl.net
WebCrawler-AddURL/2.0=WebCrawler
WebCrawler/3.0 Robot libwww/5.0a=WebCrawler
WebFindBot=Web-find.com
WebFindBot(http://www.web-find.com)=Web-find.com
WebGather=WebGather
WebGenie=WebGenie
Weblink Scanner=Weblink Link Checker
Weblog Attitude Diffusion=LANL.gov
webmaster@intags.de=Intags.de
webmeasurement-bot, http://rvs.informatik.uni-leipzig.de=RVS.Informatik.uni-leipzig.de
WebRankSpider=WebRankSpider
WebSearch.COM.AU=WebSearch.com.au
WebSite-Watcher=WebSite-Watcher Link Checker
WebsiteWorth=WebsiteWorth
Webspinne=Webspinne.de
Websquash.com=WebSquash.com
WebTrends Link Analyzer=WebTrends Link Checker
Webverzeichnis.de=Webverzeichnis.de
Wget=Unknown
whatuseek=Whatuseek.com
whatUseek_winona/3.0=Whatuseek.com
WhizBang! Lab=Whizbanglabs.com
Willow Internet Crawler by Twotrees=TwoTrees.com
WinkBot=Wink.com
WIRE WebRefiner=Wire.co.uk
WIRE WebRefiner:=wire.co.uk
wisenutbot=Looksmart.com
WiseWire-Spider2=Wisewire.com Domain Checker
Worio=Worio.com
Woriobot=Worio.com
WorldLight=EntireWeb.com
Wotbox=WotBox.com
WSCbot=WorldSearchCenter.com
wume_crawler=Wume.cse.lehigh.edu
wume_crawler/1.1=Wume.cse.lehigh.edu
www.arianna.it=Arianna.libero.it
www.elsop.com=elsop.com Link Checker
www.inktomisearch.com=Yahoo.com
www.WebWombat.com.au=Webwombat.com.au
WWWeasel=WWWeasel.de
X-Crawler=Arexera.de
xirq/0.1-beta=XIRQ.com
xyro_(xcrawler@cosmos.inria.fr)=Inria.fr
Y!J=Yahoo.co.jp
Yacy=Yacy.net
Yahoo=Yahoo.com
Yahoo-Blogs/v3.9=Yahoo.com Blogs
Yahoo-MMCrawler/3.x=Yahoo Publisher Network
YahooFeedSeeker=Yahoo.com RSS Bot
YahooSeeker/CafeKelsa=Yahoo.com
YahooYSMcm/1.0.0=Yahoo Publisher Network
YahooYSMcm/2.0.0=Yahoo Publisher Network
Yandex=Yandex.com
Yellopet-Spider=YellowPet.com
YodaoBot=Yodao.com
Yoogli=Yoogli.com
Yoono=Yoono.com
YottaShopping_Bot/4.12=YottaShopping.com
ypn-rss.overture.com=Yahoo Publisher Network
ZACATEK=Zacatek.cz
Zao-Crawler=Zao Bot
Zao/0.1=Zao Bot
Zao/0.1 (http://www.kototoi.org/zao/)=Zao Bot
Zao/0.2=Zao Bot
Zearchit=Zearchit.de
Zerxbot=Zerx.com
zerxbot/Version 0.6 libwww-perl/5.79=Zerx.com
Zeusbot=Ulsysseek.com
Zippy v2.0 - Zippyfinder.com=Zippyfinder.com
Zspider=Feedback.redkolibri.com
ZyBorg=Wisenut.com[/code]

Zakaz rozpowszechniania powyższej listy bez zgody [b]IPSBeyond.pl[/b]

Nastąpiła aktualizacja listy botów

  • Like 1

Udostępnij ten post


Link to postu
Udostępnij na innych stronach

W wersji 3.0.x nie wkleja się już tego, tylko musiałbyś w ACP -> zakładka System -> User Agent Management bawić się w ręczne dodawanie tych botów. Ja osobiście już ich nie stosuje, tylko używam standardowej listy z IP.Board

Udostępnij ten post


Link to postu
Udostępnij na innych stronach

Bądź aktywny! Zaloguj się lub utwórz konto

Tylko zarejestrowani użytkownicy mogą komentować zawartość tej strony


  • Kto przegląda   0 użytkowników

    Brak zalogowanych użytkowników przeglądających tę stronę.

×

Ważne informacje

Kontynuując przeglądanie strony, wyrażasz zgodę na używanie przez nas plików cookies.