#==================== # NO ACCESS BOT LIST #==================== # NO access (e-collector) User-agent: ecollector Disallow: / # NO access (GenDoor) User-agent: GenCrawler Disallow: / # NO access (Internet Cruiser) User-agent: Internet Cruiser Robot Disallow: / # NO access (VietGATE) User-agent: jcrawler Disallow: / # NO access (Zeus) User-agent: Zeus Disallow: / # NO access (TurnitinBOT) User-agent: TurnitinBot Disallow: / # NO access (Thunderstone) User-agent: T-H-U-N-D-E-R-S-T-O-N-E Disallow: / # NO access (Seven Twentyfour) User-agent: LinkWalker Disallow: / # NO access (PolyBOT) User-agent: polybot Disallow: / # NO access (LinkAlarm) User-agent: LinkAlarm Disallow: / # FULL access (Google Image) User-agent: Googlebot-Image Disallow: / #===================== # FULL ACCESS BOT LIST #===================== # FULL access (WhoWhere?) User-agent: whowhere Disallow: /_private/ Disallow: /images/ Disallow: /anonymous/ Disallow: /ftproot/ Disallow: /database/ Disallow: /log/ Disallow: /ems/ Disallow: /about/directory/ Disallow: /forum/ Disallow: /newemail/ # FULL access (WiseNut) User-agent: ZyBorg Disallow: /_private/ Disallow: /images/ Disallow: /anonymous/ Disallow: /ftproot/ Disallow: /database/ Disallow: /log/ Disallow: /ems/ Disallow: /about/directory/ Disallow: /forum/ Disallow: /newemail/ # FULL access (Alta Vista) User-agent: Scooter Disallow: /_private/ Disallow: /images/ Disallow: /anonymous/ Disallow: /ftproot/ Disallow: /database/ Disallow: /log/ Disallow: /ems/ Disallow: /about/directory/ Disallow: /forum/ Disallow: /newemail/ # FULL access (Excite) User-agent: ArchitextSpider Disallow: /_private/ Disallow: /images/ Disallow: /anonymous/ Disallow: /ftproot/ Disallow: /database/ Disallow: /log/ Disallow: /ems/ Disallow: /about/directory/ Disallow: /forum/ Disallow: /newemail/ # FULL access (Google) User-agent: Googlebot Disallow: /_private/ Disallow: /images/ Disallow: /anonymous/ Disallow: /ftproot/ Disallow: /database/ Disallow: /log/ Disallow: /ems/ Disallow: /about/directory/ Disallow: /forum/ Disallow: /newemail/ # FULL access (TopicLink) User-agent: topiclink Disallow: /_private/ Disallow: /images/ Disallow: /anonymous/ Disallow: /ftproot/ Disallow: /database/ Disallow: /log/ Disallow: /ems/ Disallow: /about/directory/ Disallow: /forum/ Disallow: /newemail/ # FULL access (Wayback Machine) User-agent: ia_archiver Disallow: /_private/ Disallow: /images/ Disallow: /anonymous/ Disallow: /ftproot/ Disallow: /database/ Disallow: /log/ Disallow: /ems/ Disallow: /about/directory/ Disallow: /forum/ Disallow: /newemail/ # FULL access (WholeWeb) User-agent: DaviesBot Disallow: /_private/ Disallow: /images/ Disallow: /anonymous/ Disallow: /ftproot/ Disallow: /database/ Disallow: /log/ Disallow: /ems/ Disallow: /about/directory/ Disallow: /forum/ Disallow: /newemail/ # FULL access (whatUseek) User-agent: winona Disallow: /_private/ Disallow: /images/ Disallow: /anonymous/ Disallow: /ftproot/ Disallow: /database/ Disallow: /log/ Disallow: /ems/ Disallow: /about/directory/ Disallow: /forum/ Disallow: /newemail/ # FULL access (RUTGERS) User-agent: ru-robot Disallow: /_private/ Disallow: /images/ Disallow: /anonymous/ Disallow: /ftproot/ Disallow: /database/ Disallow: /log/ Disallow: /ems/ Disallow: /about/directory/ Disallow: /forum/ Disallow: /newemail/ # FULL access (ScoutAbout) User-agent: ScoutAbout Disallow: /_private/ Disallow: /images/ Disallow: /anonymous/ Disallow: /ftproot/ Disallow: /database/ Disallow: /log/ Disallow: /ems/ Disallow: /about/directory/ Disallow: /forum/ Disallow: /newemail/ # FULL access (Speedy) User-agent: Speedy_Spider Disallow: /_private/ Disallow: /images/ Disallow: /anonymous/ Disallow: /ftproot/ Disallow: /database/ Disallow: /log/ Disallow: /ems/ Disallow: /about/directory/ Disallow: /forum/ Disallow: /newemail/ # FULL access (Lycos) User-agent: Lycos_Spider_(T-Rex) Disallow: /_private/ Disallow: /images/ Disallow: /anonymous/ Disallow: /ftproot/ Disallow: /database/ Disallow: /log/ Disallow: /ems/ Disallow: /about/directory/ Disallow: /forum/ Disallow: /newemail/ # FULL access (NetMechanic) User-agent: NetMechanic Disallow: /_private/ Disallow: /images/ Disallow: /anonymous/ Disallow: /ftproot/ Disallow: /database/ Disallow: /log/ Disallow: /ems/ Disallow: /about/directory/ Disallow: /forum/ Disallow: /newemail/ # FULL access (Northern Light) User-agent: Gulliver Disallow: /_private/ Disallow: /images/ Disallow: /anonymous/ Disallow: /ftproot/ Disallow: /database/ Disallow: /log/ Disallow: /ems/ Disallow: /about/directory/ Disallow: /forum/ Disallow: /newemail/ # FULL access (PlanetSearch) User-agent: fido Disallow: /_private/ Disallow: /images/ Disallow: /anonymous/ Disallow: /ftproot/ Disallow: /database/ Disallow: /log/ Disallow: /ems/ Disallow: /about/directory/ Disallow: /forum/ Disallow: /newemail/ # FULL access (Inktomi) User-agent: Slurp Disallow: /_private/ Disallow: /images/ Disallow: /anonymous/ Disallow: /ftproot/ Disallow: /database/ Disallow: /log/ Disallow: /ems/ Disallow: /about/directory/ Disallow: /forum/ Disallow: /newemail/ # FULL access (Innerprise) User-agent: Enterprise_Search Disallow: /_private/ Disallow: /images/ Disallow: /anonymous/ Disallow: /ftproot/ Disallow: /database/ Disallow: /log/ Disallow: /ems/ Disallow: /about/directory/ Disallow: /forum/ Disallow: /newemail/ # FULL access (Legs) User-agent: legs Disallow: /_private/ Disallow: /images/ Disallow: /anonymous/ Disallow: /ftproot/ Disallow: /database/ Disallow: /log/ Disallow: /ems/ Disallow: /about/directory/ Disallow: /forum/ Disallow: /newemail/ # FULL access (Direct Hit Grabber) Disallow: /_private/ Disallow: /images/ Disallow: /anonymous/ Disallow: /ftproot/ Disallow: /database/ Disallow: /log/ Disallow: /ems/ Disallow: /about/directory/ Disallow: /forum/ Disallow: /newemail/ # FULL access (FAST/AllTheWeb) User-agent: FAST-WebCrawler Disallow: /_private/ Disallow: /images/ Disallow: /anonymous/ Disallow: /ftproot/ Disallow: /database/ Disallow: /log/ Disallow: /ems/ Disallow: /about/directory/ Disallow: /forum/ Disallow: /newemail/ # FULL access (Gigabot) User-agent: Gigabot Disallow: /_private/ Disallow: /images/ Disallow: /anonymous/ Disallow: /ftproot/ Disallow: /database/ Disallow: /log/ Disallow: /ems/ Disallow: /about/directory/ Disallow: /forum/ Disallow: /newemail/ # ALL BOTS User-agent: * Disallow: /_private/ Disallow: /images/ Disallow: /anonymous/ Disallow: /ftproot/ Disallow: /database/ Disallow: /log/ Disallow: /ems/ Disallow: /about/directory/ Disallow: /forum/ Disallow: /newemail/