# Disallow Collectors and Spam User-agent: atSpider Disallow: / User-agent: cherrypicker Disallow: / User-agent: DSurf Disallow: / User-agent: EliteSys Entry Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: Mail Sweeper Disallow: / User-agent: munky Disallow: / User-agent: Roverbot Disallow: / User-agent: WebEmailExtrac Disallow: / User-agent: 231 Disallow: / # PARTIAL access (All Spiders) User-agent: * Disallow: /cgi-bin/ Disallow: /cgi-bin/BSCounter/ Disallow: /cgi-bin/bbs/ Disallow: /cgi-bin/chat/ Disallow: /cgi-bin/guestbook/ Disallow: /cgi-bin/printenv Disallow: /cgi-bin/test-cgi Disallow: /webalizer/ Disallow: /images disallow: /html%20Images