# FULL access (Google) User-agent: Googlebot Disallow: /www/admin Disallow: /www/archieve Disallow: /www/backup Disallow: /www/beta Disallow: /www/biodata Disallow: /www/cgi-bin Disallow: /www/css Disallow: /www/email Disallow: /www/files Disallow: /www/files/thumbnails Disallow: /www/includes Disallow: /www/js Disallow: /www/style Disallow: /www/temp Disallow: /www/uploads # FULL access (Alta Vista) User-agent: Scooter Disallow: /www/admin Disallow: /www/archieve Disallow: /www/backup Disallow: /www/beta Disallow: /www/biodata Disallow: /www/cgi-bin Disallow: /www/css Disallow: /www/email Disallow: /www/files Disallow: /www/files/thumbnails Disallow: /www/includes Disallow: /www/js Disallow: /www/style Disallow: /www/temp Disallow: /www/uploads # FULL access (FASTDisallow: /AllTheWeb) User-agent: FAST-WebCrawler Disallow: /www/admin Disallow: /www/archieve Disallow: /www/backup Disallow: /www/beta Disallow: /www/biodata Disallow: /www/cgi-bin Disallow: /www/css Disallow: /www/email Disallow: /www/files Disallow: /www/files/thumbnails Disallow: /www/includes Disallow: /www/js Disallow: /www/style Disallow: /www/temp Disallow: /www/uploads # FULL access (Inktomi) User-agent: Slurp Disallow: /www/admin Disallow: /www/archieve Disallow: /www/backup Disallow: /www/beta Disallow: /www/biodata Disallow: /www/cgi-bin Disallow: /www/css Disallow: /www/email Disallow: /www/files Disallow: /www/files/thumbnails Disallow: /www/includes Disallow: /www/js Disallow: /www/style Disallow: /www/temp Disallow: /www/uploads # FULL access (Lycos) User-agent: Lycos_Spider_(T-Rex) Disallow: /www/admin Disallow: /www/archieve Disallow: /www/backup Disallow: /www/beta Disallow: /www/biodata Disallow: /www/cgi-bin Disallow: /www/css Disallow: /www/email Disallow: /www/files Disallow: /www/files/thumbnails Disallow: /www/includes Disallow: /www/js Disallow: /www/style Disallow: /www/temp Disallow: /www/uploads # FULL access (All Spiders) User-agent: * Disallow: /www/admin Disallow: /www/archieve Disallow: /www/backup Disallow: /www/beta Disallow: /www/biodata Disallow: /www/cgi-bin Disallow: /www/css Disallow: /www/email Disallow: /www/files Disallow: /www/files/thumbnails Disallow: /www/includes Disallow: /www/js Disallow: /www/style Disallow: /www/temp Disallow: /www/uploads