# CRELoaded Generated Robots.txt # Robot Exclusion File -- robots.txt # Author: CRELoaded Team # Last Updated : September 11th, 2007 User-Agent: * Disallow: /admin/ # full access (Alta Vista) User-agent: Scooter Disallow: # full access (Excite) User-agent: ArchitextSpider Disallow: # full access (Google) User-agent: Googlebot Disallow: # full access (Inktomi) User-agent: Slurp Disallow: