# Created: 2003/09/15 # Updated: 2006/10/05 # Block all the little shit robots User-agent: * Disallow: /cgi-bin/ Disallow: /cgi-sys/ Disallow: /phpBB2/ Disallow: /stats/ Disallow: /webalizer/ Disallow: /errors/ Disallow: /tmp/ Disallow: /scripts/ # Block all ghost domains from indexing Disallow: /domains/ # Might be fun to allow this! Allow: /tools/ Allow: /360anims/ Allow: /download/ Allow: /maps/ Allow: /pic-album/ Allow: /wot/