# Robots.txt # created 09.16.03 # # This is a file retrieved by webwalkers a.k.a. spiders that # conform to a defacto standard. # See User-agent: * Disallow: /admin Disallow: /content Disallow: /files/common Disallow: /js Disallow: includes.php