# By reading this file, you are blocked from accessing any regular files. # Any attempts to violate this will be recorded. If simple curiosity led # you to read this file, I'm sorry -- by reading this file, you've blocked # yourself out from the rest of the site. This is to enforce robots.txt # on robots that read robots.txt but don't obey it. Robots which read # robots.txt but then don't obey it, see only 404 errors for all pages. User-agent: * Disallow: /tools/ Disallow: /download/ Disallow: /papers/ Disallow: /html/ Disallow: /cgi-bin/ Disallow: / User-agent: Googlebot Allow: /