# robots.txt - specify which areas to not index by google, et al. User-agent: * Disallow: /cgi-bin/ Disallow: /docs/protected/ Disallow: /archives Disallow: /mailman Disallow: /RA/sponsors.htm