User-agent: * Disallow: /cgi-bin/ Disallow: /cgi/ Disallow: /admin/ Disallow: /auth/ Disallow: /cache/ Disallow: /captcha/ Disallow: /css/ Disallow: /glossary/ Disallow: /js/ Disallow: /map/ Disallow: /menu/ Disallow: /req/ Disallow: /search/ Disallow: /tools/