User-agent: * Disallow: /cms/ Disallow: /cgi-bin/ Disallow: /db/ # updated 2003-05-20 (disallow cms and cgi-bin)