User-agent: * #comment allow all bots Disallow: /cgi-bin/ Disallow: /private/ #comment disallow all bots to the two DIR's