# exclude some access-controlled areas User-agent: * Disallow: /_private Disallow: /cgi-bin Disallow: /test