User-agent: * Disallow: /_ Disallow: /_temp Disallow: /wwwstat/ Disallow: /r/ Disallow: /CF* Disallow: /warchive Disallow: /sub*