# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file User-agent:Baiduspider Disallow: User-agent:baiduspider Disallow: User-agent:GoogleBot Disallow: User-agent:Googlebot Disallow: User-agent:googlebot Disallow: User-agent:Yahoo! Slurp Disallow: User-agent:Yahoo!Slurp Disallow: User-agent:* Disallow:/