# Robots.txt file from http://com.nulog.cn # All robots will spider the domain User-agent:* Disallow:/images Disallow:/include User-agent:Googlebot Disallow:/search.htm Disallow:/mail.html User-agent:Yahoo! Slurp User-agent:Baiduspider User-agent:YodaoBot User-agent:Sosospider User-agent:sogou spider User-agent:Main web crawler Disallow:/search.htm Disallow:/mail.html