# File robots.txt,v8.0.0 20080501 This Web Site SeoER by Sumarry QQ:1642087 # 按照robots.txt的标准写法,规定一些不允许爬虫爬的页面或目录 # Format is # User-agent name of spider # ----------------------------------------------------------------------------- User-agent: * Disallow: