# robots.txt generated by stacklab User-agent: * Crawl-delay: 20 Disallow: Sitemap: http://www.repap.co.jp/sitemap.php # robots.txt http://www.bestgate.jp/ User-Agent: bgcbot Allow: /