Control Search Engine Crawlers
This tool helps you create a robots.txt file to guide search engine robots. You can decide which parts of your site should be public and which bots you want to block.
This tool helps you create a robots.txt file to guide search engine robots. You can decide which parts of your site should be public and which bots you want to block.