Robots.txt

This is a file that is added in order to restrict access to a site by search engine robots that crawl the web. It is currently not possible to edit the robots.txt file of your site. However, you can add a noindex tag to an individual page of your site, preventing it from appearing in […]