Robots.txt

A file that tells search engines which parts of a website to crawl and index.

Scroll to Top