A file that tells search engines which parts of a website to crawl and index.