A file that tells search engines which pages on your site they can and cannot crawl.
Schedule a chat to discuss