Robots.txt File Explained

Back to Infographics
Robots.txt file simply tells the search engine

Robots.txt file simply tells the search engine crawlers the places they are not allowed to index on your site.