Hlo Friends,
Can anyone explain, What’s The Significance Of Robots.txt File In A Website?
Robots.text file tell the search engine which file is indexed or which is not.
Robots file is important file. It tells search engine to which page visit or not.
It is a text file webmasters create to instruct web robots how to crawl pages on their website