![]() |
What is robots.txt? - Printable Version +- Web Design Forum HTML CSS JavaScript PHP Graphic Design SEO forum (http://www.webdesignforum.com.au) +-- Forum: Search Engine Marketing (/forumdisplay.php?fid=18) +--- Forum: Search Engine Optimisation (/forumdisplay.php?fid=8) +--- Thread: What is robots.txt? (/showthread.php?tid=33562) |
What is robots.txt? - MoulanaRafi - 01-23-2018 04:31 PM What is robots.txt? RE: What is robots.txt? - online12356 - 01-23-2018 09:03 PM The robots exclusion standard, also known as the robots exclusion protocol or simply robots.txt RE: What is robots.txt? - andreausa - 01-23-2018 10:31 PM It gives instructions to web robots about the pages the website owner doesn’t wish to be crawled. RE: What is robots.txt? - rishabjoy - 01-24-2018 05:47 PM I agree with you guys. |