Web Design Forum HTML CSS JavaScript PHP Graphic Design SEO forum
Why robert.txt file is important to Website ? - Printable Version

+- Web Design Forum HTML CSS JavaScript PHP Graphic Design SEO forum (http://www.webdesignforum.com.au)
+-- Forum: Search Engine Marketing (/forumdisplay.php?fid=18)
+--- Forum: Search Engine Optimisation (/forumdisplay.php?fid=8)
+--- Thread: Why robert.txt file is important to Website ? (/showthread.php?tid=31777)



Why robert.txt file is important to Website ? - jasminekour - 10-11-2016 06:32 PM

Hello Friends,


I want to know that Why robert.txt file is important to Website ?


RE: Why robert.txt file is important to Website ? - jackluter - 10-13-2016 05:49 PM

Robert.txt instruct the crawler to enter the particular page which website owner wants to.