Web Design Forum HTML CSS JavaScript PHP Graphic Design SEO forum
What is disallow in robots.txt file? - Printable Version

+- Web Design Forum HTML CSS JavaScript PHP Graphic Design SEO forum (http://www.webdesignforum.com.au)
+-- Forum: Search Engine Marketing (/forumdisplay.php?fid=18)
+--- Forum: Search Engine Optimisation (/forumdisplay.php?fid=8)
+--- Thread: What is disallow in robots.txt file? (/showthread.php?tid=35417)



What is disallow in robots.txt file? - rscomponent - 07-01-2019 10:11 PM

What is disallow in robots.txt file?


RE: What is disallow in robots.txt file? - thaichacha - 07-02-2019 04:59 PM

It is an instruction to the Search Engine to prevent accessing of specific pages or directories.


RE: What is disallow in robots.txt file? - rhcalvin - 07-04-2019 05:32 PM

Disallow states that search engine bots are restricted from crawling those webpages.


RE: What is disallow in robots.txt file? - gautamsharma - 09-28-2019 03:41 PM

Agree with you guys,thanks for share it.


RE: What is disallow in robots.txt file? - MoulanaRafi - 09-28-2019 09:49 PM

Thanks for sharing such knowledge with us.


RE: What is disallow in robots.txt file? - John - Smith - 10-03-2019 05:36 PM

Disallowing any URL won't be crawled by robots.


RE: What is disallow in robots.txt file? - Autofresh.in - 10-04-2019 04:24 PM

So without having knowledge of disallow term you disallowed so many things in your website Huh Angry


RE: What is disallow in robots.txt file? - John - Smith - 10-07-2019 05:15 PM

I think OP should be now clear with the disallow term! #CloseTheThread