Web Design Forum HTML CSS JavaScript PHP Graphic Design SEO forum

Full Version: What is robots.txt?

You're currently viewing a stripped down version of our content. View the full version with proper formatting.

Hello friends'
can anyone tell me what is robots.txt?

It contains instructions for robots.

It is primarily used to specify which parts of your website should be crawled by spiders

Robots.txt is a text file webmasters create to instruct web robots

Reference URL's

Web Design Forum HTML CSS JavaScript PHP Graphic Design SEO forum: http://www.webdesignforum.com.au/index.php
:

loveguru