Subscribe to the newsletter or RSS feed to receive updates automatically blog!

The robots.txt file on Wordpress



As I noted in the statistics of access to blogs, which often spiders (Google in the lead) looking into the root site of the robots.txt file and not find him, I decided to "settle" creating a content with the following: 

  User-agent: * 
  Disallow: / wp - 
  Disallow: / feed / 
  Disallow: / trackback /

This should serve to ensure that all spiders are not trying in vain to index the files directly to Wordpress. Then there are those who say that this file is a good idea to create it even if there are areas to be excluded, and then with a content of this type: 

  User-agent: * 
  Disallow:


Did you like this article? Sign up now to receive updates or news articles:
Subscribe to RSS feeds write to the RSS feed


Date Posted on February 28, 2007 at 20:01 in Web
Sharing Share | Tags: Web

Still no comment '

Comments RSS feed for this post. TrackBack URI

Leave a comment

XHTML: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>


Nothing2Hide © 2006 All rights reserved.

License | Disclaimer

Close
Send e-mail