Thursday, August 16, 2007

Google Webmaster Tools improved robots.txt testing

 

The great folks over at Google have given us webmasters an improved Robots.txt validation tool.  The tool now understands the sitemap: directive and informs you of syntax errors. 

I also discovered it informs you that one exists.  Which is way cool.  I decided to check all my sites while I was there.  I discovered that one of the larger community sites I manage didn't have the sitemaps: directive in the robots.txt file. 

Of course I quickly corrected that problem.  The tool is there, use it.  It might just get you some more traffic.

No comments: