Thursday, June 08, 2006

Google open up it's News in XHTML

A new line in the robots.txt of Google open up its news to crawlers and others scraping utilities.
Allow: /news?output=xhtml


Here how it's look like.

No comments: