Sep 19, 2011

Google News is now creeping with Googlebot


Google News recently upgraded their infrastructure to crawl with Googlebot which is main user agent. What does this mean? Not for most publishers. Any new organizations that wish to retire from Google News can continue to do so: Google News will always respect the robots.txt entry Googlebot-News, Google old user agent, if it is more restrictive than the robots.txt entry for Googlebot.

Google Help Center provides detailed guidance on using the robots exclusion protocol for Google News, and publishers can contact the Google News Support Team if they have any questions, but we wanted to first clarify the following: 

LIVE SEO NEWS © 2008.

TOPO