List of Google Robots

Search Engine Roundtable has published a list of bots that belongs to Google. Bots, or robots is a software agents to gather information. Bots and robots from Google are also called web crawlers or spiders in which they are web robots that recursively gather web-page information, as does the bot used by Google (”GoogleBot”).

According to the article, current Google robots that are active including the common GoogleBot (compatible; Googlebot/2.1; +http://www.google.com/bot.html) which is the main spider for the search engine, MediaBot (Mediapartners-Google/2.1) which analyzes web pages with Google AdSense ads to determine relevant ads, ImageBot (Googlebot-Image/1.0) which crawls for the Image Search, AdsBot (AdsBot-Google) which checks Google AdWords landing pages’ quality, Feedfetcher (Feedfetcher-Google) which retrieves rss feeds when users explicitly added them to their Google homepage or Google Reader, Generic Mobile Phone (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html) which translates (or “transcodes”) these pages by analyzing the original HTML code and converting it to a mobile-ready format.

Other robot is Google WAP Proxy (Google WAP Proxy/1.0) which is a bridge for mobile phones to access and adapting to normal web pages via the wap protocol by converting .html to .wml.


2 Responses to “List of Google Robots”

  1. Redirect or Rewrite to Remove Double or Multiple Slashes (//) in URL » My Digital Life
    July 21st, 2008 03:02
    2

    [...] other websites type or put incorrect backlink (external link), which picked up by ultra-sensitive Googlebot or Mediapartners-Google (Google AdSense crawler which also contribute website indexing of Google Search). But one thing is [...]

  2. web master
    January 3rd, 2007 21:25
    1

    where can we explore more information on google bots and how it affect rankings…

Leave a Reply

You can use these tags: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

Subscribe to comments feature has been disabled. To receive notification of latest comments posted, subscribe to My Digital Life Comments RSS feed or register to receive new comments in daily email digest.
Custom Search

New Articles

Incoming Search Terms for the Article

list of adsbot ips - install google robots - google robots pictures - googlebot mobile transcode meta - code to invite web robots -