Comments on: The Google Crawler is Fast http://www.alexloddengaard.com/2008/05/20/the-google-crawler-is-fast/ A blog by Alex Loddengaard Thu, 24 Jul 2008 22:40:26 +0000 http://wordpress.org/?v=2.5.1 By: Sunil Garg http://www.alexloddengaard.com/2008/05/20/the-google-crawler-is-fast/#comment-566 Sunil Garg Tue, 20 May 2008 17:32:36 +0000 http://www.alexloddengaard.com/?p=206#comment-566 What exactly would they need to calculate in terms of PageRank? If they know that your post is extremely fresh, couldn't they operate under the assumption that no one else has linked to it yet (so initial PageRank is close to zero, or maybe some average of your older posts), and wait until they see incoming links in future posts from across the web? Their indexing speed is nonetheless quite impressive. What exactly would they need to calculate in terms of PageRank?

If they know that your post is extremely fresh, couldn’t they operate under the assumption that no one else has linked to it yet (so initial PageRank is close to zero, or maybe some average of your older posts), and wait until they see incoming links in future posts from across the web?

Their indexing speed is nonetheless quite impressive.

]]> By: Alex Loddengaard http://www.alexloddengaard.com/2008/05/20/the-google-crawler-is-fast/#comment-562 Alex Loddengaard Tue, 20 May 2008 15:02:35 +0000 http://www.alexloddengaard.com/?p=206#comment-562 I suppose what I'm most impressed with is Google's ability to index and compute PageRank in such little amount of time. Regardless, thanks for the link, Sunil! I suppose what I’m most impressed with is Google’s ability to index and compute PageRank in such little amount of time. Regardless, thanks for the link, Sunil!

]]> By: Sunil Garg http://www.alexloddengaard.com/2008/05/20/the-google-crawler-is-fast/#comment-553 Sunil Garg Tue, 20 May 2008 10:36:10 +0000 http://www.alexloddengaard.com/?p=206#comment-553 15 minutes is fast, but Google's job is made pretty easy by <a href="http://codex.wordpress.org/Update_Services" rel="nofollow">Wordpress' use of XML-RPC pings</a>. 15 minutes is fast, but Google’s job is made pretty easy by Wordpress’ use of XML-RPC pings.

]]>