Showing posts with label crawler. Show all posts
Showing posts with label crawler. Show all posts

Wednesday, February 27, 2008

Google Search Engine Vs Yahoo Search Engine

I suppose you people have read my previous article Strange Google Crawler. After messing with google search I had decided to include my site in yahoo search .as compared to google search , yahoo search engine has crawled my pages little fast, today as on 27th February yahoo search engine showing 2 links from my Blog up their and google has crawled all links from my blog. Now lets compare time span i.e amount of time taken by yahoo and google search engine to crawl my blog.

I had submitted my blog to google search far before December of last year and 1st link of up by January 16,2008 where as I had submitted my blog to yahoo search some where after February 8,2008.today when I had checked with both search engine here is statistics

Google Search site:random-view.blogspot.com results showing 13 links

Yahoo Search http://random-view.blogspot.com result showing 2 links with 32 backlink from my wordpress blog (I had created banklink intentionally, just to make google crawler to crawl more pages from this blog )

If I compare this to search engine based on their rate at which they crawl new blog faster then it will be difficult to give any conclusion. As I have no idea whether yahoo search engine takes up any links from google search engine or not. One point which do makes me to feel yahoo search engine might be taking google search result output for further reference is, links which are up in yahoo search engine are also up in google search far before yahoo has crawled those links. Well google crawler is going good with crawling here is graphs from google analytics

Activity of Googlebot for last 90 days on my blog

Number of pages crawled per day
Maximum -41 Average- 9 Minimum- 2






Number of kilobytes downloaded per day

Maximum - 1169 Average- 140 Minimum- 0










Time spent downloading a page (in milliseconds)

Maximum- 2517 Average- 582 Minimum-123






I don’t know whether this statistics are displayed real time or there is any time lag .well any way statistics are not showing any good sigh from googlebot. Graphs are in downwards direction for last few days.

Here is result of Yahoo site Explorer

Tuesday, February 12, 2008

Strange Google Crawler

Well it has been so long that I am trying to get my blog indexed in google search but no luck yet। My Blog is not even displayed in search result when I put whole url in search keyword. Enough of trying and I had decided to create another blog in wordpress because of two reasons .one is that wordpress has great themes and many widgets and second lots of people are switching to wordpress. Just two day before I had created oraview.wordpress.com blog .but after creating I got to know that we can' t have adsense on that so, I switched back again to blogspot on my old blog random-view.blogspot.com.

Today when I was trying to search for 'random-view' term in google god damn this blog didn't came up in search result but guess what my wordpress blog was up there .This is really annoying the blog, one which is created one and half year back is still not indexed. Whereas wordpress blog which was created just 2 days back got indexed so fast . looks google search and crawling algorithm is really grate secret in it. No one can guess how it works .Anyways Till time I will keep trying my blog to get indexed with good ranking and will see people coming to my blog via Google path way :)


Link to Next Post:Antivirus reviews 2008 (part 1)
Link to Previous post:Creating Statspack job
Link to this Blog:Random-View