Google admits We have a Huge Machine Crisis

[Halfdeck]

Sky is falling

As Google grows, so does its need to store and handle more Web site information, video and e-mail content on its servers. "Those machines are full," Mr. Schmidt, the chief executive, said in an interview last month. "We have a huge machine crisis."

http://www.nytimes.com/2006/05/02/te...ewanted=2&_r=1

[Useless]

So maybe Google isn't trying to spite me after all. Perhaps the lack of hdd space is why they seem to have difficulty indexing all of my pages and backlinks. They should ask Yahoo to give them a lesson or two in that arena.

[Preacher]

I thought they tried to keep useless links out of their index.

[Fonz]

Solution: Buy more HDD's?

[alessandro]

I was thinking the same about my sites
Well, on all my 20+ domains I see google deindexed more than 50% of the pages that it had indexed for years now. Not to talk about new domains going out and not getting their pages indexed for 1+ month with good backlinks to them.

Originally Posted by Useless Warrior

So maybe Google isn't trying to spite me after all. Perhaps the lack of hdd space is why they seem to have difficulty indexing all of my pages and backlinks. They should ask Yahoo to give them a lesson or two in that arena.

[RawAlex]

"Last month, when reporting its quarterly earnings, Google reported a doubling in its rate of capital investment, mainly in computer servers, network equipment and space for data centers, and said it would spend at least $1.5 billion over the next year"

After we talked about this in the search engine chat, I thought about it for a while and a couple of things came up:

First, this could be a public plot from Google so that they have an excuse why they are not caching much of the internet at this point. The size of the job is probably very overwhelming, so they have just decided to say "fuck it" and only cache index pages and heavily referenced internal pages... everything else is supplimental and not accessible as a cached page anymore. Way less online storage.

I also think that things like Gmail and Google Calendar and whatnot take huge amounts of machine time and storage. I have a feeling that Google may have sacrificed cache access for inside pages in order to have enough machines and resources to make these products live. Capital spending for equipment will go up again in the future and more equipment is due next year, but I think that Google may have increased it's offerings faster than it has increased it's datacenters.

Google is also feeling some pressure now from the stock market to put products on the table, and I think that pressure has created too much desire to move things into the public eye without consideration for what resources will be lost by the core product, namely SERPs.

Bot activity for Google appears to be at an all time low right now, the PR rankings are misleading to useless, and it is rare as heck to find sites with internal pages in active cache. The SERPs suffer, and at the end of the day, that is what makes Google good or bad.

I predict some very bad things in the next while.

Alex

[tickler]

Ran across this slightly older piece about Googles hardware for any of the techies here.

The Secret Source of Google's Power
http://blog.topix.net/archives/000016.html

[cockhungryhoes]

I have been having a hella hard time getting indexed also and I know I am doing good SEO. Guess it might not be me. Good to know.

[suddenlysex]

cockhungryhoes.com if this is the site you think you are doing good SEO on... You are wrong! Just checked your site and I think you have no clue on SEO. You better check your ranks on msn and yahoo too.

[cd34]

http://www.iht.com/articles/2006/06/...ess/search.php

another article regarding another Google Datacenter being built