Greenguy's Board - View Single Post - google spidering takes more bandwidth now

xxxjay · 2004-06-19, 04:15 AM

Anyone noticed the google spiders are gobbling a lot more bandwidth now? Daretwo got hold of me and informed me that the CPU usage my boxes was getting pegged out, but we couldn’t figure out from where. Checked the server log to find out it was those “damn” google spiders doing it.

I just hoped the grabbed and ranked a ton of my pages well. Anyone else noticed this?

2004-06-19, 04:15 AM	#1
xxxjay You can now put whatever you want in this space :) Join Date: Apr 2003 Location: atlanta Posts: 1,787	google spidering takes more bandwidth now Anyone noticed the google spiders are gobbling a lot more bandwidth now? Daretwo got hold of me and informed me that the CPU usage my boxes was getting pegged out, but we couldn’t figure out from where. Checked the server log to find out it was those “damn” google spiders doing it. I just hoped the grabbed and ranked a ton of my pages well. Anyone else noticed this? __________________ Circle Of Violence