googlebot you are slow

neticule · 2004-12-23, 07:49 PM

I was checking my way cool new stats for ny new website (stats are called AWStats)

It was showing me all the spider/robot visits for the last month, i have 1400 from inktomi, and a bunch from other places, and uknown spiders, but googlebot is the lowest on the list with only 14 visits! The new site i have probably has upwards of 2000-3000 pages that i would like spidered, but at this rate it will be 2010 before google spiders em all lol!

I remember a few years ago googlebot used to give me the most spider hits... whats wrong googlebot! I think googlebot needs a fembot...

cd34 · 2004-12-23, 08:21 PM

Perhaps Google uses UPS to get their page results from your site?

haha.. sorry, couldn't resist.

FTS · 2004-12-23, 08:40 PM

you need to get some more links up (people linking to you)...

i find that googlebot tends to do a deeper crawl all at one time...

from my experience it would come once in a while, and then one day bam, you notice that it had 2000 hits

Bill · 2004-12-23, 08:45 PM

Google only spiders as deep as it thinks a site is important. So new sites, sites with low pr, and sites without authoritative incoming links only get shallowly spidered.

So, what kind of new site has 2-3000 pages to spider?

neticule · 2004-12-29, 01:37 AM

"So, what kind of new site has 2-3000 pages to spider?"

its a linklist, but i have my own gallery archives on there, each gallery has 12 pics and all the images are on html pages with keywords and text and such, i have about 150 galleries now so that plus the linklist and other things is well over 2000 pages, spent over amonth adding keywords and such to the image pages, it would upset me if they never even got spidered lol

"Perhaps Google uses UPS to get their page results from your site?"

LOL very funny

2004-12-23, 07:49 PM	#1
neticule A boy without mischief is like a bowling ball without a liquid center Join Date: Jan 2004 Posts: 437	googlebot you are slow I was checking my way cool new stats for ny new website (stats are called AWStats) It was showing me all the spider/robot visits for the last month, i have 1400 from inktomi, and a bunch from other places, and uknown spiders, but googlebot is the lowest on the list with only 14 visits! The new site i have probably has upwards of 2000-3000 pages that i would like spidered, but at this rate it will be 2010 before google spiders em all lol! I remember a few years ago googlebot used to give me the most spider hits... whats wrong googlebot! I think googlebot needs a fembot... __________________ Mom, I'm done! Come wipe!

2004-12-23, 08:21 PM	#2
cd34 a.k.a. Sparky Join Date: Sep 2004 Location: West Palm Beach, FL, USA Posts: 2,396	Perhaps Google uses UPS to get their page results from your site? haha.. sorry, couldn't resist. __________________ SnapReplay.com a different way to share photos - iPhone & Android

2004-12-23, 08:40 PM	#3
FTS Operator! Give me the number for 911! Join Date: Dec 2004 Posts: 139	you need to get some more links up (people linking to you)... i find that googlebot tends to do a deeper crawl all at one time... from my experience it would come once in a while, and then one day bam, you notice that it had 2000 hits __________________ Submit Your Freesites to <a href="http://www.fuckthensuck.com/submit.html"> Fuck Then Suck </a> and <a href="http://www.xxxpicssex.com/submit.php"> XXX Pics Sex </a> <br>Email me your comments! Last edited by FTS; 2004-12-23 at 08:42 PM..

2004-12-29, 01:37 AM	#5
neticule A boy without mischief is like a bowling ball without a liquid center Join Date: Jan 2004 Posts: 437	blah "So, what kind of new site has 2-3000 pages to spider?" its a linklist, but i have my own gallery archives on there, each gallery has 12 pics and all the images are on html pages with keywords and text and such, i have about 150 galleries now so that plus the linklist and other things is well over 2000 pages, spent over amonth adding keywords and such to the image pages, it would upset me if they never even got spidered lol "Perhaps Google uses UPS to get their page results from your site?" LOL very funny __________________ Mom, I'm done! Come wipe!

2004-12-23, 08:45 PM	#4
Bill Selling porn allows me to stay in a constant state of Bliss - ain't that a trip! Join Date: Apr 2003 Posts: 3,914	Google only spiders as deep as it thinks a site is important. So new sites, sites with low pr, and sites without authoritative incoming links only get shallowly spidered. So, what kind of new site has 2-3000 pages to spider?