SE Submission

T Pat · 2004-12-20, 07:52 PM

I don't, if you build a free site and submit it to some of the bigger LL's you'll get crawled in a day or two or three

If you have a hub you want crawled just use one of the links your allowed on your free site for your hub and it will get crawled too.

AWStates is real easy to read and I think most hosting companies are includeing it in all their hosting packages now. That's all you need to track the bots
looks like this:

Robots/Spiders visitors (Top 10) - Full list - Last visit
12 different robots Hits Bandwidth Last visit
Road Runner: The ImageScape Robot 1906 15.66 MB 18 Dec 2004 - 06:11
Googlebot (Google) 695 11.51 MB 19 Dec 2004 - 19:59
Inktomi Slurp 621 9.19 MB 20 Dec 2004 - 04:57
Alexa (IA Archiver) 208 3.79 MB 17 Dec 2004 - 00:11
larbin 28 433.68 KB 09 Dec 2004 - 12:41
Unknown robot (identified by 'crawl') 7 47.70 KB 18 Dec 2004 - 03:11
Walhello appie 3 35.90 KB 20 Dec 2004 - 05:56
Jeeves 2 39.06 KB 16 Dec 2004 - 05:33
SurveyBot 2 37.54 KB 13 Dec 2004 - 12:34
Unknown robot (identified by 'robot') 2 39.06 KB 18 Dec 2004 - 05:46
Others 2 39.07 KB

2004-12-20, 07:52 PM	#1
T Pat You can now put whatever you want in this space :) Join Date: Aug 2003 Location: Paridise Posts: 3,244	I don't, if you build a free site and submit it to some of the bigger LL's you'll get crawled in a day or two or three If you have a hub you want crawled just use one of the links your allowed on your free site for your hub and it will get crawled too. AWStates is real easy to read and I think most hosting companies are includeing it in all their hosting packages now. That's all you need to track the bots looks like this: Robots/Spiders visitors (Top 10) - Full list - Last visit 12 different robots Hits Bandwidth Last visit Road Runner: The ImageScape Robot 1906 15.66 MB 18 Dec 2004 - 06:11 Googlebot (Google) 695 11.51 MB 19 Dec 2004 - 19:59 Inktomi Slurp 621 9.19 MB 20 Dec 2004 - 04:57 Alexa (IA Archiver) 208 3.79 MB 17 Dec 2004 - 00:11 larbin 28 433.68 KB 09 Dec 2004 - 12:41 Unknown robot (identified by 'crawl') 7 47.70 KB 18 Dec 2004 - 03:11 Walhello appie 3 35.90 KB 20 Dec 2004 - 05:56 Jeeves 2 39.06 KB 16 Dec 2004 - 05:33 SurveyBot 2 37.54 KB 13 Dec 2004 - 12:34 Unknown robot (identified by 'robot') 2 39.06 KB 18 Dec 2004 - 05:46 Others 2 39.07 KB __________________ How To Keep An Asshole In Suspense I'll Tell You Later