Questions on Spiders for Freesites

crazypornstar · 2007-02-02, 04:56 PM

Hi, recently i had one of my servers under assualt for
dos attacks and brute force. In order to get it under control
i have been banning some ip's that were trying to
spider the /images/ folders.

How do i make sure not to block the
spiders from the link lists?
Is there a list of ip address?
Do they come directly from the parent domain?

Thank you for your help.

Ed

crazypornstar · 2007-02-03, 04:15 PM

Dang, still nothing!

crazypornstar · 2007-02-04, 08:21 PM

Before i start submitting my free sites again.
I just want to make sure i have this thing
setup correctly.

would someone be able to check and
let me know if there bot would be able to spider a url
if so i will give them one rather than spam
the forum.

Thank you for your help.

Ed

oldbrad · 2007-02-05, 12:16 AM

I dont know much about much, but while i was trying to find out about a "python robot", i found a list of search engine robots. I dont have it now, but try searching google for "search engine robot list" or something similar and see what you can find.

I dont remember exactly what i had searched before.

crazypornstar · 2007-02-12, 03:27 PM

Hi, it seems i cant get this box to work correctly.
I will be moving my main submission domain
so i can start sending in some free sites again.

Sorry for the problems with the server Link List Owners
it seems i had an unwanted visitor using my site.
the domain to be moved is crazyhardcoreporn dot com
i will start the dns changes this evening. Its already
been moved to a new machine (cleaned and tested).

Thank you.

Ed

crazypornstar · 2007-02-13, 05:39 PM

I changed the dns but put in the wrong info (GRRR)
the site propigated to a blank page over the evening.
I have made the corrections to the dns entrys
and the site should be online (soon i hope).

Sorry you guys, all i want to do is get
my site back online and start submitting again.

Ed

crazypornstar · 2007-02-14, 11:07 PM

The domain is now showing up properly with all of the old
free sites and galleries. I look forward to finally submitting
again!

Ed

crazypornstar · 2007-02-15, 10:48 AM

Thank you to all of the Link List Owners
for not black listing my domain. I coudlnt
begin to imagine the pain in the ass running a good
LL would be! I was able to submit my first free site
in a month and it was very theraputic!

Again thank you for your patience.

Ed

2007-02-02, 04:56 PM	#1
crazypornstar If something goes wrong at the plant, blame the guy who can't speak English Join Date: Nov 2004 Location: Edmonton Posts: 31	Questions on Spiders for Freesites Hi, recently i had one of my servers under assualt for dos attacks and brute force. In order to get it under control i have been banning some ip's that were trying to spider the /images/ folders. How do i make sure not to block the spiders from the link lists? Is there a list of ip address? Do they come directly from the parent domain? Thank you for your help. Ed

2007-02-03, 04:15 PM	#2
crazypornstar If something goes wrong at the plant, blame the guy who can't speak English Join Date: Nov 2004 Location: Edmonton Posts: 31	Any help would be greatly appreciated Dang, still nothing!

2007-02-04, 08:21 PM	#3
crazypornstar If something goes wrong at the plant, blame the guy who can't speak English Join Date: Nov 2004 Location: Edmonton Posts: 31	Following up Before i start submitting my free sites again. I just want to make sure i have this thing setup correctly. would someone be able to check and let me know if there bot would be able to spider a url if so i will give them one rather than spam the forum. Thank you for your help. Ed

2007-02-05, 12:16 AM	#4
oldbrad It is better to watch things then to do them Join Date: Nov 2006 Location: oregon Posts: 485	I dont know much about much, but while i was trying to find out about a "python robot", i found a list of search engine robots. I dont have it now, but try searching google for "search engine robot list" or something similar and see what you can find. I dont remember exactly what i had searched before. __________________ Help MrMaryLou Link to his Chubby TGP & Chubby Links on your sites and blogs.

2007-02-12, 03:27 PM	#5
crazypornstar If something goes wrong at the plant, blame the guy who can't speak English Join Date: Nov 2004 Location: Edmonton Posts: 31	Moving Domain to New Server Hi, it seems i cant get this box to work correctly. I will be moving my main submission domain so i can start sending in some free sites again. Sorry for the problems with the server Link List Owners it seems i had an unwanted visitor using my site. the domain to be moved is crazyhardcoreporn dot com i will start the dns changes this evening. Its already been moved to a new machine (cleaned and tested). Thank you. Ed

2007-02-13, 05:39 PM	#6
crazypornstar If something goes wrong at the plant, blame the guy who can't speak English Join Date: Nov 2004 Location: Edmonton Posts: 31	I Am a Moron with no Luck I changed the dns but put in the wrong info (GRRR) the site propigated to a blank page over the evening. I have made the corrections to the dns entrys and the site should be online (soon i hope). Sorry you guys, all i want to do is get my site back online and start submitting again. Ed

2007-02-14, 11:07 PM	#7
crazypornstar If something goes wrong at the plant, blame the guy who can't speak English Join Date: Nov 2004 Location: Edmonton Posts: 31	Finally Back to Submitting The domain is now showing up properly with all of the old free sites and galleries. I look forward to finally submitting again! Ed

2007-02-15, 10:48 AM	#8
crazypornstar If something goes wrong at the plant, blame the guy who can't speak English Join Date: Nov 2004 Location: Edmonton Posts: 31	You Guys Rock Thank you to all of the Link List Owners for not black listing my domain. I coudlnt begin to imagine the pain in the ass running a good LL would be! I was able to submit my first free site in a month and it was very theraputic! Again thank you for your patience. Ed