|
|
|
Thread Tools | Search this Thread | Rate Thread | Display Modes |
2005-06-27, 06:24 PM | #1 |
NO! Im not a female - but being a dragon, I do eat them.
|
Pulling Free Sites - Might Wanna Check This
Just so there's no misuderstandings - I posted this in another thread and there seemed to be a little surprise -
When youre pulling sites and the bots at most of the larger LLs find them 404/302 - the "normal" approach in the past has been to pull everything on that domain - I noticed lately some free site makers that are going 404 on some sites but then submitting before the bot shows up on the same domain - so all of the sites get pulled - its something to keep in mind as I do know some LLs also just pull everything based on submitter (not here but Ive seen others do it) - but more importantly - if you pull some sites on a domain but not all of them - there's a real good chance, unless we knew about specific sites ahead of time, that all sites on that domain got pulled when the bot runs happened last week. |
2005-06-27, 06:30 PM | #2 |
Subversive filth of the hedonistic decadent West
Join Date: Mar 2003
Location: Southeast Florida
Posts: 27,936
|
At this time I'm just pulling stuff that redirects or goes no DNS and not all in the domain.
I am thinking that soon we should all go back to business as usually since everyone that pulled stuff do to 2257 concerns should have pulled stuff by then. |
2005-06-27, 06:40 PM | #3 |
The Original Greenguy (Est'd 1996) & AVN HOF Member - I Crop Pics For Thumbs In My Sleep
|
What Cleo said
|
2005-06-27, 06:51 PM | #4 |
Took the hint.
|
I am giving it a few more days considering I am not completely done myself. I am at this point pulling only what shows as 302/404.
HOWEVER, I have noticed a few people pulling only the galleries and leaving the index / inside pages up. This is complete total nuclear option ban for this. Your misleading me, my bot, and my surfers. Alex |
2005-06-27, 07:26 PM | #5 |
NO! Im not a female - but being a dragon, I do eat them.
|
Yep - thats I guess the point I wanted to make - is that right now its getting back to operations as normal - which in the past has always meant pulling everything on the domain - so if you are still pulling sites - its probably not the best thing to do without at least posting here
Alex - Im getting really frustrated by the number of people doing that - and the worst is the ones that are redirecting to paysites when you click the gallery links - permanent ban here |
2005-06-27, 07:40 PM | #6 |
You can now put whatever you want in this space :)
|
We, at Debauchery, are sticking to business as usual. We're still accepting submissions (and still behind on our reviews ). We are checking a bit more often right now for redirects, pulled sites, errors and such, but we still give submitters the benefit of the doubt in that we will re-check the next day before we pull the links to sites that are down.
|
2005-06-27, 08:15 PM | #7 |
NO! Im not a female - but being a dragon, I do eat them.
|
Just a thought - Greenie and others - it would probably be good if we publish a cut-off date after which we will go back to the entire domains/submitter removals - that way everyone can be expecting the same thing - and to get us started - I propose we start this weekend - say Sunday?
|
2005-06-28, 05:18 AM | #8 |
Oh no, I'm sweating like Roger Ebert
Join Date: Apr 2005
Posts: 504
|
Just a more general question about 404s. What happens if my server temporarily goes down for say 24hrs and you bot happens to check at that time. Would you then pull all my sites - or does your bot check back a day later or something?
__________________
Please Re-Read The Rules For Sig Files |
2005-06-28, 08:39 AM | #9 |
Where there's a will, I want to be in it.
|
I do a 3 day cycle on my link checker. You have to be down for 3 consecutive days before I pull your sites.
__________________
Submit your free sites to Free Sex Pics |
2005-06-28, 08:42 AM | #10 | |
Subversive filth of the hedonistic decadent West
Join Date: Mar 2003
Location: Southeast Florida
Posts: 27,936
|
Quote:
I'll go along with whatever the rest think is good. |
|
2005-06-28, 08:53 AM | #11 |
NO! Im not a female - but being a dragon, I do eat them.
|
neveremail - I think that most pull the sites if they find them 404 - I know I had 30 sites pulled from LOR one time when my server was down for about 8 hours
|
2005-06-28, 09:04 AM | #12 | |
Oh no, I'm sweating like Roger Ebert
Join Date: Apr 2005
Posts: 504
|
Quote:
__________________
Please Re-Read The Rules For Sig Files |
|
2005-06-28, 09:09 AM | #13 |
Subversive filth of the hedonistic decadent West
Join Date: Mar 2003
Location: Southeast Florida
Posts: 27,936
|
No it's not.
When my bot flags a domain down I don't know if it is for a few hours or forever. You can resubmit them and they get on the new list again so it's not all bad. Starting a new thread on GG&J saying that you are having server problems will usually prevent your stuff from getting pulled. |
2005-06-28, 09:14 AM | #14 | |
Oh no, I'm sweating like Roger Ebert
Join Date: Apr 2005
Posts: 504
|
Quote:
__________________
Please Re-Read The Rules For Sig Files |
|
2005-06-28, 11:16 AM | #15 |
You can now put whatever you want in this space :)
|
I only check once a week, at most. When I find domains that are down, I wait a day and check'em again before I pull'em. I think that's fair...someone's domain willl have to be down for 2 consecutive days (from when I catch it) before I pull'em. If I know the submitter (or they are a regular submitter), I will try to contact them as well. It'll be end of next week before I check again...
|
2005-06-28, 11:29 AM | #16 |
Took the hint.
|
When I pull stuff, the items still stay in the database for a while. It really isn't all that hard to put them back.
Sunday? Alex |
2005-06-30, 04:16 AM | #17 | |
I want to live. I want to experience the universe, and I want to eat pie.
|
Quote:
|
|
2005-06-30, 07:26 AM | #18 |
NO! Im not a female - but being a dragon, I do eat them.
|
Mishi - do you know of a link-check bot that could tell that info? At least without running constantly?
|
2005-06-30, 07:40 AM | #19 |
Subversive filth of the hedonistic decadent West
Join Date: Mar 2003
Location: Southeast Florida
Posts: 27,936
|
Maybe that would be that bot that also picks the winning lotta numbers each week
|
2005-06-30, 11:11 AM | #20 |
Certified Nice Person
|
I would like a bot like that. It could even predict when links will go down days before the event. If it's predictions were far enough ahead, it could email the link owner and warn them that they are about to have hosting issues.
Is Sparky working in this ESP Bot yet?
__________________
Click here to purchase a bridge I'm selling. |
2005-07-02, 05:28 AM | #21 | |
I want to live. I want to experience the universe, and I want to eat pie.
|
Quote:
|
|
2005-07-02, 06:09 AM | #22 |
NO! Im not a female - but being a dragon, I do eat them.
|
well - thats kinda what I meant by constantly - I think most people - if they saw a bot hitting them on all of their free sites 4x a day - would just add the referrer to their ban list - at least I would
|
2005-07-02, 07:29 AM | #23 |
Subversive filth of the hedonistic decadent West
Join Date: Mar 2003
Location: Southeast Florida
Posts: 27,936
|
My bot runs two times a day and does keep a history but that still doesn't tell me if someone's stuff goes down if it is temporary or forever and I'm still left with surfers that all they know is I have listings that don't work.
If I recognize a name from the boards or something I will often wait a day but many of the people who submit to me I have no idea who they are. |
2005-07-02, 07:49 AM | #24 |
What can I do - I was born this way LOL
Join Date: Oct 2003
Location: ohio
Posts: 3,086
|
the border line cheater took advantage of this 2257 BS - oh I am removing sites but really I am redirecting to sponsor tours.. BS
|
2005-07-02, 08:33 AM | #25 |
NO! Im not a female - but being a dragon, I do eat them.
|
plateman - the bigger problem now is going through all of the links manually - seems a few have left up their sites - but changed the inner pages like the galleries - from things like no pics, no recips, to an all out redirect and toolbad downloads - its amazing to see how many people that we trusted as good WMs that have posted here and other places have done this
|
|
|