Greenguy's Board


Go Back   Greenguy's Board > Link Lists & Getting Listed
Register FAQ Calendar Today's Posts

Reply
 
Thread Tools Search this Thread Rate Thread Display Modes
Old 2004-06-03, 01:34 PM   #1
ChristyB
You tried your best and you failed miserably. The lesson is 'never try'
 
ChristyB's Avatar
 
Join Date: Aug 2003
Location: South West UK
Posts: 165
Link Checkers, Site stealers and User_Agents

I use htaccess protection to guard against the constant stream of site stealer agents sent to my domains and the htaccess file blocks by user agent.
I have included most 'known' stealer software agents in the file.

It seems we have a problem with some of the user_agents being employed by some link lists to check links.
Recently one or two linklists have been dropping some of our links and when we enquire about it we discover that the user_agent employed is one of those which is commonly used by site stealers.

I have two suggestions which would save a lot of time, trouble and mistaken removal of valid links in a case like this:
1. Change the user agent name (name it after your linklist).
2. Display the name of your user_agent on your submissions page so that webmasters like us can decide whether it's worthwhile allowing the agent.

It seems obvious to me that renaming the user agent would be the best solution but I have no idea how hard it is to do (I know it's possible because at least one link lists did this in order to overcome the problem) but - for some, maybe option 2 is the only answer...

Perhaps there's another way to guard against site stealers?
If not - does anybody have any better suggestions?
__________________
ChristyB

I have a little spot I like to show to adult webmasters
Feeling submissive? Submit your free sites to my directory
ChristyB is offline   Reply With Quote
Old 2004-06-03, 01:43 PM   #2
Cleo
Subversive filth of the hedonistic decadent West
 
Cleo's Avatar
 
Join Date: Mar 2003
Location: Southeast Florida
Posts: 27,936
No way.

The last thing that I would want is someone to know what to look for so that they can serve up the correct page to me and only me.

This is the same reason that I don't want anyone to know what IP address that I use so I never posts on boards that show IPs.
__________________
Free Rides on Uber and Lyft
Uber Car: uberTzTerri
Lyft Car: TZ896289
Cleo is offline   Reply With Quote
Old 2004-06-03, 01:44 PM   #3
ChristyB
You tried your best and you failed miserably. The lesson is 'never try'
 
ChristyB's Avatar
 
Join Date: Aug 2003
Location: South West UK
Posts: 165
That's fair enough, but what about option 1?

...or

What else do you suggest?
__________________
ChristyB

I have a little spot I like to show to adult webmasters
Feeling submissive? Submit your free sites to my directory
ChristyB is offline   Reply With Quote
Old 2004-06-04, 07:01 AM   #4
ChristyB
You tried your best and you failed miserably. The lesson is 'never try'
 
ChristyB's Avatar
 
Join Date: Aug 2003
Location: South West UK
Posts: 165
Actually we've never had a problem with Cleos links.

I sure as hell wouldn't go to the trouble of cloaking a free site for one link list - that would be anal.

It still leaves us with the same problem for the "others" though...
Altering the user_agent slightly will allow it to bypass the htaccess protection - no need to say which user_agent you use but if you use a link checker script which is in the common list of site stealer bots then you will not get access!
__________________
ChristyB

I have a little spot I like to show to adult webmasters
Feeling submissive? Submit your free sites to my directory
ChristyB is offline   Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT -4. The time now is 02:04 PM.


Mark Read
Powered by vBulletin® Version 3.8.1
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
© Greenguy Marketing Inc