View Single Post
Old 2013-10-17, 01:39 PM   #1
mOrrI
You can now put whatever you want in this space :)
 
mOrrI's Avatar
 
Join Date: Feb 2004
Location: Portugal
Posts: 1,083
Question Blocking Unknown Robots/Spiders?

So you guys do care on what scans your domains?

if so what techniques do you guys use?

I came across this blog post:

http://michael.langley.id.au/blog/posts/28

Dunno if it is the better way to do this kind of thing...

I'm interested in this because I check the stats on one of mine domains and got a lot of unknown robots...

__________________
mOrrI is offline   Reply With Quote