![]() |
Getting rid of spiders that keep coming back
I've banned (via robots.txt and httpaccess) the BaiDu spider from my sites, but it still keeps showing up. I don't want traffic from China (not in my audience demograhic), so is there a good way to ban this thing, or get myself banned by the Great Firewall of Aforementioned Place?
(Maybe put "Facts on Tibet" or something in the metatag? |goodidea) |
My guess is if it's ignoring your robots.txt it's spoofing the UserAgent.
I'd try to narrow down the ip block and stop it via a firewall |
Firewall will be the most effective, but .htaccess would work as well. Try blockacountry.com
Best of Luck! |
Odds are if you are able to identify the BaiDu spider in your logs, maybe an htaccess rewrite rule would deal with it. Blocking by IP is easy but very fallible, using rewrite rules is more fun. Like feed them a 301 to a creative place...
|
All times are GMT -4. The time now is 11:53 AM. |
Powered by vBulletin® Version 3.8.1
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
© Greenguy Marketing Inc