Linking To Mirrors & Penalties?

[LowryBigwood]

Originally Posted by Sleep[Walker]

I think you can be banned by LLs for using robots.txt to disallow SE to crawl freesites. Link list are giving recips not only for direct clicks on your warning page, but also to have inbound links. And if you put your freesite's warning page into robots.txt, all the LLs' links won't come into count. Maybe you're allowed to include gallery pages... i don't know.

Good point. I agree, even though they may be duplicate or near dupe pages it's probably not a good idea to disallow them to the search engines as some LL owners will not like it. One submitter doing that here and there isn't going to make a difference to the LL owner as we're linking to thousands of these pages like this already.