robots txt to prevent crawling of freesites

[virgohippy]

Originally Posted by Halfdeck

Preventing duplicate content is a legitimate reason for disallowing mirrors, however. A large percentage of supps under a domain may negatively impact the entire domain.

From an SEO POV for a LL, which would be worse:

Linking to a number of freesites on a domain with tons of dissallowed pages?

or

Linking to a number of freesites which may or may not be flagged for spam?

Seems to me most submitters aren't able to produce and submit more than a small handful of mirrors anyway.

Originally Posted by Mr. Blue

A little extra work, but feasibly 1 freesite can be optimized for a whole bunch of keywords depending on how many LL you're submitting to and how much you're changing the page.

As a submitter, I second your advice Mr. Blue.

Originally Posted by Preacher

I actually did this for a while but finally got tired of it and just left his sites in an error/delisted status...

Not only that, but the occasional bot check of existing listings must surely make regular check ups yet even more fun.