robots txt to prevent crawling of freesites

[Carrie]

Originally Posted by DJilla

My guess is that lower sales is due to more competition.

Probably a good part of it. I'd love to know if the # of submitters has grown, shrunk, or remained pretty steady over the past 4 years or so. That would be interesting.

I think another factor in less sales might be the sheer number of sites that the larger LLs have in their archives. The ones that have been around a few years have a few hundred thousand sites in there, most likely. I was never up for the "remove the listing after 3/6 months" (because sometimes the SEs don't even notice you for that long or they sandbox you for a while to see if you're gonna stick around), but I'm starting to think that dumping sites that are over a year old might help the submitters make more sales. There would still be a ton of sites to keep the bookmarkers around looking at the LLs ads, so maybe it wouldn't negatively affect the LL owners to do this. Would love your take on it D.