View Single Post
Old 2006-02-20, 08:06 AM   #3
DJilla
You can now put whatever you want in this space :)
 
DJilla's Avatar
 
Join Date: Sep 2005
Posts: 525
Send a message via ICQ to DJilla
Quote:
Originally Posted by Halfdeck
I personally never thought of it before, but the robot.txt thing is a nice idea. Like Magnoody said, with duplicate content pages, you won't be getting SE traffic or PR even if there was no robots.txt there. If more LLs allowed people to link multiple index.htmls to one main.html, I wonder if this would ever be a problem.
I hope I'm not getting myself in trouble and if anyone has a problem with the practice I hope they'll post it in a response but:

After considering the robots.tx idea a ways back I kind of thought that people who weren't really up on its reason could get freaked out so I passed. BUT, I have begun using your second idea and haven't had any bad feedback. Everybody wants an index page recip so just give it to them. Obviously everybody can't be with penisbot or jays so I've arranged the folders to refer back to a "pages" folder all within the same particular free site sub folder. I'm very careful to change keywords, titles, content tages, and the warning page text on each index page so no duplicates exist.

This way I can watch traffic and see which recips really deliver the best and it gives me the chance to keep people together who like to be together. Maybe I'll get more listings and I understand that getting listings and PR in Google is important for every linklist too, not just direct traffic so I've done this so that I and they can benefit too.

IMHO as a new linklist owner and a long time self employed person I think it is just downright impolite (I can't say unprofessional because it is too common) not to notify a submitter of your successful relationship. I think unless you are one of the top 20 LL's it also helps to build goodwill with the submitters.

Re: Hacking. I'm not a lawyer of course but I'm pretty sure to qualify for hacking the owner has to make an effort to put some barrier or security on the file or at minium perhaps provide a notice and the user has to make an effort to circumvent this barrier (the barrier indicates intention of privacy). Something that is freely accessiable by typing in a url like www.domain/robots.txt probably wouldn't rise to that level. I may be wrong though.
DJilla is offline   Reply With Quote