Greenguy's Board - View Single Post

Halfdeck · 2005-10-07, 01:42 AM

I personally never thought of it before, but the robot.txt thing is a nice idea. Like Magnoody said, with duplicate content pages, you won't be getting SE traffic or PR even if there was no robots.txt there. If more LLs allowed people to link multiple index.htmls to one main.html, I wonder if this would ever be a problem.

2005-10-07, 01:42 AM	#1
Halfdeck You can now put whatever you want in this space :) Join Date: Oct 2004 Location: New Haven, CT Posts: 985	I personally never thought of it before, but the robot.txt thing is a nice idea. Like Magnoody said, with duplicate content pages, you won't be getting SE traffic or PR even if there was no robots.txt there. If more LLs allowed people to link multiple index.htmls to one main.html, I wonder if this would ever be a problem. __________________ Success is going from failure to failure without a loss of enthusiasm.