Google Bot Info request

[Halfdeck]

Originally Posted by Mattinblack

(Tip dont submit index pages in sub-directories to google! Have the index pages in case people nav to the directory by accident but never link to them from anywhere and dissalow them in Robots Txt.)

True, linking to index.htm/html can cause a havoc.

Note: Don't rely solely on robots.txt since Google likes to ignore it in some cases.