Thread: robot.txt
View Single Post
Old 2009-07-13, 12:48 AM   #1
faxxaff
I've always wondered if there was a god. And now I know there is -- and it's me
 
Join Date: Mar 2005
Location: Vietnam
Posts: 326
A lot of robots including Googlebot will do nothing but ignore a robots.txt file.
faxxaff is offline   Reply With Quote