View Single Post
Old 2008-03-12, 09:27 AM   #1
LD
wtfwjd?
 
LD's Avatar
 
Join Date: May 2007
Posts: 2,103
Question About the robots.txt file

Assuming I want everything crawled, should I just leave it out completely? Should I use this line in the header:

"<META NAME="ROBOTS" CONTENT="ALL">"

What's the best way to go about this when you want to get crawled?
__________________
Artisteer Wordpress Theme Generator Create Custom Themes!
My Little Network
LD is offline   Reply With Quote