Greenguy's Board - robots.txt do you need to have one?

Greenguy's Board (http://www.greenguysboard.com/board/index.php)

- Search Engines (http://www.greenguysboard.com/board/forumdisplay.php?f=13)

- - robots.txt do you need to have one? (http://www.greenguysboard.com/board/showthread.php?t=11648)

Klove

2004-09-29 03:04 PM

robots.txt do you need to have one?

do you need to have one, or can you survive without one?

DangerDave

2004-09-29 04:27 PM

Klove you don't NEED to have one.. but if you have /dirs/ you want robots to stay out of... then yes... it's worth having one.

DD

Klove

2004-09-29 04:27 PM

Thank you, I want it to sniff my entire domain! ;P

All times are GMT -4. The time now is 02:56 PM.