Greenguy's Board - View Single Post

Alphawolf · 2004-04-14, 09:11 PM

Only thing with Xenu is that it doesn't obey robots.txt unless that has changed with newer versions.

It's on his Future features List:

http://home.snafu.de/tilman/xenulink.html

2004-04-14, 09:11 PM	#12
Alphawolf Don't come to Florida for vacation. We're closed. Join Date: Nov 2003 Location: Orlando, Florida Posts: 1,874	Only thing with Xenu is that it doesn't obey robots.txt unless that has changed with newer versions. It's on his Future features List: http://home.snafu.de/tilman/xenulink.html __________________ Regards, AW Weekly Pay. Sites That Convert. Start Pimpin' Today!