Greenguy's Board - View Single Post

pc · 2013-10-17, 04:16 PM

You can set the rules in robots.txt in your root of a domain but most both don't obey those.

2013-10-17, 04:16 PM	#3
pc Shift Out / X-On Join Date: Jul 2007 Location: unknown Posts: 2,298	You can set the rules in robots.txt in your root of a domain but most both don't obey those.