Greenguy's Board - View Single Post

rooty · 2009-07-10, 11:37 AM

Im not using this method yet as im not building freesites at the rate most people do but this sounds like a reasonable way of doing it maybe

adding this to your robots.txt

Code:

Sitemap: http://www.urdomain.tld/sitemap.xml

User-agent: *
Disallow: /freesites/porn/freesite-mirror.html
Disallow: /freesites/porn/freesite-mirror2.html

then adding the url's you would like to be indexed to the sitemap file

2009-07-10, 11:37 AM	#7
rooty A woman is like beer. They look good, they smell good, and you'd step over your own mother just to get one! Join Date: Sep 2008 Posts: 51	Im not using this method yet as im not building freesites at the rate most people do but this sounds like a reasonable way of doing it maybe adding this to your robots.txt Code: Sitemap: http://www.urdomain.tld/sitemap.xml User-agent: * Disallow: /freesites/porn/freesite-mirror.html Disallow: /freesites/porn/freesite-mirror2.html then adding the url's you would like to be indexed to the sitemap file __________________ Nothing to see here really - My boring blog