 |
|
|
|
|
|
|
|
|
2005-10-06, 09:22 AM
|
#1 |
|
Shut up brain, or I'll stab you with a Q-tip!
Join Date: May 2005
Location: Everywhere
Posts: 119
 |
Robots.txt & freesites ?
What's your opinion on this one?
I was checking broken links today and found out that site below have robots.txt file that disallow SE spiders to see these pages. http://www.titfuckingxxx.com/free/hu...y-fucking/xxx/ Personally, I would like to see freesites submitted to my sites listed in SEs as well, so I deleted this one. |
|
|
|
|
Threaded Mode