Quote:
Originally Posted by bDok
On my splog networks this is what I did and it really helped to drive the amount of indexed pages through the roof.
|
Now that's interesting as I had the same happen to me. My sites that have a robots.txt file get more pages indexed and they get indexed quicker than sites without one.