Quote:
|
Originally Posted by Chop Smith
If this was in Celtic's robots.txt file, would it have caused his problem?
"User-agent: *
Crawl-Delay: 20"
|
Just to clarify - I didn't put the robots.txt file up - like alot of webmasters (I'm presuming) I didn't have a robots.txt file up but I'm presuming that when I was trying out a link list/directory script and it was put up during the install and when I took the script down alas it remained unnoticed. Not sure if it was the cause of my downfall but after searching the domain it was the only thing suspect I could find.