Quote:
Originally Posted by JK
If I am reading your post correctly, you're saying that the referrer was from robots.txt.....
|
Yes, but the problem is that there is
NO robots.txt on that domain! However all the search engines appear to have refused to list that domain, as though there was a robots.txt file with a "no list" rule! So I was asking if it is possible for there to be a hidden robots.txt file that does not show up on FTP?