 |
|
|
|
|
|
|
|
|
|
|
2007-02-08, 04:24 AM
|
#1 |
|
I want to set the record straight - I thought the cop was a prostitute
Join Date: May 2004
Location: Serbia & Montenegro
Posts: 292
 |
robots.txt tells search engines what NOT to index on your site. It's useful to "hide" your site administration consoles (for example) from SEs.
What tools do you use to search for the file? And why? |
|
|
|
2007-02-08, 02:51 PM
|
#2 |
|
They have the Internet on computers, now?
Join Date: Apr 2005
Posts: 148
|
I used the google tool and another website that I didn't bookmark.
Both showed an error message of: Success (200) robots.txt file does not appear to be valid Then it shows the default text of my robots.txt file but it shows the text on my 404 page not my blank robots.txt page. |
|
|
|
 |
|
|
Hybrid Mode
