Tjid is all I have in my .htaccess file:
ErrorDocument 404
http://www.stars4porn.com/missing.html
AddType application/x-httpd-php .html
When I type in:
http://www.stars4porn.com/robots.txt I get my empy (almost) robots.txt file:
###############################
#
#
User-agent: *
#
# list folders robots are not allowed to index
#
Disallow:
Disallow:
Disallow:
Disallow:
#
# list specific files robots are not allowed to index
#
Disallow:
Disallow:
#
#
###############################
Everything seems to be working fine my problem is only with google:
When I use their robots.txt tool I get:
robots.txt file does not appear to be valid
Then it shows the default text of my robots.txt file but it shows the text on my 404 page not my blank (almost) robots.txt page.