404 Trap ads

poornpig · 2008-08-05, 03:15 AM

If the 404 Error Page is set up in the .htaccess, the request returned already a 404.

For a crawler of a searchengine it would look like this:

Host example.com
GET /something.html HTTP/1.1
-> 404

<html>
....

Now it is the question if the crawler fetches the 404 error page. I have not noticed, that google or yahoo are doing this.
Google does it only if you use the webmaster tools and verify your domain. This is to check if your server does return the 404 correctly.

A normal client (not everyone) would see the same as above but it would render the html send by the webserver.

this would be the 404 error page, which is send by the webserver.

Now i could ask why do you have 404? is it good not to dispaly an error message?

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes	Rate This Thread
Switch to Linear Mode Switch to Hybrid Mode Threaded Mode	Rate This Thread:

2008-08-05, 03:15 AM	#8
poornpig Rock stars ... is there anything they don't know? Join Date: Aug 2008 Posts: 16	If the 404 Error Page is set up in the .htaccess, the request returned already a 404. For a crawler of a searchengine it would look like this: Host example.com GET /something.html HTTP/1.1 -> 404 <html> .... Now it is the question if the crawler fetches the 404 error page. I have not noticed, that google or yahoo are doing this. Google does it only if you use the webmaster tools and verify your domain. This is to check if your server does return the 404 correctly. A normal client (not everyone) would see the same as above but it would render the html send by the webserver. this would be the 404 error page, which is send by the webserver. Now i could ask why do you have 404? is it good not to dispaly an error message?