View Single Post
Old 2005-06-28, 05:18 AM   #5
neveremail
Oh no, I'm sweating like Roger Ebert
 
neveremail's Avatar
 
Join Date: Apr 2005
Posts: 504
Just a more general question about 404s. What happens if my server temporarily goes down for say 24hrs and you bot happens to check at that time. Would you then pull all my sites - or does your bot check back a day later or something?
neveremail is offline   Reply With Quote