 |
|
|
|
|
|
|
|
|
2003-04-02, 11:23 AM
|
#3 |
|
The Original Greenguy (Est'd 1996) & AVN HOF Member - I Crop Pics For Thumbs In My Sleep
Join Date: Feb 2003
Location: Blasdell, NY (shithole suburb south of Buffalo)
Posts: 41,929
 |
I think that when they spider, they would look at whatever is on the page at them time, but I also have to assume that it depends alot on the file extension on the page (you don't see alot of cgi pages in the SE results)
But of course I am just guessing  Let me see if I can scare up a few people that know a little more about this than I do |
|
|
|
|
Threaded Mode