If you could build your own link list, what would you want?

[Greenguy]

Here's a couple of tips, my friend (even though I had to hear about this little project that you will own when you announced it on the board)

Originally Posted by Jim

Toplist

That's not really part of a Link List's admin, since it runs off the server stats & there's so many top list & ranking scripts out there that I wouldn't bother building something custom into an admin.

Checking for recips and changes to the pages daily

The recip part is easy - but the changes to the pages, this would be rather tricky - see, a TGP can check the galleries that it's linking to for html changes because (and someone correct me if I'm wrong) they check the characters on the page & keep a list of the page sizes that they are linking to - a change in the page size would mean a change in the html & thus, a verification process would have to take place. The big point is that it's only 1 page.

But Link Lists link to Free Sites, which are usually 4 pages, so you'd need to have the script spider the pages on the site & check the sizes for all of the pages. But the problem with that is if the site has any other links to pages on that domain (which is a very common thing with copyrights & extra links & 2257 stuff & whatnot) then the spider would either have to total up a lot of pages (assuming that all the links are not hard links with the domain in them, which would probably throw the spider off) OR the reviewer would have to tell the admin which pages to monitor & which pages to ignore & that seems like it'd be a HUGE pain in the ass.

Any other dreams of yours that I can crush?

[Jim]

Originally Posted by Greenguy

Here's a couple of tips, my friend (even though I had to hear about this little project that you will own when you announced it on the board)


That's not really part of a Link List's admin, since it runs off the server stats & there's so many top list & ranking scripts out there that I wouldn't bother building something custom into an admin.

The recip part is easy - but the changes to the pages, this would be rather tricky - see, a TGP can check the galleries that it's linking to for html changes because (and someone correct me if I'm wrong) they check the characters on the page & keep a list of the page sizes that they are linking to - a change in the page size would mean a change in the html & thus, a verification process would have to take place. The big point is that it's only 1 page.

But Link Lists link to Free Sites, which are usually 4 pages, so you'd need to have the script spider the pages on the site & check the sizes for all of the pages. But the problem with that is if the site has any other links to pages on that domain (which is a very common thing with copyrights & extra links & 2257 stuff & whatnot) then the spider would either have to total up a lot of pages (assuming that all the links are not hard links with the domain in them, which would probably throw the spider off) OR the reviewer would have to tell the admin which pages to monitor & which pages to ignore & that seems like it'd be a HUGE pain in the ass.

Any other dreams of yours that I can crush?

You are crushing Sparkys dreams if that is possible

[swedguy]

Originally Posted by Greenguy

But Link Lists link to Free Sites, which are usually 4 pages, so you'd need to have the script spider the pages on the site & check the sizes for all of the pages. But the problem with that is if the site has any other links to pages on that domain (which is a very common thing with copyrights & extra links & 2257 stuff & whatnot) then the spider would either have to total up a lot of pages (assuming that all the links are not hard links with the domain in them, which would probably throw the spider off) OR the reviewer would have to tell the admin which pages to monitor & which pages to ignore & that seems like it'd be a HUGE pain in the ass.

Any other dreams of yours that I can crush?

It is very doable. Mine gets it right 99 times out of 100.

[Verbal]

Originally Posted by Greenguy

But Link Lists link to Free Sites, which are usually 4 pages, so you'd need to have the script spider the pages on the site & check the sizes for all of the pages.

Well, why can't this be done? Have the bot spider each page, then add up the total size of the entire freesite and add up the total number of links for the freesite. Store these values to check against when the bot comes back later.

Don't listen to GG, Jim. if you guys get this going I'll be one of your first customers. Now get coding already!

[Greenguy]

Originally Posted by Verbal

Well, why can't this be done? Have the bot spider each page, then add up the total size of the entire freesite and add up the total number of links for the freesite. Store these values to check against when the bot comes back later.

Re-read my entire post my friend

[Verbal]

Originally Posted by Greenguy

Re-read my entire post my friend

Ah, I just re-read it and noticed I've totally overlooked your point (and a good one). So I have to agree with you, the freesite link-checker would certainly be a bitch to code without some sort of crazy limits on where it goes and stores. I would sure hate to code this thing.

Now I'm interested in how Swedguy has implemented this so that it works so well.

[swedguy]

Originally Posted by Verbal

Now I'm interested in how Swedguy has implemented this so that it works so well.

It's not that hard actually.

Go to the index page and fetch all links, keep all links that are 1 dir deep (works on 99% of all sites). I'll fine tune that part when I get some time over. It should be dynamic depending on how many dirs deep the original site is.

Now we have a bunch of links that the script thinks are main page links. Fetch all links on the "main" page and keep the ones that are 1 dir deep. Go to the links and see if it has links to images, if it doesn't, discard it, it's not a gallery. If it does, keep it.

Now we have an index, main, gallery and images trail that we can do whatever we want to do with

There are some other filters. But that's the basics of it.