|
2008-12-07, 08:20 PM | #1 |
Oh no, I'm sweating like Roger Ebert
|
Please Pull any links to...
XXX Blog Index, XXX Blog Maniac (Porn Tags), Porn Blog Surfer and Pure Porn Fed.
I'm really sorry to be doing this but it seems I have little choice. I've got 4 mega-blogs that unfortunately continue to melt down servers. It started about 4 years ago and was probably the cause of my major server data base loss of a couple years ago. Each blog has over 10k in posts, both hand written and RSS and get between 4-6k uniques a day, depending on the site. I've been through two different and respected hosts and more hosting plans than one can shake a stick at including dedicated server packages but everytime I get things stable I've got 3 months of peace and then the hell starts all over again. I've been through WP-Cache, super-cache, Xcache, memcached, eAccelerator and just about anything else you can think of that is supposed to help stabilize large WP blogs. I've spent way to much time with this and everything else I've been trying to do has suffered for it. I'm going to work on stabilizing my remaining blogs, moving things like galleries out of the blog and as separate pages from the blog, build more sales pages and SEO pages and simply work on building back up my traffic network with the balance of that traffic not being to a blogging script and rather than running the traffic through the blog I'll use the blog as a traffic source for my other projects. Sorry about the inconvenience but I really don't see where I have much of a choice. |
2008-12-07, 10:40 PM | #2 |
You can now put whatever you want in this space :)
Join Date: Nov 2006
Location: Vulcan
Posts: 695
|
Sorry to that Walrus , I think we have exchanged links in the past - will look and pull them today.
Seems like what you are saying is that if one becomes too successful with your blogging you'll become a victim of your own success. |
2008-12-08, 08:32 AM | #3 |
Shift Out / X-On
|
Totally Understandable Walrus.
I pulling your links down. |
2008-12-08, 09:48 AM | #4 |
Of all the things I've lost, I miss my mind the most.
|
I'll pull your links down too. Why do large blogs do this, is it because they are all php and the constant queries melt the server down, or use up all the cache?
I know when I posted up hun galleries on my domains with a blog in the root, just running through the standard .htaccess for every hit due to the permalink rewrite caused my apache to keep crashing. Is it from something like this, or just from blog traffic? Curious, because I don't want to be in your shoes a year down the road if the blogs we have become large and successful.
__________________
Our 3D Comics and Props on Renderotica |
2008-12-08, 10:49 AM | #5 |
If you really need money, you can sell your kidney or even your car
Join Date: Apr 2007
Posts: 374
|
I'm sorry to hear that walrus, I've pulled your links.
If and when you get things back to speed let me know and we'll link back up. |
2008-12-08, 11:08 AM | #6 |
That which does not kill us, will try, try again.
|
Damn, that sucks, Walrus.
Seems there should be some kind of script which could make static copies of those 40K post pages so you could keep them all online and monetize them with not much server hit at all. Otherwise it really sucks even worse.
__________________
"If you're happy and you know it, think again." -- Guru Pitka |
2008-12-08, 06:02 PM | #7 |
old enough to be Grandma Scrotum
|
Sorry to hear that Walrus, I'll pull your links
__________________
Promote Bright Desire |
2008-12-08, 06:32 PM | #8 |
You can now put whatever you want in this space :)
Join Date: Feb 2007
Location: Australia
Posts: 658
|
Walrus - did you try to import them into an alternative blog/cms - on the textpattern site it states that the amount of articles/posts has no effect on speed (http://textpattern.com/faq/79/how-ma...pattern-handle) and I know it has a WP import feature
|
2008-12-08, 06:51 PM | #9 |
a.k.a. Sparky
Join Date: Sep 2004
Location: West Palm Beach, FL, USA
Posts: 2,396
|
walrus, before you shut down -- your sites can be mirrored with static files so that they would just be archived and could run on a machine with very little impact on cpu. Then, you could figure out a new solution without tossing all of that work out the window.
__________________
SnapReplay.com a different way to share photos - iPhone & Android |
2008-12-08, 07:42 PM | #10 |
Formerly known as TekAngel
|
How do you do that? The mirrored part?
|
2008-12-08, 07:46 PM | #11 |
Oh no, I'm sweating like Roger Ebert
|
Ok, I've got everything still implace, how would one go about mirroring to static files?
|
2008-12-08, 08:00 PM | #12 |
Certified Nice Person
|
I think a common website ripper would make static copies.
__________________
Click here to purchase a bridge I'm selling. |
2008-12-08, 08:52 PM | #13 |
a.k.a. Sparky
Join Date: Sep 2004
Location: West Palm Beach, FL, USA
Posts: 2,396
|
any site ripper would work
if you're comfortable with wget, you could do something like: wget -r -l 99 http://site.com/ you MIGHT try it without adding -F to the command line which will put in <base href> for relative urls --limit-rate=300k would limit the fetch to 300k/second... if you do one site at a time, depending on the page composition, that might be enough to keep from killing the server when it spiders everything. It will put it in a directory structure which you can shuffle around. If a page is not linked to, it won't get spidered here, but, you can supply an input file of urls, so, if you have a sitemap, you could parse that to pull the pages not internally crosslinked. With wordpress, I don't think this is a problem.
__________________
SnapReplay.com a different way to share photos - iPhone & Android |
2008-12-08, 09:00 PM | #14 |
Oh no, I'm sweating like Roger Ebert
|
I'll give it a shot, but probably not for a couple days. I would love to have this work, the sites might not be dynamic but at least they would be alive.
|
2008-12-09, 02:10 AM | #15 | |
Remember to rebel against the authorities, kids!
Join Date: Aug 2003
Location: AU
Posts: 406
|
Quote:
cd34 (Chris) really, really, really knows his onions. (I'd also reccommend his hosting, colo-cation.com, in a heartbeat).
__________________
XXX Porno Hardcore |
|
2008-12-09, 11:28 AM | #16 |
ICQ:147*079*406
|
Damn, Walrus, hope that there is a solution for you, other than shutting them down.
__________________
The Sexy Side of Porn |
2008-12-09, 11:50 AM | #17 |
bang bang
|
No clue, but it would be nice if there was something that could turn a wordpress site into a static site. So at least you could keep the site up and running.
|
2008-12-09, 01:41 PM | #18 |
Oh no, I'm sweating like Roger Ebert
|
Trust me, the thought of throwing away 4 years of work was not an enticing thought so if a site ripper can do the trick, I sure the fuck am going to give it a real try.
|
2008-12-09, 02:18 PM | #19 |
Formerly known as TekAngel
|
may want to try this walrus: http://www.httrack.com/
|
2008-12-13, 03:43 PM | #20 |
...and since we know an end will come it makes our living so much fun
|
I'll miss your pingbacks...
|
|
|