UBB.Dev
Posted By: Calpy Forum slow, VPS isn't helpful, advice? options? - 02/11/2008 10:48 AM
Hi guys,
I'm excitedly awaiting the latest threads release with the other plebeians, but it's taking 20-50 seconds for the front page to load, and then subsequent movement from one page to the next in the forum is 5-15 seconds. And I'm no dummy with ten pal boxes and all that kinda stuff.

Here are the basic forum stats:
Board Statistics
Version: 7.1b5
Total Members: 1153
New in past 24 hours: 1
New in past 7 days: 15
New in past month: 62
Total Forums: 32
Total Topics: 17619
Total Posts: 266651

I have a VPS package with LiquidWeb, which honestly hasn't seemed worth the trouble, as most all my sites (I have 7 of varying popularity) rate as "Slow" or "Very Slow" on Alexa.

I ran the stat.php script in another thread on optimizing SQL and got this:
Quote
Mon Feb 11 00:41:49 PST 2008
top - 00:41:49 up 35 days,
7:44,
0 users,
load average: 1.58,
1.55,
1.49 Tasks: 87 total,
1 running,
86 sleeping,
0 stopped,
0 zombie Cpu(s): 7.7% us,
1.2% sy,
0.1% ni,
86.8% id,
4.2% wa,
0.0% hi,
0.0% si Mem: 1048576k total,
647712k used,
400864k free,
0k buffers Swap: 0k total,
0k used,
0k free,
0k cached PID USER PR NI %CPU TIME+ %MEM VIRT RES SHR S COMMAND 5150 nobody 15 0 0 0:00.01 0.1 1892 896 692 R top Http processes currently running = 24 Mysql processes currently running = 4 Netstat information summary 1 03 TIME_WAIT 1 06 TIME_WAIT 1 14 TIME_WAIT 1 16 TIME_WAIT 1 18 TIME_WAIT 1 2 TIME_WAIT 1 25 TIME_WAIT 1 26 TIME_WAIT 1 3 TIME_WAIT 1 43 TIME_WAIT 1 5 CLOSE 1 5 TIME_WAIT 1 55 TIME_WAIT 1 56 TIME_WAIT 1 58 TIME_WAIT 1 59 TIME_WAIT 1 63 FIN_WAIT2 1 86 TIME_WAIT 1 87 TIME_WAIT 1 88 TIME_WAIT 1 9 TIME_WAIT 1 90 FIN_WAIT2 1 97 TIME_WAIT 1 99 TIME_WAIT 2 CLOSE_WAIT 2 SYN_SENT 2 39 TIME_WAIT 2 6 TIME_WAIT 3 FIN_WAIT1 4 SYN_RECV 5 FIN_WAIT2 7 ESTABLISHED 10 CLOSE 29 LISTEN 52 TIME_WAIT

I also get emails like this every three days or so, since forever, from my VPS cpanel:
[Linked Image]
Well, you hae fine load (86% idle) on at least your allocated resources... could be that the "promised" resources aren't being lived up to... You could try another provider if they'e been giving you a lot of problems; I recommend clients for VPS' over to www.webintellects.com (Even our oown AA is there)
You have a lot of services failing and being restarted.

A few here and there is "normal" but that number, every 3 days, is too many.

I've no idea of they have lived up to what's advertised as I've no idea what you bought.

Did you finish tuning MySQL? Did it help?
I'm still working on it... I removed some things I liked having, such as some links generated by an rss feed from another of our sites and my Amazon affiliates box at the bottom of the page. I also deleted lots of redundant and large files from the server.

As it has done over the last few years, the speed has resolved down to 5-8 seconds of blank page and then everything loads. I never know if it's something I did, something they did or just the random tides of the internet. Sigh!

I will continue to work on optimizing MySQL and my database, and post what happens.

Is there any way to archive old posts so that they are still searchable, but don't figure in the daily default activities of the site's interaction with the database?
There are currently no archival options in UBB.T7; I've been pushing for several over at UBBCentral for a while now... Let's hope Rick has time to revisit the discussion for 7.4.
I'm at 1.6 million posts, and I would appreciate a simple way to archive.
i had a very similar problem with one customer.. 2.6 gig DB.. over 2 million posts..

1. tuned my.cnf properly -- mysqltuner.pl is very helpful
2. split the forum into 2 (archive.tld.com and forum.tld.com)

that made the forum.tld.com -- which is 95+% of the traffic scream.. zoom zoom..

then the archive.tld.com was used for searches back in time etc etc..

3. modified the DB for ubbt_POSTS to have a natural reverse time based index.. this made searches 10x faster..
4. added an 'archive these posts' option to copy from main to archive, when needed

works fine smile

so i wouldn't call it 'simple', but it works very well wink
"Simple" is always relative! I appreciate the ideas.
I have a construction like above, we just auto archive everything older then "x" days in certain forums.

Instead of manually selecting what to archive, we can manually select topics to keep, so that they stay in the main forum.

Archive forum is even on a different server in our case.

All in all, it's a few db+ubb changes (fields and code to keep/unkeep the topics), and one extra script that exports the topic data as mysql queries.

Sort of "archive.php" that as a result gives a mysql dump of one complete topic.

The receiving end needs to do cronjobs to receive the data, and run those queries. And afterwards call a fixup scripts that updates some tables in ubb with the new posts information.

I am more then willing to share the code, but I won't do this public here yet because "as-is" you need to be a bit of a techy. PM me if you want it.

Owh, and because our forum doesn't use attachments in any user forums, my archiving stuff does not take those in account.
© UBB.Developers