CPU Overload

Today i faced a CPU overload and my hosting suspended my account without any notice. first time it happens since 2 years and i did not know what caused that for my server. I do not use any scripts. They asked me to fix this problem so that they will unsuspened my account. but the problem is i have no idea what to do or fix.

I need to know what exactly Dolphin causes this problem CPU overload is it members login or uploading too many photos .... I need to know so that i can fix the problem and will not happen in the future.

I am using VPS

 

Web Space 100GB Traffic    (Bandwidth) 1500GB    RAM 1024MB    CPU 1.2Ghz    Number of CPU�s 2

That was there message:

toottii.com was overloading your server and causing instability on main VPS node. Below is full abuse report with apache usage output which shows exactly which URLs caused overload.
Please check and let us know what will be done to prevent these kind of overloads.

[---START REPORT---]
1090527 !! 2.6/- 0.2/- 2/140/MAX 21.8/3.4 103/MAX 0 1323 216.246.90.51

root@server [/]# w;ps aufx;service httpd fullstatus;mysqladmin pr;free -m;
10:34:47 up 15 days, 17:48, 0 users, load average: 6.03, 5.13, 4.16
USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT
USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
root 1 0.0 0.0 2156 668 ? Ss May07 0:26 init [3]
root 1140 0.0 0.0 2260 548 ? Sroot 1245 0.0 3.1 32744 32728 ? Sroot 1491 0.0 0.0 1812 572 ? Ss May07 0:17 syslogd -m 0
root 1516 0.0 0.0 1744 420 ? S May07 0:00 /usr/sbin/courierlogger -pid=/var/spool/authdaemon/pid -facility=mail -start /usr/libexec/courier-authlib/authdaemond
root 1517 0.0 0.0 2088 632 ? S May07 0:00 \_ /usr/libexec/courier-authlib/authdaemond
root 1534 0.0 0.0 2088 372 ? S May07 0:00 \_ /usr/libexec/courier-authlib/authdaemond
root 30195 0.0 0.2 4596 2772 ? S May20 0:05 | \_ /etc/authlib/authProg
root 1535 0.0 0.0 2088 372 ? S May07 0:00 \_ /usr/libexec/courier-authlib/authdaemond
root 19460 0.0 0.2 4596 2828 ? S May09 0:08 \_ /etc/authlib/authProg
root 1536 0.0 0.1 7240 1052 ? Ss May07 0:15 /usr/sbin/sshd
root 1547 0.0 0.0 2832 860 ? Ss May07 0:00 xinetd -stayalive -pidfile /var/run/xinetd.pid
root 1559 0.0 0.1 2548 1156 ? S May07 0:00 /bin/sh /usr/bin/mysqld_safe --datadir=/var/lib/mysql --pid-file=/var/lib/mysql/server.Toottii.com.pid
mysql 1583 6.3 12.8 305520 134236 ? Sl May07 1449:30 \_ /usr/sbin/mysqld --basedir=/ --datadir=/var/lib/mysql --user=mysql --pid-file=/var/lib/mysql/server.Toottii.com.pid --skip-external-locking
root 1706 0.0 0.0 1744 424 ? S May07 0:00 /usr/sbin/courierlogger -pid=/var/run/imapd.pid -start -name=imapd /usr/lib/courier-imap/libexec/couriertcpd -address=0 -maxprocs=30 -maxperip=15 -nodnslookup -noidentlookup 143 /usr/lib/courier-imap/sbin/i
root 1707 0.0 0.0 1856 532 ? S May07 0:00 \_ /usr/lib/courier-imap/libexec/couriertcpd -address=0 -maxprocs=30 -maxperip=15 -nodnslookup -noidentlookup 143 /usr/lib/courier-imap/sbin/imaplogin /usr/lib/courier-imap/bin/imapd Maildir
root 1713 0.0 0.0 1744 424 ? S May07 0:00 /usr/sbin/courierlogger -pid=/var/run/imapd-ssl.pid -start -name=imapd-ssl /usr/lib/courier-imap/libexec/couriertcpd -address=0 -maxprocs=30 -maxperip=15 -nodnslookup -noidentlookup 993 /usr/lib/courier-ima
root 1714 0.0 0.0 1856 532 ? S May07 0:00 \_ /usr/lib/courier-imap/libexec/couriertcpd -address=0 -maxprocs=30 -maxperip=15 -nodnslookup -noidentlookup 993 /usr/lib/courier-imap/bin/couriertls -server -tcpd /usr/lib/courier-imap/sbin/imaplogin /us
root 1719 0.0 0.0 1744 424 ? S May07 0:02 /usr/sbin/courierlogger -pid=/var/run/pop3d.pid -start -name=pop3d /usr/lib/courier-imap/libexec/couriertcpd -address=0 -maxprocs=30 -maxperip=15 -nodnslookup -noidentlookup 110 /usr/lib/courier-imap/sbin/p
root 1720 0.0 0.0 1856 532 ? S May07 0:03 \_ /usr/lib/courier-imap/libexec/couriertcpd -address=0 -maxprocs=30 -maxperip=15 -nodnslookup -noidentlookup 110 /usr/lib/courier-imap/sbin/pop3login /usr/lib/courier-imap/bin/pop3d Maildir
root 1725 0.0 0.0 1744 424 ? S May07 0:00 /usr/sbin/courierlogger -pid=/var/run/pop3d-ssl.pid -start -name=pop3d-ssl /usr/lib/courier-imap/libexec/couriertcpd -address=0 -maxprocs=30 -maxperip=15 -nodnslookup -noidentlookup 995 /usr/lib/courier-ima
root 1726 0.0 0.0 1856 536 ? S May07 0:00 \_ /usr/lib/courier-imap/libexec/couriertcpd -address=0 -maxprocs=30 -maxperip=15 -nodnslookup -noidentlookup 995 /usr/lib/courier-imap/bin/couriertls -server -tcpd /usr/lib/courier-imap/sbin/pop3login /us
root 1814 0.0 10.2 144700 107464 ? Ssl May07 2:11 /usr/sbin/clamd
mailnull 1821 0.0 0.2 9352 2276 ? Ss May07 0:02 /usr/sbin/exim -bd -q60m
root 1845 0.0 2.9 34460 31016 ? Ss May07 1:12 /usr/local/bin/spamd -d --allowed-ips=127.0.0.1 --pidfile=/var/run/spamd.pid --max-children=3 --max-spare=1
root 21558 0.0 3.0 34900 31492 ? S May22 0:19 \_ spamd child
root 1857 0.0 2.2 78088 23812 ? Ss May07 3:01 /usr/local/apache/bin/httpd -k start -DSSL
root 7650 0.0 1.0 28144 10584 ? S 10:05 0:00 \_ /usr/local/apache/bin/httpd -k start -DSSL
nobody 7651 3.8 2.5 83188 26300 ? S 10:05 1:07 \_ /usr/local/apache/bin/httpd -k start -DSSL
nobody 7664 4.0 2.5 83188 26300 ? S 10:05 1:10 \_ /usr/local/apache/bin/httpd -k start -DSSL
nobody 7667 3.9 2.4 82668 25888 ? S 10:05 1:09 \_ /usr/local/apache/bin/httpd -k start -DSSL
nobody 7838 4.1 3.2 91260 34552 ? S 10:10 1:00 \_ /usr/local/apache/bin/httpd -k start -DSSL
nobody 7928 3.2 2.6 83804 27684 ? S 10:12 0:43 \_ /usr/local/apache/bin/httpd -k start -DSSL
nobody 8005 3.6 2.7 86016 28788 ? S 10:15 0:43 \_ /usr/local/apache/bin/httpd -k start -DSSL
nobody 8054 3.6 2.5 83452 26444 ? S 10:16 0:40 \_ /usr/local/apache/bin/httpd -k start -DSSL
nobody 8060 4.2 2.7 85312 28424 ? S 10:17 0:44 \_ /usr/local/apache/bin/httpd -k start -DSSL
nobody 8068 3.9 2.7 86148 29256 ? S 10:18 0:38 \_ /usr/local/apache/bin/httpd -k start -DSSL
nobody 8069 4.1 2.3 81212 24324 ? S 10:18 0:39 \_ /usr/local/apache/bin/httpd -k start -DSSL
nobody 9248 5.2 2.7 86016 28568 ? S 10:27 0:23 \_ /usr/local/apache/bin/httpd -k start -DSSL
nobody 9252 2.9 2.7 86084 28928 ? S 10:27 0:12 \_ /usr/local/apache/bin/httpd -k start -DSSL
nobody 9255 4.7 2.5 83456 26424 ? S 10:27 0:19 \_ /usr/local/apache/bin/httpd -k start -DSSL
nobody 9331 3.9 2.5 83460 26600 ? S 10:30 0:10 \_ /usr/local/apache/bin/httpd -k start -DSSL
nobody 9332 2.8 2.6 85504 28092 ? S 10:30 0:07 \_ /usr/local/apache/bin/httpd -k start -DSSL
nobody 9333 2.9 2.7 85508 28352 ? S 10:30 0:07 \_ /usr/local/apache/bin/httpd -k start -DSSL
nobody 9378 2.4 2.4 82940 26164 ? S 10:31 0:04 \_ /usr/local/apache/bin/httpd -k start -DSSL
nobody 9379 3.6 2.4 82752 25524 ? S 10:31 0:06 \_ /usr/local/apache/bin/httpd -k start -DSSL
nobody 9388 3.0 2.8 87628 30392 ? S 10:33 0:03 \_ /usr/local/apache/bin/httpd -k start -DSSL
nobody 9389 10.1 2.7 86080 28996 ? S 10:33 0:10 \_ /usr/local/apache/bin/httpd -k start -DSSL
nobody 9392 2.4 2.6 85028 27952 ? S 10:33 0:02 \_ /usr/local/apache/bin/httpd -k start -DSSL
nobody 9393 1.2 2.6 85492 27652 ? S 10:33 0:01 \_ /usr/local/apache/bin/httpd -k start -DSSL
nobody 9394 2.5 2.4 82680 25396 ? S 10:33 0:01 \_ /usr/local/apache/bin/httpd -k start -DSSL
nobody 9398 2.6 2.4 82680 25380 ? S 10:34 0:00 \_ /usr/local/apache/bin/httpd -k start -DSSL
root 1870 0.0 0.1 5416 1540 ? Ss May07 0:01 pure-ftpd (SERVER)
root 1872 0.0 0.1 5084 1156 ? S May07 0:00 /usr/sbin/pure-authd -s /var/run/ftpd.sock -r /usr/sbin/pureauth
root 1880 0.0 0.1 3328 1108 ? Ss May07 0:11 crond
root 1888 0.0 0.0 2356 468 ? Ss May07 0:00 /usr/sbin/atd
root 3081 0.0 0.1 3944 1972 ? S May07 0:06 cPhulkd - processor
root 3119 0.0 0.7 15152 7828 ? S May07 0:08 cpdavd - accepting connections on 2077 and 2078
root 3125 0.0 0.2 5012 3136 ? S May07 0:03 queueprocd - wait to process a task
root 3198 0.0 0.5 8608 5432 ? S May07 2:10 tailwatchd
root 3206 0.0 0.1 4188 1848 ? SN May07 0:01 cpanellogd - sleeping for logs
root 3251 0.0 0.0 5684 716 ? Ss May07 0:00 /usr/sbin/saslauthd -m /var/run/saslauthd -a pam -n 2
root 3253 0.0 0.0 5684 432 ? S May07 0:00 \_ /usr/sbin/saslauthd -m /var/run/saslauthd -a pam -n 2
root 3272 0.0 0.0 1924 676 ? Ss May07 0:00 /usr/sbin/portsentry -tcp
named 3328 0.0 0.3 50576 3864 ? Ssl May07 0:08 /usr/sbin/named -u named
root 3360 0.0 0.8 15876 8580 ? S May07 0:40 cpsrvd (SSL) - waiting for connections
postgres 11970 0.0 0.3 19176 3304 ? S May22 0:00 /usr/bin/postmaster -p 5432 -D /var/lib/pgsql/data
postgres 12004 0.0 0.0 8956 876 ? S May22 0:05 \_ postgres: logger process
postgres 12006 0.0 0.1 19176 1080 ? S May22 0:23 \_ postgres: writer process
postgres 12007 0.0 0.0 9956 808 ? S May22 0:00 \_ postgres: stats buffer process
postgres 12008 0.0 0.0 9136 988 ? S May22 0:00 \_ postgres: stats collector process
root 9399 0.0 0.0 10448 392 ? Ss 10:34 0:00 vzctl: pts/0
root 9400 0.0 0.1 2548 1316 pts/0 Ss 10:34 0:00 \_ -bash
root 9450 0.0 0.1 2940 1152 pts/0 S 10:34 0:00 \_ su
root 9451 0.0 0.1 2548 1292 pts/0 S 10:34 0:00 \_ bash
root 9462 0.0 0.0 2264 836 pts/0 R 10:34 0:00 \_ ps aufx

Apache Server Status for localhost

Server Version: Apache/2.2.11 (Unix) mod_ssl/2.2.11
OpenSSL/0.9.8e-fips-rhel5 DAV/2 mod_auth_passthrough/2.1
mod_bwlimited/1.4 FrontPage/5.0.2.2635 PHP/5.2.9

Server Built: Apr 28 2009 11:38:02
_________________________________________________________________

Current Time: Wednesday, 23-May-2012 10:34:52 EEST
Restart Time: Monday, 07-May-2012 16:49:06 EEST
Parent Server Generation: 204
Server uptime: 15 days 17 hours 45 minutes 46 seconds
Total accesses: 1767475 - Total Traffic: 1.3 GB
CPU Usage: u791.16 s61.38 cu.01 cs0 - .0627% CPU load
1.3 requests/sec - 993 B/second - 764 B/request
18 requests currently being processed, 6 idle workers

L_KW__W___WKKWWWWWWWK.KWW.......................................
................................................................
................................................................
................................................................

Scoreboard Key:
_ Waiting for Connection, S Starting up, R Reading Request,
W Sending Reply, K Keepalive (read), D DNS Lookup,
C Closing connection, L Logging, G Gracefully finishing,
I Idle cleanup of worker, . Open slot with no current process

Srv PID Acc M CPU SS Req Conn Child Slot Client VHost Request
0-204 8054 35/226/116983 L 41.17 0 0 1.5 0.05 82.63 195.66.129.33
toottii.com GET /m/photos/get_image/browse/4b6278688de18e5f57f39e09fd9d8064
1-204 7664 0/328/114726 _ 70.83 3 352 0.0 0.15 84.20 82.146.178.50
toottii.com GET /flash/XML.php?module=im&action=updateInvite&recipient=1371
2-204 7667 1/311/112208 K 69.47 0 1244 0.1 0.28 84.18 85.112.95.23
toottii.com GET /flash/XML.php?module=im&action=updateInvite&recipient=89&_
3-204 9248 54/114/116611 W 23.71 7 0 4.9 0.02 79.98 195.66.129.33
toottii.com GET /member_menu_queries.php?action=get_bubbles_values&bubbles=
4-204 9378 0/20/110442 _ 4.25 20 798 0.0 0.00 78.76 85.112.95.23 toottii.com
GET /m/spy/check_updates/global/157194/all&_r=0.603943594135884
5-204 8060 0/239/107641 _ 44.24 8 9842 0.0 0.53 72.81 85.112.95.23
toottii.com POST /modules/?r=simple_messenger/get_operation/new_messages&_r
6-204 8005 3/229/104265 W 42.97 8 0 0.3 0.11 73.43 82.146.178.50 toottii.com
GET /m/spy/check_updates/global/157194/all/7&_r=0.4894635966047
7-204 9379 0/30/101699 _ 6.27 5 230 0.0 0.00 66.50 82.146.178.50 toottii.com
GET /m/profile_customize/customizepage/background/form&_r=0.665
8-204 7928 0/206/99892 _ 43.59 10 10719 0.0 0.41 68.68 82.146.178.50
toottii.com POST /modules/?r=simple_messenger/get_operation/new_messages&_r
9-204 9398 0/5/94690 _ 0.98 19 216 0.0 0.00 71.95 82.146.178.50 toottii.com
GET /flash/XML.php?module=im&action=updateInvite&recipient=794&
10-204 8068 92/257/88002 W 38.04 9 0 55.0 0.62 63.87 109.110.115.15
toottii.com GET /member_menu_queries.php?action=get_bubbles_values&bubbles=
11-204 9331 17/46/80919 K 11.11 0 504 0.7 0.03 58.36 195.66.129.33
toottii.com GET /m/photos/get_image/browse/4cf348ff639bf2cf9b093ff89e3d626d
12-204 8069 43/187/68817 K 40.53 0 1749 1.7 0.08 49.65 195.66.129.33
toottii.com GET /m/photos/get_image/browse/8c4cb7d382bb702b27e10a3d5162dea0
13-204 9388 3/15/67316 W 2.92 8 0 0.3 0.00 45.49 82.146.178.50 toottii.com
GET /m/spy/check_updates/global/157194/all&_r=0.841988678323105
14-204 7838 34/296/61358 W 60.49 5 0 26.4 0.09 47.31 109.110.115.15
toottii.com GET /member_menu_queries.php?action=get_bubbles_values&bubbles=
15-204 9332 1/37/52013 W 7.08 35 0 0.0 0.03 40.00 82.146.178.50 toottii.com
GET /modules/ibdw/3col/query_request.php?_=1337758454349 HTTP/1
16-204 7651 0/342/43345 W 67.36 0 0 0.0 0.16 28.41 127.0.0.1
generic.centos5-template.com GET /whm-server-status HTTP/1.0
17-204 9252 0/57/37246 W 12.27 7 0 0.0 0.03 23.82 85.112.95.23 toottii.com
POST /modules/?r=simple_messenger/get_operation/new_messages&_r
18-204 9333 4/33/27138 W 7.41 20 0 0.2 0.00 18.81 82.146.178.50 toottii.com
GET /modules/ibdw/3col/query_request.php?_=1337758469349 HTTP/1
19-204 9389 6/44/22756 W 10.27 5 0 0.4 0.00 17.68 85.112.95.23 toottii.com
GET /m/spy/check_updates/global/157194/all&_r=0.577357054396917
20-204 9255 30/121/18532 K 20.16 0 1920 0.8 0.05 15.97 195.66.129.33
toottii.com GET /m/photos/get_image/browse/b84d70420c78fda45e75800a05676bcc
21-204 - 0/0/14357 . 0.65 36 0 0.0 0.00 8.57 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
22-204 9392 13/15/13747 K 3.01 0 1503 1.6 0.00 10.39 195.66.129.33
toottii.com GET /m/photos/get_image/browse/dfdf7dc978421a0fa8f83a8a0efc52a6
23-204 9393 3/4/12758 W 0.81 10 0 1.3 0.00 8.29 82.146.178.50 toottii.com
GET /member_menu_queries.php?action=get_bubbles_values&bubbles=
24-204 9394 0/11/12295 W 1.94 3 0 0.0 0.00 30.23 82.146.178.50 toottii.com
POST /modules/?r=simple_messenger/get_operation/new_messages&_r
25-203 - 0/0/7896 . 29.37 3306 0 0.0 0.00 6.53 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
26-203 - 0/0/9316 . 0.00 3874 0 0.0 0.00 6.62 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
27-199 - 0/0/5917 . 2.37 30909 0 0.0 0.00 5.98 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
28-199 - 0/0/4598 . 0.00 30921 0 0.0 0.00 4.34 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
29-199 - 0/0/4454 . 0.00 30920 0 0.0 0.00 3.14 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
30-199 - 0/0/3075 . 0.00 30919 0 0.0 0.00 1.96 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
31-199 - 0/0/4529 . 0.00 30918 0 0.0 0.00 3.31 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
32-199 - 0/0/2746 . 0.69 30903 0 0.0 0.00 3.26 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
33-199 - 0/0/3063 . 17.47 30060 190 0.0 0.00 2.67 82.146.178.50 toottii.com
GET /m/spy/check_updates/global/156877/all&_r=0.128499716054648
34-199 - 0/0/2796 . 0.00 30917 0 0.0 0.00 2.38 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
35-199 - 0/0/2315 . 5.05 30060 167 0.0 0.00 1.69 82.146.178.50 toottii.com
GET /m/spy/check_updates/global/156877/all&_r=0.712004426633939
36-199 - 0/0/1580 . 17.47 30060 180 0.0 0.00 1.97 82.146.178.50 toottii.com
GET /m/spy/check_updates/global/156877/all&_r=0.171465022722259
37-199 - 0/0/1789 . 0.00 30913 0 0.0 0.00 2.50 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
38-199 - 0/0/1285 . 1.84 30907 0 0.0 0.00 0.75 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
39-199 - 0/0/1117 . 0.00 30916 0 0.0 0.00 1.17 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
40-199 - 0/0/1315 . 0.00 30915 0 0.0 0.00 1.43 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
41-199 - 0/0/1194 . 0.00 30914 0 0.0 0.00 0.76 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
42-199 - 0/0/932 . 0.00 30987 0 0.0 0.00 0.84 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
43-197 - 0/0/568 . 0.00 48740 0 0.0 0.00 0.46 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
44-197 - 0/0/746 . 0.70 51203 0 0.0 0.00 0.94 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
45-197 - 0/0/528 . 6.97 51040 87 0.0 0.00 0.85 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
46-197 - 0/0/478 . 0.68 51233 0 0.0 0.00 0.49 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
47-197 - 0/0/496 . 1.27 51217 0 0.0 0.00 0.13 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
48-197 - 0/0/493 . 0.21 51213 0 0.0 0.00 0.27 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
49-197 - 0/0/241 . 11.26 51107 54 0.0 0.00 0.16 80.89.182.215 toottii.com
HEAD /modules/esase/simple_messenger/data/soundmanager2.swf HTT
50-197 - 0/0/1394 . 0.00 51300 0 0.0 0.00 0.66 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
51-197 - 0/0/177 . 1.35 51204 0 0.0 0.00 0.07 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
52-32 - 0/0/41 . 1.04 1143170 0 0.0 0.00 0.04 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
53-32 - 0/0/200 . 1.36 1143181 0 0.0 0.00 0.07 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
54-32 - 0/0/153 . 0.94 1143203 0 0.0 0.00 0.23 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
55-32 - 0/0/284 . 0.79 1143165 647 0.0 0.00 0.11 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
56-32 - 0/0/136 . 0.59 1143190 0 0.0 0.00 0.25 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
57-32 - 0/0/49 . 1.04 1143193 0 0.0 0.00 0.06 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
58-32 - 0/0/24 . 0.64 1143183 0 0.0 0.00 0.03 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
59-32 - 0/0/26 . 0.33 1143197 0 0.0 0.00 0.03 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
60-32 - 0/0/36 . 0.79 1143204 0 0.0 0.00 0.07 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
61-32 - 0/0/159 . 1.00 1143209 0 0.0 0.00 0.37 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
62-32 - 0/0/55 . 0.86 1143202 0 0.0 0.00 0.12 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
63-32 - 0/0/74 . 1.84 1143161 0 0.0 0.00 0.06 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
64-32 - 0/0/83 . 13.79 1143196 0 0.0 0.00 0.01 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
65-32 - 0/0/40 . 0.66 1143177 0 0.0 0.00 0.34 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
66-32 - 0/0/234 . 23.34 1139049 2138 0.0 0.00 0.15 82.146.178.50 toottii.com
GET /flash/XML.php?module=im&action=updateInvite&recipient=358&
67-32 - 0/0/38 . 0.54 1143175 0 0.0 0.00 0.06 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
68-32 - 0/0/44 . 0.23 1143198 0 0.0 0.00 0.19 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
69-32 - 0/0/19 . 0.00 1143242 0 0.0 0.00 0.04 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
70-32 - 0/0/26 . 0.58 1143179 0 0.0 0.00 0.03 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
71-32 - 0/0/17 . 0.68 1143216 0 0.0 0.00 0.01 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
72-32 - 0/0/8 . 1.20 1143154 0 0.0 0.00 0.00 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
73-32 - 0/0/101 . 1.04 1143187 259 0.0 0.00 0.11 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
74-15 - 0/0/438 . 5.02 1254839 0 0.0 0.00 0.74 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
75-15 - 0/0/12 . 1.20 1255052 0 0.0 0.00 0.00 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
76-15 - 0/0/23 . 2.47 1254935 27 0.0 0.00 0.04 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
77-15 - 0/0/3 . 0.01 1255055 0 0.0 0.00 0.00 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
78-15 - 0/0/3 . 0.02 1255103 0 0.0 0.00 0.00 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
79-15 - 0/0/219 . 39.87 1257666 89 0.0 0.00 0.18 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
80-15 - 0/0/1 . 0.00 1259690 0 0.0 0.00 0.00 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
81-15 - 0/0/135 . 22.47 1258372 0 0.0 0.00 0.41 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
_________________________________________________________________

Srv Child Server number - generation
PID OS process ID
Acc Number of accesses this connection / this child / this slot
M Mode of operation
CPU CPU usage, number of seconds
SS Seconds since beginning of most recent request
Req Milliseconds required to process most recent request
Conn Kilobytes transferred this connection
Child Megabytes transferred this child
Slot Total megabytes transferred this slot
_________________________________________________________________

SSL/TLS Session Cache Status:
cache type: DBM, maximum size: unlimited
current sessions: 0, current size: 0 bytes
average session size: 0 bytes
--------- ----------------- ----------- ------------------ --------- ------ -------------- ------------------------------------------------------------------------------------------------------
| Id | User | Host | db | Command | Time | State | Info |
--------- ----------------- ----------- ------------------ --------- ------ -------------- ------------------------------------------------------------------------------------------------------
| 1584421 | toottii_d7dbusr | localhost | toottii_dolphin7 | Query | 10 | Locked | SELECT COUNT(*)
FROM `Profiles` AS p
INNER JOIN (SELECT IF( 124 = f.`ID` , f.`Profile` , f.` |
| 1584497 | toottii_d7dbusr | localhost | toottii_dolphin7 | Query | 22 | Sending data | SELECT ID FROM Profiles WHERE (ID<>1371 AND ID NOT IN (select Profile from sys_friend_list where id= |
| 1584526 | toottii_d7dbusr | localhost | toottii_dolphin7 | Query | 10 | Locked | UPDATE `Profiles` SET `DateLastNav` = NOW() WHERE `ID` = 1371 |
| 1584530 | toottii_d7dbusr | localhost | toottii_dolphin7 | Query | 10 | Locked | UPDATE `Profiles` SET `DateLastNav` = NOW() WHERE `ID` = 1147 |
| 1584534 | toottii_d7dbusr | localhost | toottii_dolphin7 | Query | 9 | Locked | SELECT COUNT(*) FROM `bx_spy_data` left JOIN `Profiles` ON `Profiles`.`ID`=`bx_spy_data`.`sender_id |
| 1584535 | toottii_d7dbusr | localhost | toottii_dolphin7 | Query | 9 | Locked | SELECT COUNT(*) FROM `bx_spy_data` left JOIN `Profiles` ON `Profiles`.`ID`=`bx_spy_data`.`sender_id |
| 1584537 | toottii_d7dbusr | localhost | toottii_dolphin7 | Query | 8 | Locked | SELECT count(ID) as count_id FROM Profiles WHERE DateLastNav > SUBDATE(NOW(), INTERVAL 360 MINUTE) A |
| 1584541 | toottii_d7dbusr | localhost | toottii_dolphin7 | Query | 8 | Locked | UPDATE `Profiles` SET `DateLastNav` = NOW() WHERE `ID` = 1371 |
| 1584553 | toottii_d7dbusr | localhost | toottii_dolphin7 | Query | 6 | Locked | UPDATE `Profiles` SET `DateLastNav` = NOW() WHERE `ID` = 1147 |
| 1584559 | toottii_d7dbusr | localhost | toottii_dolphin7 | Query | 6 | Locked | SELECT COUNT(*) FROM `bx_spy_data` left JOIN `Profiles` ON `Profiles`.`ID`=`bx_spy_data`.`sender_id |
| 1584567 | toottii_d7dbusr | localhost | toottii_dolphin7 | Query | 4 | Locked | SELECT count(ID) as count_id FROM Profiles WHERE DateLastNav > SUBDATE(NOW(), INTERVAL 360 MINUTE) A |
| 1584581 | toottii_d7dbusr | localhost | toottii_dolphin7 | Sleep | 0 | | |
| 1584583 | toottii_d7dbusr | localhost | toottii_dolphin7 | Sleep | 0 | | |
| 1584584 | toottii_d7dbusr | localhost | toottii_dolphin7 | Sleep | 0 | | |
| 1584585 | root | localhost | | Query | 0 | | show processlist |
--------- ----------------- ----------- ------------------ --------- ------ -------------- ------------------------------------------------------------------------------------------------------
total used free shared buffers cached
Mem: 1024 610 413 0 0 0
-/ buffers/cache: 610 413
Swap: 0 0 0
root@server [/]# du -sh /var/lib/mysql/toottii_dolphin7
155M /var/lib/mysql/toottii_dolphin7
[---END REPORT---]


Quote · 23 May 2012

After I have unsuspended my site even thou no members are login I still had overload on CPU and memory that happened at once today . can anyone give a help what might caused this kind of a problem

 I got an Email from my hosting:

toottii.com is raising load on your server and using up all available memory and becuase of that services on server are failing.

I've restarted apache service on server, but this is just a temporary fix. You need to consult with your web developer and optimize your site.

Below are apache processes that were raising load on server.

-------------------------------------------------------------------------
Srv PID Acc M CPU SS Req Conn Child Slot Client VHost Request
0-2 8123 0/22/270 _ 5.24 2 310 0.0 0.03 0.70 82.146.178.50 toottii.com POST
/modules/?r=simple_messenger/get_operation/new_messages&_r
1-2 8161 0/10/265 _ 2.17 4 241 0.0 0.00 0.72 82.146.178.50 toottii.com GET
/flash/XML.php?module=im&action=updateInvite&recipient=7&_t
2-2 9283 2/2/289 K 0.47 1 242 0.3 0.00 0.35 82.146.178.50 toottii.com GET
/flash/XML.php?module=im&action=updateInvite&recipient=7&_t
3-2 8048 9/43/238 K 7.50 0 169 0.7 0.04 0.54 195.66.129.33 toottii.com GET
/flash/XML.php?module=im&action=updateInvite&recipient=1371
4-2 8042 24/80/268 K 7.84 2 2667 94.5 0.17 0.38 85.112.95.23 toottii.com GET
/plugins/tiny_mce/tiny_mce_gzip.php?js=true&diskcache=true&
5-2 9284 0/0/169 W 0.24 0 0 0.0 0.00 0.17 127.0.0.1
generic.centos5-template.com GET /whm-server-status HTTP/1.0
6-2 8099 8/37/304 K 5.69 0 318 0.8 0.07 0.50 195.66.129.33 toottii.com GET
/flash/XML.php?module=im&action=updateInvite&recipient=1371
7-2 9285 0/0/264 _ 4.05 16 0 0.0 0.00 0.17 127.0.0.1
generic.centos5-template.com OPTIONS * HTTP/1.0
8-2 8114 22/52/164 K 5.09 1 290 18.2 0.03 0.13 85.112.95.23 toottii.com GET
/m/photos/get_image/icon/66c6c14f5d0ccda523833c8da25a2be1.j
9-2 8084 0/50/214 _ 6.97 8 295 0.0 0.14 0.39 195.66.129.33 toottii.com GET
/m/spy/check_updates/global/157201/all&_r=0.979495918145403
10-2 8094 21/66/238 W 5.32 0 0 22.1 0.39 0.64 85.112.95.23 toottii.com GET
/plugins/tiny_mce/tiny_mce_gzip.php?js=true&diskcache=true&
11-2 8091 15/69/341 K 6.49 1 2775 18.3 0.12 0.34 85.112.95.23 toottii.com
GET /m/photos/get_image/file/2d1ae9920be6e6b61a706ef33f17bffc.j
12-2 8045 0/38/282 _ 6.16 13 262 0.0 0.12 0.37 82.146.178.50 toottii.com GET
/flash/XML.php?module=im&action=updateInvite&recipient=7&_t
13-2 8039 21/56/294 K 8.23 0 233 72.1 0.14 0.23 85.112.95.23 toottii.com GET
/flash/XML.php?module=im&action=updateInvite&recipient=89&_
-------------------------------------------------------------------------


Quote · 23 May 2012

first of all, you have almost 15,000 photos, that alone would cause a problem on a small server like you have.

The photos, 

/m/photos/get_image/browse/4b6278688de18e5f57f39e09fd9d8064These look like facebook photo names, are you using a facebook module? The ones I use allow ALL photos from FB to be uploaded on join or in the FB wall.

Trying to browse your photos would overload the sever IMO.

Just a guess here.

Also see you have a demo user. Why? What are the privileges of that account?

[edit]

I joined your site, and you are using the facebook module, if you look at the photos tab there, I / you can upload all images from FB, I have about 1,500.

Setting that to run will stop your server in its tracks.

ManOfTeal.COM a Proud UNA site, six years running strong!
Quote · 23 May 2012

I think your site's ajax requests are taking up too much server resources.

For a quick test uninstall the modules like simple messenger, shoutbox, spy etc etc

EDIT: One more advise get a better and powerful server for your site.

so much to do....
Quote · 23 May 2012

hmm! after looking at your site. On the account page. There is a spy wall, Spy activity block and member menu which is sending too many ajax queries to the server. I think there are queries every few seconds. I am surprised your site was working without suspension till now. The reason for suspension now is maybe your members are online more now than before. If you want to keep your site as it is now, get a powerful server is the only thing you can do to keep running your site as it is now. specially processor and ram

so much to do....
Quote · 23 May 2012

will i do not have many members who login MAx 10 members  daily i do not think this will cause the problem , it is the first time today that i get this CPU overload , even thou i have uninstalled several mods but still having CPU overload and only 2 members are online :

the server load CPU jumps up to 9.0

Server load 0.5 (2 CPUs)
Memory Used 42.97% (450,588 of 1,048,576)
Swap Used 0% (0 of 1)

Uninstalling mods

 Custom RSS version 1.0.8 by Boonex
 Java Photo Uploader version 1.0.0 by ModLoaded
 News version 1.0.8 by Boonex
 OpenSocial version 1.0.8 by Boonex
 Page Access Control version 1.0.8 by Boonex
 Phototags version 1.0.0 by imodz
 Profiler version 1.0.8 by Boonex
 Quotes version 1.0.8 by Boonex
 SMTP Mailer version 1.0.8 by BoonEx
 Shoutbox version 1.0.8 by Boonex
 ZIP Code Search version 1.0.8 by BoonEx
 
 

[Nathan Paton: Removed images.]

Quote · 23 May 2012

none of the uninstalled module will help as no module uses ajax to communicate with the server. And i seriously think your site has this issue. 

so much to do....
Quote · 23 May 2012

 

none of the uninstalled module will help as no module uses ajax to communicate with the server. And i seriously think your site has this issue. 

when the overload happened there was 3 members on the website and i do not think this will cause the overload ... . if in the future i will have 100 members online what will happen :) i have same modes since last year and never had this problem only today the server load plays from 0.5 up to 5.0 up and downs all the time. can it be any spammer who can overload the server.

Quote · 23 May 2012

well as the log says

/flash/XML.php

is causing much load. that file is a famous file for resource hog. DosDowg had posted a note here

http://www.boonex.com/n/Dolphin_7_x_Resource_Hog_xml_file_and_a_few_more 

so much to do....
Quote · 23 May 2012

According to that report you have 24 apache processes using ~96% cpu. I just counted the processes and guessed an average of 4% per process. Could be more or less, I'll let someone else add up the numbers.

 

I don't think the number of photos is an issue at this point. Would help to know the file system format but if it is ext3/4 there is not a file system limit you will run into anytime soon. And mysql doesn't seem to be hanging on photo look-ups.

 

Shutting down the Simple Messenger and Instant Messenger modules may help as the generate a lot of requests per logged in browser (maybe per open page). So even if your the only one logged in but you have the site open in Chrome, IE and Firefox (like some do for testing) you have 3x the number of update requests.

 

I think the first step is for you to clean up your .htaccess files. Lots of rules can really slow down apache.  Second look into disabling any apache modules you are not using to make the apache processes a little leaner.

 

Third... Switch to Nginx and remove any services on your vps node that are not absolutely needed. Do you really need to run an email server and use FTP (ssh is much more secure for file transfer and reduces the 'attack surface' with ftp removed)?

 

My day job is System Admin. Feel free to Private Message me.

Light man a fire keep him warm for a night, light him ON fire & he will be warm the rest of his life
Quote · 23 May 2012

if you know the issue is not with your site itself, then I would suggest a server upgrade an then having 'lite speed'  added to help dealing with heavy load amounts !

 

I have A LOT of contents, photos and  anywhere from 10 - 200 visitors/members doing things at my site at anyone time and don't suffer any issues or speed lose whatsoever.

 

Lite-speed does help alot ..

 

 

DedicatedServer4You.com -- BIGGEST Range of Dedicated Servers at the Lowest Price!
Quote · 23 May 2012

 

I think the first step is for you to clean up your .htaccess files. Lots of rules can really slow down apache.  Second look into disabling any apache modules you are not using to make the apache processes a little leaner.

 

Third... Switch to Nginx and remove any services on your vps node that are not absolutely needed. Do you really need to run an email server and use FTP (ssh is much more secure for file transfer and reduces the 'attack surface' with ftp removed)?

 

My day job is System Admin. Feel free to Private Message me.

 first step is for you to clean up your .htaccess files 

which kind of files do u mean and on which .htaccess (the main one)

 disabling any apache modules  you mean uninstall mods that i do not use?

Switch to Nginx and remove any services on your vps node that are not absolutely needed   that i did not get it , what u mean ?

 

What is confussed that this problem occured suddenly yesterday even thou i had no any mods or changes in my server.

what i noticed that the server load varies from 0.50 up to 7.00 and 8.0 (2 CPU) in a time of one minuite and only 2 members are on line

Quote · 24 May 2012

I think your site's ajax requests are taking up too much server resources.

For a quick test uninstall the modules like simple messenger, shoutbox, spy etc etc

EDIT: One more advise get a better and powerful server for your site.

 I did this test and I uninstalled simple messenger, shoutbox, spy etc etc and still have the same problem overload CPU my Max CPU is 2.00 some times it reachs over 10.00 but i noticed it goes up and downs from 1.00 to 5.00 all the time

I do not think the problem is from Spy or Simple messanger ...

Quote · 24 May 2012

Just butting in again, ever consider that someone is mass uploading their photos and this affects the servers performance when this happens.. 

 

Um, my test server here at home can be sent into overload doing hundreds of photos from facebook. I have tested and if you need a video to see the server load down I will make one.

ManOfTeal.COM a Proud UNA site, six years running strong!
Quote · 24 May 2012

Hello,

I've read that you use the module IBDW 3Col.

By our side you can try if the mod 3Col is correctly tuned (otherwise this can absorbe too much resources).

Make sure to have made the optimization (an index) for the table "suggerimenti".

If not, the current version of this module (available in the market) runs this optimization automatically during the installation process.

So, you can try to update this module. Maybe you'll reduce the use of the resources.

If you want do it, follow these steps:

1) uninstall the previous version of 3Col

2) download the new and upload the files via FTP

3) then install the new version

Some customers have reported a similar issue in the past but generally this was due to an old version (with no optimization) or to exsagerate values for the thresholds in the settings.

We hope this can help.

PS: I've wrote also to you in Unity message area

See my products at http://www.boonex.com/market/posts/ilbellodelweb | Hosting: zarconia.net
Quote · 24 May 2012

The main .htaccess file in the root of your website is the most important as it has to be processed for all requests to your site it is also the file most people make changes to. The .htaccess files in sub directories could have been changed but I doubt it. Just make sure the main .htaccess is as close to the default file boonex provides as possible. If there are any IP blocking rules in there remove them for now.

 

Tuning Apache is a complex subject. This is not a bad place to start:
http://blog.monitis.com/index.php/2011/07/05/25-apache-performance-tuning-tips/

 

As for Nginx please read this: 
http://arstechnica.com/business/2011/11/a-faster-web-server-ripping-out-apache-for-nginx/

 

It is possible for the facebook import module to cause spikes in load but they should be short lived. We would need to know the time a spike in load starts then review the website access logs for that time to see what is going on.

 

Its a little more advanced to do, but installing and configuring APC or Xcache will also help.

Light man a fire keep him warm for a night, light him ON fire & he will be warm the rest of his life
Quote · 24 May 2012

He only has 1GB of ram... I don't think I would attempt to use a cacher with that small amount.

 

 

Its a little more advanced to do, but installing and configuring APC or Xcache will also help.

 

BoonEx Certified Host: Zarconia.net - Fully Supported Shared and Dedicated for Dolphin
Quote · 24 May 2012

Another issue to consider is the hosting provider itself.

 

Usually VPS accounts are configured and priced so the customer can do and use what ever they want within the allocated resource limits. It sounds like you are reaching (but not passing) those limits and effecting their ability to over sell services.

 

A simple explanation of server load is each cpu has the capacity to do 1 unit of work in real time without delay.  So when you have 2 cpus but load is 7 you have 3.5x  (7 / 2) as much work as the server an do right now and things take longer as the cpus split there time on tasks so no one process stops working. It ends up like a virtual traffic jam.

 

Is the VPS host complaining about CPU usage or Disk IO? Both? I would be interested to know how much you are paying for there service.

Light man a fire keep him warm for a night, light him ON fire & he will be warm the rest of his life
Quote · 24 May 2012

 

He only has 1GB of ram... I don't think I would attempt to use a cacher with that small amount.

 

 

Its a little more advanced to do, but installing and configuring APC or Xcache will also help.

 

 Uninstalling (or just stopping) postgres and disabling inodb in mysql should free up more then enough ram for this. 

 

Disabling the following apache modules will also free up some RAM: alias auth_basic authz_default authz_groupfile authz_user autoindex

 

Like I said, it is a little more advanced.

Light man a fire keep him warm for a night, light him ON fire & he will be warm the rest of his life
Quote · 24 May 2012

 

The main .htaccess file in the root of your website is the most important as it has to be processed for all requests to your site it is also the file most people make changes to. The .htaccess files in sub directories could have been changed but I doubt it. Just make sure the main .htaccess is as close to the default file boonex provides as possible. If there are any IP blocking rules in there remove them for now. 

Tuning Apache is a complex subject. This is not a bad place to start:
http://blog.monitis.com/index.php/2011/07/05/25-apache-performance-tuning-tips/

 As for Nginx please read this: 

http://arstechnica.com/business/2011/11/a-faster-web-server-ripping-out-apache-for-nginx/

 

It is possible for the facebook import module to cause spikes in load but they should be short lived. We would need to know the time a spike in load starts then review the website access logs for that time to see what is going on.

 

Its a little more advanced to do, but installing and configuring APC or Xcache will also help.

 Thanks for this excellent link, I was able to do most of them and did see a great  performance increase across the entire site.

ManOfTeal.COM a Proud UNA site, six years running strong!
Quote · 26 May 2012
 
 
Below is the legacy version of the Boonex site, maintained for Dolphin.Pro 7.x support.
The new Dolphin solution is powered by UNA Community Management System.