Re: [campsite-support] Campsite 2.5 performance issue
  • Did you check how much memory the old campsite used? How many templates and how big they are? Please open a shell console and type: ps faxu. Send me a screenshot.

    Mugur

    wrote: Author: tamamtech
    Link: http://code.campware.org/phorum/read.php?8,3779,3779#msg-3779
    --------------------------------------------------------------------------------

    I was talking to Sava yesterday and he asked me to report this to the list.

    We upgraded Ammannet from Campsite 2.1.5 to Campsite 2.5 . We got an identical server, installed Campsite 2.5 and designed the new ammannet site on it, then moved the old 2.1.5 database from ammannet server to the new one and then changed the dns to point to the new server.

    With the new server, we notice that Campsite is using lots of memory. We have php wrapper installed on ammannet which we think might have something to do with the memory load. Here is a screenshot of the processes running on the server:

    http://img226.imageshack.us/img226/7774/campsitescreenshot8ih.gif

    campsite instance is ammannet instance. You can see that it's using 116 MB of memory. awrd, intekhabat and cdfj instances are under development. There is only one person accessing these instances and each one is consuming 40 MB of memory. Also are the httpd instances caused by the php wrapper (since it opens an internal request to apache server). Every httpd process is consuming 27 MB or memory.


    --
    Sent from Campware Forums
    http://code.campware.org/phorum



    ---------------------------------
    New Yahoo! Messenger with Voice. Call regular phones from your PC for low, low rates.
  • 3 Comments sorted by
  • Hi Mugur, it has been some time since we bothered you Smile

    Here is the output:

    [root@ammannet ~]# ps faxu
    USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
    root 1 0.0 0.1 1744 564 ? S Mar27 0:01 init [3]
    root 2 0.0 0.0 0 0 ? SN Mar27 0:00 [ksoftirqd/0]
    root 3 0.0 0.0 0 0 ? S< Mar27 0:00 [events/0]
    root 4 0.0 0.0 0 0 ? S< Mar27 0:00 [khelper]
    root 5 0.0 0.0 0 0 ? S< Mar27 0:00 [kthread]
    root 9 0.0 0.0 0 0 ? S< Mar27 0:00 \_ [kblockd/0]
    root 10 0.0 0.0 0 0 ? S< Mar27 0:00 \_ [kacpid]
    root 224 0.0 0.0 0 0 ? S< Mar27 0:00 \_ [khubd]
    root 279 0.0 0.0 0 0 ? S Mar27 0:02 \_ [pdflush]
    root 281 0.0 0.0 0 0 ? S< Mar27 0:00 \_ [aio/0]
    root 368 0.0 0.0 0 0 ? S< Mar27 0:00 \_ [kseriod]
    root 915 0.0 0.0 0 0 ? S< Mar27 0:00 \_ [kauditd]
    root 20016 0.0 0.0 0 0 ? S 05:19 0:00 \_ [pdflush]
    root 280 0.0 0.0 0 0 ? S Mar27 0:05 [kswapd0]
    root 452 0.0 0.0 0 0 ? S Mar27 0:15 [kjournald]
    root 635 0.0 0.0 1648 428 ? S root 814 0.0 0.2 3028 1240 ? Ss Mar27 0:00 kmodule -d
    root 1249 0.0 0.0 0 0 ? S Mar27 0:00 [kjournald]
    root 1380 0.0 0.2 4588 1268 tty8 Ss+ Mar27 0:00 /bin/bash
    named 1766 0.0 0.5 36660 2912 ? Ssl Mar27 0:25 /usr/sbin/named -u named
    root 1809 0.0 0.1 11968 664 ? S root 1835 0.0 0.1 4384 516 ? Ss Mar27 0:00 rpc.idmapd
    root 1846 0.0 0.1 2160 676 ? Ss Mar27 0:00 hcid: processing events
    root 1848 0.0 0.0 1604 472 ? Ss Mar27 0:00 sdpd
    root 1863 0.0 0.0 0 0 ? S< Mar27 0:00 [krfcommd]
    root 1873 0.0 0.1 1556 520 ? Ss Mar27 0:00 /usr/sbin/acpid
    root 1885 0.0 0.3 8464 1880 ? Ss Mar27 0:00 cupsd
    root 1976 0.0 0.2 4588 1216 ? S Mar27 0:00 /bin/sh /usr/bin/mysqld_safe --defaults-file=/etc/my.cnf --p
    mysql 2009 8.0 5.9 133888 30500 ? Sl Mar27 226:39 \_ /usr/libexec/mysqld --defaults-file=/etc/my.cnf --basedi
    nobody 2029 0.0 0.2 4952 1204 ? Ss Mar27 0:00 proftpd: (accepting connections)
    root 2068 0.0 1.8 21124 9664 ? Ss Mar27 0:00 /usr/sbin/httpd
    apache 13533 0.8 2.8 27384 14340 ? S 09:32 3:06 \_ /usr/sbin/httpd
    apache 15220 1.1 2.7 27260 14208 ? S 09:46 3:51 \_ /usr/sbin/httpd
    apache 18482 0.7 2.8 27408 14336 ? S 10:14 2:18 \_ /usr/sbin/httpd
    apache 23563 0.9 2.7 27168 14040 ? S 11:02 2:37 \_ /usr/sbin/httpd
    apache 29423 0.6 2.7 27332 14228 ? S 11:51 1:31 \_ /usr/sbin/httpd
    apache 5893 0.8 2.7 27120 13952 ? S 13:08 1:17 \_ /usr/sbin/httpd
    apache 5928 1.4 2.7 27348 14220 ? S 13:08 2:11 \_ /usr/sbin/httpd
    apache 7168 0.5 2.7 27336 14144 ? S 13:19 0:43 \_ /usr/sbin/httpd
    apache 7298 0.9 2.7 27268 14132 ? S 13:20 1:21 \_ /usr/sbin/httpd
    apache 7299 0.6 2.7 27112 13960 ? S 13:20 0:56 \_ /usr/sbin/httpd
    apache 7327 0.9 2.7 27328 14172 ? S 13:20 1:18 \_ /usr/sbin/httpd
    apache 7871 1.1 2.7 27328 14172 ? S 13:24 1:29 \_ /usr/sbin/httpd
    apache 16272 1.7 2.7 27008 13852 ? S 14:38 1:02 \_ /usr/sbin/httpd
    apache 16389 1.4 2.7 27212 13976 ? S 14:39 0:49 \_ /usr/sbin/httpd
    apache 16395 0.5 2.7 26996 13836 ? S 14:39 0:18 \_ /usr/sbin/httpd
    apache 16396 0.3 2.7 27216 14080 ? S 14:39 0:13 \_ /usr/sbin/httpd
    apache 16408 0.5 2.7 27184 13948 ? S 14:39 0:17 \_ /usr/sbin/httpd
    apache 16409 1.1 2.6 27000 13804 ? S 14:39 0:38 \_ /usr/sbin/httpd
    apache 17880 1.0 2.7 27000 13836 ? S 14:53 0:27 \_ /usr/sbin/httpd
    apache 21160 0.2 2.6 26996 13780 ? S 15:20 0:02 \_ /usr/sbin/httpd
    root 2075 0.0 0.1 4764 944 ? Ss Mar27 0:00 crond
    xfs 2102 0.0 0.2 2936 1164 ? Ss Mar27 0:00 xfs -droppriv -daemon
    root 2115 0.0 0.0 1808 432 ? Ss Mar27 0:00 /usr/sbin/atd
    dbus 2122 0.0 0.1 2560 856 ? Ss Mar27 0:00 dbus-daemon --system
    root 2129 0.0 0.4 4196 2280 ? Ss Mar27 0:00 hald --retain-privileges
    root 2134 0.0 0.1 2144 700 ? S Mar27 0:00 \_ hald-addon-acpi
    root 2148 0.0 0.9 6632 4720 ? Ss Mar27 0:03 /usr/bin/perl /usr/libexec/usermin/miniserv.pl /etc/usermin/
    root 2153 0.0 1.0 7184 5232 ? Ss Mar27 0:08 /usr/bin/perl /usr/libexec/webmin/miniserv.pl /etc/webmin/mi
    root 2156 0.0 0.0 1548 420 tty1 Ss+ Mar27 0:00 /sbin/mingetty tty1
    root 2157 0.0 0.0 1552 420 tty2 Ss+ Mar27 0:00 /sbin/mingetty tty2
    root 2158 0.0 0.0 1552 424 tty3 Ss+ Mar27 0:00 /sbin/mingetty tty3
    root 2159 0.0 0.0 1552 424 tty4 Ss+ Mar27 0:00 /sbin/mingetty tty4
    root 2160 0.0 0.0 1552 424 tty5 Ss+ Mar27 0:00 /sbin/mingetty tty5
    root 2161 0.0 0.0 1552 424 tty6 Ss+ Mar27 0:00 /sbin/mingetty tty6
    root 8092 0.3 0.1 1612 564 ? Ss Mar27 9:50 syslogd -m 0
    root 8094 0.3 0.0 1568 400 ? Ss Mar27 8:40 klogd -x
    root 25215 0.0 0.0 3900 500 ? Ss Mar27 0:00 /usr/sbin/dovecot
    root 25219 0.0 0.3 6320 1776 ? S Mar27 0:01 \_ dovecot-auth
    dovecot 25220 0.0 0.2 3904 1484 ? S Mar27 0:00 \_ imap-login
    dovecot 25221 0.0 0.2 3904 1484 ? S Mar27 0:00 \_ imap-login
    dovecot 25222 0.0 0.2 3900 1480 ? S Mar27 0:00 \_ imap-login
    dovecot 15636 0.0 0.3 3896 1572 ? S 14:32 0:00 \_ pop3-login
    dovecot 21136 0.0 0.2 3892 1512 ? S 15:20 0:00 \_ pop3-login
    dovecot 22524 0.0 0.2 3896 1520 ? S 15:34 0:00 \_ pop3-login
    root 15968 0.0 0.4 7956 2112 ? Ss Mar28 0:02 sendmail: accepting connections
    smmsp 15977 0.0 0.3 6968 1660 ? Ss Mar28 0:00 sendmail: Queue runner@01:00:00 for /var/spool/clientmqueue
    root 20068 0.0 0.2 4400 1064 ? Ss 05:20 0:00 /usr/sbin/sshd
    root 22407 0.0 0.4 7272 2328 ? Ss 15:33 0:00 \_ sshd: root@pts/1
    root 22432 0.0 0.2 4728 1456 pts/1 Ss 15:33 0:00 \_ -bash
    root 22647 0.0 0.1 4656 892 pts/1 R+ 15:36 0:00 \_ ps faxu
    apache 4626 9.3 1.5 116076 7724 ? Ssl 08:11 41:25 /usr/local/campsite/bin/campsite_server -i campsite
    root 4673 0.0 0.7 40608 3852 ? Ssl 08:11 0:17 /usr/local/campsite/bin/campsite_server -i intekhabat
    apache 6810 0.0 0.7 40568 3796 ? Ssl 08:34 0:03 /usr/local/campsite/bin/campsite_server -i cdfj
    apache 18573 0.0 0.7 40660 3968 ? Ssl 10:15 0:08 /usr/local/campsite/bin/campsite_server -i awrd
    apache 2048 0.0 0.7 20036 3612 ? Ssl 12:37 0:00 /usr/local/campsite/bin/campsite_server -i alerhab
    [root@ammannet ~]#
  • Hi Raed,

    You didn't answer the other questions: did you check how much memory 2.4 used for the same sites (the same database and templates)? How many templates and how big they are?

    Regarding the memory:

    USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
    ...
    apache 13533 0.8 2.8 27384 14340 ? S 09:32 3:06 \_ /usr/sbin/httpd
    ...
    apache 4626 9.3 1.5 116076 7724 ? Ssl 08:11 41:25 /usr/local/campsite/bin/campsite_server -i campsite

    What you saw on the web interface is the virtual memory size which is the 'virtual' memory the process uses. Why virtual? Because it sums up the memory used by all libraries accessed by the process. But these libraries are shared by all processes that use them so this IS NOT a reliable way of measuring the process memory. The real memory used by the process is RSS: 14340 for apache and 7724 for campsite.

    Also, in case of a big site with many templates, many topics the template engine uses more memory to cache them.

    Mugur

    wrote: Author: tamamtech
    Link: http://code.campware.org/phorum/read.php?8,3780,3781#msg-3781
    --------------------------------------------------------------------------------

    Hi Mugur, it has been some time since we bothered you Smile

    Here is the output:

    # ps faxu
    USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
    root 1 0.0 0.1 1744 564 ? S Mar27 0:01 init [3]
    root 2 0.0 0.0 0 0 ? SN Mar27 0:00
    root 3 0.0 0.0 0 0 ? S< Mar27 0:00
    root 4 0.0 0.0 0 0 ? S< Mar27 0:00
    root 5 0.0 0.0 0 0 ? S< Mar27 0:00
    root 9 0.0 0.0 0 0 ? S< Mar27 0:00 \_
    root 10 0.0 0.0 0 0 ? S< Mar27 0:00 \_
    root 224 0.0 0.0 0 0 ? S< Mar27 0:00 \_
    root 279 0.0 0.0 0 0 ? S Mar27 0:02 \_
    root 281 0.0 0.0 0 0 ? S< Mar27 0:00 \_
    root 368 0.0 0.0 0 0 ? S< Mar27 0:00 \_
    root 915 0.0 0.0 0 0 ? S< Mar27 0:00 \_
    root 20016 0.0 0.0 0 0 ? S 05:19 0:00 \_
    root 280 0.0 0.0 0 0 ? S Mar27 0:05
    root 452 0.0 0.0 0 0 ? S Mar27 0:15
    root 635 0.0 0.0 1648 428 ? S
    root 814 0.0 0.2 3028 1240 ? Ss Mar27 0:00 kmodule -d
    root 1249 0.0 0.0 0 0 ? S Mar27 0:00
    root 1380 0.0 0.2 4588 1268 tty8 Ss+ Mar27 0:00 /bin/bash
    named 1766 0.0 0.5 36660 2912 ? Ssl Mar27 0:25 /usr/sbin/named -u named
    root 1809 0.0 0.1 11968 664 ? S
    root 1835 0.0 0.1 4384 516 ? Ss Mar27 0:00 rpc.idmapd
    root 1846 0.0 0.1 2160 676 ? Ss Mar27 0:00 hcid: processing events
    root 1848 0.0 0.0 1604 472 ? Ss Mar27 0:00 sdpd
    root 1863 0.0 0.0 0 0 ? S< Mar27 0:00
    root 1873 0.0 0.1 1556 520 ? Ss Mar27 0:00 /usr/sbin/acpid
    root 1885 0.0 0.3 8464 1880 ? Ss Mar27 0:00 cupsd
    root 1976 0.0 0.2 4588 1216 ? S Mar27 0:00 /bin/sh /usr/bin/mysqld_safe --defaults-file=/etc/my.cnf --p
    mysql 2009 8.0 5.9 133888 30500 ? Sl Mar27 226:39 \_ /usr/libexec/mysqld --defaults-file=/etc/my.cnf --basedi
    nobody 2029 0.0 0.2 4952 1204 ? Ss Mar27 0:00 proftpd: (accepting connections)
    root 2068 0.0 1.8 21124 9664 ? Ss Mar27 0:00 /usr/sbin/httpd
    apache 13533 0.8 2.8 27384 14340 ? S 09:32 3:06 \_ /usr/sbin/httpd
    apache 15220 1.1 2.7 27260 14208 ? S 09:46 3:51 \_ /usr/sbin/httpd
    apache 18482 0.7 2.8 27408 14336 ? S 10:14 2:18 \_ /usr/sbin/httpd
    apache 23563 0.9 2.7 27168 14040 ? S 11:02 2:37 \_ /usr/sbin/httpd
    apache 29423 0.6 2.7 27332 14228 ? S 11:51 1:31 \_ /usr/sbin/httpd
    apache 5893 0.8 2.7 27120 13952 ? S 13:08 1:17 \_ /usr/sbin/httpd
    apache 5928 1.4 2.7 27348 14220 ? S 13:08 2:11 \_ /usr/sbin/httpd
    apache 7168 0.5 2.7 27336 14144 ? S 13:19 0:43 \_ /usr/sbin/httpd
    apache 7298 0.9 2.7 27268 14132 ? S 13:20 1:21 \_ /usr/sbin/httpd
    apache 7299 0.6 2.7 27112 13960 ? S 13:20 0:56 \_ /usr/sbin/httpd
    apache 7327 0.9 2.7 27328 14172 ? S 13:20 1:18 \_ /usr/sbin/httpd
    apache 7871 1.1 2.7 27328 14172 ? S 13:24 1:29 \_ /usr/sbin/httpd
    apache 16272 1.7 2.7 27008 13852 ? S 14:38 1:02 \_ /usr/sbin/httpd
    apache 16389 1.4 2.7 27212 13976 ? S 14:39 0:49 \_ /usr/sbin/httpd
    apache 16395 0.5 2.7 26996 13836 ? S 14:39 0:18 \_ /usr/sbin/httpd
    apache 16396 0.3 2.7 27216 14080 ? S 14:39 0:13 \_ /usr/sbin/httpd
    apache 16408 0.5 2.7 27184 13948 ? S 14:39 0:17 \_ /usr/sbin/httpd
    apache 16409 1.1 2.6 27000 13804 ? S 14:39 0:38 \_ /usr/sbin/httpd
    apache 17880 1.0 2.7 27000 13836 ? S 14:53 0:27 \_ /usr/sbin/httpd
    apache 21160 0.2 2.6 26996 13780 ? S 15:20 0:02 \_ /usr/sbin/httpd
    root 2075 0.0 0.1 4764 944 ? Ss Mar27 0:00 crond
    xfs 2102 0.0 0.2 2936 1164 ? Ss Mar27 0:00 xfs -droppriv -daemon
    root 2115 0.0 0.0 1808 432 ? Ss Mar27 0:00 /usr/sbin/atd
    dbus 2122 0.0 0.1 2560 856 ? Ss Mar27 0:00 dbus-daemon --system
    root 2129 0.0 0.4 4196 2280 ? Ss Mar27 0:00 hald --retain-privileges
    root 2134 0.0 0.1 2144 700 ? S Mar27 0:00 \_ hald-addon-acpi
    root 2148 0.0 0.9 6632 4720 ? Ss Mar27 0:03 /usr/bin/perl /usr/libexec/usermin/miniserv.pl /etc/usermin/
    root 2153 0.0 1.0 7184 5232 ? Ss Mar27 0:08 /usr/bin/perl /usr/libexec/webmin/miniserv.pl /etc/webmin/mi
    root 2156 0.0 0.0 1548 420 tty1 Ss+ Mar27 0:00 /sbin/mingetty tty1
    root 2157 0.0 0.0 1552 420 tty2 Ss+ Mar27 0:00 /sbin/mingetty tty2
    root 2158 0.0 0.0 1552 424 tty3 Ss+ Mar27 0:00 /sbin/mingetty tty3
    root 2159 0.0 0.0 1552 424 tty4 Ss+ Mar27 0:00 /sbin/mingetty tty4
    root 2160 0.0 0.0 1552 424 tty5 Ss+ Mar27 0:00 /sbin/mingetty tty5
    root 2161 0.0 0.0 1552 424 tty6 Ss+ Mar27 0:00 /sbin/mingetty tty6
    root 8092 0.3 0.1 1612 564 ? Ss Mar27 9:50 syslogd -m 0
    root 8094 0.3 0.0 1568 400 ? Ss Mar27 8:40 klogd -x
    root 25215 0.0 0.0 3900 500 ? Ss Mar27 0:00 /usr/sbin/dovecot
    root 25219 0.0 0.3 6320 1776 ? S Mar27 0:01 \_ dovecot-auth
    dovecot 25220 0.0 0.2 3904 1484 ? S Mar27 0:00 \_ imap-login
    dovecot 25221 0.0 0.2 3904 1484 ? S Mar27 0:00 \_ imap-login
    dovecot 25222 0.0 0.2 3900 1480 ? S Mar27 0:00 \_ imap-login
    dovecot 15636 0.0 0.3 3896 1572 ? S 14:32 0:00 \_ pop3-login
    dovecot 21136 0.0 0.2 3892 1512 ? S 15:20 0:00 \_ pop3-login
    dovecot 22524 0.0 0.2 3896 1520 ? S 15:34 0:00 \_ pop3-login
    root 15968 0.0 0.4 7956 2112 ? Ss Mar28 0:02 sendmail: accepting connections
    smmsp 15977 0.0 0.3 6968 1660 ? Ss Mar28 0:00 sendmail: Queue runner@01:00:00 for /var/spool/clientmqueue
    root 20068 0.0 0.2 4400 1064 ? Ss 05:20 0:00 /usr/sbin/sshd
    root 22407 0.0 0.4 7272 2328 ? Ss 15:33 0:00 \_ sshd: root@pts/1
    root 22432 0.0 0.2 4728 1456 pts/1 Ss 15:33 0:00 \_ -bash
    root 22647 0.0 0.1 4656 892 pts/1 R+ 15:36 0:00 \_ ps faxu
    apache 4626 9.3 1.5 116076 7724 ? Ssl 08:11 41:25 /usr/local/campsite/bin/campsite_server -i campsite
    root 4673 0.0 0.7 40608 3852 ? Ssl 08:11 0:17 /usr/local/campsite/bin/campsite_server -i intekhabat
    apache 6810 0.0 0.7 40568 3796 ? Ssl 08:34 0:03 /usr/local/campsite/bin/campsite_server -i cdfj
    apache 18573 0.0 0.7 40660 3968 ? Ssl 10:15 0:08 /usr/local/campsite/bin/campsite_server -i awrd
    apache 2048 0.0 0.7 20036 3612 ? Ssl 12:37 0:00 /usr/local/campsite/bin/campsite_server -i alerhab
    #


    --
    Sent from Campware Forums
    http://code.campware.org/phorum



    ---------------------------------
    Yahoo! Messenger with Voice. PC-to-Phone calls for ridiculously low rates.
  • The older campsite was 2.1.5 not 2.4 . The templates sizes are different. With 2.5 we design a whole new layout. So we can't really compare.

    Thanks for clearing this up.