Posting in the Magento forums has been disabled pending the implementation of a new and improved forum solution which should better serve the community.

For new questions please post at magento.stackexchange.com, the community-run support site for the Magento community. We will be providing updates on the new forum solution soon. For questions or concerns please email community@magento.com.

Magento Forum

Admin Panel - System Configuration performance problem on dedicated server
 
Richard Ayotte
Jr. Member
 
Total Posts:  7
Joined:  2009-02-28
 

I’m experiencing a serious performance problem on a dedicated server with Magento ver. 1.2.1.2. I’m not sure if this is normal or if there’s something wrong with my setup. Here’s the hardware and software that I’m using.

Hardware
CPU: Intel(R) Celeron(R) E1200 @ 1.60GHz, Cache: 512 kb, Units/Processor: 2
Memory Size: 2 GB
Network: 100Mb Ethernet connected locally.
Disk: = 203 GB Maxtor 6B200S0, Serial ATA-150, 7200RPM

OS and Software
OS: Ubuntu 8.10 Server Edition (No graphical interface, No Xorg etc.)
Kernel: Linux 2.6.27-13-server #1 SMP Thu Feb 26 08:12:00 UTC 2009 i686 GNU/Linux
Filesystem: xfs (rw,noatime,relatime)
Web server: Apache/2.2.9 (Ubuntu) PHP/5.2.6-2ubuntu4.1 with Suhosin-Patch mod_ssl/2.2.9 OpenSSL/0.9.8g
PHP bytecode cache: APC 3.0.19 stable
apc.enabled = 1
apc.shm_segments = 1
apc.shm_size = 64
apc.max_file_size = 10M
apc.stat=1
Database: MySQL 5.0.67
key_buffer = 384M
max_allowed_packet = 64M
table_cache = 512
sort_buffer_size = 4M
read_buffer_size = 4M
myisam_sort_buffer_size = 64M
tmp_table_size = 128M
thread_stack = 128K
thread_cache_size = 8
max_connections = 200
table_cache = 512
thread_concurrency = 10
innodb_buffer_pool_size = 768M
innodb_additional_mem_pool_size = 20M
innodb_flush_log_at_trx_commit = 0
innodb_flush_method = O_DSYNC
innodb_log_buffer_size = 8M
query_cache_limit = 1M
query_cache_size = 64M
query_cache_type = 1

Now for the performance numbers. Measurements were done using Firebug and done three times consecutively.

Clicking on:
Configuration -> 8.69 to 9.08 seconds
Design -> 1.72 to 2.94 sec
Design/Save -> 11.88 to 11.93 sec
Saving anything takes between 11 and 12 seconds. 

Is this normal?

Any suggestions?

 
Magento Community Magento Community
Magento Community
Magento Community
 
Richard Ayotte
Jr. Member
 
Total Posts:  7
Joined:  2009-02-28
 

Bump!

I also want to mention that CPU Load essentially remains nil and it’s all disk activity. Have I configured something wrong or is this the expected speed?

 
Magento Community Magento Community
Magento Community
Magento Community
 
Richard Ayotte
Jr. Member
 
Total Posts:  7
Joined:  2009-02-28
 

I just ran iotop and it shows heavy disk *writes* when I simply click on the System->Configuration menu item. I’m not saving anything so why the heavy disk writes?

 
Magento Community Magento Community
Magento Community
Magento Community
 
skippybosco
Moderator
 
Avatar
Total Posts:  796
Joined:  2008-10-03
 

It seems the MSQL Profiler would be the appropriate way to figure it out.

Something that come to mind is logging?

 
Magento Community Magento Community
Magento Community
Magento Community
 
Richard Ayotte
Jr. Member
 
Total Posts:  7
Joined:  2009-02-28
 

Thanks for the reply. I’m running iotop and it’s only showing activity from apache2. Apache is writing to something for a full 13 seconds just to display the System->Configuration page. There’s actually very little activity from the database.

Total DISK READ0 B/Total DISK WRITE89.32 K/s
  PID USER      DISK READ  DISK WRITE   SWAPIN    IO
>    COMMAND                                     
25010 www
-data       0 B/s   89.32 K/s  0.00 %  0.00 apache2 -k start
    1 root           0 B
/s       0 B/s  0.00 %  0.00 init
    2 root           0 B
/s       0 B/s  0.00 %  0.00 [kthreadd]
    3 root           0 B
/s       0 B/s  0.00 %  0.00 [migration/0]
    4 root           0 B
/s       0 B/s  0.00 %  0.00 [ksoftirqd/0]
    5 root           0 B
/s       0 B/s  0.00 %  0.00 [watchdog/0]
    6 root           0 B
/s       0 B/s  0.00 %  0.00 [migration/1]
    7 root           0 B
/s       0 B/s  0.00 %  0.00 [ksoftirqd/1]
    8 root           0 B
/s       0 B/s  0.00 %  0.00 [watchdog/1]
    9 root           0 B
/s       0 B/s  0.00 %  0.00 [events/0]
   10 root           0 B
/s       0 B/s  0.00 %  0.00 [events/1]

Apache is writing to the session but that’s too small, it’s only about 30K and the sustained write of about 80K/s means that Apache is writing out about 1M. Why would it take 13 seconds to write 1M?! CPU load is 0 so that’s not a bottleneck. This thing is driving me nuts.

Here are the open files that that apache process has open.

COMMAND   PID     USER   FD   TYPE     DEVICE    SIZE      NODE NAME
apache2 25011 www
-data  cwd    DIR        8,3    4096 336245369 /var/www/photoscan-magento
apache2 25011 www
-data  rtd    DIR        8,3    4096       128 /
apache2 25011 www-data  txt    REG        8,3  367704 603980296 /usr/sbin/apache2
apache2 25011 www
-data  DEL    REG        0,9            403959 /dev/zero
apache2 25011 www
-data  mem    REG        8,3   54740 402653316 /lib/libgcc_s.so.1
apache2 25011 www
-data  DEL    REG        0,9            403954 /dev/zero
apache2 25011 www
-data  mem    REG        8,3   26436 738317550 /usr/lib/php5/20060613+lfs/pdo_mysql.so
apache2 25011 www
-data  mem    REG        8,3   89728 738317551 /usr/lib/php5/20060613+lfs/pdo.so
apache2 25011 www
-data  mem    REG        8,3  101604 738317548 /usr/lib/php5/20060613+lfs/mysqli.so
apache2 25011 www
-data  mem    REG        8,3   44604 738319681 /usr/lib/php5/20060613+lfs/mysql.so
apache2 25011 www
-data  mem    REG        8,3  382992 537280867 /usr/lib/libsybdb.so.5.0.0
apache2 25011 www
-data  mem    REG        8,3   49012 738319676 /usr/lib/php5/20060613+lfs/mssql.so
apache2 25011 www
-data  mem    REG        8,3   74836 738266168 /usr/lib/php5/20060613+lfs/memcache.so
apache2 25011 www
-data  mem    REG        8,3   30104 537388738 /usr/lib/libltdl.so.7.1.2
apache2 25011 www
-data  mem    REG        8,3  162320 537263184 /usr/lib/libmcrypt.so.4.4.7
apache2 25011 www
-data  mem    REG        8,3   35324 738317563 /usr/lib/php5/20060613+lfs/mcrypt.so
apache2 25011 www
-data  mem    REG        8,3   87576 537316202 /usr/lib/libICE.so.6.3.0
apache2 25011 www
-data  mem    REG        8,3   30064 537388789 /usr/lib/libSM.so.6.0.0
apache2 25011 www
-data  mem    REG        8,3  332816 537316210 /usr/lib/libXt.so.6.0.0
apache2 25011 www
-data  mem    REG        8,3   55772 537252410 /usr/lib/libXext.so.6.4.0
apache2 25011 www
-data  mem    REG        8,3  346040 537339815 /usr/lib/libtiff.so.4.2.1
apache2 25011 www
-data  mem    REG        8,3  195720 537262039 /usr/lib/liblcms.so.1.0.16
apache2 25011 www
-data  mem    REG        8,3 1973044 537277088 /usr/lib/libMagick.so.10.0.9
apache2 25011 www
-data  mem    REG        8,3  818456 537277089 /usr/lib/libWand.so.10.0.9
apache2 25011 www
-data  mem    REG        8,3  278488 738346962 /usr/lib/php5/20060613+lfs/imagick.so
apache2 25011 www
-data  mem    REG        8,3   16628 537296046 /usr/lib/libXdmcp.so.6.0.0
apache2 25011 www
-data  mem    REG        8,3    7408 537296044 /usr/lib/libXau.so.6.0.0
apache2 25011 www
-data  mem    REG        8,3   95676 537296049 /usr/lib/libxcb.so.1.0.0
apache2 25011 www
-data  mem    REG        8,3    5364 537296052 /usr/lib/libxcb-xlib.so.0.0.0
apache2 25011 www
-data  mem    REG        8,3  179024 537252397 /usr/lib/libfontconfig.so.1.3.0
apache2 25011 www
-data  mem    REG        8,3  126732 537282798 /usr/lib/libjpeg.so.62.0.0
apache2 25011 www
-data  mem    REG        8,3  149288 537252414 /usr/lib/libpng12.so.0.27.0
apache2 25011 www
-data  mem    REG        8,3   65236 537263157 /usr/lib/libXpm.so.4.11.0
apache2 25011 www
-data  mem    REG        8,3  971436 537296068 /usr/lib/libX11.so.6.2.0
apache2 25011 www
-data  mem    REG        8,3  476544 537296078 /usr/lib/libfreetype.so.6.3.18
apache2 25011 www
-data  mem    REG        8,3  263920 537280871 /usr/lib/libt1.so.5.1.2
apache2 25011 www
-data  mem    REG        8,3  250604 537263163 /usr/lib/libgd.so.2.0.0
apache2 25011 www
-data  mem    REG        8,3  105200 738319680 /usr/lib/php5/20060613+lfs/gd.so
apache2 25011 www
-data  mem    REG        8,3  202192 537303044 /usr/lib/libidn.so.11.5.37
apache2 25011 www
-data  mem    REG        8,3  252356 537498275 /usr/lib/libcurl.so.4.1.0
apache2 25011 www
-data  mem    REG        8,3   56824 738319679 /usr/lib/php5/20060613+lfs/curl.so
apache2 25011 www
-data  mem    REG        8,3  420903 738319663 /usr/lib/php5/20060613+lfs/apc.so
apache2 25011 www
-data  mem    REG        8,3   26040 738200018 /usr/lib/gconv/gconv-modules.cache
apache2 25011 www
-data  DEL    REG        0,9            403961 /dev/zero
apache2 25011 www
-data  mem    REG        8,3   17884     11952 /lib/tls/i686/cmov/libnss_dns-2.8.90.so
apache2 25011 www
-data  mem    REG        8,3   42508     11953 /lib/tls/i686/cmov/libnss_files-2.8.90.so
apache2 25011 www
-data  mem    REG        8,3   38448     11955 /lib/tls/i686/cmov/libnss_nis-2.8.90.so
apache2 25011 www
-data  mem    REG        8,3   30436     11951 /lib/tls/i686/cmov/libnss_compat-2.8.90.so
apache2 25011 www
-data  mem    REG        8,3    9476 738223805 /usr/lib/gconv/ISO8859-1.so
apache2 25011 www
-data  mem    REG        8,3   14020 738319677 /usr/lib/php5/20060613+lfs/pdo_dblib.so
apache2 25011 www
-data  mem    REG        8,3   22044 671139305 /usr/lib/apache2/modules/mod_status.so
apache2 25011 www
-data  mem    REG        8,3  158956 671139302 /usr/lib/apache2/modules/mod_ssl.so
apache2 25011 www
-data  mem    REG        8,3   59204 671139322 /usr/lib/apache2/modules/mod_rewrite.so
apache2 25011 www
-data  mem    REG        8,3 1286600 537259129 /usr/lib/libxml2.so.2.6.32
apache2 25011 www
-data  mem    REG        8,3   70020 402653537 /lib/libbz2.so.1.0.4
apache2 25011 www
-data  mem    REG        8,3    9636 671139320 /usr/lib/apache2/modules/mod_userdir.so
apache2 25011 www
-data  mem    REG        8,3    9668 671222154 /usr/lib/apache2/modules/mod_setenvif.so
apache2 25011 www
-data  mem    REG        8,3 5433624 671189108 /usr/lib/apache2/modules/libphp5.so
apache2 25011 www
-data  mem    REG        8,3   30312 671139315 /usr/lib/apache2/modules/mod_negotiation.so
apache2 25011 www
-data  mem    REG        8,3   17888 671139303 /usr/lib/apache2/modules/mod_mime.so
apache2 25011 www
-data  mem    REG        8,3    5504 671163808 /usr/lib/apache2/modules/mod_env.so
apache2 25011 www
-data  mem    REG        8,3    9600 671139316 /usr/lib/apache2/modules/mod_dir.so
apache2 25011 www
-data  mem    REG        8,3   17924 671175212 /usr/lib/apache2/modules/mod_deflate.so
apache2 25011 www
-data  mem    REG        8,3    5512 671189106 /usr/lib/apache2/modules/mod_authz_user.so
apache2 25011 www
-data  mem    REG        8,3    9640 671189104 /usr/lib/apache2/modules/mod_authz_host.so
apache2 25011 www
-data  mem    REG        8,3    9676 671189105 /usr/lib/apache2/modules/mod_authz_groupfile.so
apache2 25011 www
-data  mem    REG        8,3    5484 671188171 /usr/lib/apache2/modules/mod_authz_default.so
apache2 25011 www
-data  mem    REG        8,3    5512 671189085 /usr/lib/apache2/modules/mod_authn_file.so
apache2 25011 www
-data  mem    REG        8,3    9640 671188175 /usr/lib/apache2/modules/mod_auth_basic.so
apache2 25011 www
-data  mem    REG        8,3    9436 402655231 /lib/libkeyutils-1.2.so
apache2 25011 www
-data  mem    REG        8,3   30436 537316250 /usr/lib/libkrb5support.so.0.1
apache2 25011 www
-data  mem    REG        8,3  144928 537312056 /usr/lib/libk5crypto.so.3.1
apache2 25011 www
-data  mem    REG        8,3   12844 402703373 /lib/libgpg-error.so.0.3.0
apache2 25011 www
-data  mem    REG        8,3  149332     11948 /lib/tls/i686/cmov/libm-2.8.90.so
apache2 25011 www
-data  mem    REG        8,3   87804     11950 /lib/tls/i686/cmov/libnsl-2.8.90.so
apache2 25011 www
-data  mem    REG        8,3  171028 537312050 /usr/lib/libgssapi_krb5.so.2.2
apache2 25011 www
-data  mem    REG        8,3    9576 402661420 /lib/libcom_err.so.2.1
apache2 25011 www
-data  mem    REG        8,3  592532 537316249 /usr/lib/libkrb5.so.3.3
apache2 25011 www
-data  mem    REG        8,3 1340100 134222052 /usr/lib/i686/cmov/libcrypto.so.0.9.8
apache2 25011 www
-data  mem    REG        8,3  282052 134222063 /usr/lib/i686/cmov/libssl.so.0.9.8
apache2 25011 www
-data  mem    REG        8,3  423876 402655201 /lib/libgcrypt.so.11.4.4
apache2 25011 www
-data  mem    REG        8,3   83552 537282752 /usr/lib/libz.so.1.2.3.3
apache2 25011 www
-data  mem    REG        8,3   67164 537262038 /usr/lib/libtasn1.so.3.0.15
apache2 25011 www
-data  mem    REG        8,3  641504 537263198 /usr/lib/libgnutls.so.26.4.5
apache2 25011 www
-data  mem    REG        8,3   67408     11959 /lib/tls/i686/cmov/libresolv-2.8.90.so
apache2 25011 www
-data  mem    REG        8,3   92168 537279617 /usr/lib/libsasl2.so.2.0.22
apache2 25011 www
-data  mem    REG        8,3    9676     11947 /lib/tls/i686/cmov/libdl-2.8.90.so
apache2 25011 www
-data  mem    REG        8,3   38300     11946 /lib/tls/i686/cmov/libcrypt-2.8.90.so
apache2 25011 www
-data  mem    REG        8,3   34720     11960 /lib/tls/i686/cmov/librt-2.8.90.so
apache2 25011 www
-data  mem    REG        8,3   13872 402655617 /lib/libuuid.so.1.2
apache2 25011 www
-data  mem    REG        8,3  152908 537282904 /usr/lib/libexpat.so.1.5.2
apache2 25011 www
-data  mem    REG        8,3  452292 537282773 /usr/lib/libsqlite3.so.0.8.6
apache2 25011 www
-data  mem    REG        8,3 1979888 537282898 /usr/lib/libmysqlclient_r.so.15.0.0
apache2 25011 www
-data  mem    REG        8,3  130996 537426017 /usr/lib/libpq.so.5.1
apache2 25011 www
-data  mem    REG        8,3 1234948 537282777 /usr/lib/libdb-4.6.so
apache2 25011 www
-data  mem    REG        8,3   50628 537260470 /usr/lib/liblber-2.4.so.2.1.0
apache2 25011 www
-data  mem    REG        8,3  261444 537263162 /usr/lib/libldap_r-2.4.so.2.1.0
apache2 25011 www
-data  mem    REG        8,3 1425800     11944 /lib/tls/i686/cmov/libc-2.8.90.so
apache2 25011 www
-data  mem    REG        8,3  116457     11958 /lib/tls/i686/cmov/libpthread-2.8.90.so
apache2 25011 www
-data  mem    REG        8,3  170576 537422200 /usr/lib/libapr-1.so.0.2.12
apache2 25011 www
-data  mem    REG        8,3  116956 537280874 /usr/lib/libaprutil-1.so.0.2.12
apache2 25011 www
-data  mem    REG        8,3  165124 402653321 /lib/libpcre.so.3.12.1
apache2 25011 www
-data  mem    REG        8,3    9668 671139321 /usr/lib/apache2/modules/mod_alias.so
apache2 25011 www
-data  mem    REG        8,3    5508 671139318 /usr/lib/apache2/modules/mod_actions.so
apache2 25011 www
-data  mem    REG        8,3  113252 402654344 /lib/ld-2.8.90.so
apache2 25011 www
-data    0r   CHR        1,3              5498 /dev/null
apache2 25011 www
-data    1w   CHR        1,3              5498 /dev/null
apache2 25011 www
-data    2w   REG        8,3   20423 604123576 /var/log/apache2/error.log
apache2 25011 www
-data    3u  IPv4     403913               TCP *:www (LISTEN)
apache2 25011 www-data    4u  IPv4     403915               TCP *:https (LISTEN)
apache2 25011 www-data    5r  FIFO        0,6            403953 pipe
apache2 25011 www
-data    6w  FIFO        0,6            403953 pipe
apache2 25011 www
-data    7w   REG        8,3    3405 604123596 /var/log/apache2/other_vhosts_access.log
apache2 25011 www
-data    8w   REG        8,3  510097 604123574 /var/log/apache2/access.log
apache2 25011 www
-data    9w   REG        8,3  510097 604123574 /var/log/apache2/access.log
apache2 25011 www
-data   10w   REG        8,3  510097 604123574 /var/log/apache2/access.log
apache2 25011 www
-data   11w   REG        8,3  510097 604123574 /var/log/apache2/access.log
apache2 25011 www
-data   12w   REG        8,3  510097 604123574 /var/log/apache2/access.log
apache2 25011 www
-data   13w   REG        8,3  510097 604123574 /var/log/apache2/access.log
apache2 25011 www
-data   14w   REG       0,18       0    403937 /var/run/apache2/ssl_mutex (deleted)
apache2 25011 www-data   15u  0000        0,7       0        29 anon_inode
apache2 25011 www
-data   16u  IPv4     406982               TCP polarbear:www->d38-13-211.commercial1.cgocable.net:44108 (ESTABLISHED)
apache2 25011 www-data   17u  unix 0xf5c06c40            406983 socket
apache2 25011 www
-data   18u  IPv4     404216               TCP localhost:53636->localhost:11211 (ESTABLISHED)

Apache is writing to logs, sockets, /dev/null but I can’t tell which is the culprit. I thought that writing to the session was the problem so I installed memcache to handle the sessions and there was no difference in performance at all. So writing the session data to the filesystem directly isn’t the issue.

 
Magento Community Magento Community
Magento Community
Magento Community
 
skippybosco
Moderator
 
Avatar
Total Posts:  796
Joined:  2008-10-03
 

Do you have cache enabled? I’m curious how your numbers change when you disable caching for Magento (and clear var/cache folder)

 
Magento Community Magento Community
Magento Community
Magento Community
 
Richard Ayotte
Jr. Member
 
Total Posts:  7
Joined:  2009-02-28
 

I had Magento cache disabled so re-enabled it.

I then loaded the config page a bunch of time, no difference. Always taking between 12 and 14 seconds with abnormal disk activity.

I then did:

Catalog Rewrites -> Refresh
Images Cache -> Clear
Layered Navigation Indices -> Refresh Now
Search Index -> Rebuild
Inventory Stock Status -> Refresh

Loaded the config page again and no difference, still 12 to 14 seconds.

 
Magento Community Magento Community
Magento Community
Magento Community
 
GianlucaZ
Jr. Member
 
Total Posts:  19
Joined:  2009-01-22
 

hi richard,

i wonder if you had any luck in solving this issue? im experiencing some weird speed problems in the administration myself.

 
Magento Community Magento Community
Magento Community
Magento Community
 
Richard Ayotte
Jr. Member
 
Total Posts:  7
Joined:  2009-02-28
 

@GianlucaZ: No, I haven’t. I’ve also been updating the the latest versions as they’ve been coming out but still the problem persists.

 
Magento Community Magento Community
Magento Community
Magento Community
Magento Community
Magento Community
Back to top