Recently, our development team has experienced significantly slow response times in Percussion when clicking edit on pages or assets, switching sections or creating new assets. At times, it could take up to 15-20 seconds for a single action to take place.
I understand your team uses Macs. I am currently running some tests to see if any of your issues here and in your two other posts are Mac-specific. I’ll get back to you shortly to let you know what I find. For this problem in particular it might have to do with your database, in which case I can open up a support ticket for you to look into this deeper. Do you know if you’re using the embedded Derby database, or an external SQL database?
I wanted to add that this morning’s slow down seems different in nature. We see the effect when logging in and when we open folders. The root level itself shows the spinning circle for some time before showing its contents.
Thanks for the information. Can you give me a rough estimate of the amount of pages and users in your system? I’m looking into whether the types of slowdowns you are experiencing are consistent with the issues you might face when operating a large Derby database, or if this is an unrelated issue.
I’m glad to hear the restart appears to have sped you system up. Another thing to check is if you use any combination of the Activity, Traffic, and What’s Working gadgets on you dashboard, these can use a large amount of database bandwidth, which might lead to the slowdowns you’ve described. If you are using any of these gadgets and encounter further slow response times, try disabling them and see if that speeds things up.
It does sound like a memory issue, then. Can you tell me if you are on CM1 2.6 or 2.7? There was a known inefficacy with the Derby database which affected 2.6, leading to memory usage issues and slowdowns similar to what you’re describing. If memory serves, however, we were on a call with you earlier this month to upgrade to 2.7. Is this correct?
Another thing, do you know if your CM1 application server is running in a 32bit or 64bit environment?
I’m looking into other possible ways to improve your performance; I will get back to you when I know more.
You can check the available memory on your Unbuntu server using the “free -t -m” command. It will list totals in megabytes. It would also be usefull to see the output from top to see how much memory java processes are using.
There are 2 files that contain settings that control how much memory CM1 uses on Linux with embedded Derby both in the installation directory.
To add some more information to this, it has come to our attention that on Linux machines, the DatabaseStartup.sh script defaults to use only 128MB, as opposed to CM1’s intended default of 512MB. A fix for this is expected in CM1 2.8.
If any other customers are running CM1 on a Linux machine and are using the Derby database, they should check the DatabaseStartup.sh file at CM1’s root and verify that the line Nate referenced above is allocating at least 512MB for the database.
Thanks for bumping up that memory. We did notice fast response times. However, we’ve noticed these past few weeks that after a few days of use, Percussion will start bogging down again. To fix it, we’ve been running a quick shutdown/startup; after which, it seems to run fine again.
Jonathan mentioned in the future (if support becomes available) of possibility migrating our database from Derby to MYSQL.
In the meantime, is there anything else we can do to improve response times? It’s specifically slow when editing, saving or approving site-wide assets.
Beyond migrating from Derby over to MySQL – which is a feature we’re targeting for the first half of 2013, as indicated in this topic: https://community.percussion.com/t/can-we-migrate-to-sql-from-derby/757 – the next obvious step would be to check your available system memory for the machine which CM1 runs off of (using the command Nate posted above), and look into the possibility of adding more system memory. I will follow-up if I think of any other ways to optimize your machine for CM1.
When you say CM1 is running out of memory, does the UI appear to be slowing down after a while, or is it simply becoming unresponsive after a time and requiring a restart?
Can you tell me how much RAM the machine which runs CM1 has available, and if you run your CM1 database on the same machine (or if you’re using the embedded Derby database)? Additionally, you say you increased the system’s memory allocation – are you referring to the “-Xms128m -Xmx1024m” settings in the PercussionServer.bin.lax config file? If so, can you tell me what you set these to?
Without looking at your server log file to know for sure, it sounds like you are running out of Java heap space again. It is not uncommon to have to allocate 3GB to the CM1 Java process, depending on the size and quantity of the content you have in CM1 (we allocate 3GB for the CM1 instance we use to run Percusison.com, for instance).
I believe your system has 8GM of RAM available, is that correct? If so, as a next step, I would recommend upping both your Xms and your Xmx settings in that PercussionServer.bin.lax from:
Be sure to stop then start CM1 after making these changes. You can find additional information about these options in this help document:
We at Embry-Riddle worldwide are having this problem again! This is getting pretty frustrating, what are our next steps?
Our middleware folks are out today so we will lose two days of development time because we cannot restart the system. Our deadlines are tight, I cannot spare two days.
Director, Web Services Embry-Riddle Worldwide Claryc@erau.edu
I completely understand your frustration. Do you know if your middleware people were able to make the memory allocation adjustments I recommended previously? At any rate, I’m going to reach out to you through our existing support ticket to see if there’s anything we can do to get you back in the system in the meantime.