CFMX7 becomes Unresponsive

[Phil Fenstermacher]

I'm running CFMX7 on a server, and we're trying to avoid upgrading to CF8 since we're actually trying to move away from CF.

The server was running for weeks at a time with no issues, until recently.  After a reboot (because of a Kernel upgrade for RHEL) it started acting up.

Roughly every 12 hours, the cfmx7 process becomes unresponsive, and takes up about 100% of the CPU.  This makes the server seem unresponsive to web requests.  The only message in the log when this happens is "java.lang.OutOfMemoryError" over and over until the process is killed and the service is restarted.

I've already tried upping the memory in the JVM, but still no fix.  Any other thoughts?

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date
Get the Free Trial
http://ad.doubleclick.net/clk;207172674;29440083;f

Archive: http://www.houseoffusion.com/groups/cf-server/message.cfm/messageid:6811
Subscription: http://www.houseoffusion.com/groups/cf-server/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=17837.14401.10

[James Holmes-3]

I assume you're increasing the heap size without increasing the perm
space to match. You are probably running out of perm space; what's it
currently set to?

mxAjax / CFAjax docs and other useful articles:
http://www.bifrost.com.au/blog/



2009/5/5 Phil Fenstermacher <phillip.fenstermacher@...>:

>
> I'm running CFMX7 on a server, and we're trying to avoid upgrading to CF8 since we're actually trying to move away from CF.
>
> The server was running for weeks at a time with no issues, until recently.  After a reboot (because of a Kernel upgrade for RHEL) it started acting up.
>
> Roughly every 12 hours, the cfmx7 process becomes unresponsive, and takes up about 100% of the CPU.  This makes the server seem unresponsive to web requests.  The only message in the log when this happens is "java.lang.OutOfMemoryError" over and over until the process is killed and the service is restarted.
>
> I've already tried upping the memory in the JVM, but still no fix.  Any other thoughts?
>
>

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date
Get the Free Trial
http://ad.doubleclick.net/clk;207172674;29440083;f

Archive: http://www.houseoffusion.com/groups/cf-server/message.cfm/messageid:6812
Subscription: http://www.houseoffusion.com/groups/cf-server/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=17837.14401.10

[Steven Erat - Webapper Services]

Phil,

There are multiple possible reasons for encountering the out of memory
error, other than the main jvm heap, including hitting the ceiling on the
Permanent Generation heap or encountering "Unable to create new native
thread", etc.

It might be helpful to post a log snippet starting a few entries before to a
few entries later, to see the context and detail of the error (if any).
That sometimes points to what the actual source might be.

You can also enable JRun metrics in the jrun.xml file which will log memory
utilization.  Additionally, you can prepare for taking a stack trace (or
three) at the time that the server is unresponsive.  That will enable you to
see the thread pool and which pages are running and their state.  By taking
several thread dumps over a brief period (during the hang) you can compare
them to see what's been processed and what's hung.   JRun metrics and stack
trace generation are easily Googlable for details of usage.  If you're still
stuck, sometimes JVM Garbage Collection logging is helpful.


--
Steven Erat
Webapper Services



On Mon, May 4, 2009 at 12:19 PM, Phil Fenstermacher <
phillip.fenstermacher@...> wrote:

>
> I'm running CFMX7 on a server, and we're trying to avoid upgrading to CF8
> since we're actually trying to move away from CF.
>
> The server was running for weeks at a time with no issues, until recently.
>  After a reboot (because of a Kernel upgrade for RHEL) it started acting up.
>
> Roughly every 12 hours, the cfmx7 process becomes unresponsive, and takes
> up about 100% of the CPU.  This makes the server seem unresponsive to web
> requests.  The only message in the log when this happens is
> "java.lang.OutOfMemoryError" over and over until the process is killed and
> the service is restarted.
>
> I've already tried upping the memory in the JVM, but still no fix.  Any
> other thoughts?
>
>

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date
Get the Free Trial
http://ad.doubleclick.net/clk;207172674;29440083;f

Archive: http://www.houseoffusion.com/groups/cf-server/message.cfm/messageid:6813
Subscription: http://www.houseoffusion.com/groups/cf-server/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=17837.14401.10

[Phil Fenstermacher]

Min and Max Heap size is set to 1024 and I've attached the JVM Arguments here as well.

-server -Dsun.io.useCanonCaches=false -XX:MaxPermSize=128m -XX:PermSize=64m -XX:NewSize=48m -Dcoldfusion.rootDir={application.home}/../ -Dcoldfusion.libPath={application.home}/../lib

Thanks for all the help so far, it at least points me in the right direction.

>I assume you're increasing the heap size without increasing the perm
>space to match. You are probably running out of perm space; what's it
>currently set to?
>
>mxAjax / CFAjax docs and other useful articles:
>http://www.bifrost.com.au/blog/
>>

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date
Get the Free Trial
http://ad.doubleclick.net/clk;207172674;29440083;f

Archive: http://www.houseoffusion.com/groups/cf-server/message.cfm/messageid:6814
Subscription: http://www.houseoffusion.com/groups/cf-server/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=17837.14401.10

[James Holmes-3]

Ah, your perm space is 128MB Max. Since you've doubled the heap size
to 1024, as a rough first go try doubling the max perm space
-XX:MaxPermSize=256m.

mxAjax / CFAjax docs and other useful articles:
http://www.bifrost.com.au/blog/

2009/5/5 Phil Fenstermacher <phillip.fenstermacher@...>:
>
> Min and Max Heap size is set to 1024 and I've attached the JVM Arguments here as well.
>
> -server -Dsun.io.useCanonCaches=false -XX:MaxPermSize=128m -XX:PermSize=64m -XX:NewSize=48m -Dcoldfusion.rootDir={application.home}/../ -Dcoldfusion.libPath={application.home}/../lib
>
> Thanks for all the help so far, it at least points me in the right direction.

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date
Get the Free Trial
http://ad.doubleclick.net/clk;207172674;29440083;f

Archive: http://www.houseoffusion.com/groups/cf-server/message.cfm/messageid:6816
Subscription: http://www.houseoffusion.com/groups/cf-server/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=17837.14401.10

[Wil Genovese]

Another thing that has not been mentioned or asked about is which JVM  
version are you running? If your using Sun's JVM then anything less  
than 1.4.2_13 should be upgraded.  Here is some more information on  
which JVM version you should be using.

http://www.trunkful.com/index.cfm/2009/1/16/Coldfusion-JVM-Version



Wil Genovese

One man with courage makes a majority.
-Andrew Jackson

A fine is a tax for doing wrong. A tax is a fine for doing well.

On May 4, 2009, at 7:29 PM, James Holmes wrote:

>
> Ah, your perm space is 128MB Max. Since you've doubled the heap size
> to 1024, as a rough first go try doubling the max perm space
> -XX:MaxPermSize=256m.
>
> mxAjax / CFAjax docs and other useful articles:
> http://www.bifrost.com.au/blog/
>
> 2009/5/5 Phil Fenstermacher <phillip.fenstermacher@...>:
>>
>> Min and Max Heap size is set to 1024 and I've attached the JVM  
>> Arguments here as well.
>>
>> -server -Dsun.io.useCanonCaches=false -XX:MaxPermSize=128m -
>> XX:PermSize=64m -XX:NewSize=48m -
>> Dcoldfusion.rootDir={application.home}/../ -
>> Dcoldfusion.libPath={application.home}/../lib
>>
>> Thanks for all the help so far, it at least points me in the right  
>> direction.
>
>

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date
Get the Free Trial
http://ad.doubleclick.net/clk;207172674;29440083;f

Archive: http://www.houseoffusion.com/groups/cf-server/message.cfm/messageid:6817
Subscription: http://www.houseoffusion.com/groups/cf-server/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=17837.14401.10

[Steven Erat - Webapper Services]

On Mon, May 4, 2009 at 8:36 PM, Wil Genovese <juggler@...> wrote:

>
> Another thing that has not been mentioned or asked about is which JVM
> version are you running? If your using Sun's JVM then anything less
> than 1.4.2_13 should be upgraded.  Here is some more information on
> which JVM version you should be using.
>
> http://www.trunkful.com/index.cfm/2009/1/16/Coldfusion-JVM-Version
>
>
>
> Wil Genovese
>

Its true that recent versions of the JVM have dramatic performance increases
over the 1.4 series, ColdFusion MX 7 doesn't support JVM 1.5 or 1.6 because
some features will not function under the newer versions.

http://www.adobe.com/products/coldfusion/coldfusion7/systemreqs/

ColdFusion 8, on the other hand, has a great performance improvement over
CF7 partly because it runs on the newer JVM 1.6 (and partly because
performance improvement was itself a development feature with CF8).


--
Steven Erat
Webapper Services
http://www.webapper.com/


~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date
Get the Free Trial
http://ad.doubleclick.net/clk;207172674;29440083;f

Archive: http://www.houseoffusion.com/groups/cf-server/message.cfm/messageid:6818
Subscription: http://www.houseoffusion.com/groups/cf-server/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=17837.14401.10

[Wil Genovese]

That is true, but there are huge differences within the 1.4.2_xx series.
Like I pointed out, if the JVM is running anything older than 1.4.2_13 it
really should be upgraded.  The most recent version in that series that I
know of 1.4.2_19.  The last version I have experience with and found to be
stable was 1.4.2_17.

Wil Genovese
Sr. Web Application Developer
http://www.trunkful.com






On Tue, May 5, 2009 at 8:11 AM, Steven Erat - Webapper Services <
serat@...> wrote:

>
> On Mon, May 4, 2009 at 8:36 PM, Wil Genovese <juggler@...> wrote:
>
> >
> > Another thing that has not been mentioned or asked about is which JVM
> > version are you running? If your using Sun's JVM then anything less
> > than 1.4.2_13 should be upgraded.  Here is some more information on
> > which JVM version you should be using.
> >
> > http://www.trunkful.com/index.cfm/2009/1/16/Coldfusion-JVM-Version
> >
> >
> >
> > Wil Genovese
> >
>
>
>
> Its true that recent versions of the JVM have dramatic performance
> increases
> over the 1.4 series, ColdFusion MX 7 doesn't support JVM 1.5 or 1.6 because
> some features will not function under the newer versions.
>
> http://www.adobe.com/products/coldfusion/coldfusion7/systemreqs/
>
> ColdFusion 8, on the other hand, has a great performance improvement over
> CF7 partly because it runs on the newer JVM 1.6 (and partly because
> performance improvement was itself a development feature with CF8).
>
>
> --
> Steven Erat
> Webapper Services
> http://www.webapper.com/
>
>
>

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date
Get the Free Trial
http://ad.doubleclick.net/clk;207172674;29440083;f

Archive: http://www.houseoffusion.com/groups/cf-server/message.cfm/messageid:6819
Subscription: http://www.houseoffusion.com/groups/cf-server/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=17837.14401.10