#1204 [HHQ-1958] Many runnable threads at ValueChangeTrigger.proce

[Hyperic Team]

http://jira.hyperic.com/browse/HHQ-1958
On performance environment where I have lots of value change alert definitions (active) I am seeing lots of threads consistently in runnable state at following location.


Tom suggested that we should atleast log this measurement IDs in the debug log message. Need to investigate why are so many threads stuck at this location

"JMS SessionPool Worker-14" daemon prio=10 tid=0x00002aabc3b4ac00 nid=0x6937 runnable [0x0000000057685000..0x0000000057686d00]


   java.lang.Thread.State: RUNNABLE


        at org.hyperic.hq.bizapp.server.trigger.conditional.ValueChangeTrigger.processEvent(ValueChangeTrigger.java:153)


        at org.hyperic.hq.bizapp.server.mdb.RegisteredDispatcherEJBImpl.dispatchEvent(RegisteredDispatcherEJBImpl.java:103)


        at org.hyperic.hq.bizapp.server.mdb.RegisteredDispatcherEJBImpl.onMessage(RegisteredDispatcherEJBImpl.java:175)


        at sun.reflect.GeneratedMethodAccessor532.invoke(Unknown Source)


        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)


        at java.lang.reflect.Method.invoke(Method.java:597)


        at org.jboss.invocation.Invocation.performCall(Invocation.java:345)


        at org.jboss.ejb.MessageDrivenContainer$ContainerInterceptor.invoke(MessageDrivenContainer.java:475)


        at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:149)


        at org.jboss.ejb.plugins.MessageDrivenInstanceInterceptor.invoke(MessageDrivenInstanceInterceptor.java:101)


        at org.jboss.ejb.plugins.CallValidationInterceptor.invoke(CallValidationInterceptor.java:48)


        at org.hyperic.hq.application.HQApp$Snatcher.invokeNextBoth(HQApp.java:416)


        at org.hyperic.hq.application.HQApp$Snatcher.invokeNext(HQApp.java:468)


        at org.hyperic.txsnatch.TxSnatch.invoke(TxSnatch.java:71)


        at org.jboss.ejb.plugins.AbstractTxInterceptor.invokeNext(AbstractTxInterceptor.java:106)


        at org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxInterceptorCMT.java:335)


        at org.jboss.ejb.plugins.TxInterceptorCMT.invoke(TxInterceptorCMT.java:166)


        at org.hyperic.hq.application.HQApp$Snatcher.invokeNextBoth(HQApp.java:416)


        at org.hyperic.hq.application.HQApp$Snatcher.invokeNext(HQApp.java:468)


        at org.hyperic.txsnatch.TxSnatch.invoke(TxSnatch.java:71)


        at org.jboss.ejb.plugins.RunAsSecurityInterceptor.invoke(RunAsSecurityInterceptor.java:94)


        at org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:192)


        at org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invoke(ProxyFactoryFinderInterceptor.java:122)


        at org.jboss.ejb.MessageDrivenContainer.internalInvoke(MessageDrivenContainer.java:389)


        at org.jboss.ejb.Container.invoke(Container.java:873)


        at org.jboss.ejb.plugins.jms.JMSContainerInvoker.invoke(JMSContainerInvoker.java:1077)


        at org.jboss.ejb.plugins.jms.JMSContainerInvoker$MessageListenerImpl.onMessage(JMSContainerInvoker.java:1379)


        at org.jboss.jms.asf.StdServerSession.onMessage(StdServerSession.java:256)


        at org.jboss.mq.SpyMessageConsumer.sessionConsumerProcessMessage(SpyMessageConsumer.java:904)


        at org.jboss.mq.SpyMessageConsumer.addMessage(SpyMessageConsumer.java:160)


        at org.jboss.mq.SpySession.run(SpySession.java:333)


        - locked <0x00002aab0cf664c0> (a java.util.LinkedList)


        at org.jboss.jms.asf.StdServerSession.run(StdServerSession.java:180)


        at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:748)


        at java.lang.Thread.run(Thread.java:619)