CDV ❯ Deadlock in AspectWerks (tickled by Geronimo

• Type: Bug
• Status: Closed
• Priority: 1 Critical
• Resolution: Fixed
• Component/s: DSO:L1,X-AspectWerkz
• Labels:

• Assignee: teck
• Reporter:
• Created: February 06, 2007
• Votes: 0
• Watchers: 0
• Updated:

  July 27, 2012
• Resolved:

  February 27, 2007

Attachments

• (3.00 k) application/xml tc-config.xml

Description

Full thread dump Java HotSpot(TM) Client VM (1.5.0_06-64 mixed mode):

“Geronimo shutdown thread” prio=5 tid=0x00593730 nid=0x18ae800 waiting for monitor entry [0xb171d000..0xb171ed10] at com.tc.aspectwerkz.reflect.impl.asm.AsmClassInfoRepository.getRepository(AsmClassInfoRepository.java:80) - waiting to lock <0x0b0a4728> (a java.lang.Class) at com.tc.aspectwerkz.reflect.impl.asm.AsmClassInfo.getClassInfo(AsmClassInfo.java:298) at com.tc.object.bytecode.hook.impl.DefaultWeavingStrategy.transform(DefaultWeavingStrategy.java:92) at com.tc.object.bytecode.hook.impl.DSOContextImpl.preProcess(DSOContextImpl.java:109) at com.tc.object.bytecode.hook.impl.ClassProcessorHelper.defineClass0Pre(ClassProcessorHelper.java:415) at java.lang.ClassLoader.defineClass(ClassLoader.java:620) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124) at org.apache.geronimo.kernel.classloader.JarFileClassLoader.access$200(JarFileClassLoader.java:51) at org.apache.geronimo.kernel.classloader.JarFileClassLoader$6.run(JarFileClassLoader.java:275) at java.security.AccessController.doPrivileged(Native Method) at org.apache.geronimo.kernel.classloader.JarFileClassLoader.findClass(JarFileClassLoader.java:227) at org.apache.geronimo.kernel.config.MultiParentClassLoader.loadClass(MultiParentClassLoader.java:243) - locked <0x076d9300> (a org.apache.geronimo.kernel.classloader.JarFileClassLoader) at java.lang.ClassLoader.loadClass(ClassLoader.java:251) at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319) - locked <0x076d9300> (a org.apache.geronimo.kernel.classloader.JarFileClassLoader) at org.apache.catalina.startup.ContextConfig.destroy(ContextConfig.java:1271) - locked <0x07f71e60> (a org.apache.catalina.startup.ContextConfig) at org.apache.catalina.startup.ContextConfig.lifecycleEvent(ContextConfig.java:281) at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:119) at org.apache.catalina.core.StandardContext.destroy(StandardContext.java:4419) at org.apache.geronimo.tomcat.TomcatContainer.removeContext(TomcatContainer.java:325) at org.apache.geronimo.tomcat.TomcatContainer\(FastClassByCGLIB\)9370b073.invoke() at net.sf.cglib.reflect.FastMethod.invoke(FastMethod.java:53) at org.apache.geronimo.gbean.runtime.FastMethodInvoker.invoke(FastMethodInvoker.java:38) at org.apache.geronimo.gbean.runtime.GBeanOperation.invoke(GBeanOperation.java:122) at org.apache.geronimo.gbean.runtime.GBeanInstance.invoke(GBeanInstance.java:817) at org.apache.geronimo.gbean.runtime.RawInvoker.invoke(RawInvoker.java:57) at org.apache.geronimo.kernel.basic.RawOperationInvoker.invoke(RawOperationInvoker.java:35) at org.apache.geronimo.kernel.basic.ProxyMethodInterceptor.intercept(ProxyMethodInterceptor.java:96) at org.apache.geronimo.tomcat.TomcatContainer$$EnhancerByCGLIB$$5a4a35f1.removeContext() at org.apache.geronimo.tomcat.TomcatWebAppContext.doStop(TomcatWebAppContext.java:449) at org.apache.geronimo.gbean.runtime.GBeanInstance.destroyInstance(GBeanInstance.java:1143) at org.apache.geronimo.gbean.runtime.GBeanInstanceState.attemptFullStop(GBeanInstanceState.java:337) at org.apache.geronimo.gbean.runtime.GBeanInstanceState.stop(GBeanInstanceState.java:188) at org.apache.geronimo.gbean.runtime.GBeanInstance.stop(GBeanInstance.java:548) at org.apache.geronimo.kernel.basic.BasicKernel.stopGBean(BasicKernel.java:423) at org.apache.geronimo.gbean.runtime.GBeanInstanceState.stop(GBeanInstanceState.java:180) at org.apache.geronimo.gbean.runtime.GBeanInstance.stop(GBeanInstance.java:548) at org.apache.geronimo.kernel.basic.BasicKernel.stopGBean(BasicKernel.java:423) at org.apache.geronimo.kernel.config.KernelConfigurationManager$ShutdownHook.run(KernelConfigurationManager.java:310) at org.apache.geronimo.kernel.basic.BasicKernel.notifyShutdownHooks(BasicKernel.java:668) at org.apache.geronimo.kernel.basic.BasicKernel.shutdown(BasicKernel.java:645) at org.apache.geronimo.system.main.Daemon$1.run(Daemon.java:245)

“SIGINT handler” daemon prio=9 tid=0x00593380 nid=0x1939600 in Object.wait() [0xb161c000..0xb161cd10] at java.lang.Object.wait(Native Method) - waiting on <0x07165cc0> (a org.apache.geronimo.system.main.Daemon$1) at java.lang.Thread.join(Thread.java:1113) - locked <0x07165cc0> (a org.apache.geronimo.system.main.Daemon$1) at java.lang.Thread.join(Thread.java:1166) at java.lang.Shutdown.runHooks(Shutdown.java:132) at java.lang.Shutdown.sequence(Shutdown.java:173) at java.lang.Shutdown.exit(Shutdown.java:218) - locked <0x0ae141a0> (a java.lang.Class) at java.lang.Terminator$1.handle(Terminator.java:35) at sun.misc.Signal$1.run(Signal.java:195) at java.lang.Thread.run(Thread.java:613)

“ConnectionEstablisher” daemon prio=5 tid=0x00590920 nid=0x193fe00 in Object.wait() [0xb151a000..0xb151ad10] at java.lang.Object.wait(Native Method) - waiting on <0x07101d90> (a com.tc.net.protocol.transport.MessageTransportStatus) at com.tc.util.concurrent.TCFuture.get(TCFuture.java:88) - locked <0x07101d90> (a com.tc.net.protocol.transport.MessageTransportStatus) at com.tc.util.concurrent.TCFuture.get(TCFuture.java:64) at com.tc.net.protocol.transport.ClientMessageTransport.waitForSynAck(ClientMessageTransport.java:225) at com.tc.net.protocol.transport.ClientMessageTransport.handShake(ClientMessageTransport.java:219) at com.tc.net.protocol.transport.ClientMessageTransport.reconnect(ClientMessageTransport.java:259) at com.tc.net.protocol.transport.ClientConnectionEstablisher.reconnect(ClientConnectionEstablisher.java:144) at com.tc.net.protocol.transport.ClientConnectionEstablisher.run(ClientConnectionEstablisher.java:211) at java.lang.Thread.run(Thread.java:613)

“Geronimo hot deploy scanner” daemon prio=5 tid=0x0058b490 nid=0x1ae2c00 waiting on condition [0xb457a000..0xb457ad10] at java.lang.Thread.sleep(Native Method) at org.apache.geronimo.deployment.hot.DirectoryMonitor.run(DirectoryMonitor.java:194) at java.lang.Thread.run(Thread.java:613)

“Geronimo Config Store Reaper” daemon prio=5 tid=0x0057d1b0 nid=0x1a63600 waiting on condition [0xb44f9000..0xb44f9d10] at java.lang.Thread.sleep(Native Method) at org.apache.geronimo.deployment.Deployer$DeployerReaper.run(Deployer.java:438) at java.lang.Thread.run(Thread.java:613)

“TP-Monitor” daemon prio=5 tid=0x0057bef0 nid=0x1a51400 in Object.wait() [0xb4478000..0xb4478d10] at java.lang.Object.wait(Native Method) - waiting on <0x07976920> (a org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable) at org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable.run(ThreadPool.java:559) - locked <0x07976920> (a org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable) at java.lang.Thread.run(Thread.java:613)

“TP-Processor4” daemon prio=5 tid=0x0057bae0 nid=0x1a51000 runnable [0xb43f7000..0xb43f7d10] at java.net.PlainSocketImpl.socketAccept(Native Method) at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) - locked <0x079769c0> (a java.net.SocksSocketImpl) at java.net.ServerSocket.implAccept(ServerSocket.java:450) at java.net.ServerSocket.accept(ServerSocket.java:421) at org.apache.jk.common.ChannelSocket.accept(ChannelSocket.java:293) at org.apache.jk.common.ChannelSocket.acceptConnections(ChannelSocket.java:647) at org.apache.jk.common.ChannelSocket$SocketAcceptor.runIt(ChannelSocket.java:857) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684) at java.lang.Thread.run(Thread.java:613)

“TP-Processor3” daemon prio=5 tid=0x0057b6d0 nid=0x1a52600 in Object.wait() [0xb4376000..0xb4376d10] at java.lang.Object.wait(Native Method) - waiting on <0x07976c60> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x07976c60> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“TP-Processor2” daemon prio=5 tid=0x0057b2d0 nid=0x1a52200 in Object.wait() [0xb42f5000..0xb42f5d10] at java.lang.Object.wait(Native Method) - waiting on <0x07976cf8> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x07976cf8> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“TP-Processor1” daemon prio=5 tid=0x0057b000 nid=0x1a61200 in Object.wait() [0xb4274000..0xb4274d10] at java.lang.Object.wait(Native Method) - waiting on <0x07976d90> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x07976d90> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-9081-Monitor” prio=5 tid=0x00577210 nid=0x1a69400 in Object.wait() [0xb41f3000..0xb41f3d10] at java.lang.Object.wait(Native Method) - waiting on <0x0794ece8> (a org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable) at org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable.run(ThreadPool.java:559) - locked <0x0794ece8> (a org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-9081-Processor25” daemon prio=5 tid=0x00576f40 nid=0x1a74c00 in Object.wait() [0xb4172000..0xb4172d10] at java.lang.Object.wait(Native Method) - waiting on <0x0794eda0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x0794eda0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-9081-Processor24” daemon prio=5 tid=0x00576c70 nid=0x1a69000 runnable [0xb40f1000..0xb40f1d10] at java.net.PlainSocketImpl.socketAccept(Native Method) at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) - locked <0x0792cf80> (a java.net.SocksSocketImpl) at java.net.ServerSocket.implAccept(ServerSocket.java:450) at java.net.ServerSocket.accept(ServerSocket.java:421) at org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:60) at org.apache.tomcat.util.net.PoolTcpEndpoint.acceptSocket(PoolTcpEndpoint.java:407) at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:70) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-9081-Processor23” daemon prio=5 tid=0x005769a0 nid=0x1a68c00 in Object.wait() [0xb4070000..0xb4070d10] at java.lang.Object.wait(Native Method) - waiting on <0x0794eed0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x0794eed0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-9081-Processor22” daemon prio=5 tid=0x005766d0 nid=0x1a50800 in Object.wait() [0xb3fef000..0xb3fefd10] at java.lang.Object.wait(Native Method) - waiting on <0x0794ef68> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x0794ef68> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-9081-Processor21” daemon prio=5 tid=0x00576400 nid=0x1a50400 in Object.wait() [0xb3f6e000..0xb3f6ed10] at java.lang.Object.wait(Native Method) - waiting on <0x0794f000> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x0794f000> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-9081-Processor20” daemon prio=5 tid=0x00576130 nid=0x1a61800 in Object.wait() [0xb3eed000..0xb3eedd10] at java.lang.Object.wait(Native Method) - waiting on <0x0794f098> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x0794f098> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-9081-Processor19” daemon prio=5 tid=0x00575e60 nid=0x1a60e00 in Object.wait() [0xb3e6c000..0xb3e6cd10] at java.lang.Object.wait(Native Method) - waiting on <0x0794f130> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x0794f130> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-9081-Processor18” daemon prio=5 tid=0x00575b90 nid=0x1a60a00 in Object.wait() [0xb3deb000..0xb3debd10] at java.lang.Object.wait(Native Method) - waiting on <0x0794f1c8> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x0794f1c8> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-9081-Processor17” daemon prio=5 tid=0x005758c0 nid=0x1a50000 in Object.wait() [0xb3d6a000..0xb3d6ad10] at java.lang.Object.wait(Native Method) - waiting on <0x0794f260> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x0794f260> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-9081-Processor16” daemon prio=5 tid=0x005755f0 nid=0x1a4fc00 in Object.wait() [0xb3ce9000..0xb3ce9d10] at java.lang.Object.wait(Native Method) - waiting on <0x0794f2f8> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x0794f2f8> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-9081-Processor15” daemon prio=5 tid=0x00575320 nid=0x1a67600 in Object.wait() [0xb3c68000..0xb3c68d10] at java.lang.Object.wait(Native Method) - waiting on <0x0794f390> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x0794f390> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-9081-Processor14” daemon prio=5 tid=0x00575050 nid=0x1a61e00 in Object.wait() [0xb3be7000..0xb3be7d10] at java.lang.Object.wait(Native Method) - waiting on <0x0794f428> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x0794f428> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-9081-Processor13” daemon prio=5 tid=0x00574db0 nid=0x1a60600 in Object.wait() [0xb3b66000..0xb3b66d10] at java.lang.Object.wait(Native Method) - waiting on <0x0794f4c0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x0794f4c0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-9081-Processor12” daemon prio=5 tid=0x00574b80 nid=0x1a50c00 in Object.wait() [0xb3ae5000..0xb3ae5d10] at java.lang.Object.wait(Native Method) - waiting on <0x0794f558> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x0794f558> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-9081-Processor11” daemon prio=5 tid=0x00574880 nid=0x1a72a00 in Object.wait() [0xb3a64000..0xb3a64d10] at java.lang.Object.wait(Native Method) - waiting on <0x0794f5f0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x0794f5f0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-9081-Processor10” daemon prio=5 tid=0x005744f0 nid=0x1a72600 in Object.wait() [0xb39e3000..0xb39e3d10] at java.lang.Object.wait(Native Method) - waiting on <0x0794f688> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x0794f688> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-9081-Processor9” daemon prio=5 tid=0x00574220 nid=0x1a72200 in Object.wait() [0xb3962000..0xb3962d10] at java.lang.Object.wait(Native Method) - waiting on <0x0794f720> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x0794f720> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-9081-Processor8” daemon prio=5 tid=0x00573f50 nid=0x1a68800 in Object.wait() [0xb38e1000..0xb38e1d10] at java.lang.Object.wait(Native Method) - waiting on <0x0794f7b8> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x0794f7b8> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-9081-Processor7” daemon prio=5 tid=0x00573c80 nid=0x1a68400 in Object.wait() [0xb3860000..0xb3860d10] at java.lang.Object.wait(Native Method) - waiting on <0x0794f850> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x0794f850> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-9081-Processor6” daemon prio=5 tid=0x005739b0 nid=0x1a68000 in Object.wait() [0xb37df000..0xb37dfd10] at java.lang.Object.wait(Native Method) - waiting on <0x0794f8e8> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x0794f8e8> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-9081-Processor5” daemon prio=5 tid=0x005736e0 nid=0x1a67c00 in Object.wait() [0xb375e000..0xb375ed10] at java.lang.Object.wait(Native Method) - waiting on <0x0794f980> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x0794f980> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-9081-Processor4” daemon prio=5 tid=0x00573410 nid=0x1a6de00 in Object.wait() [0xb36dd000..0xb36ddd10] at java.lang.Object.wait(Native Method) - waiting on <0x0794fa18> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x0794fa18> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-9081-Processor3” daemon prio=5 tid=0x00573150 nid=0x1a6da00 in Object.wait() [0xb365c000..0xb365cd10] at java.lang.Object.wait(Native Method) - waiting on <0x0794fab0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x0794fab0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-9081-Processor2” daemon prio=5 tid=0x00572ef0 nid=0x1a48000 in Object.wait() [0xb35db000..0xb35dbd10] at java.lang.Object.wait(Native Method) - waiting on <0x0794fb48> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x0794fb48> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-9081-Processor1” daemon prio=5 tid=0x00572d70 nid=0x1a47c00 in Object.wait() [0xb355a000..0xb355ad10] at java.lang.Object.wait(Native Method) - waiting on <0x079208c8> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x079208c8> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-8443-Monitor” prio=5 tid=0x00572180 nid=0x1a6d600 in Object.wait() [0xb34d9000..0xb34d9d10] at java.lang.Object.wait(Native Method) - waiting on <0x07920948> (a org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable) at org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable.run(ThreadPool.java:559) - locked <0x07920948> (a org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-8443-Processor25” daemon prio=5 tid=0x00571c30 nid=0x1a6c800 runnable [0xb3458000..0xb3458d10] at java.net.PlainSocketImpl.socketAccept(Native Method) at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) - locked <0x0792a638> (a java.net.SocksSocketImpl) at java.net.ServerSocket.implAccept(ServerSocket.java:450) at com.sun.net.ssl.internal.ssl.SSLServerSocketImpl.accept(SSLServerSocketImpl.java:259) at org.apache.tomcat.util.net.jsse.JSSESocketFactory.acceptSocket(JSSESocketFactory.java:110) at org.apache.tomcat.util.net.PoolTcpEndpoint.acceptSocket(PoolTcpEndpoint.java:407) at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:70) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-8443-Processor24” daemon prio=5 tid=0x005718c0 nid=0x1a6c400 in Object.wait() [0xb33d7000..0xb33d7d10] at java.lang.Object.wait(Native Method) - waiting on <0x07920b28> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x07920b28> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-8443-Processor23” daemon prio=5 tid=0x00571550 nid=0x1a6c000 in Object.wait() [0xb3356000..0xb3356d10] at java.lang.Object.wait(Native Method) - waiting on <0x07920bc0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x07920bc0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-8443-Processor22” daemon prio=5 tid=0x005710a0 nid=0x1a6bc00 in Object.wait() [0xb32d5000..0xb32d5d10] at java.lang.Object.wait(Native Method) - waiting on <0x07920c58> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x07920c58> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-8443-Processor21” daemon prio=5 tid=0x00570bf0 nid=0x1a6b800 in Object.wait() [0xb3254000..0xb3254d10] at java.lang.Object.wait(Native Method) - waiting on <0x07920cf0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x07920cf0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-8443-Processor20” daemon prio=5 tid=0x00570880 nid=0x1a6b400 in Object.wait() [0xb31d3000..0xb31d3d10] at java.lang.Object.wait(Native Method) - waiting on <0x07920d88> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x07920d88> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-8443-Processor19” daemon prio=5 tid=0x00570510 nid=0x1a37800 in Object.wait() [0xb3152000..0xb3152d10] at java.lang.Object.wait(Native Method) - waiting on <0x07920e20> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x07920e20> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-8443-Processor18” daemon prio=5 tid=0x00570060 nid=0x1a37400 in Object.wait() [0xb30d1000..0xb30d1d10] at java.lang.Object.wait(Native Method) - waiting on <0x07920eb8> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x07920eb8> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-8443-Processor17” daemon prio=5 tid=0x0056fc50 nid=0x1a37000 in Object.wait() [0xb3050000..0xb3050d10] at java.lang.Object.wait(Native Method) - waiting on <0x07920f50> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x07920f50> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-8443-Processor16” daemon prio=5 tid=0x0056f8e0 nid=0x1a36c00 in Object.wait() [0xb2fcf000..0xb2fcfd10] at java.lang.Object.wait(Native Method) - waiting on <0x07920fe8> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x07920fe8> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-8443-Processor15” daemon prio=5 tid=0x0056f4d0 nid=0x1a36800 in Object.wait() [0xb2f4e000..0xb2f4ed10] at java.lang.Object.wait(Native Method) - waiting on <0x07921080> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x07921080> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-8443-Processor14” daemon prio=5 tid=0x0056ef80 nid=0x1a36400 in Object.wait() [0xb2ecd000..0xb2ecdd10] at java.lang.Object.wait(Native Method) - waiting on <0x07921118> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x07921118> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-8443-Processor13” daemon prio=5 tid=0x0056eb70 nid=0x1a36000 in Object.wait() [0xb2e4c000..0xb2e4cd10] at java.lang.Object.wait(Native Method) - waiting on <0x079211b0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x079211b0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-8443-Processor12” daemon prio=5 tid=0x0056e760 nid=0x1a35c00 in Object.wait() [0xb2dcb000..0xb2dcbd10] at java.lang.Object.wait(Native Method) - waiting on <0x07921248> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x07921248> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-8443-Processor11” daemon prio=5 tid=0x0056e490 nid=0x1a35800 in Object.wait() [0xb2d4a000..0xb2d4ad10] at java.lang.Object.wait(Native Method) - waiting on <0x079212e0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x079212e0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-8443-Processor10” daemon prio=5 tid=0x0056df40 nid=0x1a47800 in Object.wait() [0xb2cc9000..0xb2cc9d10] at java.lang.Object.wait(Native Method) - waiting on <0x07921378> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x07921378> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-8443-Processor9” daemon prio=5 tid=0x0056db30 nid=0x1a47400 in Object.wait() [0xb2c48000..0xb2c48d10] at java.lang.Object.wait(Native Method) - waiting on <0x07921410> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x07921410> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-8443-Processor8” daemon prio=5 tid=0x0056d7c0 nid=0x1a47000 in Object.wait() [0xb2bc7000..0xb2bc7d10] at java.lang.Object.wait(Native Method) - waiting on <0x079214a8> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x079214a8> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-8443-Processor7” daemon prio=5 tid=0x0056d450 nid=0x1a46c00 in Object.wait() [0xb2b46000..0xb2b46d10] at java.lang.Object.wait(Native Method) - waiting on <0x07921540> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x07921540> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-8443-Processor6” daemon prio=5 tid=0x0056cf00 nid=0x1a46800 in Object.wait() [0xb2ac5000..0xb2ac5d10] at java.lang.Object.wait(Native Method) - waiting on <0x079215d8> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x079215d8> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-8443-Processor5” daemon prio=5 tid=0x0056caf0 nid=0x1a46400 in Object.wait() [0xb2a44000..0xb2a44d10] at java.lang.Object.wait(Native Method) - waiting on <0x07921670> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x07921670> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-8443-Processor4” daemon prio=5 tid=0x0056c780 nid=0x1a46000 in Object.wait() [0xb29c3000..0xb29c3d10] at java.lang.Object.wait(Native Method) - waiting on <0x07921708> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x07921708> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-8443-Processor3” daemon prio=5 tid=0x0056c410 nid=0x1a48a00 in Object.wait() [0xb2942000..0xb2942d10] at java.lang.Object.wait(Native Method) - waiting on <0x079217a0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x079217a0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-8443-Processor2” daemon prio=5 tid=0x0056bf70 nid=0x1a48600 in Object.wait() [0xb28c1000..0xb28c1d10] at java.lang.Object.wait(Native Method) - waiting on <0x07921838> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x07921838> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“http-0.0.0.0-8443-Processor1” daemon prio=5 tid=0x0056bcc0 nid=0x1939a00 in Object.wait() [0xb2840000..0xb2840d10] at java.lang.Object.wait(Native Method) - waiting on <0x079218d0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x079218d0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:613)

“ContainerBackgroundProcessor[StandardEngine[Geronimo]]” daemon prio=5 tid=0x00568900 nid=0x18e2000 waiting on condition [0xb1820000..0xb1820d10] at java.lang.Thread.sleep(Native Method) at org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1546) at java.lang.Thread.run(Thread.java:613)

“TcpTransportServerChannel@tcp://0.0.0.0:61616” daemon prio=5 tid=0x0055e620 nid=0x18e2800 runnable [0xb27bf000..0xb27bfd10] at java.net.PlainSocketImpl.socketAccept(Native Method) at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) - locked <0x07634de0> (a java.net.SocksSocketImpl) at java.net.ServerSocket.implAccept(ServerSocket.java:450) at java.net.ServerSocket.accept(ServerSocket.java:421) at org.activemq.transport.tcp.TcpTransportServerChannel.run(TcpTransportServerChannel.java:144) at java.lang.Thread.run(Thread.java:613)

“Thread-19” daemon prio=6 tid=0x0055dbf0 nid=0x18e2400 waiting on condition [0xb273e000..0xb273ed10] at java.lang.Thread.sleep(Native Method) at org.activemq.service.boundedvm.TransientQueueBoundedMessageManager.run(TransientQueueBoundedMessageManager.java:194) at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Thread.java:613)

“Dispatch Worker” daemon prio=6 tid=0x0055d8a0 nid=0x1a2d600 in Object.wait() [0xb26bd000..0xb26bdd10] at java.lang.Object.wait(Native Method) - waiting on <0x075fd8d0> (a java.lang.Object) at org.activemq.service.impl.DispatchWorker.run(DispatchWorker.java:120) - locked <0x075fd8d0> (a java.lang.Object) at java.lang.Thread.run(Thread.java:613)

“Durable Queue Worker” daemon prio=6 tid=0x0055d680 nid=0x1a2d200 waiting on condition [0xb263c000..0xb263cd10] at java.lang.Thread.sleep(Native Method) at org.activemq.service.boundedvm.DurableQueueBoundedMessageManager.run(DurableQueueBoundedMessageManager.java:197) at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Thread.java:613)

“Checkpoint Timer” daemon prio=5 tid=0x0055cdc0 nid=0x1a2ce00 waiting for monitor entry [0xb25ba000..0xb25bbd10] at org.apache.geronimo.kernel.config.MultiParentClassLoader.isDestroyed(MultiParentClassLoader.java:377) - waiting to lock <0x073e0088> (a org.apache.geronimo.kernel.classloader.JarFileClassLoader) at org.apache.geronimo.kernel.config.MultiParentClassLoader.getResource(MultiParentClassLoader.java:278) at org.apache.geronimo.kernel.config.MultiParentClassLoader.getResource(MultiParentClassLoader.java:298) at java.lang.ClassLoader.getResourceAsStream(ClassLoader.java:1159) at com.tc.aspectwerkz.reflect.impl.asm.AsmClassInfoRepository.(AsmClassInfoRepository.java:55) at com.tc.aspectwerkz.reflect.impl.asm.AsmClassInfoRepository.getRepository(AsmClassInfoRepository.java:87) - locked <0x0b0a4728> (a java.lang.Class) at com.tc.aspectwerkz.reflect.impl.asm.AsmClassInfo.getClassInfo(AsmClassInfo.java:298) at com.tc.object.bytecode.hook.impl.DefaultWeavingStrategy.transform(DefaultWeavingStrategy.java:92) at com.tc.object.bytecode.hook.impl.DSOContextImpl.preProcess(DSOContextImpl.java:109) at com.tc.object.bytecode.hook.impl.ClassProcessorHelper.defineClass0Pre(ClassProcessorHelper.java:415) at java.lang.ClassLoader.defineClass(ClassLoader.java:620) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124) at org.apache.geronimo.kernel.classloader.JarFileClassLoader.access$200(JarFileClassLoader.java:51) at org.apache.geronimo.kernel.classloader.JarFileClassLoader$6.run(JarFileClassLoader.java:275) at java.security.AccessController.doPrivileged(Native Method) at org.apache.geronimo.kernel.classloader.JarFileClassLoader.findClass(JarFileClassLoader.java:227) at org.apache.geronimo.kernel.config.MultiParentClassLoader.loadClass(MultiParentClassLoader.java:243) - locked <0x07527308> (a org.apache.geronimo.kernel.classloader.JarFileClassLoader) at java.lang.ClassLoader.loadClass(ClassLoader.java:251) at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319) - locked <0x07527308> (a org.apache.geronimo.kernel.classloader.JarFileClassLoader) at org.activemq.store.journal.JournalPersistenceAdapter.checkpoint(JournalPersistenceAdapter.java:326) at org.activemq.store.journal.JournalPersistenceAdapter$2.run(JournalPersistenceAdapter.java:199) at EDU.oswego.cs.dl.util.concurrent.ClockDaemon$RunLoop.run(Unknown Source) at java.lang.Thread.run(Thread.java:613)

“Journal Writter” daemon prio=10 tid=0x0055c720 nid=0x1a2dc00 in Object.wait() [0xb253a000..0xb253ad10] at java.lang.Object.wait(Native Method) - waiting on <0x075f0550> (a java.lang.Object) at java.lang.Object.wait(Object.java:474) at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.take(Unknown Source) - locked <0x075f0550> (a java.lang.Object) at EDU.oswego.cs.dl.util.concurrent.QueuedExecutor$RunLoop.run(Unknown Source) at java.lang.Thread.run(Thread.java:613)

“Cleanup Timmer” daemon prio=5 tid=0x0055be70 nid=0x1a2c400 waiting for monitor entry [0xb24b8000..0xb24b9d10] at com.tc.aspectwerkz.reflect.impl.asm.AsmClassInfoRepository.getRepository(AsmClassInfoRepository.java:80) - waiting to lock <0x0b0a4728> (a java.lang.Class) at com.tc.aspectwerkz.reflect.impl.asm.AsmClassInfo.getClassInfo(AsmClassInfo.java:298) at com.tc.object.bytecode.hook.impl.DefaultWeavingStrategy.transform(DefaultWeavingStrategy.java:92) at com.tc.object.bytecode.hook.impl.DSOContextImpl.preProcess(DSOContextImpl.java:109) at com.tc.object.bytecode.hook.impl.ClassProcessorHelper.defineClass0Pre(ClassProcessorHelper.java:415) at java.lang.ClassLoader.defineClass(ClassLoader.java:620) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124) at org.apache.geronimo.kernel.classloader.JarFileClassLoader.access$200(JarFileClassLoader.java:51) at org.apache.geronimo.kernel.classloader.JarFileClassLoader$6.run(JarFileClassLoader.java:275) at java.security.AccessController.doPrivileged(Native Method) at org.apache.geronimo.kernel.classloader.JarFileClassLoader.findClass(JarFileClassLoader.java:227) at org.apache.geronimo.kernel.config.MultiParentClassLoader.loadClass(MultiParentClassLoader.java:243) - locked <0x073e0088> (a org.apache.geronimo.kernel.classloader.JarFileClassLoader) at java.lang.ClassLoader.loadClass(ClassLoader.java:251) at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319) - locked <0x073e0088> (a org.apache.geronimo.kernel.classloader.JarFileClassLoader) at org.apache.derby.impl.sql.execute.DMLWriteResultSet.(Unknown Source) at org.apache.derby.impl.sql.execute.DeleteResultSet.(Unknown Source) at org.apache.derby.impl.sql.execute.DeleteResultSet.(Unknown Source) at org.apache.derby.impl.sql.execute.GenericResultSetFactory.getDeleteResultSet(Unknown Source) at org.apache.derby.exe.ac601a400fx0110x9905x1c6fx000038a2b7ea2.fillResultSet(Unknown Source) at org.apache.derby.exe.ac601a400fx0110x9905x1c6fx000038a2b7ea2.execute(Unknown Source) at org.apache.derby.impl.sql.GenericActivationHolder.execute(Unknown Source) at org.apache.derby.impl.sql.GenericPreparedStatement.execute(Unknown Source) at org.apache.derby.impl.jdbc.EmbedStatement.executeStatement(Unknown Source) - locked <0x075152b0> (a org.apache.derby.impl.jdbc.EmbedConnection30) at org.apache.derby.impl.jdbc.EmbedPreparedStatement.executeStatement(Unknown Source) at org.apache.derby.impl.jdbc.EmbedPreparedStatement.executeUpdate(Unknown Source) at org.apache.derby.iapi.jdbc.BrokeredPreparedStatement.executeUpdate(Unknown Source) at org.tranql.connector.jdbc.PreparedStatementHandle.executeUpdate(PreparedStatementHandle.java:103) at org.activemq.store.jdbc.adapter.DefaultJDBCAdapter.doDeleteOldMessages(DefaultJDBCAdapter.java:653) at org.activemq.store.jdbc.JDBCPersistenceAdapter.cleanup(JDBCPersistenceAdapter.java:270) at org.activemq.store.jdbc.JDBCPersistenceAdapter$1.run(JDBCPersistenceAdapter.java:257) at EDU.oswego.cs.dl.util.concurrent.ClockDaemon$RunLoop.run(Unknown Source) at java.lang.Thread.run(Thread.java:613)

“Timer-7” daemon prio=5 tid=0x00557d40 nid=0x1972600 in Object.wait() [0xb2438000..0xb2438d10] at java.lang.Object.wait(Native Method) - waiting on <0x07527280> (a java.util.TaskQueue) at java.lang.Object.wait(Object.java:474) at java.util.TimerThread.mainLoop(Timer.java:483) - locked <0x07527280> (a java.util.TaskQueue) at java.util.TimerThread.run(Timer.java:462)

“Timer-6” daemon prio=5 tid=0x005577a0 nid=0x1a2c000 in Object.wait() [0xb23b7000..0xb23b7d10] at java.lang.Object.wait(Native Method) - waiting on <0x075272f8> (a java.util.TaskQueue) at java.lang.Object.wait(Object.java:474) at java.util.TimerThread.mainLoop(Timer.java:483) - locked <0x075272f8> (a java.util.TaskQueue) at java.util.TimerThread.run(Timer.java:462)

“derby.rawStoreDaemon” daemon prio=5 tid=0x005563d0 nid=0x1972200 in Object.wait() [0xb2336000..0xb2336d10] at java.lang.Object.wait(Native Method) - waiting on <0x074d8878> (a org.apache.derby.impl.services.daemon.BasicDaemon) at org.apache.derby.impl.services.daemon.BasicDaemon.rest(Unknown Source) - locked <0x074d8878> (a org.apache.derby.impl.services.daemon.BasicDaemon) at org.apache.derby.impl.services.daemon.BasicDaemon.run(Unknown Source) at java.lang.Thread.run(Thread.java:613)

“Timer-5” daemon prio=5 tid=0x00554da0 nid=0x19ea200 in Object.wait() [0xb22b5000..0xb22b5d10] at java.lang.Object.wait(Native Method) - waiting on <0x074c86b8> (a java.util.TaskQueue) at java.util.TimerThread.mainLoop(Timer.java:509) - locked <0x074c86b8> (a java.util.TaskQueue) at java.util.TimerThread.run(Timer.java:462)

“Thread-15” daemon prio=5 tid=0x00554460 nid=0x1971e00 runnable [0xb2234000..0xb2234d10] at java.net.PlainSocketImpl.socketAccept(Native Method) at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) - locked <0x074bd4c8> (a java.net.SocksSocketImpl) at java.net.ServerSocket.implAccept(ServerSocket.java:450) at java.net.ServerSocket.accept(ServerSocket.java:421) at org.apache.derby.impl.drda.ClientThread$1.run(Unknown Source) at java.security.AccessController.doPrivileged(Native Method) at org.apache.derby.impl.drda.ClientThread.run(Unknown Source) at java.lang.Thread.run(Thread.java:613)

“derby.NetworkServerStarter” daemon prio=5 tid=0x00553f80 nid=0x19ea800 in Object.wait() [0xb21b3000..0xb21b3d10] at java.lang.Object.wait(Native Method) - waiting on <0x074adda0> (a java.lang.Object) at java.lang.Object.wait(Object.java:474) at org.apache.derby.impl.drda.NetworkServerControlImpl.blockingStart(Unknown Source) - locked <0x074adda0> (a java.lang.Object) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.derby.iapi.jdbc.DRDAServerStarter.run(Unknown Source) at java.lang.Thread.run(Thread.java:613)

“derby.antiGC” daemon prio=1 tid=0x00552990 nid=0x1a2e400 in Object.wait() [0xb2132000..0xb2132d10] at java.lang.Object.wait(Native Method) - waiting on <0x074942d0> (a org.apache.derby.impl.services.monitor.AntiGC) at java.lang.Object.wait(Object.java:474) at org.apache.derby.impl.services.monitor.AntiGC.run(Unknown Source) - locked <0x074942d0> (a org.apache.derby.impl.services.monitor.AntiGC) at java.lang.Thread.run(Thread.java:613)

“service.EJB@9441188” daemon prio=5 tid=0x00551240 nid=0x1a2e000 runnable [0xb20b1000..0xb20b1d10] at java.net.PlainSocketImpl.socketAccept(Native Method) at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) - locked <0x0744f2f8> (a java.net.SocksSocketImpl) at java.net.ServerSocket.implAccept(ServerSocket.java:450) at java.net.ServerSocket.accept(ServerSocket.java:421) at org.activeio.xnet.ServiceDaemon$SocketListener.run(ServiceDaemon.java:146) at java.lang.Thread.run(Thread.java:613)

“RMI LeaseChecker” daemon prio=5 tid=0x0054c930 nid=0x1952800 waiting on condition [0xb1f2e000..0xb1f2ed10] at java.lang.Thread.sleep(Native Method) at sun.rmi.transport.DGCImpl$LeaseChecker.run(DGCImpl.java:310) at java.lang.Thread.run(Thread.java:613)

“RMI RenewClean-[10.0.0.144:9999]” daemon prio=5 tid=0x0054bce0 nid=0x1952000 in Object.wait() [0xb1e2c000..0xb1e2cd10] at java.lang.Object.wait(Native Method) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116) - locked <0x0739eed8> (a java.lang.ref.ReferenceQueue$Lock) at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:500) at java.lang.Thread.run(Thread.java:613)

“GC Daemon” daemon prio=2 tid=0x0054af50 nid=0x1960400 in Object.wait() [0xb1d2a000..0xb1d2ad10] at java.lang.Object.wait(Native Method) - waiting on <0x0739efb8> (a sun.misc.GC$LatencyLock) at sun.misc.GC$Daemon.run(GC.java:100) - locked <0x0739efb8> (a sun.misc.GC$LatencyLock)

“RMI Reaper” prio=5 tid=0x0054ab10 nid=0x1960000 in Object.wait() [0xb1ca9000..0xb1ca9d10] at java.lang.Object.wait(Native Method) - waiting on <0x0725ef50> (a java.lang.ref.ReferenceQueue$Lock) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116) - locked <0x0725ef50> (a java.lang.ref.ReferenceQueue$Lock) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132) at sun.rmi.transport.ObjectTable$Reaper.run(ObjectTable.java:336) at java.lang.Thread.run(Thread.java:613)

“RMI TCP Accept-9999” daemon prio=5 tid=0x0054a680 nid=0x195fc00 runnable [0xb1c28000..0xb1c28d10] at java.net.PlainSocketImpl.socketAccept(Native Method) at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) - locked <0x0739f098> (a java.net.SocksSocketImpl) at java.net.ServerSocket.implAccept(ServerSocket.java:450) at java.net.ServerSocket.accept(ServerSocket.java:421) at sun.rmi.transport.tcp.TCPTransport.run(TCPTransport.java:334) at java.lang.Thread.run(Thread.java:613)

“Socket Server: tcp://0.0.0.0:4242” daemon prio=5 tid=0x005494c0 nid=0x195f800 runnable [0xb1ba7000..0xb1ba7d10] at java.net.PlainSocketImpl.socketAccept(Native Method) at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) - locked <0x0738aff0> (a java.net.SocksSocketImpl) at java.net.ServerSocket.implAccept(ServerSocket.java:450) at java.net.ServerSocket.accept(ServerSocket.java:421) at org.activeio.net.SocketStreamChannelServer.accept(SocketStreamChannelServer.java:66) at org.activeio.net.SocketSyncChannelServer.accept(SocketSyncChannelServer.java:48) at org.activeio.adapter.SyncToAsyncChannelServer.run(SyncToAsyncChannelServer.java:140) at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Thread.java:613)

“LoginService login modules monitor” daemon prio=5 tid=0x00548520 nid=0x197e400 in Object.wait() [0xb1b26000..0xb1b26d10] at java.lang.Object.wait(Native Method) - waiting on <0x07387d98> (a EDU.oswego.cs.dl.util.concurrent.ClockDaemon) at EDU.oswego.cs.dl.util.concurrent.ClockDaemon.nextTask(Unknown Source) - locked <0x07387d98> (a EDU.oswego.cs.dl.util.concurrent.ClockDaemon) at EDU.oswego.cs.dl.util.concurrent.ClockDaemon$RunLoop.run(Unknown Source) at java.lang.Thread.run(Thread.java:613)

“FlushManager” daemon prio=5 tid=0x005458a0 nid=0x197e000 waiting on condition [0xb1aa5000..0xb1aa5d10] at java.lang.Thread.sleep(Native Method) at org.objectweb.howl.log.LogBufferManager$FlushManager.run(LogBufferManager.java:1232)

“LogFileManager.EventManager” daemon prio=5 tid=0x005455e0 nid=0x195dc00 in Object.wait() [0xb1a24000..0xb1a24d10] at java.lang.Object.wait(Native Method) - waiting on <0x07305f68> (a java.lang.Object) at java.lang.Object.wait(Object.java:474) at org.objectweb.howl.log.LogFileManager$EventManager.run(LogFileManager.java:1220) - locked <0x07305f68> (a java.lang.Object)

“RMI TCP Accept-1099” daemon prio=5 tid=0x0053ee50 nid=0x18bd800 runnable [0xb19a3000..0xb19a3d10] at java.net.PlainSocketImpl.socketAccept(Native Method) at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) - locked <0x0725cfe8> (a java.net.SocksSocketImpl) at java.net.ServerSocket.implAccept(ServerSocket.java:450) at java.net.ServerSocket.accept(ServerSocket.java:421) at sun.rmi.transport.tcp.TCPTransport.run(TCPTransport.java:334) at java.lang.Thread.run(Thread.java:613)

“Timer-4” daemon prio=5 tid=0x0053ea30 nid=0x199c400 in Object.wait() [0xb1922000..0xb1922d10] at java.lang.Object.wait(Native Method) - waiting on <0x0725d108> (a java.util.TaskQueue) at java.lang.Object.wait(Object.java:474) at java.util.TimerThread.mainLoop(Timer.java:483) - locked <0x0725d108> (a java.util.TaskQueue) at java.util.TimerThread.run(Timer.java:462)

“Timer-3” daemon prio=5 tid=0x0053a710 nid=0x193e600 in Object.wait() [0xb18a1000..0xb18a1d10] at java.lang.Object.wait(Native Method) - waiting on <0x071f70e0> (a java.util.TaskQueue) at java.util.TimerThread.mainLoop(Timer.java:509) - locked <0x071f70e0> (a java.util.TaskQueue) at java.util.TimerThread.run(Timer.java:462)

“Timer-1” prio=5 tid=0x00539610 nid=0x1938e00 in Object.wait() [0xb0f0e000..0xb0f0ed10] at java.lang.Object.wait(Native Method) - waiting on <0x071ebfe0> (a java.util.TaskQueue) at java.lang.Object.wait(Object.java:474) at java.util.TimerThread.mainLoop(Timer.java:483) - locked <0x071ebfe0> (a java.util.TaskQueue) at java.util.TimerThread.run(Timer.java:462)

“DistributedMethodInvoke” daemon prio=5 tid=0x0052a510 nid=0x193a000 in Object.wait() [0xb179f000..0xb179fd10] at java.lang.Object.wait(Native Method) - waiting on <0x0712a350> (a java.util.IdentityHashMap) at java.lang.Object.wait(Object.java:474) at com.tc.object.lockmanager.impl.ClientLock.waitForLock(ClientLock.java:456) - locked <0x0712a350> (a java.util.IdentityHashMap) at com.tc.object.lockmanager.impl.ClientLock.wait(ClientLock.java:272) at com.tc.object.lockmanager.impl.ClientLockManagerImpl.wait(ClientLockManagerImpl.java:266) at com.tc.object.lockmanager.impl.ThreadLockManagerImpl.wait(ThreadLockManagerImpl.java:54) at com.tc.object.tx.ClientTransactionManagerImpl.wait(ClientTransactionManagerImpl.java:216) at com.tc.object.event.DistributedMethodCallManagerImpl$InvokerThread.run(DistributedMethodCallManagerImpl.java:183)

“Thread-5” daemon prio=5 tid=0x00523310 nid=0x18b6e00 in Object.wait() [0xb1499000..0xb1499d10] at java.lang.Object.wait(Native Method) - waiting on <0x0710b8a0> (a com.tc.management.remote.protocol.terracotta.TunnelingEventHandler) at java.lang.Object.wait(Object.java:474) at com.tc.management.remote.protocol.terracotta.TunnelingEventHandler.accept(TunnelingEventHandler.java:67) - locked <0x0710b8a0> (a com.tc.management.remote.protocol.terracotta.TunnelingEventHandler) at com.tc.management.remote.protocol.terracotta.TunnelingMessageConnectionServer.accept(TunnelingMessageConnectionServer.java:31) at com.sun.jmx.remote.generic.SynchroMessageConnectionServerImpl.accept(SynchroMessageConnectionServerImpl.java:41) at javax.management.remote.generic.GenericConnectorServer$Receiver.run(GenericConnectorServer.java:293)

“WorkerThread(lock_response_stage,0)” daemon prio=5 tid=0x00522c00 nid=0x1939200 in Object.wait() [0xb1418000..0xb1418d10] at java.lang.Object.wait(Native Method) at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(Unknown Source) - locked <0x0710b8c8> (a java.lang.Object) at com.tc.async.impl.StageQueueImpl.poll(StageQueueImpl.java:111) at com.tc.async.impl.StageImpl$WorkerThread.run(StageImpl.java:127)

“WorkerThread(object_id_request_response_stage,0)” daemon prio=5 tid=0x005227e0 nid=0x18b8800 in Object.wait() [0xb1397000..0xb1397d10] at java.lang.Object.wait(Native Method) at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(Unknown Source) - locked <0x0710b918> (a java.lang.Object) at com.tc.async.impl.StageQueueImpl.poll(StageQueueImpl.java:111) at com.tc.async.impl.StageImpl$WorkerThread.run(StageImpl.java:127)

“WorkerThread(jmxremote_tunnel_stage,0)” daemon prio=5 tid=0x00522310 nid=0x193e200 in Object.wait() [0xb1316000..0xb1316d10] at java.lang.Object.wait(Native Method) at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(Unknown Source) - locked <0x0710b968> (a java.lang.Object) at com.tc.async.impl.StageQueueImpl.poll(StageQueueImpl.java:111) at com.tc.async.impl.StageImpl$WorkerThread.run(StageImpl.java:127)

“WorkerThread(receive_root_id_stage,0)” daemon prio=5 tid=0x00521fc0 nid=0x18b7a00 in Object.wait() [0xb1295000..0xb1295d10] at java.lang.Object.wait(Native Method) at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(Unknown Source) - locked <0x0710b9b8> (a java.lang.Object) at com.tc.async.impl.StageQueueImpl.poll(StageQueueImpl.java:111) at com.tc.async.impl.StageImpl$WorkerThread.run(StageImpl.java:127)

“WorkerThread(batch_txn_ack_stage,0)” daemon prio=5 tid=0x00521ad0 nid=0x18b8400 in Object.wait() [0xb1214000..0xb1214d10] at java.lang.Object.wait(Native Method) at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(Unknown Source) - locked <0x0710ba08> (a java.lang.Object) at com.tc.async.impl.StageQueueImpl.poll(StageQueueImpl.java:111) at com.tc.async.impl.StageImpl$WorkerThread.run(StageImpl.java:127)

“WorkerThread(client_pause_stage,0)” daemon prio=5 tid=0x005216c0 nid=0x18b9000 in Object.wait() [0xb1193000..0xb1193d10] at java.lang.Object.wait(Native Method) at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(Unknown Source) - locked <0x0710ba58> (a java.lang.Object) at com.tc.async.impl.StageQueueImpl.poll(StageQueueImpl.java:111) at com.tc.async.impl.StageImpl$WorkerThread.run(StageImpl.java:127)

“WorkerThread(receive_transaction_stage,0)” daemon prio=5 tid=0x005212a0 nid=0x18b8c00 in Object.wait() [0xb1112000..0xb1112d10] at java.lang.Object.wait(Native Method) at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(Unknown Source) - locked <0x0710baa8> (a java.lang.Object) at com.tc.async.impl.StageQueueImpl.poll(StageQueueImpl.java:111) at com.tc.async.impl.StageImpl$WorkerThread.run(StageImpl.java:127)

“WorkerThread(receive_object_stage,0)” daemon prio=5 tid=0x00520ea0 nid=0x193aa00 in Object.wait() [0xb1091000..0xb1091d10] at java.lang.Object.wait(Native Method) at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(Unknown Source) - locked <0x0710baf8> (a java.lang.Object) at com.tc.async.impl.StageQueueImpl.poll(StageQueueImpl.java:111) at com.tc.async.impl.StageImpl$WorkerThread.run(StageImpl.java:127)

“WorkerThread(receive_transaction_complete_stage,0)” daemon prio=5 tid=0x00520ae0 nid=0x193a600 in Object.wait() [0xb1010000..0xb1010d10] at java.lang.Object.wait(Native Method) at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(Unknown Source) - locked <0x0710bb48> (a java.lang.Object) at com.tc.async.impl.StageQueueImpl.poll(StageQueueImpl.java:111) at com.tc.async.impl.StageImpl$WorkerThread.run(StageImpl.java:127)

“WorkerThread(hydrate_message_stage,0)” daemon prio=5 tid=0x00520720 nid=0x18b8000 in Object.wait() [0xb0f8f000..0xb0f8fd10] at java.lang.Object.wait(Native Method) at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(Unknown Source) - locked <0x0710bb98> (a java.lang.Object) at com.tc.async.impl.StageQueueImpl.poll(StageQueueImpl.java:111) at com.tc.async.impl.StageImpl$WorkerThread.run(StageImpl.java:127)

“TC Memory Monitor” daemon prio=5 tid=0x0051ef70 nid=0x18b6a00 waiting on condition [0xb0e8d000..0xb0e8dd10] at java.lang.Thread.sleep(Native Method) at com.tc.runtime.TCMemoryManagerImpl$MemoryMonitor.run(TCMemoryManagerImpl.java:127) at java.lang.Thread.run(Thread.java:613)

“Reaper” daemon prio=5 tid=0x0051e9f0 nid=0x192fe00 in Object.wait() [0xb0e0c000..0xb0e0cd10] at java.lang.Object.wait(Native Method) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116) - locked <0x07102740> (a java.lang.ref.ReferenceQueue$Lock) at com.tc.object.ClientObjectManagerImpl$1.run(ClientObjectManagerImpl.java:1021)

“DSO Lock Object.wait() timer” daemon prio=5 tid=0x0051e500 nid=0x192fa00 in Object.wait() [0xb0d8b000..0xb0d8bd10] at java.lang.Object.wait(Native Method) - waiting on <0x07102d20> (a com.tc.object.lockmanager.impl.ClientLockManagerImpl) at java.lang.Object.wait(Object.java:474) at com.tc.object.lockmanager.impl.ClientLockManagerImpl.waitUntilRunning(ClientLockManagerImpl.java:433) at com.tc.object.lockmanager.impl.ClientLockManagerImpl.runGC(ClientLockManagerImpl.java:100) - locked <0x07102d20> (a com.tc.object.lockmanager.impl.ClientLockManagerImpl) at com.tc.object.lockmanager.impl.ClientLockManagerImpl$LockGCTask.run(ClientLockManagerImpl.java:483) at java.util.TimerThread.mainLoop(Timer.java:512) at java.util.TimerThread.run(Timer.java:462)

“TCComm Selector Thread 1” daemon prio=5 tid=0x0051da20 nid=0x18b6600 runnable [0xb0d0a000..0xb0d0ad10] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:118) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) - locked <0x070ffd58> (a sun.nio.ch.Util$1) - locked <0x070ffd68> (a java.util.Collections$UnmodifiableSet) - locked <0x070ffd10> (a sun.nio.ch.KQueueSelectorImpl) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:84) at com.tc.net.core.TCCommJDK14.selectLoop(TCCommJDK14.java:276) at com.tc.net.core.TCCommJDK14$TCCommThread.run(TCCommJDK14.java:620)

“Low Memory Detector” daemon prio=5 tid=0x00509280 nid=0x1812000 runnable [0x00000000..0x00000000]

“CompilerThread0” daemon prio=9 tid=0x00508880 nid=0x1811c00 waiting on condition [0x00000000..0xb0b0674c]

“Signal Dispatcher” daemon prio=9 tid=0x00508320 nid=0x1811800 waiting on condition [0x00000000..0xb0a85d20]

“Finalizer” daemon prio=8 tid=0x00507770 nid=0x1808800 in Object.wait() [0xb0a04000..0xb0a04d10] at java.lang.Object.wait(Native Method) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116) - locked <0x06ac4fd0> (a java.lang.ref.ReferenceQueue$Lock) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132) at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)

“Reference Handler” daemon prio=10 tid=0x005073a0 nid=0x1808400 in Object.wait() [0xb0983000..0xb0983d10] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:474) at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116) - locked <0x06ac5068> (a java.lang.ref.Reference$Lock)

“main” prio=5 tid=0x005014c0 nid=0x1804a00 in Object.wait() [0xb07ff000..0xb080011c] at java.lang.Object.wait(Native Method) - waiting on <0x07138f38> (a org.apache.geronimo.kernel.basic.BasicKernel) at java.lang.Object.wait(Object.java:474) at org.apache.geronimo.system.main.Daemon.doStartup(Daemon.java:331) - locked <0x07138f38> (a org.apache.geronimo.kernel.basic.BasicKernel) at org.apache.geronimo.system.main.Daemon.(Daemon.java:74) at org.apache.geronimo.system.main.Daemon.main(Daemon.java:377)

“VM Thread” prio=9 tid=0x00506aa0 nid=0x1813400 runnable

“VM Periodic Task Thread” prio=9 tid=0x00509de0 nid=0x1812400 waiting on condition

“Exception Catcher Thread” prio=10 tid=0x005016e0 nid=0x1804e00 runnable

Found one Java-level deadlock:

“Checkpoint Timer”: waiting to lock monitor 0x01a6cc70 (object 0x073e0088, a org.apache.geronimo.kernel.classloader.JarFileClassLoader), which is held by “Cleanup Timmer” “Cleanup Timmer”: waiting to lock monitor 0x01a6cd48 (object 0x0b0a4728, a java.lang.Class), which is held by “Checkpoint Timer”

Java stack information for the threads listed above:

“Checkpoint Timer”: at org.apache.geronimo.kernel.config.MultiParentClassLoader.isDestroyed(MultiParentClassLoader.java:377) - waiting to lock <0x073e0088> (a org.apache.geronimo.kernel.classloader.JarFileClassLoader) at org.apache.geronimo.kernel.config.MultiParentClassLoader.getResource(MultiParentClassLoader.java:278) at org.apache.geronimo.kernel.config.MultiParentClassLoader.getResource(MultiParentClassLoader.java:298) at java.lang.ClassLoader.getResourceAsStream(ClassLoader.java:1159) at com.tc.aspectwerkz.reflect.impl.asm.AsmClassInfoRepository.(AsmClassInfoRepository.java:55) at com.tc.aspectwerkz.reflect.impl.asm.AsmClassInfoRepository.getRepository(AsmClassInfoRepository.java:87) - locked <0x0b0a4728> (a java.lang.Class) at com.tc.aspectwerkz.reflect.impl.asm.AsmClassInfo.getClassInfo(AsmClassInfo.java:298) at com.tc.object.bytecode.hook.impl.DefaultWeavingStrategy.transform(DefaultWeavingStrategy.java:92) at com.tc.object.bytecode.hook.impl.DSOContextImpl.preProcess(DSOContextImpl.java:109) at com.tc.object.bytecode.hook.impl.ClassProcessorHelper.defineClass0Pre(ClassProcessorHelper.java:415) at java.lang.ClassLoader.defineClass(ClassLoader.java:620) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124) at org.apache.geronimo.kernel.classloader.JarFileClassLoader.access$200(JarFileClassLoader.java:51) at org.apache.geronimo.kernel.classloader.JarFileClassLoader$6.run(JarFileClassLoader.java:275) at java.security.AccessController.doPrivileged(Native Method) at org.apache.geronimo.kernel.classloader.JarFileClassLoader.findClass(JarFileClassLoader.java:227) at org.apache.geronimo.kernel.config.MultiParentClassLoader.loadClass(MultiParentClassLoader.java:243) - locked <0x07527308> (a org.apache.geronimo.kernel.classloader.JarFileClassLoader) at java.lang.ClassLoader.loadClass(ClassLoader.java:251) at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319) - locked <0x07527308> (a org.apache.geronimo.kernel.classloader.JarFileClassLoader) at org.activemq.store.journal.JournalPersistenceAdapter.checkpoint(JournalPersistenceAdapter.java:326) at org.activemq.store.journal.JournalPersistenceAdapter$2.run(JournalPersistenceAdapter.java:199) at EDU.oswego.cs.dl.util.concurrent.ClockDaemon$RunLoop.run(Unknown Source) at java.lang.Thread.run(Thread.java:613) "Cleanup Timmer": at com.tc.aspectwerkz.reflect.impl.asm.AsmClassInfoRepository.getRepository(AsmClassInfoRepository.java:80) - waiting to lock <0x0b0a4728> (a java.lang.Class) at com.tc.aspectwerkz.reflect.impl.asm.AsmClassInfo.getClassInfo(AsmClassInfo.java:298) at com.tc.object.bytecode.hook.impl.DefaultWeavingStrategy.transform(DefaultWeavingStrategy.java:92) at com.tc.object.bytecode.hook.impl.DSOContextImpl.preProcess(DSOContextImpl.java:109) at com.tc.object.bytecode.hook.impl.ClassProcessorHelper.defineClass0Pre(ClassProcessorHelper.java:415) at java.lang.ClassLoader.defineClass(ClassLoader.java:620) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124) at org.apache.geronimo.kernel.classloader.JarFileClassLoader.access$200(JarFileClassLoader.java:51) at org.apache.geronimo.kernel.classloader.JarFileClassLoader$6.run(JarFileClassLoader.java:275) at java.security.AccessController.doPrivileged(Native Method) at org.apache.geronimo.kernel.classloader.JarFileClassLoader.findClass(JarFileClassLoader.java:227) at org.apache.geronimo.kernel.config.MultiParentClassLoader.loadClass(MultiParentClassLoader.java:243) - locked <0x073e0088> (a org.apache.geronimo.kernel.classloader.JarFileClassLoader) at java.lang.ClassLoader.loadClass(ClassLoader.java:251) at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319) - locked <0x073e0088> (a org.apache.geronimo.kernel.classloader.JarFileClassLoader) at org.apache.derby.impl.sql.execute.DMLWriteResultSet.(Unknown Source) at org.apache.derby.impl.sql.execute.DeleteResultSet.(Unknown Source) at org.apache.derby.impl.sql.execute.DeleteResultSet.(Unknown Source) at org.apache.derby.impl.sql.execute.GenericResultSetFactory.getDeleteResultSet(Unknown Source) at org.apache.derby.exe.ac601a400fx0110x9905x1c6fx000038a2b7ea2.fillResultSet(Unknown Source) at org.apache.derby.exe.ac601a400fx0110x9905x1c6fx000038a2b7ea2.execute(Unknown Source) at org.apache.derby.impl.sql.GenericActivationHolder.execute(Unknown Source) at org.apache.derby.impl.sql.GenericPreparedStatement.execute(Unknown Source) at org.apache.derby.impl.jdbc.EmbedStatement.executeStatement(Unknown Source) - locked <0x075152b0> (a org.apache.derby.impl.jdbc.EmbedConnection30) at org.apache.derby.impl.jdbc.EmbedPreparedStatement.executeStatement(Unknown Source) at org.apache.derby.impl.jdbc.EmbedPreparedStatement.executeUpdate(Unknown Source) at org.apache.derby.iapi.jdbc.BrokeredPreparedStatement.executeUpdate(Unknown Source) at org.tranql.connector.jdbc.PreparedStatementHandle.executeUpdate(PreparedStatementHandle.java:103) at org.activemq.store.jdbc.adapter.DefaultJDBCAdapter.doDeleteOldMessages(DefaultJDBCAdapter.java:653) at org.activemq.store.jdbc.JDBCPersistenceAdapter.cleanup(JDBCPersistenceAdapter.java:270) at org.activemq.store.jdbc.JDBCPersistenceAdapter$1.run(JDBCPersistenceAdapter.java:257) at EDU.oswego.cs.dl.util.concurrent.ClockDaemon$RunLoop.run(Unknown Source) at java.lang.Thread.run(Thread.java:613)

Found 1 deadlock.

Comments

orion 2007-02-06

I’ve attached the Terracotta config that was in effect when this happened.

Fiona OShea 2007-02-07

Updating Due date to last day of Moraga dev iteration