• Bug
  • Status: Closed
  • 1 Critical
  • Resolution: Fixed
  • Forge
  • kkannaiy
  • Reporter: nelrahma
  • May 27, 2009
  • 0
  • Watchers: 1
  • February 12, 2013
  • May 30, 2009

Attachments

Description

Having HibernateCache using the MutableConfig class causes too much contention when using Hibernate second level cache.

When a get occurs on the cache, it checks to see if eviction is enabled. this entails checking the TTI and TTL values. In MutableConfig a DSO Lock is acquired when reading these values. Since it is the same lock, all other threads doing a get is getting blocked as demonstrated in the stacktrace below.

Since it is the same lock, they all hash to the same ClientLockManagerImpl, so it blocks on the call to lock.

The effect of this contention is significant. In our ReadOnly case, we went from 28k app TPS to 18k app TPS by using MutableConfig.

“PerAppThread-14” - Thread [email protected] java.lang.Thread.State: BLOCKED on [email protected] owned by: PerAppThread-8 at com.tc.management.beans.tx.ClientTxMonitor.committedReadTransaction(ClientTxMonitor.java:137) at com.tc.object.tx.ClientTransactionManagerImpl.commitInternal(ClientTransactionManagerImpl.java:520) at com.tc.object.tx.ClientTransactionManagerImpl.commit(ClientTransactionManagerImpl.java:499) at com.tc.object.tx.ClientTransactionManagerImpl.commit(ClientTransactionManagerImpl.java:427) at com.tc.object.bytecode.ManagerImpl.monitorExit(ManagerImpl.java:551) at com.tc.object.bytecode.ManagerUtil.monitorExit(ManagerUtil.java:534) at java.util.concurrent.locks.ReentrantReadWriteLock$DsoLock.unlock(ReentrantReadWriteLock.java:74) at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.unlock(ReentrantReadWriteLock.java) at org.terracotta.modules.dmap.MutableConfig.getMaxTTISeconds(MutableConfig.java:77) at org.terracotta.modules.dmap.MutableConfig.isEvictionEnabled(MutableConfig.java:191) at org.terracotta.modules.dmap.impl.ClusteredDistributedMap.getNonExpiredEntry(ClusteredDistributedMap.java:173) at org.terracotta.modules.dmap.impl.ClusteredDistributedMap.getEntry(ClusteredDistributedMap.java:158) at org.terracotta.modules.hibernatecache.TerracottaHibernateCache.get(TerracottaHibernateCache.java:129) at org.hibernate.cache.NonstrictReadWriteCache.get(NonstrictReadWriteCache.java:69) at org.hibernate.cache.impl.bridge.EntityAccessStrategyAdapter.get(EntityAccessStrategyAdapter.java:55) at org.hibernate.event.def.DefaultLoadEventListener.loadFromSecondLevelCache(DefaultLoadEventListener.java:524) at org.hibernate.event.def.DefaultLoadEventListener.doLoad(DefaultLoadEventListener.java:397) at org.hibernate.event.def.DefaultLoadEventListener.load(DefaultLoadEventListener.java:165) at org.hibernate.event.def.DefaultLoadEventListener.proxyOrLoad(DefaultLoadEventListener.java:207) at org.hibernate.event.def.DefaultLoadEventListener.onLoad(DefaultLoadEventListener.java:126) at org.hibernate.impl.SessionImpl.fireLoad(SessionImpl.java:905) at org.hibernate.impl.SessionImpl.internalLoad(SessionImpl.java:873) at org.hibernate.type.EntityType.resolveIdentifier(EntityType.java:590) at org.hibernate.type.ManyToOneType.assemble(ManyToOneType.java:219) at org.hibernate.type.TypeFactory.assemble(TypeFactory.java:443) at org.hibernate.cache.entry.CacheEntry.assemble(CacheEntry.java:119) at org.hibernate.cache.entry.CacheEntry.assemble(CacheEntry.java:105) at org.hibernate.event.def.DefaultLoadEventListener.assembleCacheEntry(DefaultLoadEventListener.java:587) at org.hibernate.event.def.DefaultLoadEventListener.loadFromSecondLevelCache(DefaultLoadEventListener.java:542) at org.hibernate.event.def.DefaultLoadEventListener.doLoad(DefaultLoadEventListener.java:397) at org.hibernate.event.def.DefaultLoadEventListener.load(DefaultLoadEventListener.java:165) at org.hibernate.event.def.DefaultLoadEventListener.proxyOrLoad(DefaultLoadEventListener.java:207) at org.hibernate.event.def.DefaultLoadEventListener.onLoad(DefaultLoadEventListener.java:126) at org.hibernate.impl.SessionImpl.fireLoad(SessionImpl.java:905) at org.hibernate.impl.SessionImpl.internalLoad(SessionImpl.java:873) at org.hibernate.type.EntityType.resolveIdentifier(EntityType.java:590) at org.hibernate.type.ManyToOneType.assemble(ManyToOneType.java:219) at org.hibernate.collection.PersistentSet.initializeFromCache(PersistentSet.java:147) at org.hibernate.cache.entry.CollectionCacheEntry.assemble(CollectionCacheEntry.java:58) at org.hibernate.event.def.DefaultInitializeCollectionEventListener.initializeCollectionFromCache(DefaultInitializeCollectionEventListener.java:159) at org.hibernate.event.def.DefaultInitializeCollectionEventListener.onInitializeCollection(DefaultInitializeCollectionEventListener.java:71) at org.hibernate.impl.SessionImpl.initializeCollection(SessionImpl.java:1743) at org.hibernate.collection.AbstractPersistentCollection.forceInitialization(AbstractPersistentCollection.java:476) at org.hibernate.engine.StatefulPersistenceContext.initializeNonLazyCollections(StatefulPersistenceContext.java:867) at org.hibernate.event.def.DefaultLoadEventListener.assembleCacheEntry(DefaultLoadEventListener.java:614) at org.hibernate.event.def.DefaultLoadEventListener.loadFromSecondLevelCache(DefaultLoadEventListener.java:542) at org.hibernate.event.def.DefaultLoadEventListener.doLoad(DefaultLoadEventListener.java:397) at org.hibernate.event.def.DefaultLoadEventListener.load(DefaultLoadEventListener.java:165) at org.hibernate.event.def.DefaultLoadEventListener.proxyOrLoad(DefaultLoadEventListener.java:207) at org.hibernate.event.def.DefaultLoadEventListener.onLoad(DefaultLoadEventListener.java:126) at org.hibernate.impl.SessionImpl.fireLoad(SessionImpl.java:905) at org.hibernate.impl.SessionImpl.get(SessionImpl.java:842) at org.hibernate.impl.SessionImpl.get(SessionImpl.java:835) at org.hibernate.ejb.AbstractEntityManagerImpl.find(AbstractEntityManagerImpl.java:182) at sun.reflect.GeneratedMethodAccessor25.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.orm.jpa.SharedEntityManagerCreator$SharedEntityManagerInvocationHandler.invoke(SharedEntityManagerCreator.java:194) at $Proxy15.find(Unknown Source) at org.springframework.samples.petclinic.jpa.EntityManagerClinic.loadOwner(EntityManagerClinic.java:70) at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:310) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:106) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at $Proxy17.loadOwner(Unknown Source) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwnerAccordingToFetchStrategy(PetClinicPerfTestActions.java:120) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwner(PetClinicPerfTestActions.java:38) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions\(FastClassByCGLIB\)6a48c588.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:191) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:628) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions$$EnhancerByCGLIB$$aa5cf164.getOwner() at org.terracotta.petclinic.perftest.type.ReadOnlyTest.doTestBody(ReadOnlyTest.java:14) at org.terracotta.petclinic.perftest.AbstractPerfTest.doTestBody(AbstractPerfTest.java:341) at org.terracotta.petclinic.perftest.AbstractPerfTest.runTest(AbstractPerfTest.java:472) at org.terracotta.petclinic.perftest.AbstractPerfTest.access$000(AbstractPerfTest.java:32) at org.terracotta.petclinic.perftest.AbstractPerfTest$1.run(Ab

Comments

Saravanan Subbiah 2009-05-27

Nabib reverted it to Immuatable config for now in revision 15948

Alex Miller 2009-05-27

I don’t disagree with the possibility that MutableConfig is an issue (particularly if you’ve confirmed with ImmutableConfig as an alternative). But this particular stack trace doesn’t indicate MutableConfig - it just is the normal read locked get to look up the data and does not involve the config at all. It would be helpful if you could attach a better stack trace.

Fiona OShea 2009-05-27

Please update with latest status. thanks

Walter Harley 2009-05-27

The stack trace originally posted to the Jira was incorrect; Nabib has replaced it with the correct trace. The contention is on the monitor of the ClientLockManagerImpl instance, caused by lots of threads trying to read the lockId map in order to get the same lock, the lock on the MutableConfig.

We can address this by making the map-evictor code use a local (volatile transient) MutableConfig instance (actually could probably be an ImmutableConfig), which gets updated from the clustered one on every evictor cycle.

Nabib will change the cache back to use MutableConfig, so that the admin console is fixed; the perf test guys will use a local patch rather than trunk. I’ll make the perf change so that trunk works fast again, but in the interest of stability, probably won’t check it in till after the beta has been cut.

Nabib El-Rahman 2009-05-27

“RMI TCP Connection(15)-10.0.0.176” - Thread [email protected] java.lang.Thread.State: RUNNABLE at sun.management.ThreadImpl.dumpThreads0(Native Method) at sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:374) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at com.sun.jmx.mbeanserver.ConvertingMethod.invokeWithOpenReturn(ConvertingMethod.java:167) at com.sun.jmx.mbeanserver.MXBeanIntrospector.invokeM2(MXBeanIntrospector.java:96) at com.sun.jmx.mbeanserver.MXBeanIntrospector.invokeM2(MXBeanIntrospector.java:33) at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:208) at com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:120) at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:262) at javax.management.StandardMBean.invoke(StandardMBean.java:391) at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836) at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761) at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1426) at javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72) at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1264) at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1359) at javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:788) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:305) at sun.rmi.transport.Transport$1.run(Transport.java:159) at java.security.AccessController.doPrivileged(Native Method) at sun.rmi.transport.Transport.serviceCall(Transport.java:155) at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - locked [email protected]

“RMI TCP Connection(14)-10.0.0.176” - Thread [email protected] java.lang.Thread.State: RUNNABLE at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.read(SocketInputStream.java:129) at java.io.BufferedInputStream.fill(BufferedInputStream.java:218) at java.io.BufferedInputStream.read(BufferedInputStream.java:237) - locked [email protected] at java.io.FilterInputStream.read(FilterInputStream.java:66) at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:517) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - locked [email protected]

“JMX server connection timeout 131” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING on [[email protected] at java.lang.Object.wait(Native Method) at com.sun.jmx.remote.internal.ServerCommunicatorAdmin$Timeout.run(ServerCommunicatorAdmin.java:150) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - None

“JMX server connection timeout 130” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING on [[email protected] at java.lang.Object.wait(Native Method) at com.sun.jmx.remote.internal.ServerCommunicatorAdmin$Timeout.run(ServerCommunicatorAdmin.java:150) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - None

“RMI TCP Connection(12)-10.0.0.176” - Thread [email protected] java.lang.Thread.State: RUNNABLE at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.read(SocketInputStream.java:129) at java.io.BufferedInputStream.fill(BufferedInputStream.java:218) at java.io.BufferedInputStream.read(BufferedInputStream.java:237) - locked [email protected] at java.io.FilterInputStream.read(FilterInputStream.java:66) at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:517) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - locked [email protected]

“RMI TCP Connection(10)-10.0.0.176” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING on [email protected] at java.lang.Object.wait(Native Method) at com.sun.jmx.remote.internal.ArrayNotificationBuffer.fetchNotifications(ArrayNotificationBuffer.java:417) at com.sun.jmx.remote.internal.ArrayNotificationBuffer$ShareBuffer.fetchNotifications(ArrayNotificationBuffer.java:209) at com.sun.jmx.remote.internal.ServerNotifForwarder.fetchNotifs(ServerNotifForwarder.java:258) at javax.management.remote.rmi.RMIConnectionImpl$2.run(RMIConnectionImpl.java:1227) at javax.management.remote.rmi.RMIConnectionImpl$2.run(RMIConnectionImpl.java:1225) at javax.management.remote.rmi.RMIConnectionImpl.fetchNotifications(RMIConnectionImpl.java:1231) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:305) at sun.rmi.transport.Transport$1.run(Transport.java:159) at java.security.AccessController.doPrivileged(Native Method) at sun.rmi.transport.Transport.serviceCall(Transport.java:155) at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - locked [email protected]

“Thread-63” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING at java.lang.Thread.sleep(Native Method) at org.terracotta.petclinic.perftest.AbstractPerfTest$2.run(AbstractPerfTest.java:324)

Locked ownable synchronizers: - None

“PerAppThread-14” - Thread [email protected] java.lang.Thread.State: BLOCKED on [email protected] owned by: PerAppThread-8 at com.tc.management.beans.tx.ClientTxMonitor.committedReadTransaction(ClientTxMonitor.java:137) at com.tc.object.tx.ClientTransactionManagerImpl.commitInternal(ClientTransactionManagerImpl.java:520) at com.tc.object.tx.ClientTransactionManagerImpl.commit(ClientTransactionManagerImpl.java:499) at com.tc.object.tx.ClientTransactionManagerImpl.commit(ClientTransactionManagerImpl.java:427) at com.tc.object.bytecode.ManagerImpl.monitorExit(ManagerImpl.java:551) at com.tc.object.bytecode.ManagerUtil.monitorExit(ManagerUtil.java:534) at java.util.concurrent.locks.ReentrantReadWriteLock$DsoLock.unlock(ReentrantReadWriteLock.java:74) at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.unlock(ReentrantReadWriteLock.java) at org.terracotta.modules.dmap.MutableConfig.getMaxTTISeconds(MutableConfig.java:77) at org.terracotta.modules.dmap.MutableConfig.isEvictionEnabled(MutableConfig.java:191) at org.terracotta.modules.dmap.impl.ClusteredDistributedMap.getNonExpiredEntry(ClusteredDistributedMap.java:173) at org.terracotta.modules.dmap.impl.ClusteredDistributedMap.getEntry(ClusteredDistributedMap.java:158) at org.terracotta.modules.hibernatecache.TerracottaHibernateCache.get(TerracottaHibernateCache.java:129) at org.hibernate.cache.NonstrictReadWriteCache.get(NonstrictReadWriteCache.java:69) at org.hibernate.cache.impl.bridge.EntityAccessStrategyAdapter.get(EntityAccessStrategyAdapter.java:55) at org.hibernate.event.def.DefaultLoadEventListener.loadFromSecondLevelCache(DefaultLoadEventListener.java:524) at org.hibernate.event.def.DefaultLoadEventListener.doLoad(DefaultLoadEventListener.java:397) at org.hibernate.event.def.DefaultLoadEventListener.load(DefaultLoadEventListener.java:165) at org.hibernate.event.def.DefaultLoadEventListener.proxyOrLoad(DefaultLoadEventListener.java:207) at org.hibernate.event.def.DefaultLoadEventListener.onLoad(DefaultLoadEventListener.java:126) at org.hibernate.impl.SessionImpl.fireLoad(SessionImpl.java:905) at org.hibernate.impl.SessionImpl.internalLoad(SessionImpl.java:873) at org.hibernate.type.EntityType.resolveIdentifier(EntityType.java:590) at org.hibernate.type.ManyToOneType.assemble(ManyToOneType.java:219) at org.hibernate.type.TypeFactory.assemble(TypeFactory.java:443) at org.hibernate.cache.entry.CacheEntry.assemble(CacheEntry.java:119) at org.hibernate.cache.entry.CacheEntry.assemble(CacheEntry.java:105) at org.hibernate.event.def.DefaultLoadEventListener.assembleCacheEntry(DefaultLoadEventListener.java:587) at org.hibernate.event.def.DefaultLoadEventListener.loadFromSecondLevelCache(DefaultLoadEventListener.java:542) at org.hibernate.event.def.DefaultLoadEventListener.doLoad(DefaultLoadEventListener.java:397) at org.hibernate.event.def.DefaultLoadEventListener.load(DefaultLoadEventListener.java:165) at org.hibernate.event.def.DefaultLoadEventListener.proxyOrLoad(DefaultLoadEventListener.java:207) at org.hibernate.event.def.DefaultLoadEventListener.onLoad(DefaultLoadEventListener.java:126) at org.hibernate.impl.SessionImpl.fireLoad(SessionImpl.java:905) at org.hibernate.impl.SessionImpl.internalLoad(SessionImpl.java:873) at org.hibernate.type.EntityType.resolveIdentifier(EntityType.java:590) at org.hibernate.type.ManyToOneType.assemble(ManyToOneType.java:219) at org.hibernate.collection.PersistentSet.initializeFromCache(PersistentSet.java:147) at org.hibernate.cache.entry.CollectionCacheEntry.assemble(CollectionCacheEntry.java:58) at org.hibernate.event.def.DefaultInitializeCollectionEventListener.initializeCollectionFromCache(DefaultInitializeCollectionEventListener.java:159) at org.hibernate.event.def.DefaultInitializeCollectionEventListener.onInitializeCollection(DefaultInitializeCollectionEventListener.java:71) at org.hibernate.impl.SessionImpl.initializeCollection(SessionImpl.java:1743) at org.hibernate.collection.AbstractPersistentCollection.forceInitialization(AbstractPersistentCollection.java:476) at org.hibernate.engine.StatefulPersistenceContext.initializeNonLazyCollections(StatefulPersistenceContext.java:867) at org.hibernate.event.def.DefaultLoadEventListener.assembleCacheEntry(DefaultLoadEventListener.java:614) at org.hibernate.event.def.DefaultLoadEventListener.loadFromSecondLevelCache(DefaultLoadEventListener.java:542) at org.hibernate.event.def.DefaultLoadEventListener.doLoad(DefaultLoadEventListener.java:397) at org.hibernate.event.def.DefaultLoadEventListener.load(DefaultLoadEventListener.java:165) at org.hibernate.event.def.DefaultLoadEventListener.proxyOrLoad(DefaultLoadEventListener.java:207) at org.hibernate.event.def.DefaultLoadEventListener.onLoad(DefaultLoadEventListener.java:126) at org.hibernate.impl.SessionImpl.fireLoad(SessionImpl.java:905) at org.hibernate.impl.SessionImpl.get(SessionImpl.java:842) at org.hibernate.impl.SessionImpl.get(SessionImpl.java:835) at org.hibernate.ejb.AbstractEntityManagerImpl.find(AbstractEntityManagerImpl.java:182) at sun.reflect.GeneratedMethodAccessor25.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.orm.jpa.SharedEntityManagerCreator$SharedEntityManagerInvocationHandler.invoke(SharedEntityManagerCreator.java:194) at $Proxy15.find(Unknown Source) at org.springframework.samples.petclinic.jpa.EntityManagerClinic.loadOwner(EntityManagerClinic.java:70) at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:310) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:106) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at $Proxy17.loadOwner(Unknown Source) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwnerAccordingToFetchStrategy(PetClinicPerfTestActions.java:120) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwner(PetClinicPerfTestActions.java:38) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions\(FastClassByCGLIB\)6a48c588.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:191) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:628) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions$$EnhancerByCGLIB$$aa5cf164.getOwner() at org.terracotta.petclinic.perftest.type.ReadOnlyTest.doTestBody(ReadOnlyTest.java:14) at org.terracotta.petclinic.perftest.AbstractPerfTest.doTestBody(AbstractPerfTest.java:341) at org.terracotta.petclinic.perftest.AbstractPerfTest.runTest(AbstractPerfTest.java:472) at org.terracotta.petclinic.perftest.AbstractPerfTest.access$000(AbstractPerfTest.java:32) at org.terracotta.petclinic.perftest.AbstractPerfTest$1.run(AbstractPerfTest.java:271)

Locked ownable synchronizers: - None

“PerAppThread-13” - Thread [email protected] java.lang.Thread.State: BLOCKED on [email protected] owned by: PerAppThread-8 at com.tc.management.beans.tx.ClientTxMonitor.committedReadTransaction(ClientTxMonitor.java:137) at com.tc.object.tx.ClientTransactionManagerImpl.commitInternal(ClientTransactionManagerImpl.java:520) at com.tc.object.tx.ClientTransactionManagerImpl.commit(ClientTransactionManagerImpl.java:499) at com.tc.object.tx.ClientTransactionManagerImpl.commit(ClientTransactionManagerImpl.java:427) at com.tc.object.bytecode.ManagerImpl.monitorExit(ManagerImpl.java:551) at com.tc.object.bytecode.ManagerUtil.monitorExit(ManagerUtil.java:534) at java.util.concurrent.locks.ReentrantReadWriteLock$DsoLock.unlock(ReentrantReadWriteLock.java:74) at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.unlock(ReentrantReadWriteLock.java) at org.terracotta.modules.hibernatecache.TerracottaHibernateCache.isEnabled(TerracottaHibernateCache.java:77) at org.terracotta.modules.hibernatecache.TerracottaHibernateCache.get(TerracottaHibernateCache.java:127) at org.hibernate.cache.NonstrictReadWriteCache.get(NonstrictReadWriteCache.java:69) at org.hibernate.cache.impl.bridge.EntityAccessStrategyAdapter.get(EntityAccessStrategyAdapter.java:55) at org.hibernate.event.def.DefaultLoadEventListener.loadFromSecondLevelCache(DefaultLoadEventListener.java:524) at org.hibernate.event.def.DefaultLoadEventListener.doLoad(DefaultLoadEventListener.java:397) at org.hibernate.event.def.DefaultLoadEventListener.load(DefaultLoadEventListener.java:165) at org.hibernate.event.def.DefaultLoadEventListener.proxyOrLoad(DefaultLoadEventListener.java:207) at org.hibernate.event.def.DefaultLoadEventListener.onLoad(DefaultLoadEventListener.java:126) at org.hibernate.impl.SessionImpl.fireLoad(SessionImpl.java:905) at org.hibernate.impl.SessionImpl.get(SessionImpl.java:842) at org.hibernate.impl.SessionImpl.get(SessionImpl.java:835) at org.hibernate.ejb.AbstractEntityManagerImpl.find(AbstractEntityManagerImpl.java:182) at sun.reflect.GeneratedMethodAccessor25.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.orm.jpa.SharedEntityManagerCreator$SharedEntityManagerInvocationHandler.invoke(SharedEntityManagerCreator.java:194) at $Proxy15.find(Unknown Source) at org.springframework.samples.petclinic.jpa.EntityManagerClinic.loadOwner(EntityManagerClinic.java:70) at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:310) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:106) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at $Proxy17.loadOwner(Unknown Source) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwnerAccordingToFetchStrategy(PetClinicPerfTestActions.java:120) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwner(PetClinicPerfTestActions.java:38) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions\(FastClassByCGLIB\)6a48c588.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:191) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:628) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions$$EnhancerByCGLIB$$aa5cf164.getOwner() at org.terracotta.petclinic.perftest.type.ReadOnlyTest.doTestBody(ReadOnlyTest.java:14) at org.terracotta.petclinic.perftest.AbstractPerfTest.doTestBody(AbstractPerfTest.java:341) at org.terracotta.petclinic.perftest.AbstractPerfTest.runTest(AbstractPerfTest.java:472) at org.terracotta.petclinic.perftest.AbstractPerfTest.access$000(AbstractPerfTest.java:32) at org.terracotta.petclinic.perftest.AbstractPerfTest$1.run(AbstractPerfTest.java:271)

Locked ownable synchronizers: - None

“PerAppThread-12” - Thread [email protected] java.lang.Thread.State: BLOCKED on [email protected] owned by: PerAppThread-8 at com.tc.management.beans.tx.ClientTxMonitor.committedReadTransaction(ClientTxMonitor.java:137) at com.tc.object.tx.ClientTransactionManagerImpl.commitInternal(ClientTransactionManagerImpl.java:520) at com.tc.object.tx.ClientTransactionManagerImpl.commit(ClientTransactionManagerImpl.java:499) at com.tc.object.tx.ClientTransactionManagerImpl.commit(ClientTransactionManagerImpl.java:427) at com.tc.object.bytecode.ManagerImpl.monitorExit(ManagerImpl.java:551) at com.tc.object.bytecode.ManagerUtil.monitorExit(ManagerUtil.java:534) at java.util.concurrent.locks.ReentrantReadWriteLock$DsoLock.unlock(ReentrantReadWriteLock.java:74) at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.unlock(ReentrantReadWriteLock.java) at org.terracotta.modules.hibernatecache.TerracottaHibernateCache.isEnabled(TerracottaHibernateCache.java:77) at org.terracotta.modules.hibernatecache.TerracottaHibernateCache.get(TerracottaHibernateCache.java:127) at org.hibernate.cache.NonstrictReadWriteCache.get(NonstrictReadWriteCache.java:69) at org.hibernate.cache.impl.bridge.CollectionAccessStrategyAdapter.get(CollectionAccessStrategyAdapter.java:55) at org.hibernate.event.def.DefaultInitializeCollectionEventListener.initializeCollectionFromCache(DefaultInitializeCollectionEventListener.java:133) at org.hibernate.event.def.DefaultInitializeCollectionEventListener.onInitializeCollection(DefaultInitializeCollectionEventListener.java:71) at org.hibernate.impl.SessionImpl.initializeCollection(SessionImpl.java:1743) at org.hibernate.collection.AbstractPersistentCollection.forceInitialization(AbstractPersistentCollection.java:476) at org.hibernate.engine.StatefulPersistenceContext.initializeNonLazyCollections(StatefulPersistenceContext.java:867) at org.hibernate.event.def.DefaultLoadEventListener.assembleCacheEntry(DefaultLoadEventListener.java:614) at org.hibernate.event.def.DefaultLoadEventListener.loadFromSecondLevelCache(DefaultLoadEventListener.java:542) at org.hibernate.event.def.DefaultLoadEventListener.doLoad(DefaultLoadEventListener.java:397) at org.hibernate.event.def.DefaultLoadEventListener.load(DefaultLoadEventListener.java:165) at org.hibernate.event.def.DefaultLoadEventListener.proxyOrLoad(DefaultLoadEventListener.java:207) at org.hibernate.event.def.DefaultLoadEventListener.onLoad(DefaultLoadEventListener.java:126) at org.hibernate.impl.SessionImpl.fireLoad(SessionImpl.java:905) at org.hibernate.impl.SessionImpl.get(SessionImpl.java:842) at org.hibernate.impl.SessionImpl.get(SessionImpl.java:835) at org.hibernate.ejb.AbstractEntityManagerImpl.find(AbstractEntityManagerImpl.java:182) at sun.reflect.GeneratedMethodAccessor25.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.orm.jpa.SharedEntityManagerCreator$SharedEntityManagerInvocationHandler.invoke(SharedEntityManagerCreator.java:194) at $Proxy15.find(Unknown Source) at org.springframework.samples.petclinic.jpa.EntityManagerClinic.loadOwner(EntityManagerClinic.java:70) at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:310) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:106) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at $Proxy17.loadOwner(Unknown Source) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwnerAccordingToFetchStrategy(PetClinicPerfTestActions.java:120) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwner(PetClinicPerfTestActions.java:38) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions\(FastClassByCGLIB\)6a48c588.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:191) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:628) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions$$EnhancerByCGLIB$$aa5cf164.getOwner() at org.terracotta.petclinic.perftest.type.ReadOnlyTest.doTestBody(ReadOnlyTest.java:14) at org.terracotta.petclinic.perftest.AbstractPerfTest.doTestBody(AbstractPerfTest.java:341) at org.terracotta.petclinic.perftest.AbstractPerfTest.runTest(AbstractPerfTest.java:472) at org.terracotta.petclinic.perftest.AbstractPerfTest.access$000(AbstractPerfTest.java:32) at org.terracotta.petclinic.perftest.AbstractPerfTest$1.run(AbstractPerfTest.java:271)

Locked ownable synchronizers: - None

“PerAppThread-11” - Thread [email protected] java.lang.Thread.State: RUNNABLE at com.tc.management.beans.tx.ClientTxMonitor.committedReadTransaction(ClientTxMonitor.java:137) - locked [email protected] at com.tc.object.tx.ClientTransactionManagerImpl.commitInternal(ClientTransactionManagerImpl.java:520) at com.tc.object.tx.ClientTransactionManagerImpl.commit(ClientTransactionManagerImpl.java:499) at com.tc.object.tx.ClientTransactionManagerImpl.commit(ClientTransactionManagerImpl.java:427) at com.tc.object.bytecode.ManagerImpl.monitorExit(ManagerImpl.java:551) at com.tc.object.bytecode.ManagerUtil.monitorExit(ManagerUtil.java:534) at java.util.concurrent.locks.ReentrantReadWriteLock$DsoLock.unlock(ReentrantReadWriteLock.java:74) at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.unlock(ReentrantReadWriteLock.java) at org.terracotta.modules.dmap.MutableConfig.getMaxTTISeconds(MutableConfig.java:77) at org.terracotta.modules.dmap.MutableConfig.isEvictionEnabled(MutableConfig.java:191) at org.terracotta.modules.dmap.impl.ClusteredDistributedMap.getNonExpiredEntry(ClusteredDistributedMap.java:173) at org.terracotta.modules.dmap.impl.ClusteredDistributedMap.getEntry(ClusteredDistributedMap.java:158) at org.terracotta.modules.hibernatecache.TerracottaHibernateCache.get(TerracottaHibernateCache.java:129) at org.hibernate.cache.NonstrictReadWriteCache.get(NonstrictReadWriteCache.java:69) at org.hibernate.cache.impl.bridge.CollectionAccessStrategyAdapter.get(CollectionAccessStrategyAdapter.java:55) at org.hibernate.event.def.DefaultInitializeCollectionEventListener.initializeCollectionFromCache(DefaultInitializeCollectionEventListener.java:133) at org.hibernate.event.def.DefaultInitializeCollectionEventListener.onInitializeCollection(DefaultInitializeCollectionEventListener.java:71) at org.hibernate.impl.SessionImpl.initializeCollection(SessionImpl.java:1743) at org.hibernate.collection.AbstractPersistentCollection.forceInitialization(AbstractPersistentCollection.java:476) at org.hibernate.engine.StatefulPersistenceContext.initializeNonLazyCollections(StatefulPersistenceContext.java:867) at org.hibernate.event.def.DefaultLoadEventListener.assembleCacheEntry(DefaultLoadEventListener.java:614) at org.hibernate.event.def.DefaultLoadEventListener.loadFromSecondLevelCache(DefaultLoadEventListener.java:542) at org.hibernate.event.def.DefaultLoadEventListener.doLoad(DefaultLoadEventListener.java:397) at org.hibernate.event.def.DefaultLoadEventListener.load(DefaultLoadEventListener.java:165) at org.hibernate.event.def.DefaultLoadEventListener.proxyOrLoad(DefaultLoadEventListener.java:207) at org.hibernate.event.def.DefaultLoadEventListener.onLoad(DefaultLoadEventListener.java:126) at org.hibernate.impl.SessionImpl.fireLoad(SessionImpl.java:905) at org.hibernate.impl.SessionImpl.get(SessionImpl.java:842) at org.hibernate.impl.SessionImpl.get(SessionImpl.java:835) at org.hibernate.ejb.AbstractEntityManagerImpl.find(AbstractEntityManagerImpl.java:182) at sun.reflect.GeneratedMethodAccessor25.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.orm.jpa.SharedEntityManagerCreator$SharedEntityManagerInvocationHandler.invoke(SharedEntityManagerCreator.java:194) at $Proxy15.find(Unknown Source) at org.springframework.samples.petclinic.jpa.EntityManagerClinic.loadOwner(EntityManagerClinic.java:70) at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:310) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:106) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at $Proxy17.loadOwner(Unknown Source) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwnerAccordingToFetchStrategy(PetClinicPerfTestActions.java:120) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwner(PetClinicPerfTestActions.java:38) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions\(FastClassByCGLIB\)6a48c588.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:191) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:628) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions$$EnhancerByCGLIB$$aa5cf164.getOwner() at org.terracotta.petclinic.perftest.type.ReadOnlyTest.doTestBody(ReadOnlyTest.java:14) at org.terracotta.petclinic.perftest.AbstractPerfTest.doTestBody(AbstractPerfTest.java:341) at org.terracotta.petclinic.perftest.AbstractPerfTest.runTest(AbstractPerfTest.java:472) at org.terracotta.petclinic.perftest.AbstractPerfTest.access$000(AbstractPerfTest.java:32) at org.terracotta.petclinic.perftest.AbstractPerfTest$1.run(AbstractPerfTest.java:271)

Locked ownable synchronizers: - None

“PerAppThread-10” - Thread [email protected] java.lang.Thread.State: RUNNABLE at java.net.PlainSocketImpl.socketAvailable(Native Method) at java.net.PlainSocketImpl.available(PlainSocketImpl.java:448) - locked [email protected] at java.net.SocketInputStream.available(SocketInputStream.java:217) at com.mysql.jdbc.util.ReadAheadInputStream.fill(ReadAheadInputStream.java:71) at com.mysql.jdbc.util.ReadAheadInputStream.readFromUnderlyingStreamIfNecessary(ReadAheadInputStream.java:160) at com.mysql.jdbc.util.ReadAheadInputStream.read(ReadAheadInputStream.java:188) - locked [email protected] at com.mysql.jdbc.MysqlIO.readFully(MysqlIO.java:2428) at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:2938) at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:2871) at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3414) at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1936) at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2060) at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2536) - locked [email protected] at com.mysql.jdbc.ConnectionImpl.commit(ConnectionImpl.java:1543) - locked [email protected] at org.apache.commons.dbcp.DelegatingConnection.commit(DelegatingConnection.java:301) at org.apache.commons.dbcp.DelegatingConnection.commit(DelegatingConnection.java:301) at org.apache.commons.dbcp.PoolingDataSource$PoolGuardConnectionWrapper.commit(PoolingDataSource.java:200) at org.hibernate.transaction.JDBCTransaction.commitAndResetAutoCommit(JDBCTransaction.java:170) at org.hibernate.transaction.JDBCTransaction.commit(JDBCTransaction.java:146) at org.hibernate.ejb.TransactionImpl.commit(TransactionImpl.java:54) at org.springframework.orm.jpa.JpaTransactionManager.doCommit(JpaTransactionManager.java:456) at org.springframework.transaction.support.AbstractPlatformTransactionManager.processCommit(AbstractPlatformTransactionManager.java:709) at org.springframework.transaction.support.AbstractPlatformTransactionManager.commit(AbstractPlatformTransactionManager.java:678) at org.springframework.transaction.interceptor.TransactionAspectSupport.commitTransactionAfterReturning(TransactionAspectSupport.java:321) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:116) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at $Proxy17.loadOwner(Unknown Source) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwnerAccordingToFetchStrategy(PetClinicPerfTestActions.java:120) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwner(PetClinicPerfTestActions.java:38) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions\(FastClassByCGLIB\)6a48c588.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:191) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:628) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions$$EnhancerByCGLIB$$aa5cf164.getOwner() at org.terracotta.petclinic.perftest.type.ReadOnlyTest.doTestBody(ReadOnlyTest.java:14) at org.terracotta.petclinic.perftest.AbstractPerfTest.doTestBody(AbstractPerfTest.java:341) at org.terracotta.petclinic.perftest.AbstractPerfTest.runTest(AbstractPerfTest.java:472) at org.terracotta.petclinic.perftest.AbstractPerfTest.access$000(AbstractPerfTest.java:32) at org.terracotta.petclinic.perftest.AbstractPerfTest$1.run(AbstractPerfTest.java:271)

Locked ownable synchronizers: - None

“PerAppThread-9” - Thread [email protected] java.lang.Thread.State: BLOCKED on [email protected] owned by: PerAppThread-8 at com.tc.management.beans.tx.ClientTxMonitor.committedReadTransaction(ClientTxMonitor.java:137) at com.tc.object.tx.ClientTransactionManagerImpl.commitInternal(ClientTransactionManagerImpl.java:520) at com.tc.object.tx.ClientTransactionManagerImpl.commit(ClientTransactionManagerImpl.java:499) at com.tc.object.tx.ClientTransactionManagerImpl.commit(ClientTransactionManagerImpl.java:427) at com.tc.object.bytecode.ManagerImpl.monitorExit(ManagerImpl.java:551) at com.tc.object.bytecode.ManagerUtil.monitorExit(ManagerUtil.java:534) at java.util.concurrent.locks.ReentrantReadWriteLock$DsoLock.unlock(ReentrantReadWriteLock.java:74) at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.unlock(ReentrantReadWriteLock.java) at org.terracotta.modules.hibernatecache.TerracottaHibernateCache.isEnabled(TerracottaHibernateCache.java:77) at org.terracotta.modules.hibernatecache.TerracottaHibernateCache.get(TerracottaHibernateCache.java:127) at org.hibernate.cache.NonstrictReadWriteCache.get(NonstrictReadWriteCache.java:69) at org.hibernate.cache.impl.bridge.EntityAccessStrategyAdapter.get(EntityAccessStrategyAdapter.java:55) at org.hibernate.event.def.DefaultLoadEventListener.loadFromSecondLevelCache(DefaultLoadEventListener.java:524) at org.hibernate.event.def.DefaultLoadEventListener.doLoad(DefaultLoadEventListener.java:397) at org.hibernate.event.def.DefaultLoadEventListener.load(DefaultLoadEventListener.java:165) at org.hibernate.event.def.DefaultLoadEventListener.proxyOrLoad(DefaultLoadEventListener.java:207) at org.hibernate.event.def.DefaultLoadEventListener.onLoad(DefaultLoadEventListener.java:126) at org.hibernate.impl.SessionImpl.fireLoad(SessionImpl.java:905) at org.hibernate.impl.SessionImpl.internalLoad(SessionImpl.java:873) at org.hibernate.type.EntityType.resolveIdentifier(EntityType.java:590) at org.hibernate.type.ManyToOneType.assemble(ManyToOneType.java:219) at org.hibernate.collection.PersistentSet.initializeFromCache(PersistentSet.java:147) at org.hibernate.cache.entry.CollectionCacheEntry.assemble(CollectionCacheEntry.java:58) at org.hibernate.event.def.DefaultInitializeCollectionEventListener.initializeCollectionFromCache(DefaultInitializeCollectionEventListener.java:159) at org.hibernate.event.def.DefaultInitializeCollectionEventListener.onInitializeCollection(DefaultInitializeCollectionEventListener.java:71) at org.hibernate.impl.SessionImpl.initializeCollection(SessionImpl.java:1743) at org.hibernate.collection.AbstractPersistentCollection.forceInitialization(AbstractPersistentCollection.java:476) at org.hibernate.engine.StatefulPersistenceContext.initializeNonLazyCollections(StatefulPersistenceContext.java:867) at org.hibernate.event.def.DefaultLoadEventListener.assembleCacheEntry(DefaultLoadEventListener.java:614) at org.hibernate.event.def.DefaultLoadEventListener.loadFromSecondLevelCache(DefaultLoadEventListener.java:542) at org.hibernate.event.def.DefaultLoadEventListener.doLoad(DefaultLoadEventListener.java:397) at org.hibernate.event.def.DefaultLoadEventListener.load(DefaultLoadEventListener.java:165) at org.hibernate.event.def.DefaultLoadEventListener.proxyOrLoad(DefaultLoadEventListener.java:207) at org.hibernate.event.def.DefaultLoadEventListener.onLoad(DefaultLoadEventListener.java:126) at org.hibernate.impl.SessionImpl.fireLoad(SessionImpl.java:905) at org.hibernate.impl.SessionImpl.get(SessionImpl.java:842) at org.hibernate.impl.SessionImpl.get(SessionImpl.java:835) at org.hibernate.ejb.AbstractEntityManagerImpl.find(AbstractEntityManagerImpl.java:182) at sun.reflect.GeneratedMethodAccessor25.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.orm.jpa.SharedEntityManagerCreator$SharedEntityManagerInvocationHandler.invoke(SharedEntityManagerCreator.java:194) at $Proxy15.find(Unknown Source) at org.springframework.samples.petclinic.jpa.EntityManagerClinic.loadOwner(EntityManagerClinic.java:70) at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:310) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:106) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at $Proxy17.loadOwner(Unknown Source) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwnerAccordingToFetchStrategy(PetClinicPerfTestActions.java:120) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwner(PetClinicPerfTestActions.java:38) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions\(FastClassByCGLIB\)6a48c588.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:191) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:628) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions$$EnhancerByCGLIB$$aa5cf164.getOwner() at org.terracotta.petclinic.perftest.type.ReadOnlyTest.doTestBody(ReadOnlyTest.java:14) at org.terracotta.petclinic.perftest.AbstractPerfTest.doTestBody(AbstractPerfTest.java:341) at org.terracotta.petclinic.perftest.AbstractPerfTest.runTest(AbstractPerfTest.java:472) at org.terracotta.petclinic.perftest.AbstractPerfTest.access$000(AbstractPerfTest.java:32) at org.terracotta.petclinic.perftest.AbstractPerfTest$1.run(AbstractPerfTest.java:271)

Locked ownable synchronizers: - None

“PerAppThread-8” - Thread [email protected] java.lang.Thread.State: RUNNABLE at com.tc.management.beans.tx.ClientTxMonitor.committedReadTransaction(ClientTxMonitor.java:137) - locked [email protected] at com.tc.object.tx.ClientTransactionManagerImpl.commitInternal(ClientTransactionManagerImpl.java:520) at com.tc.object.tx.ClientTransactionManagerImpl.commit(ClientTransactionManagerImpl.java:499) at com.tc.object.tx.ClientTransactionManagerImpl.commit(ClientTransactionManagerImpl.java:427) at com.tc.object.bytecode.ManagerImpl.monitorExit(ManagerImpl.java:551) at com.tc.object.bytecode.ManagerUtil.monitorExit(ManagerUtil.java:534) at java.util.concurrent.locks.ReentrantReadWriteLock$DsoLock.unlock(ReentrantReadWriteLock.java:74) at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.unlock(ReentrantReadWriteLock.java) at org.terracotta.modules.dmap.MutableConfig.getMaxTTISeconds(MutableConfig.java:77) at org.terracotta.modules.dmap.MutableConfig.isEvictionEnabled(MutableConfig.java:191) at org.terracotta.modules.dmap.impl.ClusteredDistributedMap.getNonExpiredEntry(ClusteredDistributedMap.java:173) at org.terracotta.modules.dmap.impl.ClusteredDistributedMap.getEntry(ClusteredDistributedMap.java:158) at org.terracotta.modules.hibernatecache.TerracottaHibernateCache.get(TerracottaHibernateCache.java:129) at org.hibernate.cache.NonstrictReadWriteCache.get(NonstrictReadWriteCache.java:69) at org.hibernate.cache.impl.bridge.EntityAccessStrategyAdapter.get(EntityAccessStrategyAdapter.java:55) at org.hibernate.event.def.DefaultLoadEventListener.loadFromSecondLevelCache(DefaultLoadEventListener.java:524) at org.hibernate.event.def.DefaultLoadEventListener.doLoad(DefaultLoadEventListener.java:397) at org.hibernate.event.def.DefaultLoadEventListener.load(DefaultLoadEventListener.java:165) at org.hibernate.event.def.DefaultLoadEventListener.proxyOrLoad(DefaultLoadEventListener.java:207) at org.hibernate.event.def.DefaultLoadEventListener.onLoad(DefaultLoadEventListener.java:126) at org.hibernate.impl.SessionImpl.fireLoad(SessionImpl.java:905) at org.hibernate.impl.SessionImpl.internalLoad(SessionImpl.java:873) at org.hibernate.type.EntityType.resolveIdentifier(EntityType.java:590) at org.hibernate.type.ManyToOneType.assemble(ManyToOneType.java:219) at org.hibernate.collection.PersistentSet.initializeFromCache(PersistentSet.java:147) at org.hibernate.cache.entry.CollectionCacheEntry.assemble(CollectionCacheEntry.java:58) at org.hibernate.event.def.DefaultInitializeCollectionEventListener.initializeCollectionFromCache(DefaultInitializeCollectionEventListener.java:159) at org.hibernate.event.def.DefaultInitializeCollectionEventListener.onInitializeCollection(DefaultInitializeCollectionEventListener.java:71) at org.hibernate.impl.SessionImpl.initializeCollection(SessionImpl.java:1743) at org.hibernate.collection.AbstractPersistentCollection.forceInitialization(AbstractPersistentCollection.java:476) at org.hibernate.engine.StatefulPersistenceContext.initializeNonLazyCollections(StatefulPersistenceContext.java:867) at org.hibernate.event.def.DefaultLoadEventListener.assembleCacheEntry(DefaultLoadEventListener.java:614) at org.hibernate.event.def.DefaultLoadEventListener.loadFromSecondLevelCache(DefaultLoadEventListener.java:542) at org.hibernate.event.def.DefaultLoadEventListener.doLoad(DefaultLoadEventListener.java:397) at org.hibernate.event.def.DefaultLoadEventListener.load(DefaultLoadEventListener.java:165) at org.hibernate.event.def.DefaultLoadEventListener.proxyOrLoad(DefaultLoadEventListener.java:207) at org.hibernate.event.def.DefaultLoadEventListener.onLoad(DefaultLoadEventListener.java:126) at org.hibernate.impl.SessionImpl.fireLoad(SessionImpl.java:905) at org.hibernate.impl.SessionImpl.get(SessionImpl.java:842) at org.hibernate.impl.SessionImpl.get(SessionImpl.java:835) at org.hibernate.ejb.AbstractEntityManagerImpl.find(AbstractEntityManagerImpl.java:182) at sun.reflect.GeneratedMethodAccessor25.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.orm.jpa.SharedEntityManagerCreator$SharedEntityManagerInvocationHandler.invoke(SharedEntityManagerCreator.java:194) at $Proxy15.find(Unknown Source) at org.springframework.samples.petclinic.jpa.EntityManagerClinic.loadOwner(EntityManagerClinic.java:70) at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:310) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:106) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at $Proxy17.loadOwner(Unknown Source) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwnerAccordingToFetchStrategy(PetClinicPerfTestActions.java:120) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwner(PetClinicPerfTestActions.java:38) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions\(FastClassByCGLIB\)6a48c588.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:191) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:628) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions$$EnhancerByCGLIB$$aa5cf164.getOwner() at org.terracotta.petclinic.perftest.type.ReadOnlyTest.doTestBody(ReadOnlyTest.java:14) at org.terracotta.petclinic.perftest.AbstractPerfTest.doTestBody(AbstractPerfTest.java:341) at org.terracotta.petclinic.perftest.AbstractPerfTest.runTest(AbstractPerfTest.java:472) at org.terracotta.petclinic.perftest.AbstractPerfTest.access$000(AbstractPerfTest.java:32) at org.terracotta.petclinic.perftest.AbstractPerfTest$1.run(AbstractPerfTest.java:271)

Locked ownable synchronizers: - None

“PerAppThread-7” - Thread [email protected] java.lang.Thread.State: RUNNABLE at com.tc.object.lockmanager.impl.ClientLockManagerImpl.isRunning(ClientLockManagerImpl.java:736) - locked [email protected] at com.tc.object.lockmanager.impl.ClientLockManagerImpl.waitUntilRunning(ClientLockManagerImpl.java:725) at com.tc.object.lockmanager.impl.ClientLockManagerImpl.unlock(ClientLockManagerImpl.java:451) - locked [email protected] at com.tc.object.lockmanager.impl.StripedClientLockManagerImpl.unlock(StripedClientLockManagerImpl.java:160) at com.tc.object.lockmanager.impl.ThreadLockManagerImpl.unlock(ThreadLockManagerImpl.java:68) at com.tc.object.tx.ClientTransactionManagerImpl.commitInternal(ClientTransactionManagerImpl.java:545) at com.tc.object.tx.ClientTransactionManagerImpl.commit(ClientTransactionManagerImpl.java:499) at com.tc.object.tx.ClientTransactionManagerImpl.commit(ClientTransactionManagerImpl.java:427) at com.tc.object.bytecode.ManagerImpl.commitLock(ManagerImpl.java:395) at com.tc.object.bytecode.ManagerUtil.commitLock(ManagerUtil.java:222) at org.terracotta.modules.concurrent.collections.ConcurrentStringMapDsoInstrumented.get(ConcurrentStringMapDsoInstrumented.java:135) at org.terracotta.modules.concurrent.collections.ConcurrentStringMapDsoInstrumentedArray.get(ConcurrentStringMapDsoInstrumentedArray.java:131) at org.terracotta.modules.concurrent.collections.ConcurrentStringMap.get(ConcurrentStringMap.java:144) at org.terracotta.modules.dmap.impl.ClusteredDistributedMap.getNonExpiredEntry(ClusteredDistributedMap.java:170) at org.terracotta.modules.dmap.impl.ClusteredDistributedMap.getEntry(ClusteredDistributedMap.java:158) at org.terracotta.modules.hibernatecache.TerracottaHibernateCache.get(TerracottaHibernateCache.java:129) at org.hibernate.cache.NonstrictReadWriteCache.get(NonstrictReadWriteCache.java:69) at org.hibernate.cache.impl.bridge.EntityAccessStrategyAdapter.get(EntityAccessStrategyAdapter.java:55) at org.hibernate.event.def.DefaultLoadEventListener.loadFromSecondLevelCache(DefaultLoadEventListener.java:524) at org.hibernate.event.def.DefaultLoadEventListener.doLoad(DefaultLoadEventListener.java:397) at org.hibernate.event.def.DefaultLoadEventListener.load(DefaultLoadEventListener.java:165) at org.hibernate.event.def.DefaultLoadEventListener.proxyOrLoad(DefaultLoadEventListener.java:207) at org.hibernate.event.def.DefaultLoadEventListener.onLoad(DefaultLoadEventListener.java:126) at org.hibernate.impl.SessionImpl.fireLoad(SessionImpl.java:905) at org.hibernate.impl.SessionImpl.internalLoad(SessionImpl.java:873) at org.hibernate.type.EntityType.resolveIdentifier(EntityType.java:590) at org.hibernate.type.ManyToOneType.assemble(ManyToOneType.java:219) at org.hibernate.collection.PersistentSet.initializeFromCache(PersistentSet.java:147) at org.hibernate.cache.entry.CollectionCacheEntry.assemble(CollectionCacheEntry.java:58) at org.hibernate.event.def.DefaultInitializeCollectionEventListener.initializeCollectionFromCache(DefaultInitializeCollectionEventListener.java:159) at org.hibernate.event.def.DefaultInitializeCollectionEventListener.onInitializeCollection(DefaultInitializeCollectionEventListener.java:71) at org.hibernate.impl.SessionImpl.initializeCollection(SessionImpl.java:1743) at org.hibernate.collection.AbstractPersistentCollection.forceInitialization(AbstractPersistentCollection.java:476) at org.hibernate.engine.StatefulPersistenceContext.initializeNonLazyCollections(StatefulPersistenceContext.java:867) at org.hibernate.event.def.DefaultLoadEventListener.assembleCacheEntry(DefaultLoadEventListener.java:614) at org.hibernate.event.def.DefaultLoadEventListener.loadFromSecondLevelCache(DefaultLoadEventListener.java:542) at org.hibernate.event.def.DefaultLoadEventListener.doLoad(DefaultLoadEventListener.java:397) at org.hibernate.event.def.DefaultLoadEventListener.load(DefaultLoadEventListener.java:165) at org.hibernate.event.def.DefaultLoadEventListener.proxyOrLoad(DefaultLoadEventListener.java:207) at org.hibernate.event.def.DefaultLoadEventListener.onLoad(DefaultLoadEventListener.java:126) at org.hibernate.impl.SessionImpl.fireLoad(SessionImpl.java:905) at org.hibernate.impl.SessionImpl.get(SessionImpl.java:842) at org.hibernate.impl.SessionImpl.get(SessionImpl.java:835) at org.hibernate.ejb.AbstractEntityManagerImpl.find(AbstractEntityManagerImpl.java:182) at sun.reflect.GeneratedMethodAccessor25.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.orm.jpa.SharedEntityManagerCreator$SharedEntityManagerInvocationHandler.invoke(SharedEntityManagerCreator.java:194) at $Proxy15.find(Unknown Source) at org.springframework.samples.petclinic.jpa.EntityManagerClinic.loadOwner(EntityManagerClinic.java:70) at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:310) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:106) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at $Proxy17.loadOwner(Unknown Source) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwnerAccordingToFetchStrategy(PetClinicPerfTestActions.java:120) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwner(PetClinicPerfTestActions.java:38) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions\(FastClassByCGLIB\)6a48c588.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:191) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:628) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions$$EnhancerByCGLIB$$aa5cf164.getOwner() at org.terracotta.petclinic.perftest.type.ReadOnlyTest.doTestBody(ReadOnlyTest.java:14) at org.terracotta.petclinic.perftest.AbstractPerfTest.doTestBody(AbstractPerfTest.java:341) at org.terracotta.petclinic.perftest.AbstractPerfTest.runTest(AbstractPerfTest.java:472) at org.terracotta.petclinic.perftest.AbstractPerfTest.access$000(AbstractPerfTest.java:32) at org.terracotta.petclinic.perftest.AbstractPerfTest$1.run(AbstractPerfTest.java:271)

Locked ownable synchronizers: - None

“PerAppThread-6” - Thread [email protected] java.lang.Thread.State: RUNNABLE at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.read(SocketInputStream.java:129) at com.mysql.jdbc.util.ReadAheadInputStream.fill(ReadAheadInputStream.java:113) at com.mysql.jdbc.util.ReadAheadInputStream.readFromUnderlyingStreamIfNecessary(ReadAheadInputStream.java:160) at com.mysql.jdbc.util.ReadAheadInputStream.read(ReadAheadInputStream.java:188) - locked [email protected] at com.mysql.jdbc.MysqlIO.readFully(MysqlIO.java:2428) at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:2882) at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:2871) at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3414) at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1936) at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2060) at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2536) - locked [email protected] at com.mysql.jdbc.ConnectionImpl.commit(ConnectionImpl.java:1543) - locked [email protected] at org.apache.commons.dbcp.DelegatingConnection.commit(DelegatingConnection.java:301) at org.apache.commons.dbcp.DelegatingConnection.commit(DelegatingConnection.java:301) at org.apache.commons.dbcp.PoolingDataSource$PoolGuardConnectionWrapper.commit(PoolingDataSource.java:200) at org.hibernate.transaction.JDBCTransaction.commitAndResetAutoCommit(JDBCTransaction.java:170) at org.hibernate.transaction.JDBCTransaction.commit(JDBCTransaction.java:146) at org.hibernate.ejb.TransactionImpl.commit(TransactionImpl.java:54) at org.springframework.orm.jpa.JpaTransactionManager.doCommit(JpaTransactionManager.java:456) at org.springframework.transaction.support.AbstractPlatformTransactionManager.processCommit(AbstractPlatformTransactionManager.java:709) at org.springframework.transaction.support.AbstractPlatformTransactionManager.commit(AbstractPlatformTransactionManager.java:678) at org.springframework.transaction.interceptor.TransactionAspectSupport.commitTransactionAfterReturning(TransactionAspectSupport.java:321) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:116) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at $Proxy17.loadOwner(Unknown Source) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwnerAccordingToFetchStrategy(PetClinicPerfTestActions.java:120) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwner(PetClinicPerfTestActions.java:38) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions\(FastClassByCGLIB\)6a48c588.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:191) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:628) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions$$EnhancerByCGLIB$$aa5cf164.getOwner() at org.terracotta.petclinic.perftest.type.ReadOnlyTest.doTestBody(ReadOnlyTest.java:14) at org.terracotta.petclinic.perftest.AbstractPerfTest.doTestBody(AbstractPerfTest.java:341) at org.terracotta.petclinic.perftest.AbstractPerfTest.runTest(AbstractPerfTest.java:472) at org.terracotta.petclinic.perftest.AbstractPerfTest.access$000(AbstractPerfTest.java:32) at org.terracotta.petclinic.perftest.AbstractPerfTest$1.run(AbstractPerfTest.java:271)

Locked ownable synchronizers: - None

“PerAppThread-5” - Thread [email protected] java.lang.Thread.State: RUNNABLE at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.read(SocketInputStream.java:129) at com.mysql.jdbc.util.ReadAheadInputStream.fill(ReadAheadInputStream.java:113) at com.mysql.jdbc.util.ReadAheadInputStream.readFromUnderlyingStreamIfNecessary(ReadAheadInputStream.java:160) at com.mysql.jdbc.util.ReadAheadInputStream.read(ReadAheadInputStream.java:188) - locked [email protected] at com.mysql.jdbc.MysqlIO.readFully(MysqlIO.java:2428) at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:2882) at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:2871) at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3414) at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1936) at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2060) at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2536) - locked [email protected] at com.mysql.jdbc.ConnectionImpl.commit(ConnectionImpl.java:1543) - locked [email protected] at org.apache.commons.dbcp.DelegatingConnection.commit(DelegatingConnection.java:301) at org.apache.commons.dbcp.DelegatingConnection.commit(DelegatingConnection.java:301) at org.apache.commons.dbcp.PoolingDataSource$PoolGuardConnectionWrapper.commit(PoolingDataSource.java:200) at org.hibernate.transaction.JDBCTransaction.commitAndResetAutoCommit(JDBCTransaction.java:170) at org.hibernate.transaction.JDBCTransaction.commit(JDBCTransaction.java:146) at org.hibernate.ejb.TransactionImpl.commit(TransactionImpl.java:54) at org.springframework.orm.jpa.JpaTransactionManager.doCommit(JpaTransactionManager.java:456) at org.springframework.transaction.support.AbstractPlatformTransactionManager.processCommit(AbstractPlatformTransactionManager.java:709) at org.springframework.transaction.support.AbstractPlatformTransactionManager.commit(AbstractPlatformTransactionManager.java:678) at org.springframework.transaction.interceptor.TransactionAspectSupport.commitTransactionAfterReturning(TransactionAspectSupport.java:321) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:116) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at $Proxy17.loadOwner(Unknown Source) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwnerAccordingToFetchStrategy(PetClinicPerfTestActions.java:120) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwner(PetClinicPerfTestActions.java:38) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions\(FastClassByCGLIB\)6a48c588.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:191) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:628) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions$$EnhancerByCGLIB$$aa5cf164.getOwner() at org.terracotta.petclinic.perftest.type.ReadOnlyTest.doTestBody(ReadOnlyTest.java:14) at org.terracotta.petclinic.perftest.AbstractPerfTest.doTestBody(AbstractPerfTest.java:341) at org.terracotta.petclinic.perftest.AbstractPerfTest.runTest(AbstractPerfTest.java:472) at org.terracotta.petclinic.perftest.AbstractPerfTest.access$000(AbstractPerfTest.java:32) at org.terracotta.petclinic.perftest.AbstractPerfTest$1.run(AbstractPerfTest.java:271)

Locked ownable synchronizers: - None

“PerAppThread-4” - Thread [email protected] java.lang.Thread.State: BLOCKED on [email protected] owned by: PerAppThread-8 at com.tc.management.beans.tx.ClientTxMonitor.committedReadTransaction(ClientTxMonitor.java:137) at com.tc.object.tx.ClientTransactionManagerImpl.commitInternal(ClientTransactionManagerImpl.java:520) at com.tc.object.tx.ClientTransactionManagerImpl.commit(ClientTransactionManagerImpl.java:499) at com.tc.object.tx.ClientTransactionManagerImpl.commit(ClientTransactionManagerImpl.java:427) at com.tc.object.bytecode.ManagerImpl.monitorExit(ManagerImpl.java:551) at com.tc.object.bytecode.ManagerUtil.monitorExit(ManagerUtil.java:534) at java.util.concurrent.locks.ReentrantReadWriteLock$DsoLock.unlock(ReentrantReadWriteLock.java:74) at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.unlock(ReentrantReadWriteLock.java) at org.terracotta.modules.dmap.MutableConfig.getMaxTTLSeconds(MutableConfig.java:86) at org.terracotta.modules.dmap.MutableConfig.isEvictionEnabled(MutableConfig.java:191) at org.terracotta.modules.dmap.impl.ClusteredDistributedMap.getNonExpiredEntry(ClusteredDistributedMap.java:173) at org.terracotta.modules.dmap.impl.ClusteredDistributedMap.getEntry(ClusteredDistributedMap.java:158) at org.terracotta.modules.hibernatecache.TerracottaHibernateCache.get(TerracottaHibernateCache.java:129) at org.hibernate.cache.NonstrictReadWriteCache.get(NonstrictReadWriteCache.java:69) at org.hibernate.cache.impl.bridge.EntityAccessStrategyAdapter.get(EntityAccessStrategyAdapter.java:55) at org.hibernate.event.def.DefaultLoadEventListener.loadFromSecondLevelCache(DefaultLoadEventListener.java:524) at org.hibernate.event.def.DefaultLoadEventListener.doLoad(DefaultLoadEventListener.java:397) at org.hibernate.event.def.DefaultLoadEventListener.load(DefaultLoadEventListener.java:165) at org.hibernate.event.def.DefaultLoadEventListener.proxyOrLoad(DefaultLoadEventListener.java:207) at org.hibernate.event.def.DefaultLoadEventListener.onLoad(DefaultLoadEventListener.java:126) at org.hibernate.impl.SessionImpl.fireLoad(SessionImpl.java:905) at org.hibernate.impl.SessionImpl.internalLoad(SessionImpl.java:873) at org.hibernate.type.EntityType.resolveIdentifier(EntityType.java:590) at org.hibernate.type.ManyToOneType.assemble(ManyToOneType.java:219) at org.hibernate.collection.PersistentSet.initializeFromCache(PersistentSet.java:147) at org.hibernate.cache.entry.CollectionCacheEntry.assemble(CollectionCacheEntry.java:58) at org.hibernate.event.def.DefaultInitializeCollectionEventListener.initializeCollectionFromCache(DefaultInitializeCollectionEventListener.java:159) at org.hibernate.event.def.DefaultInitializeCollectionEventListener.onInitializeCollection(DefaultInitializeCollectionEventListener.java:71) at org.hibernate.impl.SessionImpl.initializeCollection(SessionImpl.java:1743) at org.hibernate.collection.AbstractPersistentCollection.forceInitialization(AbstractPersistentCollection.java:476) at org.hibernate.engine.StatefulPersistenceContext.initializeNonLazyCollections(StatefulPersistenceContext.java:867) at org.hibernate.event.def.DefaultLoadEventListener.assembleCacheEntry(DefaultLoadEventListener.java:614) at org.hibernate.event.def.DefaultLoadEventListener.loadFromSecondLevelCache(DefaultLoadEventListener.java:542) at org.hibernate.event.def.DefaultLoadEventListener.doLoad(DefaultLoadEventListener.java:397) at org.hibernate.event.def.DefaultLoadEventListener.load(DefaultLoadEventListener.java:165) at org.hibernate.event.def.DefaultLoadEventListener.proxyOrLoad(DefaultLoadEventListener.java:207) at org.hibernate.event.def.DefaultLoadEventListener.onLoad(DefaultLoadEventListener.java:126) at org.hibernate.impl.SessionImpl.fireLoad(SessionImpl.java:905) at org.hibernate.impl.SessionImpl.get(SessionImpl.java:842) at org.hibernate.impl.SessionImpl.get(SessionImpl.java:835) at org.hibernate.ejb.AbstractEntityManagerImpl.find(AbstractEntityManagerImpl.java:182) at sun.reflect.GeneratedMethodAccessor25.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.orm.jpa.SharedEntityManagerCreator$SharedEntityManagerInvocationHandler.invoke(SharedEntityManagerCreator.java:194) at $Proxy15.find(Unknown Source) at org.springframework.samples.petclinic.jpa.EntityManagerClinic.loadOwner(EntityManagerClinic.java:70) at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:310) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:106) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at $Proxy17.loadOwner(Unknown Source) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwnerAccordingToFetchStrategy(PetClinicPerfTestActions.java:120) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwner(PetClinicPerfTestActions.java:38) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions\(FastClassByCGLIB\)6a48c588.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:191) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:628) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions$$EnhancerByCGLIB$$aa5cf164.getOwner() at org.terracotta.petclinic.perftest.type.ReadOnlyTest.doTestBody(ReadOnlyTest.java:14) at org.terracotta.petclinic.perftest.AbstractPerfTest.doTestBody(AbstractPerfTest.java:341) at org.terracotta.petclinic.perftest.AbstractPerfTest.runTest(AbstractPerfTest.java:472) at org.terracotta.petclinic.perftest.AbstractPerfTest.access$000(AbstractPerfTest.java:32) at org.terracotta.petclinic.perftest.AbstractPerfTest$1.run(AbstractPerfTest.java:271)

Locked ownable synchronizers: - None

“PerAppThread-3” - Thread [email protected] java.lang.Thread.State: BLOCKED on [email protected] owned by: PerAppThread-8 at com.tc.management.beans.tx.ClientTxMonitor.committedReadTransaction(ClientTxMonitor.java:137) at com.tc.object.tx.ClientTransactionManagerImpl.commitInternal(ClientTransactionManagerImpl.java:520) at com.tc.object.tx.ClientTransactionManagerImpl.commit(ClientTransactionManagerImpl.java:499) at com.tc.object.tx.ClientTransactionManagerImpl.commit(ClientTransactionManagerImpl.java:427) at com.tc.object.bytecode.ManagerImpl.monitorExit(ManagerImpl.java:551) at com.tc.object.bytecode.ManagerUtil.monitorExit(ManagerUtil.java:534) at java.util.concurrent.locks.ReentrantReadWriteLock$DsoLock.unlock(ReentrantReadWriteLock.java:74) at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.unlock(ReentrantReadWriteLock.java) at org.terracotta.modules.hibernatecache.TerracottaHibernateCache.isEnabled(TerracottaHibernateCache.java:77) at org.terracotta.modules.hibernatecache.TerracottaHibernateCache.get(TerracottaHibernateCache.java:127) at org.hibernate.cache.NonstrictReadWriteCache.get(NonstrictReadWriteCache.java:69) at org.hibernate.cache.impl.bridge.CollectionAccessStrategyAdapter.get(CollectionAccessStrategyAdapter.java:55) at org.hibernate.event.def.DefaultInitializeCollectionEventListener.initializeCollectionFromCache(DefaultInitializeCollectionEventListener.java:133) at org.hibernate.event.def.DefaultInitializeCollectionEventListener.onInitializeCollection(DefaultInitializeCollectionEventListener.java:71) at org.hibernate.impl.SessionImpl.initializeCollection(SessionImpl.java:1743) at org.hibernate.collection.AbstractPersistentCollection.forceInitialization(AbstractPersistentCollection.java:476) at org.hibernate.engine.StatefulPersistenceContext.initializeNonLazyCollections(StatefulPersistenceContext.java:867) at org.hibernate.event.def.DefaultLoadEventListener.assembleCacheEntry(DefaultLoadEventListener.java:614) at org.hibernate.event.def.DefaultLoadEventListener.loadFromSecondLevelCache(DefaultLoadEventListener.java:542) at org.hibernate.event.def.DefaultLoadEventListener.doLoad(DefaultLoadEventListener.java:397) at org.hibernate.event.def.DefaultLoadEventListener.load(DefaultLoadEventListener.java:165) at org.hibernate.event.def.DefaultLoadEventListener.proxyOrLoad(DefaultLoadEventListener.java:207) at org.hibernate.event.def.DefaultLoadEventListener.onLoad(DefaultLoadEventListener.java:126) at org.hibernate.impl.SessionImpl.fireLoad(SessionImpl.java:905) at org.hibernate.impl.SessionImpl.get(SessionImpl.java:842) at org.hibernate.impl.SessionImpl.get(SessionImpl.java:835) at org.hibernate.ejb.AbstractEntityManagerImpl.find(AbstractEntityManagerImpl.java:182) at sun.reflect.GeneratedMethodAccessor25.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.orm.jpa.SharedEntityManagerCreator$SharedEntityManagerInvocationHandler.invoke(SharedEntityManagerCreator.java:194) at $Proxy15.find(Unknown Source) at org.springframework.samples.petclinic.jpa.EntityManagerClinic.loadOwner(EntityManagerClinic.java:70) at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:310) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:106) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at $Proxy17.loadOwner(Unknown Source) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwnerAccordingToFetchStrategy(PetClinicPerfTestActions.java:120) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwner(PetClinicPerfTestActions.java:38) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions\(FastClassByCGLIB\)6a48c588.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:191) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:628) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions$$EnhancerByCGLIB$$aa5cf164.getOwner() at org.terracotta.petclinic.perftest.type.ReadOnlyTest.doTestBody(ReadOnlyTest.java:14) at org.terracotta.petclinic.perftest.AbstractPerfTest.doTestBody(AbstractPerfTest.java:341) at org.terracotta.petclinic.perftest.AbstractPerfTest.runTest(AbstractPerfTest.java:472) at org.terracotta.petclinic.perftest.AbstractPerfTest.access$000(AbstractPerfTest.java:32) at org.terracotta.petclinic.perftest.AbstractPerfTest$1.run(AbstractPerfTest.java:271)

Locked ownable synchronizers: - None

“PerAppThread-2” - Thread [email protected] java.lang.Thread.State: BLOCKED on [email protected] owned by: PerAppThread-8 at com.tc.management.beans.tx.ClientTxMonitor.committedReadTransaction(ClientTxMonitor.java:137) at com.tc.object.tx.ClientTransactionManagerImpl.commitInternal(ClientTransactionManagerImpl.java:520) at com.tc.object.tx.ClientTransactionManagerImpl.commit(ClientTransactionManagerImpl.java:499) at com.tc.object.tx.ClientTransactionManagerImpl.commit(ClientTransactionManagerImpl.java:427) at com.tc.object.bytecode.ManagerImpl.monitorExit(ManagerImpl.java:551) at com.tc.object.bytecode.ManagerUtil.monitorExit(ManagerUtil.java:534) at java.util.concurrent.locks.ReentrantReadWriteLock$DsoLock.unlock(ReentrantReadWriteLock.java:74) at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.unlock(ReentrantReadWriteLock.java) at org.terracotta.modules.hibernatecache.TerracottaHibernateCache.isEnabled(TerracottaHibernateCache.java:77) at org.terracotta.modules.hibernatecache.TerracottaHibernateCache.get(TerracottaHibernateCache.java:127) at org.hibernate.cache.NonstrictReadWriteCache.get(NonstrictReadWriteCache.java:69) at org.hibernate.cache.impl.bridge.EntityAccessStrategyAdapter.get(EntityAccessStrategyAdapter.java:55) at org.hibernate.event.def.DefaultLoadEventListener.loadFromSecondLevelCache(DefaultLoadEventListener.java:524) at org.hibernate.event.def.DefaultLoadEventListener.doLoad(DefaultLoadEventListener.java:397) at org.hibernate.event.def.DefaultLoadEventListener.load(DefaultLoadEventListener.java:165) at org.hibernate.event.def.DefaultLoadEventListener.proxyOrLoad(DefaultLoadEventListener.java:207) at org.hibernate.event.def.DefaultLoadEventListener.onLoad(DefaultLoadEventListener.java:126) at org.hibernate.impl.SessionImpl.fireLoad(SessionImpl.java:905) at org.hibernate.impl.SessionImpl.get(SessionImpl.java:842) at org.hibernate.impl.SessionImpl.get(SessionImpl.java:835) at org.hibernate.ejb.AbstractEntityManagerImpl.find(AbstractEntityManagerImpl.java:182) at sun.reflect.GeneratedMethodAccessor25.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.orm.jpa.SharedEntityManagerCreator$SharedEntityManagerInvocationHandler.invoke(SharedEntityManagerCreator.java:194) at $Proxy15.find(Unknown Source) at org.springframework.samples.petclinic.jpa.EntityManagerClinic.loadOwner(EntityManagerClinic.java:70) at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:310) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:106) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at $Proxy17.loadOwner(Unknown Source) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwnerAccordingToFetchStrategy(PetClinicPerfTestActions.java:120) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwner(PetClinicPerfTestActions.java:38) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions\(FastClassByCGLIB\)6a48c588.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:191) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:628) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions$$EnhancerByCGLIB$$aa5cf164.getOwner() at org.terracotta.petclinic.perftest.type.ReadOnlyTest.doTestBody(ReadOnlyTest.java:14) at org.terracotta.petclinic.perftest.AbstractPerfTest.doTestBody(AbstractPerfTest.java:341) at org.terracotta.petclinic.perftest.AbstractPerfTest.runTest(AbstractPerfTest.java:472) at org.terracotta.petclinic.perftest.AbstractPerfTest.access$000(AbstractPerfTest.java:32) at org.terracotta.petclinic.perftest.AbstractPerfTest$1.run(AbstractPerfTest.java:271)

Locked ownable synchronizers: - None

“PerAppThread-1” - Thread [email protected] java.lang.Thread.State: BLOCKED on [email protected] owned by: PerAppThread-8 at com.tc.management.beans.tx.ClientTxMonitor.committedReadTransaction(ClientTxMonitor.java:137) at com.tc.object.tx.ClientTransactionManagerImpl.commitInternal(ClientTransactionManagerImpl.java:520) at com.tc.object.tx.ClientTransactionManagerImpl.commit(ClientTransactionManagerImpl.java:499) at com.tc.object.tx.ClientTransactionManagerImpl.commit(ClientTransactionManagerImpl.java:427) at com.tc.object.bytecode.ManagerImpl.monitorExit(ManagerImpl.java:551) at com.tc.object.bytecode.ManagerUtil.monitorExit(ManagerUtil.java:534) at java.util.concurrent.locks.ReentrantReadWriteLock$DsoLock.unlock(ReentrantReadWriteLock.java:74) at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.unlock(ReentrantReadWriteLock.java) at org.terracotta.modules.hibernatecache.TerracottaHibernateCache.isEnabled(TerracottaHibernateCache.java:77) at org.terracotta.modules.hibernatecache.TerracottaHibernateCache.get(TerracottaHibernateCache.java:127) at org.hibernate.cache.NonstrictReadWriteCache.get(NonstrictReadWriteCache.java:69) at org.hibernate.cache.impl.bridge.CollectionAccessStrategyAdapter.get(CollectionAccessStrategyAdapter.java:55) at org.hibernate.event.def.DefaultInitializeCollectionEventListener.initializeCollectionFromCache(DefaultInitializeCollectionEventListener.java:133) at org.hibernate.event.def.DefaultInitializeCollectionEventListener.onInitializeCollection(DefaultInitializeCollectionEventListener.java:71) at org.hibernate.impl.SessionImpl.initializeCollection(SessionImpl.java:1743) at org.hibernate.collection.AbstractPersistentCollection.forceInitialization(AbstractPersistentCollection.java:476) at org.hibernate.engine.StatefulPersistenceContext.initializeNonLazyCollections(StatefulPersistenceContext.java:867) at org.hibernate.event.def.DefaultLoadEventListener.assembleCacheEntry(DefaultLoadEventListener.java:614) at org.hibernate.event.def.DefaultLoadEventListener.loadFromSecondLevelCache(DefaultLoadEventListener.java:542) at org.hibernate.event.def.DefaultLoadEventListener.doLoad(DefaultLoadEventListener.java:397) at org.hibernate.event.def.DefaultLoadEventListener.load(DefaultLoadEventListener.java:165) at org.hibernate.event.def.DefaultLoadEventListener.proxyOrLoad(DefaultLoadEventListener.java:207) at org.hibernate.event.def.DefaultLoadEventListener.onLoad(DefaultLoadEventListener.java:126) at org.hibernate.impl.SessionImpl.fireLoad(SessionImpl.java:905) at org.hibernate.impl.SessionImpl.get(SessionImpl.java:842) at org.hibernate.impl.SessionImpl.get(SessionImpl.java:835) at org.hibernate.ejb.AbstractEntityManagerImpl.find(AbstractEntityManagerImpl.java:182) at sun.reflect.GeneratedMethodAccessor25.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.orm.jpa.SharedEntityManagerCreator$SharedEntityManagerInvocationHandler.invoke(SharedEntityManagerCreator.java:194) at $Proxy15.find(Unknown Source) at org.springframework.samples.petclinic.jpa.EntityManagerClinic.loadOwner(EntityManagerClinic.java:70) at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:310) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:106) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at $Proxy17.loadOwner(Unknown Source) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwnerAccordingToFetchStrategy(PetClinicPerfTestActions.java:120) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwner(PetClinicPerfTestActions.java:38) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions\(FastClassByCGLIB\)6a48c588.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:191) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:628) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions$$EnhancerByCGLIB$$aa5cf164.getOwner() at org.terracotta.petclinic.perftest.type.ReadOnlyTest.doTestBody(ReadOnlyTest.java:14) at org.terracotta.petclinic.perftest.AbstractPerfTest.doTestBody(AbstractPerfTest.java:341) at org.terracotta.petclinic.perftest.AbstractPerfTest.runTest(AbstractPerfTest.java:472) at org.terracotta.petclinic.perftest.AbstractPerfTest.access$000(AbstractPerfTest.java:32) at org.terracotta.petclinic.perftest.AbstractPerfTest$1.run(AbstractPerfTest.java:271)

Locked ownable synchronizers: - None

“PerAppThread-0” - Thread [email protected] java.lang.Thread.State: RUNNABLE at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.read(SocketInputStream.java:129) at com.mysql.jdbc.util.ReadAheadInputStream.fill(ReadAheadInputStream.java:113) at com.mysql.jdbc.util.ReadAheadInputStream.readFromUnderlyingStreamIfNecessary(ReadAheadInputStream.java:160) at com.mysql.jdbc.util.ReadAheadInputStream.read(ReadAheadInputStream.java:188) - locked [email protected] at com.mysql.jdbc.MysqlIO.readFully(MysqlIO.java:2428) at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:2882) at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:2871) at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3414) at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1936) at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2060) at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2536) - locked [email protected] at com.mysql.jdbc.ConnectionImpl.commit(ConnectionImpl.java:1543) - locked [email protected] at org.apache.commons.dbcp.DelegatingConnection.commit(DelegatingConnection.java:301) at org.apache.commons.dbcp.DelegatingConnection.commit(DelegatingConnection.java:301) at org.apache.commons.dbcp.PoolingDataSource$PoolGuardConnectionWrapper.commit(PoolingDataSource.java:200) at org.hibernate.transaction.JDBCTransaction.commitAndResetAutoCommit(JDBCTransaction.java:170) at org.hibernate.transaction.JDBCTransaction.commit(JDBCTransaction.java:146) at org.hibernate.ejb.TransactionImpl.commit(TransactionImpl.java:54) at org.springframework.orm.jpa.JpaTransactionManager.doCommit(JpaTransactionManager.java:456) at org.springframework.transaction.support.AbstractPlatformTransactionManager.processCommit(AbstractPlatformTransactionManager.java:709) at org.springframework.transaction.support.AbstractPlatformTransactionManager.commit(AbstractPlatformTransactionManager.java:678) at org.springframework.transaction.interceptor.TransactionAspectSupport.commitTransactionAfterReturning(TransactionAspectSupport.java:321) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:116) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at $Proxy17.loadOwner(Unknown Source) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwnerAccordingToFetchStrategy(PetClinicPerfTestActions.java:120) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions.getOwner(PetClinicPerfTestActions.java:38) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions\(FastClassByCGLIB\)6a48c588.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:191) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:628) at org.terracotta.petclinic.perftest.PetClinicPerfTestActions$$EnhancerByCGLIB$$aa5cf164.getOwner() at org.terracotta.petclinic.perftest.type.ReadOnlyTest.doTestBody(ReadOnlyTest.java:14) at org.terracotta.petclinic.perftest.AbstractPerfTest.doTestBody(AbstractPerfTest.java:341) at org.terracotta.petclinic.perftest.AbstractPerfTest.runTest(AbstractPerfTest.java:472) at org.terracotta.petclinic.perftest.AbstractPerfTest.access$000(AbstractPerfTest.java:32) at org.terracotta.petclinic.perftest.AbstractPerfTest$1.run(AbstractPerfTest.java:271)

Locked ownable synchronizers: - None

“JMX server connection timeout 111” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING on [[email protected] at java.lang.Object.wait(Native Method) at com.sun.jmx.remote.internal.ServerCommunicatorAdmin$Timeout.run(ServerCommunicatorAdmin.java:150) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - None

“RMI TCP Connection(13)-10.0.0.176” - Thread [email protected]0 java.lang.Thread.State: TIMED_WAITING on [email protected] at java.lang.Object.wait(Native Method) at com.sun.jmx.remote.internal.ArrayNotificationBuffer.fetchNotifications(ArrayNotificationBuffer.java:417) at com.sun.jmx.remote.internal.ArrayNotificationBuffer$ShareBuffer.fetchNotifications(ArrayNotificationBuffer.java:209) at com.sun.jmx.remote.internal.ServerNotifForwarder.fetchNotifs(ServerNotifForwarder.java:258) at javax.management.remote.rmi.RMIConnectionImpl$2.run(RMIConnectionImpl.java:1227) at javax.management.remote.rmi.RMIConnectionImpl$2.run(RMIConnectionImpl.java:1225) at javax.management.remote.rmi.RMIConnectionImpl.fetchNotifications(RMIConnectionImpl.java:1231) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:305) at sun.rmi.transport.Transport$1.run(Transport.java:159) at java.security.AccessController.doPrivileged(Native Method) at sun.rmi.transport.Transport.serviceCall(Transport.java:155) at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - locked [email protected]

“RMI Scheduler(0)” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING on c[email protected]4d91390 at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:443) at com.tc.object.bytecode.ManagerImpl.objectWait(ManagerImpl.java:491) at com.tc.object.bytecode.ManagerUtil.objectWait(ManagerUtil.java:504) at java.util.concurrent.TimeUnit.timedWait(TimeUnit.java:292) at com.tcclient.util.concurrent.locks.ConditionObject.awaitNanos(ConditionObject.java:193) at java.util.concurrent.DelayQueue.take(DelayQueue.java:164) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - None

“org.hibernate.cache.StandardQueryCache Evictor” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING at java.lang.Thread.sleep(Native Method) at org.terracotta.modules.evictor.EvictionScheduler$EvictionRunner.sleep(EvictionScheduler.java:147) at org.terracotta.modules.evictor.EvictionScheduler$EvictionRunner.run(EvictionScheduler.java:104) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - None

“org.hibernate.cache.UpdateTimestampsCache Evictor” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING at java.lang.Thread.sleep(Native Method) at org.terracotta.modules.evictor.EvictionScheduler$EvictionRunner.sleep(EvictionScheduler.java:147) at org.terracotta.modules.evictor.EvictionScheduler$EvictionRunner.run(EvictionScheduler.java:104) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - None

“org.springframework.samples.petclinic.Pet.visitsInternal Evictor” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING at java.lang.Thread.sleep(Native Method) at org.terracotta.modules.evictor.EvictionScheduler$EvictionRunner.sleep(EvictionScheduler.java:147) at org.terracotta.modules.evictor.EvictionScheduler$EvictionRunner.run(EvictionScheduler.java:104) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - None

“org.springframework.samples.petclinic.Vet.specialtiesInternal Evictor” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING at java.lang.Thread.sleep(Native Method) at org.terracotta.modules.evictor.EvictionScheduler$EvictionRunner.sleep(EvictionScheduler.java:147) at org.terracotta.modules.evictor.EvictionScheduler$EvictionRunner.run(EvictionScheduler.java:104) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - None

“org.springframework.samples.petclinic.Owner.petsInternal Evictor” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING at java.lang.Thread.sleep(Native Method) at org.terracotta.modules.evictor.EvictionScheduler$EvictionRunner.sleep(EvictionScheduler.java:147) at org.terracotta.modules.evictor.EvictionScheduler$EvictionRunner.run(EvictionScheduler.java:104) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - None

“org.springframework.samples.petclinic.Owner Evictor” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING at java.lang.Thread.sleep(Native Method) at org.terracotta.modules.evictor.EvictionScheduler$EvictionRunner.sleep(EvictionScheduler.java:147) at org.terracotta.modules.evictor.EvictionScheduler$EvictionRunner.run(EvictionScheduler.java:104) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - None

“org.springframework.samples.petclinic.Vet Evictor” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING at java.lang.Thread.sleep(Native Method) at org.terracotta.modules.evictor.EvictionScheduler$EvictionRunner.sleep(EvictionScheduler.java:147) at org.terracotta.modules.evictor.EvictionScheduler$EvictionRunner.run(EvictionScheduler.java:104) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - None

“org.springframework.samples.petclinic.PetType Evictor” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING at java.lang.Thread.sleep(Native Method) at org.terracotta.modules.evictor.EvictionScheduler$EvictionRunner.sleep(EvictionScheduler.java:147) at org.terracotta.modules.evictor.EvictionScheduler$EvictionRunner.run(EvictionScheduler.java:104) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - None

“org.springframework.samples.petclinic.Specialty Evictor” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING at java.lang.Thread.sleep(Native Method) at org.terracotta.modules.evictor.EvictionScheduler$EvictionRunner.sleep(EvictionScheduler.java:147) at org.terracotta.modules.evictor.EvictionScheduler$EvictionRunner.run(EvictionScheduler.java:104) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - None

“org.springframework.samples.petclinic.Pet Evictor” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING at java.lang.Thread.sleep(Native Method) at org.terracotta.modules.evictor.EvictionScheduler$EvictionRunner.sleep(EvictionScheduler.java:147) at org.terracotta.modules.evictor.EvictionScheduler$EvictionRunner.run(EvictionScheduler.java:104) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - None

“org.springframework.samples.petclinic.Visit Evictor” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING at java.lang.Thread.sleep(Native Method) at org.terracotta.modules.evictor.EvictionScheduler$EvictionRunner.sleep(EvictionScheduler.java:147) at org.terracotta.modules.evictor.EvictionScheduler$EvictionRunner.run(EvictionScheduler.java:104) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - None

“MySQL Statement Cancellation Timer” - Thread [email protected] java.lang.Thread.State: WAITING on [email protected] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:485) at java.util.TimerThread.mainLoop(Timer.java:483) at java.util.TimerThread.run(Timer.java:462)

Locked ownable synchronizers: - None

“Job_Executor2” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING on [email protected] at java.lang.Object.wait(Native Method) at com.sun.jmx.remote.opt.internal.ArrayNotificationBuffer.fetchNotifications(ArrayNotificationBuffer.java:344) at com.sun.jmx.remote.opt.internal.ArrayNotificationBuffer$ShareBuffer.fetchNotifications(ArrayNotificationBuffer.java:123) at com.sun.jmx.remote.opt.internal.ServerNotifForwarder.fetchNotifs(ServerNotifForwarder.java:169) at javax.management.remote.generic.ServerIntermediary$RequestHandler.handleNotifReqMessage(ServerIntermediary.java:679) at javax.management.remote.generic.ServerIntermediary$RequestHandler.execute(ServerIntermediary.java:626) at com.sun.jmx.remote.generic.ServerSynchroMessageConnectionImpl$RemoteJob.run(ServerSynchroMessageConnectionImpl.java:266) at com.sun.jmx.remote.opt.util.ThreadService$ThreadServiceJob.run(ThreadService.java:208) at com.sun.jmx.remote.opt.util.JobExecutor.run(JobExecutor.java:59)

Locked ownable synchronizers: - None

“Job_Executor1” - Thread [email protected] java.lang.Thread.State: WAITING on com.tc.m[email protected]4954c72c at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:485) at com.tc.management.remote.protocol.terracotta.TunnelingMessageConnection.readMessage(TunnelingMessageConnection.java:64) at com.sun.jmx.remote.generic.ServerSynchroMessageConnectionImpl$MessageReader.run(ServerSynchroMessageConnectionImpl.java:185) at com.sun.jmx.remote.opt.util.ThreadService$ThreadServiceJob.run(ThreadService.java:208) at com.sun.jmx.remote.opt.util.JobExecutor.run(JobExecutor.java:59)

Locked ownable synchronizers: - None

“RMI TCP Accept-0” - Thread [email protected] java.lang.Thread.State: RUNNABLE at java.net.PlainSocketImpl.socketAccept(Native Method) at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) - locked [email protected] at java.net.ServerSocket.implAccept(ServerSocket.java:453) at java.net.ServerSocket.accept(ServerSocket.java:421) at sun.management.jmxremote.LocalRMIServerSocketFactory$1.accept(LocalRMIServerSocketFactory.java:34) at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369) at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - None

“RMI TCP Accept-9240” - Thread [email protected] java.lang.Thread.State: RUNNABLE at java.net.PlainSocketImpl.socketAccept(Native Method) at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) - locked [email protected] at java.net.ServerSocket.implAccept(ServerSocket.java:453) at java.net.ServerSocket.accept(ServerSocket.java:421) at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369) at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - None

“RMI TCP Accept-0” - Thread [email protected] java.lang.Thread.State: RUNNABLE at java.net.PlainSocketImpl.socketAccept(Native Method) at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) - locked [email protected] at java.net.ServerSocket.implAccept(ServerSocket.java:453) at java.net.ServerSocket.accept(ServerSocket.java:421) at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369) at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - None

“Thread-12” - Thread [email protected] java.lang.Thread.State: WAITING on com[email protected]245d1391 at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:485) at com.tc.management.remote.protocol.terracotta.TunnelingEventHandler.accept(TunnelingEventHandler.java:84) at com.tc.management.remote.protocol.terracotta.TunnelingMessageConnectionServer.accept(TunnelingMessageConnectionServer.java:32) at com.sun.jmx.remote.generic.SynchroMessageConnectionServerImpl.accept(SynchroMessageConnectionServerImpl.java:47) at javax.management.remote.generic.GenericConnectorServer$Receiver.run(GenericConnectorServer.java:340)

Locked ownable synchronizers: - None

“WorkerThread(client_coordination_stage,0)” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING on [email protected] at java.lang.Object.wait(Native Method) at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(Unknown Source) at com.tc.util.concurrent.TCBoundedLinkedQueue.poll(TCBoundedLinkedQueue.java:29) at com.tc.async.impl.StageQueueImpl.poll(StageQueueImpl.java:103) at com.tc.async.impl.StageImpl$WorkerThread.run(StageImpl.java:129)

Locked ownable synchronizers: - None

“WorkerThread(lock_response_stage,0)” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING on [email protected] at java.lang.Object.wait(Native Method) at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(Unknown Source) at com.tc.util.concurrent.TCBoundedLinkedQueue.poll(TCBoundedLinkedQueue.java:29) at com.tc.async.impl.StageQueueImpl.poll(StageQueueImpl.java:103) at com.tc.async.impl.StageImpl$WorkerThread.run(StageImpl.java:129)

Locked ownable synchronizers: - None

“WorkerThread(hydrate_message_stage,0)” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING on [email protected] at java.lang.Object.wait(Native Method) at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(Unknown Source) at com.tc.util.concurrent.TCBoundedLinkedQueue.poll(TCBoundedLinkedQueue.java:29) at com.tc.async.impl.StageQueueImpl.poll(StageQueueImpl.java:103) at com.tc.async.impl.StageImpl$WorkerThread.run(StageImpl.java:129)

Locked ownable synchronizers: - None

“WorkerThread(receive_transaction_complete_stage,0)” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING on [email protected] at java.lang.Object.wait(Native Method) at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(Unknown Source) at com.tc.util.concurrent.TCBoundedLinkedQueue.poll(TCBoundedLinkedQueue.java:29) at com.tc.async.impl.StageQueueImpl.poll(StageQueueImpl.java:103) at com.tc.async.impl.StageImpl$WorkerThread.run(StageImpl.java:129)

Locked ownable synchronizers: - None

“WorkerThread(dmi_stage,0)” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING on [email protected] at java.lang.Object.wait(Native Method) at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(Unknown Source) at com.tc.util.concurrent.TCBoundedLinkedQueue.poll(TCBoundedLinkedQueue.java:29) at com.tc.async.impl.StageQueueImpl.poll(StageQueueImpl.java:103) at com.tc.async.impl.StageImpl$WorkerThread.run(StageImpl.java:129)

Locked ownable synchronizers: - None

“WorkerThread(batch_txn_ack_stage,0)” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING on [email protected] at java.lang.Object.wait(Native Method) at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(Unknown Source) at com.tc.util.concurrent.TCBoundedLinkedQueue.poll(TCBoundedLinkedQueue.java:29) at com.tc.async.impl.StageQueueImpl.poll(StageQueueImpl.java:103) at com.tc.async.impl.StageImpl$WorkerThread.run(StageImpl.java:129)

Locked ownable synchronizers: - None

“WorkerThread(lock_statistics_response_stage,0)” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING on [email protected] at java.lang.Object.wait(Native Method) at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(Unknown Source) at com.tc.util.concurrent.TCBoundedLinkedQueue.poll(TCBoundedLinkedQueue.java:29) at com.tc.async.impl.StageQueueImpl.poll(StageQueueImpl.java:103) at com.tc.async.impl.StageImpl$WorkerThread.run(StageImpl.java:129)

Locked ownable synchronizers: - None

“WorkerThread(jmxremote_tunnel_stage,0)” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING on [email protected] at java.lang.Object.wait(Native Method) at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(Unknown Source) at com.tc.util.concurrent.TCBoundedLinkedQueue.poll(TCBoundedLinkedQueue.java:29) at com.tc.async.impl.StageQueueImpl.poll(StageQueueImpl.java:103) at com.tc.async.impl.StageImpl$WorkerThread.run(StageImpl.java:129)

Locked ownable synchronizers: - None

“WorkerThread(receive_object_stage,0)” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING on [email protected] at java.lang.Object.wait(Native Method) at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(Unknown Source) at com.tc.util.concurrent.TCBoundedLinkedQueue.poll(TCBoundedLinkedQueue.java:29) at com.tc.async.impl.StageQueueImpl.poll(StageQueueImpl.java:103) at com.tc.async.impl.StageImpl$WorkerThread.run(StageImpl.java:129)

Locked ownable synchronizers: - None

“WorkerThread(cluster_metadata_stage,0)” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING on [email protected] at java.lang.Object.wait(Native Method) at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(Unknown Source) at com.tc.util.concurrent.TCBoundedLinkedQueue.poll(TCBoundedLinkedQueue.java:29) at com.tc.async.impl.StageQueueImpl.poll(StageQueueImpl.java:103) at com.tc.async.impl.StageImpl$WorkerThread.run(StageImpl.java:129)

Locked ownable synchronizers: - None

“WorkerThread(receive_root_id_stage,0)” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING on [email protected] at java.lang.Object.wait(Native Method) at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(Unknown Source) at com.tc.util.concurrent.TCBoundedLinkedQueue.poll(TCBoundedLinkedQueue.java:29) at com.tc.async.impl.StageQueueImpl.poll(StageQueueImpl.java:103) at com.tc.async.impl.StageImpl$WorkerThread.run(StageImpl.java:129)

Locked ownable synchronizers: - None

“WorkerThread(object_id_request_response_stage,0)” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING on [email protected] at java.lang.Object.wait(Native Method) at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(Unknown Source) at com.tc.util.concurrent.TCBoundedLinkedQueue.poll(TCBoundedLinkedQueue.java:29) at com.tc.async.impl.StageQueueImpl.poll(StageQueueImpl.java:103) at com.tc.async.impl.StageImpl$WorkerThread.run(StageImpl.java:129)

Locked ownable synchronizers: - None

“WorkerThread(lock_statistics_enable_disable_stage,0)” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING on [email protected] at java.lang.Object.wait(Native Method) at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(Unknown Source) at com.tc.util.concurrent.TCBoundedLinkedQueue.poll(TCBoundedLinkedQueue.java:29) at com.tc.async.impl.StageQueueImpl.poll(StageQueueImpl.java:103) at com.tc.async.impl.StageImpl$WorkerThread.run(StageImpl.java:129)

Locked ownable synchronizers: - None

“WorkerThread(receive_transaction_stage,0)” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING on [email protected] at java.lang.Object.wait(Native Method) at EDU.oswego.cs.dl.util.concurrent.BoundedLinkedQueue.poll(Unknown Source) at com.tc.util.concurrent.TCBoundedLinkedQueue.poll(TCBoundedLinkedQueue.java:29) at com.tc.async.impl.StageQueueImpl.poll(StageQueueImpl.java:103) at com.tc.async.impl.StageImpl$WorkerThread.run(StageImpl.java:129)

Locked ownable synchronizers: - None

“Timer-0” - Thread [email protected] java.lang.Thread.State: WAITING on [email protected] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:485) at java.util.TimerThread.mainLoop(Timer.java:483) at java.util.TimerThread.run(Timer.java:462)

Locked ownable synchronizers: - None

“TC Memory Monitor” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING at java.lang.Thread.sleep(Native Method) at com.tc.runtime.TCMemoryManagerImpl$MemoryMonitor.run(TCMemoryManagerImpl.java:132) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - None

“Reaper” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING on [email protected] at java.lang.Object.wait(Native Method) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116) at com.tc.object.ClientObjectManagerImpl$2.run(ClientObjectManagerImpl.java:1197)

Locked ownable synchronizers: - None

“H2 Log Writer STATISTICS-BUFFER” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING at java.lang.Thread.sleep(Native Method) at org.h2.store.WriterThread.run(WriterThread.java:147)

Locked ownable synchronizers: - None

“H2 File Lock Watchdog /export1/bench/perfTests/perfLogs/client/statistics/statistics-buffer.lock.db” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING at java.lang.Thread.sleep(Native Method) at org.h2.store.FileLock$1.run(FileLock.java:198) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - None

“Statistics Logger” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING on [email protected] at java.lang.Object.wait(Native Method) at java.util.TimerThread.mainLoop(Timer.java:509) at java.util.TimerThread.run(Timer.java:462)

Locked ownable synchronizers: - None

“DSO Lock Object.wait() timer” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING on [email protected] at java.lang.Object.wait(Native Method) at java.util.TimerThread.mainLoop(Timer.java:509) at java.util.TimerThread.run(Timer.java:462)

Locked ownable synchronizers: - None

“RemoteTransactionManager Flusher” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING on [email protected] at java.lang.Object.wait(Native Method) at java.util.TimerThread.mainLoop(Timer.java:509) at java.util.TimerThread.run(Timer.java:462)

Locked ownable synchronizers: - None

“HealthChecker” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING at java.lang.Thread.sleep(Native Method) at java.lang.Thread.sleep(Thread.java:298) at com.tc.util.concurrent.ThreadUtil.reallySleep(ThreadUtil.java:24) at com.tc.util.concurrent.ThreadUtil.reallySleep(ThreadUtil.java:16) at com.tc.net.protocol.transport.ConnectionHealthCheckerImpl$HealthCheckerMonitorThreadEngine.run(ConnectionHealthCheckerImpl.java:196) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - None

“TCComm Main Selector Thread (listen 0:0:0:0:0:0:0:0:55645)” - Thread [email protected] java.lang.Thread.State: RUNNABLE at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:215) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) - locked [email protected] - locked [email protected] - locked [email protected] at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:84) at com.tc.net.core.CoreNIOServices.selectLoop(CoreNIOServices.java:335) at com.tc.net.core.CoreNIOServices.run(CoreNIOServices.java:61)

Locked ownable synchronizers: - None

“SampledCounterManager Timer” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING on [email protected] at java.lang.Object.wait(Native Method) at java.util.TimerThread.mainLoop(Timer.java:509) at java.util.TimerThread.run(Timer.java:462)

Locked ownable synchronizers: - None

“startlevel job thread” - Thread [email protected] java.lang.Thread.State: TIMED_WAITING on [email protected] at java.lang.Object.wait(Native Method) at org.knopflerfish.framework.Queue.removeWait(Queue.java:108) at org.knopflerfish.framework.StartLevelImpl.run(StartLevelImpl.java:170) at java.lang.Thread.run(Thread.java:619)

Locked ownable synchronizers: - None

“Signal Dispatcher” - Thread [email protected] java.lang.Thread.State: RUNNABLE

Locked ownable synchronizers: - None

“Finalizer” - Thread [email protected] java.lang.Thread.State: WAITING on [email protected] at java.lang.Object.wait(Native Method) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132) at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)

Locked ownable synchronizers: - None

“Reference Handler” - Thread [email protected] java.lang.Thread.State: WAITING on [email protected] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:485) at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)

Locked ownable synchronizers: - None

“main” - Thread [email protected] java.lang.Thread.State: WAITING on [email protected] at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1143) at java.lang.Thread.join(Thread.java:1196) at org.terracotta.petclinic.perftest.AbstractPerfTest.waitForTestThreads(AbstractPerfTest.java:298) at org.terracotta.petclinic.perftest.AbstractPerfTest.startTest(AbstractPerfTest.java:119) at org.terracotta.petclinic.perftest.PetClinicPerfTest.main(PetClinicPerfTest.java:284)

Locked ownable synchronizers: - None

Walter Harley 2009-05-29

Proposed patch (diff from trunk v15988)

Walter Harley 2009-05-30

Patch applied in trunk 15997. MutableConfig now reports values from a snapshot, refreshed by the EvictionScheduler every eviction cycle.

Kalai Kannaiyan 2009-08-13

unable to verify the changes -> tim-map-evictor branch moved as tim-distributed-cache