Re: WOSessionStore$TimeoutEntry

by Fred Larken :: Rate this Message:

The thread dumps that do not show that trace of the WOSessionStore look ok to me. I don't see any deadlocks or other problems. I will post a dump at the bottom of this message.

So I guess our course of action to locate the problem, whether this is a symptom or the actual problem, would be to put debuggin info in the awake, sleep and terminate methods and maybe even stick the code in that was posted in that link?

Here is a dump, if you see something that could be the prob, let me know:

[GC 1965998K->1859608K(2109632K), 0.0120830 secs]
[GC 1966091K->1859548K(2108544K), 0.0114000 secs]
[GC
1965518K->1859536K(2108352K), 0.0115210 secs]
[GC 1965066K->1860128K(2112640K), 0.0119960 secs]
[GC 1965216K->1862373K(2111296K), 0.0180350 secs]
- No item node or content record was received - therefore related content can't be added.
[GC 1967013K->1863573K(2109312K), 0.0291220 secs]
[GC 1967676K->1864917K(2111168K), 0.0146630 secs]
- No item node or content record was received - therefore related content can't be added.
Dumping JVM state.
Full thread dump Java HotSpot(TM) Server VM (1.5.0_15-b04 mixed mode):

"Thread-450" daemon prio=1 tid=0x4a6b8998 nid=0x34fc waiting on condition [0x518bf000..0x518c0020]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256)
at com.webobjects.eocontrol.EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420)
at com.webobjects.eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java:4650)
at com.webobjects.eocontrol.EOCustomObject.willReadRelationship(EOCustomObject.java:1270)

"http-20226-Processor50" daemon prio=1 tid=0x4ae120a8 nid=0x104d in Object.wait() [0x4db6d000..0x4db6dfa0]
at java.lang.Object.wait(Native Method)
- waiting on <0x7b93e440> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at java.lang.Object.wait(Object.java:474)
at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191)
- locked <0x7b93e440> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131)
at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
at com.webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java:695)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)

"http-20226-Processor49" daemon prio=1 tid=0x4ae11338 nid=0x104c waiting on condition [0x4dbed000..0x4dbef020]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
at java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync.wlock(ReentrantReadWriteLock.java:342)
at java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock(ReentrantReadWriteLock.java:637)
at com.webobjects.eocontrol.EOSharedEditingContext.lock(EOSharedEditingContext.java:736)
at com.webobjects.eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java:4648)
at com.webobjects.eocontrol.EOEditingContext.refaultObject(EOEditingContext.java:3984)
at com.webobjects.eocontrol.EOEditingContext._refaultObjectWithGlobalID(EOEditingContext.java:3243)
at com.webobjects.eocontrol.EOEditingContext._refaultLocalObjectWithGlobalID(EOEditingContext.java:3250)
at com.webobjects.eocontrol.EOEditingContext._refaultObjectsWithGlobalIDs(EOEditingContext.java:3275)
at com.webobjects.eocontrol.EOEditingContext._processObjectStoreChanges(EOEditingContext.java:3500)
at sun.reflect.GeneratedMethodAccessor471.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:585)
at com.webobjects.foundation.NSSelector.invoke(NSSelector.java:358)
at com.webobjects.foundation.NSSelector._safeInvokeSelector(NSSelector.java:110)
at com.webobjects.eocontrol.EOEditingContext._processNotificationQueue(EOEditingContext.java:4725)
at com.webobjects.eocontrol.EOEditingContext.lock(EOEditingContext.java:4604)
at com.webobjects.eocontrol.EOEditingContext.tryLock(EOEditingContext.java:4616)
at com.webobjects.eocontrol.EOEditingContext._sendOrEnqueueNotification(EOEditingContext.java:4689)
at com.webobjects.eocontrol.EOEditingContext._objectsChangedInStore(EOEditingContext.java:3546)
at sun.reflect.GeneratedMethodAccessor470.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:585)
at com.webobjects.foundation.NSSelector._safeInvokeMethod(NSSelector.java:122)
at com.webobjects.foundation.NSNotificationCenter$_Entry.invokeMethod(NSNotificationCenter.java:588)
at com.webobjects.foundation.NSNotificationCenter.postNotification(NSNotificationCenter.java:532)
at com.webobjects.foundation.NSNotificationCenter.postNotification(NSNotificationCenter.java:562)
at com.webobjects.eocontrol.EOObjectStoreCoordinator._objectsChangedInSubStore(EOObjectStoreCoordinator.java:693)
at sun.reflect.GeneratedMethodAccessor712.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:585)
at com.webobjects.foundation.NSSelector._safeInvokeMethod(NSSelector.java:122)
at com.webobjects.foundation.NSNotificationCenter$_Entry.invokeMethod(NSNotificationCenter.java:588)
at com.webobjects.foundation.NSNotificationCenter.postNotification(NSNotificationCenter.java:532)
at com.webobjects.foundation.NSNotificationCenter.postNotification(NSNotificationCenter.java:562)
at com.webobjects.eoaccess.EODatabaseContext._snapshotsChangedInDatabase(EODatabaseContext.java:3664)
at sun.reflect.GeneratedMethodAccessor710.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:585)
at com.webobjects.foundation.NSSelector._safeInvokeMethod(NSSelector.java:122)
at com.webobjects.foundation.NSNotificationCenter$_Entry.invokeMethod(NSNotificationCenter.java:588)
at com.webobjects.foundation.NSNotificationCenter.postNotification(NSNotificationCenter.java:532)
at com.webobjects.foundation.NSNotificationCenter.postNotification(NSNotificationCenter.java:562)
at com.webobjects.eoaccess.EODatabaseContext.commitChanges(EODatabaseContext.java:6418)
at com.webobjects.eocontrol.EOObjectStoreCoordinator.saveChangesInEditingContext(EOObjectStoreCoordinator.java:386)
at com.webobjects.eocontrol.EOEditingContext.saveChanges(EOEditingContext.java:3176)

"http-20226-Processor48" daemon prio=1 tid=0x4ae105c8 nid=0x104b in Object.wait() [0x4dc6f000..0x4dc700a0]
at java.lang.Object.wait(Native Method)
- waiting on <0x7b93e440> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at java.lang.Object.wait(Object.java:474)
at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191)
- locked <0x7b93e440> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131)
at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
at com.webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java:695)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)

"http-20226-Processor47" daemon prio=1 tid=0x4ae0f858 nid=0x104a runnable [0x4dcf0000..0x4dcf1120]
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:737)
at org.apache.coyote.http11.InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:398)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:827)
at org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:664)
at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527)
at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
at java.lang.Thread.run(Thread.java:595)

"http-20226-Processor46" daemon prio=1 tid=0x4ae0eae8 nid=0x1049 waiting on condition [0x4dd70000..0x4dd71da0]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256)
at com.webobjects.eocontrol.EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420)
at com.webobjects.eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java:4650)
at com.webobjects.eocontrol.EOCustomObject.willReadRelationship(EOCustomObject.java:1270)
at com.webobjects.eocontrol._EOMutableKnownKeyDictionary$Initializer$_LazyGenericRecordBinding.valueInObject(_EOMutableKnownKeyDictionary.java:614)
at com.webobjects.eocontrol.EOCustomObject.storedValueForKey(EOCustomObject.java:1634)

"http-20226-Processor45" daemon prio=1 tid=0x4ae0ddb0 nid=0x1048 in Object.wait() [0x4ddf2000..0x4ddf2e20]
at java.lang.Object.wait(Native Method)
- waiting on <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at java.lang.Object.wait(Object.java:474)
at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191)
- locked <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131)
at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)

"http-20226-Processor44" daemon prio=1 tid=0x4ae03f58 nid=0x1047 in Object.wait() [0x4de73000..0x4de73ea0]
at java.lang.Object.wait(Native Method)
- waiting on <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at java.lang.Object.wait(Object.java:474)
at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191)
- locked <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131)
at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)

"http-20226-Processor43" daemon prio=1 tid=0x4ae02390 nid=0x1046 in Object.wait() [0x4def4000..0x4def4f20]
at java.lang.Object.wait(Native Method)
- waiting on <0x6eec6df0> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at java.lang.Object.wait(Object.java:474)
at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191)
- locked <0x6eec6df0> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131)
at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)

"http-20226-Processor42" daemon prio=1 tid=0x0841e560 nid=0x1045 in Object.wait() [0x4df75000..0x4df75fa0]
at java.lang.Object.wait(Native Method)
- waiting on <0xcd1b9410> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at java.lang.Object.wait(Object.java:474)
at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191)
- locked <0xcd1b9410> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131)
at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)

"http-20226-Processor41" daemon prio=1 tid=0x088eb1a0 nid=0x1044 in Object.wait() [0x4dff6000..0x4dff7020]
at java.lang.Object.wait(Native Method)
- waiting on <0xcd1b9410> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at java.lang.Object.wait(Object.java:474)
at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191)
- locked <0xcd1b9410> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131)
at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)

"http-20226-Processor40" daemon prio=1 tid=0x088e8258 nid=0x1043 waiting on condition [0x4e076000..0x4e0780a0]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256)
at com.webobjects.eocontrol.EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420)
at com.webobjects.eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java:4650)
at com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4051)
at com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4428)

"http-20226-Processor39" daemon prio=1 tid=0x088e7318 nid=0x1042 runnable [0x4e0f8000..0x4e0f9120]
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
- locked <0x687d18f0> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:450)
at java.net.ServerSocket.accept(ServerSocket.java:421)
at org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:60)
at org.apache.tomcat.util.net.PoolTcpEndpoint.acceptSocket(PoolTcpEndpoint.java:407)
at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:70)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
at java.lang.Thread.run(Thread.java:595)

"http-20226-Processor38" daemon prio=1 tid=0x088ec3e0 nid=0x1041 in Object.wait() [0x4e179000..0x4e179da0]
at java.lang.Object.wait(Native Method)
- waiting on <0x916494d0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x916494d0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)

"http-20226-Processor37" daemon prio=1 tid=0x088eb500 nid=0x1040 in Object.wait() [0x4e1fa000..0x4e1fae20]
at java.lang.Object.wait(Native Method)
- waiting on <0x916494b0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x916494b0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)

"http-20226-Processor36" daemon prio=1 tid=0x091a3938 nid=0x103f in Object.wait() [0x4e27b000..0x4e27bea0]
at java.lang.Object.wait(Native Method)
- waiting on <0x91649490> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x91649490> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)

"http-20226-Processor35" daemon prio=1 tid=0x091a2b80 nid=0x103e in Object.wait() [0x4e2fc000..0x4e2fcf20]
at java.lang.Object.wait(Native Method)
- waiting on <0x91649470> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x91649470> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)

"http-20226-Processor34" daemon prio=1 tid=0x0862cef8 nid=0x103d in Object.wait() [0x4e37d000..0x4e37dfa0]
at java.lang.Object.wait(Native Method)
- waiting on <0x91649450> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x91649450> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)

"http-20226-Processor33" daemon prio=1 tid=0x0921f260 nid=0x103c in Object.wait() [0x4e3fe000..0x4e3ff020]
at java.lang.Object.wait(Native Method)
- waiting on <0x91649430> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x91649430> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)

"http-20226-Processor32" daemon prio=1 tid=0x0921e380 nid=0x103b in Object.wait() [0x4e5fe000..0x4e5ff0a0]
at java.lang.Object.wait(Native Method)
- waiting on <0x91649410> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x91649410> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)

"http-20226-Processor31" daemon prio=1 tid=0x086c6b20 nid=0x103a in Object.wait() [0x4e7c0000..0x4e7c1120]
at java.lang.Object.wait(Native Method)
- waiting on <0x916493f0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x916493f0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)

"http-20226-Processor30" daemon prio=1 tid=0x086c5db8 nid=0x1039 in Object.wait() [0x4e841000..0x4e841da0]
at java.lang.Object.wait(Native Method)
- waiting on <0x916493d0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x916493d0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)

"http-20226-Processor29" daemon prio=1 tid=0x08249350 nid=0x1038 in Object.wait() [0x4e8c2000..0x4e8c2e20]
at java.lang.Object.wait(Native Method)
- waiting on <0x916493b0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x916493b0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)

"http-20226-Processor28" daemon prio=1 tid=0x082489d8 nid=0x1037 in Object.wait() [0x4f9fe000..0x4f9feea0]
at java.lang.Object.wait(Native Method)
- waiting on <0x91649390> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x91649390> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)

"http-20226-Processor27" daemon prio=1 tid=0x09420140 nid=0x1036 in Object.wait() [0x519fa000..0x519faf20]
at java.lang.Object.wait(Native Method)
- waiting on <0x91649370> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x91649370> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)

"http-20226-Processor26" daemon prio=1 tid=0x0941fd28 nid=0x1035 in Object.wait() [0x51979000..0x51979fa0]
at java.lang.Object.wait(Native Method)
- waiting on <0x91649350> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x91649350> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)

"http-20226-Monitor" prio=1 tid=0x51c30138 nid=0x595 in Object.wait() [0x51a7b000..0x51a7c020]
at java.lang.Object.wait(Native Method)
- waiting on <0x6e6b48e8> (a org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable)
at org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable.run(ThreadPool.java:559)
- locked <0x6e6b48e8> (a org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable)
at java.lang.Thread.run(Thread.java:595)

"http-20226-Processor25" daemon prio=1 tid=0x51c2f440 nid=0x594 in Object.wait() [0x51afc000..0x51afd0a0]
at java.lang.Object.wait(Native Method)
- waiting on <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at java.lang.Object.wait(Object.java:474)
at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191)
- locked <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131)
at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
at com.webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java:695)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)

"http-20226-Processor24" daemon prio=1 tid=0x52321880 nid=0x593 in Object.wait() [0x51b7d000..0x51b7e120]
at java.lang.Object.wait(Native Method)
- waiting on <0xaaede7d8> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at java.lang.Object.wait(Object.java:474)
at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191)
- locked <0xaaede7d8> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131)
at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)

"http-20226-Processor23" daemon prio=1 tid=0x52320b70 nid=0x592 in Object.wait() [0x51bfe000..0x51bfeda0]
at java.lang.Object.wait(Native Method)
- waiting on <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at java.lang.Object.wait(Object.java:474)
at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191)
- locked <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131)
at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)

"http-20226-Processor22" daemon prio=1 tid=0x521d5e90 nid=0x591 waiting on condition [0x51ffd000..0x51ffee20]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256)
at com.webobjects.eocontrol.EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420)
at com.webobjects.eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java:4650)
at com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4051)
at com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4428)

"http-20226-Processor21" daemon prio=1 tid=0x521d52a0 nid=0x590 in Object.wait() [0x524fe000..0x524feea0]
at java.lang.Object.wait(Native Method)
- waiting on <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at java.lang.Object.wait(Object.java:474)
at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191)
- locked <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131)
at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)

"http-20226-Processor20" daemon prio=1 tid=0x52b03bf0 nid=0x58f in Object.wait() [0x52afe000..0x52afef20]
at java.lang.Object.wait(Native Method)
- waiting on <0xcd1b9410> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at java.lang.Object.wait(Object.java:474)
at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191)
- locked <0xcd1b9410> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131)
at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)

"http-20226-Processor19" daemon prio=1 tid=0x52695fb0 nid=0x58e in Object.wait() [0x52cfe000..0x52cfefa0]
at java.lang.Object.wait(Native Method)
- waiting on <0xaaede7d8> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at java.lang.Object.wait(Object.java:474)
at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191)
- locked <0xaaede7d8> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131)
at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)

"http-20226-Processor18" daemon prio=1 tid=0x52b37c50 nid=0x58d waiting on condition [0x530fd000..0x530ff020]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256)
at com.webobjects.eocontrol.EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420)
at com.webobjects.eoaccess.EODatabaseContext.registeredDatabaseContextForModel(EODatabaseContext.java:999)
at com.webobjects.eoaccess.EODatabaseContext.registeredDatabaseContextForModel(EODatabaseContext.java:1033)
at com.webobjects.eoaccess.EOUtilities.databaseContextForModelNamed(EOUtilities.java:814)
at com.webobjects.eoaccess.EOUtilities.rawRowsForSQL(EOUtilities.java:585)

"http-20226-Processor17" daemon prio=1 tid=0x526c1980 nid=0x58c in Object.wait() [0x532bb000..0x532bc0a0]
at java.lang.Object.wait(Native Method)
- waiting on <0xcd1b9410> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at java.lang.Object.wait(Object.java:474)
at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191)
- locked <0xcd1b9410> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131)
at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)

"http-20226-Processor16" daemon prio=1 tid=0x4fa0f908 nid=0x58b in Object.wait() [0x538e2000..0x538e3120]
at java.lang.Object.wait(Native Method)
- waiting on <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at java.lang.Object.wait(Object.java:474)
at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191)
- locked <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131)
at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)

"http-20226-Processor15" daemon prio=1 tid=0x4fa0f780 nid=0x58a in Object.wait() [0x53963000..0x53963da0]
at java.lang.Object.wait(Native Method)
- waiting on <0xaaede7d8> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at java.lang.Object.wait(Object.java:474)
at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191)
- locked <0xaaede7d8> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131)
at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)

"http-20226-Processor14" daemon prio=1 tid=0x52b74250 nid=0x589 in Object.wait() [0x539e4000..0x539e4e20]
at java.lang.Object.wait(Native Method)
- waiting on <0xcd1b9410> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at java.lang.Object.wait(Object.java:474)
at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191)
- locked <0xcd1b9410> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131)
at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)

"http-20226-Processor13" daemon prio=1 tid=0x521be938 nid=0x588 in Object.wait() [0x53a65000..0x53a65ea0]
at java.lang.Object.wait(Native Method)
- waiting on <0x6ea04b80> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x6ea04b80> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)

"http-20226-Processor12" daemon prio=1 tid=0x52b13970 nid=0x587 waiting on condition [0x53ae5000..0x53ae6f20]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
at java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync.wlock(ReentrantReadWriteLock.java:342)
at java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock(ReentrantReadWriteLock.java:637)
at com.webobjects.eocontrol.EOSharedEditingContext.lock(EOSharedEditingContext.java:736)
at com.webobjects.eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java:4648)
at com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4051)
at com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4428)

"http-20226-Processor11" daemon prio=1 tid=0x52b740c8 nid=0x586 in Object.wait() [0x53b67000..0x53b67fa0]
at java.lang.Object.wait(Native Method)
- waiting on <0xcd1b9410> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at java.lang.Object.wait(Object.java:474)
at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191)
- locked <0xcd1b9410> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131)
at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)

"http-20226-Processor10" daemon prio=1 tid=0x52387828 nid=0x585 runnable [0x53be8000..0x53be9020]
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:737)
at org.apache.coyote.http11.InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:398)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:827)
at org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:664)
at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527)
at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
at java.lang.Thread.run(Thread.java:595)

"http-20226-Processor9" daemon prio=1 tid=0x523876a0 nid=0x584 in Object.wait() [0x53c69000..0x53c6a0a0]
at java.lang.Object.wait(Native Method)
- waiting on <0x7b93e440> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at java.lang.Object.wait(Object.java:474)
at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191)
- locked <0x7b93e440> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131)
at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
at com.webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java:695)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)

"http-20226-Processor8" daemon prio=1 tid=0x521f67f0 nid=0x583 in Object.wait() [0x53cea000..0x53ceb120]
at java.lang.Object.wait(Native Method)
- waiting on <0xaaede7d8> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at java.lang.Object.wait(Object.java:474)
at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191)
- locked <0xaaede7d8> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131)
at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)

"http-20226-Processor7" daemon prio=1 tid=0x521f9ed0 nid=0x582 waiting on condition [0x53de7000..0x53de8da0]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256)
at com.webobjects.eocontrol.EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420)
at com.webobjects.eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java:4650)
at com.webobjects.eocontrol.EOCustomObject.willReadRelationship(EOCustomObject.java:1270)
at com.webobjects.eocontrol._EOMutableKnownKeyDictionary$Initializer$_LazyGenericRecordBinding.valueInObject(_EOMutableKnownKeyDictionary.java:614)
at com.webobjects.eocontrol.EOCustomObject.storedValueForKey(EOCustomObject.java:1634)

"http-20226-Processor6" daemon prio=1 tid=0x52356090 nid=0x581 in Object.wait() [0x53e69000..0x53e69e20]
at java.lang.Object.wait(Native Method)
- waiting on <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at java.lang.Object.wait(Object.java:474)
at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191)
- locked <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131)
at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)

"http-20226-Processor5" daemon prio=1 tid=0x52356ff0 nid=0x580 waiting on condition [0x53ee9000..0x53eeaea0]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
at java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync.wlock(ReentrantReadWriteLock.java:342)
at java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock(ReentrantReadWriteLock.java:637)
at com.webobjects.eocontrol.EOSharedEditingContext.lock(EOSharedEditingContext.java:736)
at com.webobjects.eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java:4648)
at com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4051)
at com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4428)

"http-20226-Processor4" daemon prio=1 tid=0x52691360 nid=0x57f waiting on condition [0x53f6a000..0x53f6bf20]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256)
at com.webobjects.eocontrol.EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420)
at com.webobjects.eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java:4650)
at com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4051)
at com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4428)

"http-20226-Processor3" daemon prio=1 tid=0x5262eba8 nid=0x57e waiting on condition [0x53feb000..0x53fecfa0]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
at java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync.wlock(ReentrantReadWriteLock.java:342)
at java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock(ReentrantReadWriteLock.java:637)
at com.webobjects.eocontrol.EOSharedEditingContext.lock(EOSharedEditingContext.java:736)
at com.webobjects.eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java:4648)
at com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4051)
at com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4428)

"http-20226-Processor2" daemon prio=1 tid=0x52b744e0 nid=0x57d waiting on condition [0x5406c000..0x5406e020]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076)
at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256)
at com.webobjects.eocontrol.EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420)
at com.webobjects.eoaccess.EODatabaseContext.registeredDatabaseContextForModel(EODatabaseContext.java:999)
at com.webobjects.eoaccess.EODatabaseContext.registeredDatabaseContextForModel(EODatabaseContext.java:1033)
at com.webobjects.eoaccess.EOUtilities.databaseContextForModelNamed(EOUtilities.java:814)
at com.webobjects.eoaccess.EOUtilities.rawRowsForSQL(EOUtilities.java:585)

"http-20226-Processor1" daemon prio=1 tid=0x52ba7b78 nid=0x57c in Object.wait() [0x5333c000..0x5333d0a0]
at java.lang.Object.wait(Native Method)
- waiting on <0x7b93e440> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at java.lang.Object.wait(Object.java:474)
at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191)
- locked <0x7b93e440> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry)
at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369)
at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445)
at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131)
at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
at com.webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java:695)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)

"ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon prio=1 tid=0x52321f80 nid=0x57b waiting on condition [0x54102000..0x54102120]
at java.lang.Thread.sleep(Native Method)
at org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1547)
at java.lang.Thread.run(Thread.java:595)

"Timer-2" prio=1 tid=0x52b74a20 nid=0x574 in Object.wait() [0x54182000..0x54182f20]
at java.lang.Object.wait(Native Method)
- waiting on <0x6d201840> (a java.util.TaskQueue)
at java.util.TimerThread.mainLoop(Timer.java:509)
- locked <0x6d201840> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:462)

"Timer-1" prio=1 tid=0x4fa0fb18 nid=0x573 in Object.wait() [0x54203000..0x54203fa0]
at java.lang.Object.wait(Native Method)
- waiting on <0x6d2018c8> (a java.util.TaskQueue)
at java.util.TimerThread.mainLoop(Timer.java:509)
- locked <0x6d2018c8> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:462)

"Thread-8" prio=1 tid=0x090e20e0 nid=0x56e waiting on condition [0x54284000..0x54285020]
at java.lang.Thread.sleep(Native Method)
at com.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.client.beans.Timer.run(Timer.java:110)
at java.lang.Thread.run(Thread.java:595)

"PoolManagerCleanup-20012302" daemon prio=1 tid=0x52357328 nid=0x560 waiting on condition [0x54dfd000..0x54dfd120]
at java.lang.Thread.sleep(Native Method)
at org.apache.cayenne.conn.PoolManager$PoolMaintenanceThread.run(PoolManager.java:522)

"EventDispatchThread-1" daemon prio=1 tid=0x5230da30 nid=0x55f in Object.wait() [0x54e7d000..0x54e7dda0]
at java.lang.Object.wait(Native Method)
- waiting on <0x6c18b350> (a java.util.Collections$SynchronizedList)
at java.lang.Object.wait(Object.java:474)
at org.apache.cayenne.event.EventManager$DispatchThread.run(EventManager.java:450)
- locked <0x6c18b350> (a java.util.Collections$SynchronizedList)

"EventDispatchThread-0" daemon prio=1 tid=0x51c12b20 nid=0x55e in Object.wait() [0x54efe000..0x54efee20]
at java.lang.Object.wait(Native Method)
- waiting on <0x6c18b350> (a java.util.Collections$SynchronizedList)
at java.lang.Object.wait(Object.java:474)
at org.apache.cayenne.event.EventManager$DispatchThread.run(EventManager.java:450)
- locked <0x6c18b350> (a java.util.Collections$SynchronizedList)

"EventDispatchThread-4" daemon prio=1 tid=0x52654e70 nid=0x55d in Object.wait() [0x54305000..0x54305ea0]
at java.lang.Object.wait(Native Method)
- waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList)
at java.lang.Object.wait(Object.java:474)
at org.apache.cayenne.event.EventManager$DispatchThread.run(EventManager.java:450)
- locked <0x6c133f48> (a java.util.Collections$SynchronizedList)

"EventDispatchThread-3" daemon prio=1 tid=0x52bd8860 nid=0x55c in Object.wait() [0x54386000..0x54386f20]
at java.lang.Object.wait(Native Method)
- waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList)
at java.lang.Object.wait(Object.java:474)
at org.apache.cayenne.event.EventManager$DispatchThread.run(EventManager.java:450)
- locked <0x6c133f48> (a java.util.Collections$SynchronizedList)

"EventDispatchThread-2" daemon prio=1 tid=0x526f6880 nid=0x55b in Object.wait() [0x54407000..0x54407fa0]
at java.lang.Object.wait(Native Method)
- waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList)
at java.lang.Object.wait(Object.java:474)
at org.apache.cayenne.event.EventManager$DispatchThread.run(EventManager.java:450)
- locked <0x6c133f48> (a java.util.Collections$SynchronizedList)

"EventDispatchThread-1" daemon prio=1 tid=0x52ba5c08 nid=0x55a in Object.wait() [0x54ba3000..0x54ba4020]
at java.lang.Object.wait(Native Method)
- waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList)
at java.lang.Object.wait(Object.java:474)
at org.apache.cayenne.event.EventManager$DispatchThread.run(EventManager.java:450)
- locked <0x6c133f48> (a java.util.Collections$SynchronizedList)

"EventDispatchThread-0" daemon prio=1 tid=0x51c1af80 nid=0x559 in Object.wait() [0x55dc2000..0x55dc30a0]
at java.lang.Object.wait(Native Method)
- waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList)
at java.lang.Object.wait(Object.java:474)
at org.apache.cayenne.event.EventManager$DispatchThread.run(EventManager.java:450)
- locked <0x6c133f48> (a java.util.Collections$SynchronizedList)

"PoolManagerCleanup-18771651" daemon prio=1 tid=0x52bd8c68 nid=0x558 waiting on condition [0x55ec5000..0x55ec5120]
at java.lang.Thread.sleep(Native Method)
at org.apache.cayenne.conn.PoolManager$PoolMaintenanceThread.run(PoolManager.java:522)

"WrapperStartStopAppMain" prio=1 tid=0x0819d920 nid=0x534 runnable [0x55d41000..0x55d41fa0]
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
- locked <0x6e9a3098> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:450)
at java.net.ServerSocket.accept(ServerSocket.java:421)
at org.apache.catalina.core.StandardServer.await(StandardServer.java:388)
at org.apache.catalina.startup.Catalina.await(Catalina.java:615)
at org.apache.catalina.startup.Catalina.start(Catalina.java:575)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:585)
at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:294)
at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:432)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:585)
at org.tanukisoftware.wrapper.WrapperStartStopApp.run(WrapperStartStopApp.java:238)
at java.lang.Thread.run(Thread.java:595)

"DestroyJavaVM" prio=1 tid=0x568d5eb8 nid=0x51c waiting on condition [0x00000000..0xffff9190]

"Wrapper-Connection" daemon prio=1 tid=0x568ae0e8 nid=0x532 runnable [0x55e43000..0x55e440a0]
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at java.net.SocketInputStream.read(SocketInputStream.java:182)
at java.io.DataInputStream.readByte(DataInputStream.java:241)
at org.tanukisoftware.wrapper.WrapperManager.handleSocket(WrapperManager.java:3737)
at org.tanukisoftware.wrapper.WrapperManager.run(WrapperManager.java:4084)
at java.lang.Thread.run(Thread.java:595)

"Wrapper-Control-Event-Monitor" daemon prio=1 tid=0x568ac820 nid=0x530 sleeping[0x55f45000..0x55f45da0]
at java.lang.Thread.sleep(Native Method)
at org.tanukisoftware.wrapper.WrapperManager$3.run(WrapperManager.java:731)

"RMI TCP Accept-0" daemon prio=1 tid=0x5689e660 nid=0x52e runnable [0x5604a000..0x5604aea0]
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
- locked <0x68888648> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:450)
at java.net.ServerSocket.accept(ServerSocket.java:421)
at sun.rmi.transport.tcp.TCPTransport.run(TCPTransport.java:340)
at java.lang.Thread.run(Thread.java:595)

"Timer-0" daemon prio=1 tid=0x5689e158 nid=0x52d in Object.wait() [0x560cb000..0x560cbf20]
at java.lang.Object.wait(Native Method)
- waiting on <0x6a979aa8> (a java.util.TaskQueue)
at java.lang.Object.wait(Object.java:474)
at java.util.TimerThread.mainLoop(Timer.java:483)
- locked <0x6a979aa8> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:462)

"Low Memory Detector" daemon prio=1 tid=0x08149ee0 nid=0x52c runnable [0x00000000..0x00000000]

"CompilerThread1" daemon prio=1 tid=0x08148a60 nid=0x52b waiting on condition [0x00000000..0x56b01248]

"CompilerThread0" daemon prio=1 tid=0x08147a08 nid=0x52a waiting on condition [0x00000000..0x56b822c8]

"AdapterThread" daemon prio=1 tid=0x081468d0 nid=0x529 waiting on condition [0x00000000..0x00000000]

"Signal Dispatcher" daemon prio=1 tid=0x08145b00 nid=0x528 waiting on condition [0x00000000..0x00000000]

"Finalizer" daemon prio=1 tid=0x0813b348 nid=0x527 in Object.wait() [0x56f05000..0x56f05e20]
at java.lang.Object.wait(Native Method)
- waiting on <0x68958b38> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:120)
- locked <0x68958b38> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:136)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)

"Reference Handler" daemon prio=1 tid=0x0813ae20 nid=0x526 in Object.wait() [0x56f86000..0x56f86ea0]
at java.lang.Object.wait(Native Method)
- waiting on <0x6a97a128> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:474)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
- locked <0x6a97a128> (a java.lang.ref.Reference$Lock)

"VM Thread" prio=1 tid=0x081388d8 nid=0x525 runnable

"GC task thread#0 (ParallelGC)" prio=1 tid=0x0807a548 nid=0x51d runnable

"GC task thread#1 (ParallelGC)" prio=1 tid=0x0807b5a0 nid=0x51e runnable

"GC task thread#2 (ParallelGC)" prio=1 tid=0x0807c1b8 nid=0x51f runnable

"GC task thread#3 (ParallelGC)" prio=1 tid=0x0807cdd8 nid=0x520 runnable

"GC task thread#4 (ParallelGC)" prio=1 tid=0x0807da10 nid=0x521 runnable

"GC task thread#5 (ParallelGC)" prio=1 tid=0x0807e648 nid=0x522 runnable

"GC task thread#6 (ParallelGC)" prio=1 tid=0x0807f280 nid=0x523 runnable

"GC task thread#7 (ParallelGC)" prio=1 tid=0x0807feb8 nid=0x524 runnable

"VM Periodic Task Thread" prio=1 tid=0x568a7868 nid=0x52f waiting on condition

Jul 30, 2008 5:30:24 PM org.apache.catalina.core.ApplicationContext log
INFO: HTMLManager: list: Listing contexts for virtual host 'localhost'
[GC 1968661K->1868524K(2111040K), 0.0176210 secs]
Dumping JVM state.
Full thread dump Java HotSpot(TM) Server VM (1.5.0_15-b04 mixed mode):

Chuck Hill wrote:

On Jul 31, 2008, at 10:16 AM, Fred Larken wrote:

>
> Yes, we are setting this in the code:
> setAllowsConcurrentRequestHandling(true);

The trace below is probably a symptom then, not the cause.

> The session timeout is set to 30 minutes.
>
> How do I find out why a session is hung, or how to fix this?

Check the the thread dumps that don't show this trace.

Check that session's sleep() and terminate() methods can't throw.
Check awake too for good measure.

> I saw one post that said something about adding code to your
> Application.java
> Is this the correct way to fix it, or is this problem just a result of
> something else happening?
> http://www.mail-archive.com/webobjects-dev@lists.apple.com/msg09497.html
> http://www.mail-archive.com/webobjects-dev@lists.apple.com/msg09497.html

You could try this if nothing else pans out.

Chuck

>>
>>
>> On Jul 31, 2008, at 9:52 AM, Fred Larken wrote:
>>
>>>
>>> we have a linux server running our web objects app. After a day, the
>>> system
>>> locks up for 30 mins. It will self-recoverbut in the mean time,
>>> nobody can
>>> log in or use the app. I have seen thread dumps during this period
>>> and I
>>> have noticed the following trace:
>>>
>>>
>>> "http-20226-Processor24" daemon prio=1 tid=0x52321880 nid=0x593 in
>>> Object.wait() [0x51b7d000..0x51b7e120]
>>> at java.lang.Object.wait(Native Method)
>>> - waiting on <0xaaede7d8> (a
>>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>>> at java.lang.Object.wait(Object.java:474)
>>> at
>>> com
>>> .webobjects
>>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:
>>> 191)
>>> - locked <0xaaede7d8> (a
>>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>>> at
>>> com
>>> .webobjects
>>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:
>>> 1904)
>>>
>>> There are a lot of http threads in this state. There is one lock for
>>> every 4
>>> http threads waiting on it.
>>>
>>> Can any one explain what the above means?
>>
>> Are you dispatching requests concurrently? I am guessing the answer
>> is
>> no. Is your session timeout 30 minutes? It looks like a session is
>> getting hung and blocking the app until it expires
>>
>> Chuck
>>
>>
>> --
>> Chuck Hill Senior Consultant / VP Development
>>
>> Practical WebObjects - for developers who want to increase their
>> overall knowledge of WebObjects or who are trying to solve specific
>> problems.
>> http://www.global-village.net/products/practical_webobjects
>>
>>
>>
>>
>>
>>
>> _______________________________________________
>> WebObjects-dev mailing list
>> WebObjects-dev@omnigroup.com
>> http://www.omnigroup.com/mailman/listinfo/webobjects-dev
>>
>>
>
> --
> View this message in context: http://www.nabble.com/WOSessionStore%24TimeoutEntry-tp18756956p18759318.html
> Sent from the WebObjects-Dev mailing list archive at Nabble.com.
>
> _______________________________________________
> WebObjects-dev mailing list
> WebObjects-dev@omnigroup.com
> http://www.omnigroup.com/mailman/listinfo/webobjects-dev
>

--
Chuck Hill Senior Consultant / VP Development

Practical WebObjects - for developers who want to increase their
overall knowledge of WebObjects or who are trying to solve specific
problems.
http://www.global-village.net/products/practical_webobjects

_______________________________________________
WebObjects-dev mailing list
WebObjects-dev@omnigroup.com
http://www.omnigroup.com/mailman/listinfo/webobjects-dev

« Return to Thread: WOSessionStore$TimeoutEntry