|
View:
New views
11 Messages
—
Rating Filter:
Alert me
|
|
|
WOSessionStore$TimeoutEntrywe have a linux server running our web objects app. After a day, the system locks up for 30 mins. It will self-recoverbut in the mean time, nobody can log in or use the app. I have seen thread dumps during this period and I have noticed the following trace:
"http-20226-Processor24" daemon prio=1 tid=0x52321880 nid=0x593 in Object.wait() [0x51b7d000..0x51b7e120] at java.lang.Object.wait(Native Method) - waiting on <0xaaede7d8> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at java.lang.Object.wait(Object.java:474) at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191) - locked <0xaaede7d8> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) There are a lot of http threads in this state. There is one lock for every 4 http threads waiting on it. Can any one explain what the above means? |
|
|
Re: WOSessionStore$TimeoutEntryOn Jul 31, 2008, at 9:52 AM, Fred Larken wrote: > > we have a linux server running our web objects app. After a day, the > system > locks up for 30 mins. It will self-recoverbut in the mean time, > nobody can > log in or use the app. I have seen thread dumps during this period > and I > have noticed the following trace: > > > "http-20226-Processor24" daemon prio=1 tid=0x52321880 nid=0x593 in > Object.wait() [0x51b7d000..0x51b7e120] > at java.lang.Object.wait(Native Method) > - waiting on <0xaaede7d8> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at java.lang.Object.wait(Object.java:474) > at > com > .webobjects > .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: > 191) > - locked <0xaaede7d8> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at > com > .webobjects > .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) > > There are a lot of http threads in this state. There is one lock for > every 4 > http threads waiting on it. > > Can any one explain what the above means? Are you dispatching requests concurrently? I am guessing the answer is no. Is your session timeout 30 minutes? It looks like a session is getting hung and blocking the app until it expires Chuck -- Chuck Hill Senior Consultant / VP Development Practical WebObjects - for developers who want to increase their overall knowledge of WebObjects or who are trying to solve specific problems. http://www.global-village.net/products/practical_webobjects _______________________________________________ WebObjects-dev mailing list WebObjects-dev@... http://www.omnigroup.com/mailman/listinfo/webobjects-dev |
|
|
Re: WOSessionStore$TimeoutEntryYes, we are setting this in the code:
setAllowsConcurrentRequestHandling(true); The session timeout is set to 30 minutes. How do I find out why a session is hung, or how to fix this? I saw one post that said something about adding code to your Application.java Is this the correct way to fix it, or is this problem just a result of something else happening? http://www.mail-archive.com/webobjects-dev@lists.apple.com/msg09497.html
|
|
|
Re: WOSessionStore$TimeoutEntryWhat version of WO is this? There were a number of potential session
deadlocks that were fixed in WO 5.4 (including the one you link to from the mail archives). -Ryan On Jul 31, 2008, at 10:16 AM, Fred Larken wrote: > > Yes, we are setting this in the code: > setAllowsConcurrentRequestHandling(true); > > The session timeout is set to 30 minutes. > > How do I find out why a session is hung, or how to fix this? > > I saw one post that said something about adding code to your > Application.java > Is this the correct way to fix it, or is this problem just a result of > something else happening? > http://www.mail-archive.com/webobjects-dev@.../msg09497.html > http://www.mail-archive.com/webobjects-dev@.../msg09497.html > > > Chuck Hill wrote: >> >> >> On Jul 31, 2008, at 9:52 AM, Fred Larken wrote: >> >>> >>> we have a linux server running our web objects app. After a day, the >>> system >>> locks up for 30 mins. It will self-recoverbut in the mean time, >>> nobody can >>> log in or use the app. I have seen thread dumps during this period >>> and I >>> have noticed the following trace: >>> >>> >>> "http-20226-Processor24" daemon prio=1 tid=0x52321880 nid=0x593 in >>> Object.wait() [0x51b7d000..0x51b7e120] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0xaaede7d8> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0xaaede7d8> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java: >>> 1904) >>> >>> There are a lot of http threads in this state. There is one lock for >>> every 4 >>> http threads waiting on it. >>> >>> Can any one explain what the above means? >> >> Are you dispatching requests concurrently? I am guessing the answer >> is >> no. Is your session timeout 30 minutes? It looks like a session is >> getting hung and blocking the app until it expires >> >> Chuck >> >> >> -- >> Chuck Hill Senior Consultant / VP Development >> >> Practical WebObjects - for developers who want to increase their >> overall knowledge of WebObjects or who are trying to solve specific >> problems. >> http://www.global-village.net/products/practical_webobjects >> >> >> >> >> >> >> _______________________________________________ >> WebObjects-dev mailing list >> WebObjects-dev@... >> http://www.omnigroup.com/mailman/listinfo/webobjects-dev >> >> > > -- > View this message in context: http://www.nabble.com/WOSessionStore%24TimeoutEntry-tp18756956p18759318.html > Sent from the WebObjects-Dev mailing list archive at Nabble.com. > > _______________________________________________ > WebObjects-dev mailing list > WebObjects-dev@... > http://www.omnigroup.com/mailman/listinfo/webobjects-dev _______________________________________________ WebObjects-dev mailing list WebObjects-dev@... http://www.omnigroup.com/mailman/listinfo/webobjects-dev |
|
|
Re: WOSessionStore$TimeoutEntryThe version of WebObjects is 5.4.1
(Thanks to both of you for your replies!)
|
|
|
Re: WOSessionStore$TimeoutEntryOn Jul 31, 2008, at 10:16 AM, Fred Larken wrote: > > Yes, we are setting this in the code: > setAllowsConcurrentRequestHandling(true); The trace below is probably a symptom then, not the cause. > The session timeout is set to 30 minutes. > > How do I find out why a session is hung, or how to fix this? Check the the thread dumps that don't show this trace. Check that session's sleep() and terminate() methods can't throw. Check awake too for good measure. > I saw one post that said something about adding code to your > Application.java > Is this the correct way to fix it, or is this problem just a result of > something else happening? > http://www.mail-archive.com/webobjects-dev@.../msg09497.html > http://www.mail-archive.com/webobjects-dev@.../msg09497.html You could try this if nothing else pans out. Chuck >> >> >> On Jul 31, 2008, at 9:52 AM, Fred Larken wrote: >> >>> >>> we have a linux server running our web objects app. After a day, the >>> system >>> locks up for 30 mins. It will self-recoverbut in the mean time, >>> nobody can >>> log in or use the app. I have seen thread dumps during this period >>> and I >>> have noticed the following trace: >>> >>> >>> "http-20226-Processor24" daemon prio=1 tid=0x52321880 nid=0x593 in >>> Object.wait() [0x51b7d000..0x51b7e120] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0xaaede7d8> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0xaaede7d8> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java: >>> 1904) >>> >>> There are a lot of http threads in this state. There is one lock for >>> every 4 >>> http threads waiting on it. >>> >>> Can any one explain what the above means? >> >> Are you dispatching requests concurrently? I am guessing the answer >> is >> no. Is your session timeout 30 minutes? It looks like a session is >> getting hung and blocking the app until it expires >> >> Chuck >> >> >> -- >> Chuck Hill Senior Consultant / VP Development >> >> Practical WebObjects - for developers who want to increase their >> overall knowledge of WebObjects or who are trying to solve specific >> problems. >> http://www.global-village.net/products/practical_webobjects >> >> >> >> >> >> >> _______________________________________________ >> WebObjects-dev mailing list >> WebObjects-dev@... >> http://www.omnigroup.com/mailman/listinfo/webobjects-dev >> >> > > -- > View this message in context: http://www.nabble.com/WOSessionStore%24TimeoutEntry-tp18756956p18759318.html > Sent from the WebObjects-Dev mailing list archive at Nabble.com. > > _______________________________________________ > WebObjects-dev mailing list > WebObjects-dev@... > http://www.omnigroup.com/mailman/listinfo/webobjects-dev > -- Chuck Hill Senior Consultant / VP Development Practical WebObjects - for developers who want to increase their overall knowledge of WebObjects or who are trying to solve specific problems. http://www.global-village.net/products/practical_webobjects _______________________________________________ WebObjects-dev mailing list WebObjects-dev@... http://www.omnigroup.com/mailman/listinfo/webobjects-dev |
|
|
Re: WOSessionStore$TimeoutEntryI'd definitely update to 5.4.2. You want the bug fixes in that version.
On Jul 31, 2008, at 10:21 AM, Fred Larken wrote: > > The version of WebObjects is 5.4.1 > (Thanks to both of you for your replies!) > > > Ryan Klems wrote: >> >> What version of WO is this? There were a number of potential session >> deadlocks that were fixed in WO 5.4 (including the one you link to >> from the mail archives). >> >> -Ryan >> >> On Jul 31, 2008, at 10:16 AM, Fred Larken wrote: >> >>> >>> Yes, we are setting this in the code: >>> setAllowsConcurrentRequestHandling(true); >>> >>> The session timeout is set to 30 minutes. >>> >>> How do I find out why a session is hung, or how to fix this? >>> >>> I saw one post that said something about adding code to your >>> Application.java >>> Is this the correct way to fix it, or is this problem just a >>> result of >>> something else happening? >>> http://www.mail-archive.com/webobjects-dev@.../msg09497.html >>> http://www.mail-archive.com/webobjects-dev@.../msg09497.html >>> >>> >>> Chuck Hill wrote: >>>> >>>> >>>> On Jul 31, 2008, at 9:52 AM, Fred Larken wrote: >>>> >>>>> >>>>> we have a linux server running our web objects app. After a day, >>>>> the >>>>> system >>>>> locks up for 30 mins. It will self-recoverbut in the mean time, >>>>> nobody can >>>>> log in or use the app. I have seen thread dumps during this period >>>>> and I >>>>> have noticed the following trace: >>>>> >>>>> >>>>> "http-20226-Processor24" daemon prio=1 tid=0x52321880 nid=0x593 in >>>>> Object.wait() [0x51b7d000..0x51b7e120] >>>>> at java.lang.Object.wait(Native Method) >>>>> - waiting on <0xaaede7d8> (a >>>>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>>>> at java.lang.Object.wait(Object.java:474) >>>>> at >>>>> com >>>>> .webobjects >>>>> .appserver >>>>> .WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>>>> 191) >>>>> - locked <0xaaede7d8> (a >>>>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>>>> at >>>>> com >>>>> .webobjects >>>>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java: >>>>> 1904) >>>>> >>>>> There are a lot of http threads in this state. There is one lock >>>>> for >>>>> every 4 >>>>> http threads waiting on it. >>>>> >>>>> Can any one explain what the above means? >>>> >>>> Are you dispatching requests concurrently? I am guessing the answer >>>> is >>>> no. Is your session timeout 30 minutes? It looks like a session >>>> is >>>> getting hung and blocking the app until it expires >>>> >>>> Chuck >>>> >>>> >>>> -- >>>> Chuck Hill Senior Consultant / VP Development >>>> >>>> Practical WebObjects - for developers who want to increase their >>>> overall knowledge of WebObjects or who are trying to solve specific >>>> problems. >>>> http://www.global-village.net/products/practical_webobjects >>>> >>>> >>>> >>>> >>>> >>>> >>>> _______________________________________________ >>>> WebObjects-dev mailing list >>>> WebObjects-dev@... >>>> http://www.omnigroup.com/mailman/listinfo/webobjects-dev >>>> >>>> >>> >>> -- >>> View this message in context: >>> http://www.nabble.com/WOSessionStore%24TimeoutEntry-tp18756956p18759318.html >>> Sent from the WebObjects-Dev mailing list archive at Nabble.com. >>> >>> _______________________________________________ >>> WebObjects-dev mailing list >>> WebObjects-dev@... >>> http://www.omnigroup.com/mailman/listinfo/webobjects-dev >> >> _______________________________________________ >> WebObjects-dev mailing list >> WebObjects-dev@... >> http://www.omnigroup.com/mailman/listinfo/webobjects-dev >> >> > > -- > View this message in context: http://www.nabble.com/WOSessionStore%24TimeoutEntry-tp18756956p18759395.html > Sent from the WebObjects-Dev mailing list archive at Nabble.com. > > _______________________________________________ > WebObjects-dev mailing list > WebObjects-dev@... > http://www.omnigroup.com/mailman/listinfo/webobjects-dev > -- Chuck Hill Senior Consultant / VP Development Practical WebObjects - for developers who want to increase their overall knowledge of WebObjects or who are trying to solve specific problems. http://www.global-village.net/products/practical_webobjects _______________________________________________ WebObjects-dev mailing list WebObjects-dev@... http://www.omnigroup.com/mailman/listinfo/webobjects-dev |
|
|
Re: WOSessionStore$TimeoutEntryThe thread dumps that do not show that trace of the WOSessionStore look ok to me. I don't see any deadlocks or other problems. I will post a dump at the bottom of this message.
So I guess our course of action to locate the problem, whether this is a symptom or the actual problem, would be to put debuggin info in the awake, sleep and terminate methods and maybe even stick the code in that was posted in that link? Here is a dump, if you see something that could be the prob, let me know: [GC 1965998K->1859608K(2109632K), 0.0120830 secs] [GC 1966091K->1859548K(2108544K), 0.0114000 secs] [GC 1965518K->1859536K(2108352K), 0.0115210 secs] [GC 1965066K->1860128K(2112640K), 0.0119960 secs] [GC 1965216K->1862373K(2111296K), 0.0180350 secs] - No item node or content record was received - therefore related content can't be added. [GC 1967013K->1863573K(2109312K), 0.0291220 secs] [GC 1967676K->1864917K(2111168K), 0.0146630 secs] - No item node or content record was received - therefore related content can't be added. Dumping JVM state. Full thread dump Java HotSpot(TM) Server VM (1.5.0_15-b04 mixed mode): "Thread-450" daemon prio=1 tid=0x4a6b8998 nid=0x34fc waiting on condition [0x518bf000..0x518c0020] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076) at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184) at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256) at com.webobjects.eocontrol.EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) at com.webobjects.eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java:4650) at com.webobjects.eocontrol.EOCustomObject.willReadRelationship(EOCustomObject.java:1270) "http-20226-Processor50" daemon prio=1 tid=0x4ae120a8 nid=0x104d in Object.wait() [0x4db6d000..0x4db6dfa0] at java.lang.Object.wait(Native Method) - waiting on <0x7b93e440> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at java.lang.Object.wait(Object.java:474) at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191) - locked <0x7b93e440> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369) at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445) at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678) at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131) at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) at com.webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java:695) at javax.servlet.http.HttpServlet.service(HttpServlet.java:709) at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252) "http-20226-Processor49" daemon prio=1 tid=0x4ae11338 nid=0x104c waiting on condition [0x4dbed000..0x4dbef020] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076) at java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync.wlock(ReentrantReadWriteLock.java:342) at java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock(ReentrantReadWriteLock.java:637) at com.webobjects.eocontrol.EOSharedEditingContext.lock(EOSharedEditingContext.java:736) at com.webobjects.eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java:4648) at com.webobjects.eocontrol.EOEditingContext.refaultObject(EOEditingContext.java:3984) at com.webobjects.eocontrol.EOEditingContext._refaultObjectWithGlobalID(EOEditingContext.java:3243) at com.webobjects.eocontrol.EOEditingContext._refaultLocalObjectWithGlobalID(EOEditingContext.java:3250) at com.webobjects.eocontrol.EOEditingContext._refaultObjectsWithGlobalIDs(EOEditingContext.java:3275) at com.webobjects.eocontrol.EOEditingContext._processObjectStoreChanges(EOEditingContext.java:3500) at sun.reflect.GeneratedMethodAccessor471.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at com.webobjects.foundation.NSSelector.invoke(NSSelector.java:358) at com.webobjects.foundation.NSSelector._safeInvokeSelector(NSSelector.java:110) at com.webobjects.eocontrol.EOEditingContext._processNotificationQueue(EOEditingContext.java:4725) at com.webobjects.eocontrol.EOEditingContext.lock(EOEditingContext.java:4604) at com.webobjects.eocontrol.EOEditingContext.tryLock(EOEditingContext.java:4616) at com.webobjects.eocontrol.EOEditingContext._sendOrEnqueueNotification(EOEditingContext.java:4689) at com.webobjects.eocontrol.EOEditingContext._objectsChangedInStore(EOEditingContext.java:3546) at sun.reflect.GeneratedMethodAccessor470.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at com.webobjects.foundation.NSSelector._safeInvokeMethod(NSSelector.java:122) at com.webobjects.foundation.NSNotificationCenter$_Entry.invokeMethod(NSNotificationCenter.java:588) at com.webobjects.foundation.NSNotificationCenter.postNotification(NSNotificationCenter.java:532) at com.webobjects.foundation.NSNotificationCenter.postNotification(NSNotificationCenter.java:562) at com.webobjects.eocontrol.EOObjectStoreCoordinator._objectsChangedInSubStore(EOObjectStoreCoordinator.java:693) at sun.reflect.GeneratedMethodAccessor712.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at com.webobjects.foundation.NSSelector._safeInvokeMethod(NSSelector.java:122) at com.webobjects.foundation.NSNotificationCenter$_Entry.invokeMethod(NSNotificationCenter.java:588) at com.webobjects.foundation.NSNotificationCenter.postNotification(NSNotificationCenter.java:532) at com.webobjects.foundation.NSNotificationCenter.postNotification(NSNotificationCenter.java:562) at com.webobjects.eoaccess.EODatabaseContext._snapshotsChangedInDatabase(EODatabaseContext.java:3664) at sun.reflect.GeneratedMethodAccessor710.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at com.webobjects.foundation.NSSelector._safeInvokeMethod(NSSelector.java:122) at com.webobjects.foundation.NSNotificationCenter$_Entry.invokeMethod(NSNotificationCenter.java:588) at com.webobjects.foundation.NSNotificationCenter.postNotification(NSNotificationCenter.java:532) at com.webobjects.foundation.NSNotificationCenter.postNotification(NSNotificationCenter.java:562) at com.webobjects.eoaccess.EODatabaseContext.commitChanges(EODatabaseContext.java:6418) at com.webobjects.eocontrol.EOObjectStoreCoordinator.saveChangesInEditingContext(EOObjectStoreCoordinator.java:386) at com.webobjects.eocontrol.EOEditingContext.saveChanges(EOEditingContext.java:3176) "http-20226-Processor48" daemon prio=1 tid=0x4ae105c8 nid=0x104b in Object.wait() [0x4dc6f000..0x4dc700a0] at java.lang.Object.wait(Native Method) - waiting on <0x7b93e440> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at java.lang.Object.wait(Object.java:474) at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191) - locked <0x7b93e440> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369) at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445) at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678) at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131) at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) at com.webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java:695) at javax.servlet.http.HttpServlet.service(HttpServlet.java:709) at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) "http-20226-Processor47" daemon prio=1 tid=0x4ae0f858 nid=0x104a runnable [0x4dcf0000..0x4dcf1120] at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.read(SocketInputStream.java:129) at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:737) at org.apache.coyote.http11.InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:398) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:827) at org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:664) at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527) at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684) at java.lang.Thread.run(Thread.java:595) "http-20226-Processor46" daemon prio=1 tid=0x4ae0eae8 nid=0x1049 waiting on condition [0x4dd70000..0x4dd71da0] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076) at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184) at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256) at com.webobjects.eocontrol.EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) at com.webobjects.eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java:4650) at com.webobjects.eocontrol.EOCustomObject.willReadRelationship(EOCustomObject.java:1270) at com.webobjects.eocontrol._EOMutableKnownKeyDictionary$Initializer$_LazyGenericRecordBinding.valueInObject(_EOMutableKnownKeyDictionary.java:614) at com.webobjects.eocontrol.EOCustomObject.storedValueForKey(EOCustomObject.java:1634) "http-20226-Processor45" daemon prio=1 tid=0x4ae0ddb0 nid=0x1048 in Object.wait() [0x4ddf2000..0x4ddf2e20] at java.lang.Object.wait(Native Method) - waiting on <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at java.lang.Object.wait(Object.java:474) at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191) - locked <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369) at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445) at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678) at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131) at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709) at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) "http-20226-Processor44" daemon prio=1 tid=0x4ae03f58 nid=0x1047 in Object.wait() [0x4de73000..0x4de73ea0] at java.lang.Object.wait(Native Method) - waiting on <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at java.lang.Object.wait(Object.java:474) at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191) - locked <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369) at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445) at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678) at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131) at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709) at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) "http-20226-Processor43" daemon prio=1 tid=0x4ae02390 nid=0x1046 in Object.wait() [0x4def4000..0x4def4f20] at java.lang.Object.wait(Native Method) - waiting on <0x6eec6df0> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at java.lang.Object.wait(Object.java:474) at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191) - locked <0x6eec6df0> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369) at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445) at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678) at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131) at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709) at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) "http-20226-Processor42" daemon prio=1 tid=0x0841e560 nid=0x1045 in Object.wait() [0x4df75000..0x4df75fa0] at java.lang.Object.wait(Native Method) - waiting on <0xcd1b9410> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at java.lang.Object.wait(Object.java:474) at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191) - locked <0xcd1b9410> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369) at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445) at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678) at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131) at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709) at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) "http-20226-Processor41" daemon prio=1 tid=0x088eb1a0 nid=0x1044 in Object.wait() [0x4dff6000..0x4dff7020] at java.lang.Object.wait(Native Method) - waiting on <0xcd1b9410> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at java.lang.Object.wait(Object.java:474) at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191) - locked <0xcd1b9410> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369) at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445) at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678) at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131) at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709) at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) "http-20226-Processor40" daemon prio=1 tid=0x088e8258 nid=0x1043 waiting on condition [0x4e076000..0x4e0780a0] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076) at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184) at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256) at com.webobjects.eocontrol.EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) at com.webobjects.eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java:4650) at com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4051) at com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4428) "http-20226-Processor39" daemon prio=1 tid=0x088e7318 nid=0x1042 runnable [0x4e0f8000..0x4e0f9120] at java.net.PlainSocketImpl.socketAccept(Native Method) at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) - locked <0x687d18f0> (a java.net.SocksSocketImpl) at java.net.ServerSocket.implAccept(ServerSocket.java:450) at java.net.ServerSocket.accept(ServerSocket.java:421) at org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:60) at org.apache.tomcat.util.net.PoolTcpEndpoint.acceptSocket(PoolTcpEndpoint.java:407) at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:70) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684) at java.lang.Thread.run(Thread.java:595) "http-20226-Processor38" daemon prio=1 tid=0x088ec3e0 nid=0x1041 in Object.wait() [0x4e179000..0x4e179da0] at java.lang.Object.wait(Native Method) - waiting on <0x916494d0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x916494d0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:595) "http-20226-Processor37" daemon prio=1 tid=0x088eb500 nid=0x1040 in Object.wait() [0x4e1fa000..0x4e1fae20] at java.lang.Object.wait(Native Method) - waiting on <0x916494b0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x916494b0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:595) "http-20226-Processor36" daemon prio=1 tid=0x091a3938 nid=0x103f in Object.wait() [0x4e27b000..0x4e27bea0] at java.lang.Object.wait(Native Method) - waiting on <0x91649490> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x91649490> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:595) "http-20226-Processor35" daemon prio=1 tid=0x091a2b80 nid=0x103e in Object.wait() [0x4e2fc000..0x4e2fcf20] at java.lang.Object.wait(Native Method) - waiting on <0x91649470> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x91649470> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:595) "http-20226-Processor34" daemon prio=1 tid=0x0862cef8 nid=0x103d in Object.wait() [0x4e37d000..0x4e37dfa0] at java.lang.Object.wait(Native Method) - waiting on <0x91649450> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x91649450> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:595) "http-20226-Processor33" daemon prio=1 tid=0x0921f260 nid=0x103c in Object.wait() [0x4e3fe000..0x4e3ff020] at java.lang.Object.wait(Native Method) - waiting on <0x91649430> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x91649430> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:595) "http-20226-Processor32" daemon prio=1 tid=0x0921e380 nid=0x103b in Object.wait() [0x4e5fe000..0x4e5ff0a0] at java.lang.Object.wait(Native Method) - waiting on <0x91649410> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x91649410> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:595) "http-20226-Processor31" daemon prio=1 tid=0x086c6b20 nid=0x103a in Object.wait() [0x4e7c0000..0x4e7c1120] at java.lang.Object.wait(Native Method) - waiting on <0x916493f0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x916493f0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:595) "http-20226-Processor30" daemon prio=1 tid=0x086c5db8 nid=0x1039 in Object.wait() [0x4e841000..0x4e841da0] at java.lang.Object.wait(Native Method) - waiting on <0x916493d0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x916493d0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:595) "http-20226-Processor29" daemon prio=1 tid=0x08249350 nid=0x1038 in Object.wait() [0x4e8c2000..0x4e8c2e20] at java.lang.Object.wait(Native Method) - waiting on <0x916493b0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x916493b0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:595) "http-20226-Processor28" daemon prio=1 tid=0x082489d8 nid=0x1037 in Object.wait() [0x4f9fe000..0x4f9feea0] at java.lang.Object.wait(Native Method) - waiting on <0x91649390> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x91649390> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:595) "http-20226-Processor27" daemon prio=1 tid=0x09420140 nid=0x1036 in Object.wait() [0x519fa000..0x519faf20] at java.lang.Object.wait(Native Method) - waiting on <0x91649370> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x91649370> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:595) "http-20226-Processor26" daemon prio=1 tid=0x0941fd28 nid=0x1035 in Object.wait() [0x51979000..0x51979fa0] at java.lang.Object.wait(Native Method) - waiting on <0x91649350> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x91649350> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:595) "http-20226-Monitor" prio=1 tid=0x51c30138 nid=0x595 in Object.wait() [0x51a7b000..0x51a7c020] at java.lang.Object.wait(Native Method) - waiting on <0x6e6b48e8> (a org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable) at org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable.run(ThreadPool.java:559) - locked <0x6e6b48e8> (a org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable) at java.lang.Thread.run(Thread.java:595) "http-20226-Processor25" daemon prio=1 tid=0x51c2f440 nid=0x594 in Object.wait() [0x51afc000..0x51afd0a0] at java.lang.Object.wait(Native Method) - waiting on <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at java.lang.Object.wait(Object.java:474) at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191) - locked <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369) at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445) at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678) at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131) at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) at com.webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java:695) at javax.servlet.http.HttpServlet.service(HttpServlet.java:709) at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) "http-20226-Processor24" daemon prio=1 tid=0x52321880 nid=0x593 in Object.wait() [0x51b7d000..0x51b7e120] at java.lang.Object.wait(Native Method) - waiting on <0xaaede7d8> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at java.lang.Object.wait(Object.java:474) at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191) - locked <0xaaede7d8> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369) at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445) at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678) at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131) at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709) at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) "http-20226-Processor23" daemon prio=1 tid=0x52320b70 nid=0x592 in Object.wait() [0x51bfe000..0x51bfeda0] at java.lang.Object.wait(Native Method) - waiting on <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at java.lang.Object.wait(Object.java:474) at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191) - locked <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369) at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445) at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678) at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131) at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709) at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) "http-20226-Processor22" daemon prio=1 tid=0x521d5e90 nid=0x591 waiting on condition [0x51ffd000..0x51ffee20] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076) at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184) at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256) at com.webobjects.eocontrol.EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) at com.webobjects.eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java:4650) at com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4051) at com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4428) "http-20226-Processor21" daemon prio=1 tid=0x521d52a0 nid=0x590 in Object.wait() [0x524fe000..0x524feea0] at java.lang.Object.wait(Native Method) - waiting on <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at java.lang.Object.wait(Object.java:474) at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191) - locked <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369) at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445) at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678) at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131) at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709) at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) "http-20226-Processor20" daemon prio=1 tid=0x52b03bf0 nid=0x58f in Object.wait() [0x52afe000..0x52afef20] at java.lang.Object.wait(Native Method) - waiting on <0xcd1b9410> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at java.lang.Object.wait(Object.java:474) at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191) - locked <0xcd1b9410> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369) at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445) at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678) at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131) at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709) at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) "http-20226-Processor19" daemon prio=1 tid=0x52695fb0 nid=0x58e in Object.wait() [0x52cfe000..0x52cfefa0] at java.lang.Object.wait(Native Method) - waiting on <0xaaede7d8> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at java.lang.Object.wait(Object.java:474) at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191) - locked <0xaaede7d8> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369) at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445) at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678) at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131) at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709) at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) "http-20226-Processor18" daemon prio=1 tid=0x52b37c50 nid=0x58d waiting on condition [0x530fd000..0x530ff020] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076) at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184) at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256) at com.webobjects.eocontrol.EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) at com.webobjects.eoaccess.EODatabaseContext.registeredDatabaseContextForModel(EODatabaseContext.java:999) at com.webobjects.eoaccess.EODatabaseContext.registeredDatabaseContextForModel(EODatabaseContext.java:1033) at com.webobjects.eoaccess.EOUtilities.databaseContextForModelNamed(EOUtilities.java:814) at com.webobjects.eoaccess.EOUtilities.rawRowsForSQL(EOUtilities.java:585) "http-20226-Processor17" daemon prio=1 tid=0x526c1980 nid=0x58c in Object.wait() [0x532bb000..0x532bc0a0] at java.lang.Object.wait(Native Method) - waiting on <0xcd1b9410> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at java.lang.Object.wait(Object.java:474) at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191) - locked <0xcd1b9410> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369) at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445) at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678) at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131) at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709) at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) "http-20226-Processor16" daemon prio=1 tid=0x4fa0f908 nid=0x58b in Object.wait() [0x538e2000..0x538e3120] at java.lang.Object.wait(Native Method) - waiting on <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at java.lang.Object.wait(Object.java:474) at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191) - locked <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369) at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445) at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678) at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131) at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709) at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) "http-20226-Processor15" daemon prio=1 tid=0x4fa0f780 nid=0x58a in Object.wait() [0x53963000..0x53963da0] at java.lang.Object.wait(Native Method) - waiting on <0xaaede7d8> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at java.lang.Object.wait(Object.java:474) at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191) - locked <0xaaede7d8> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369) at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445) at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678) at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131) at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709) at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) "http-20226-Processor14" daemon prio=1 tid=0x52b74250 nid=0x589 in Object.wait() [0x539e4000..0x539e4e20] at java.lang.Object.wait(Native Method) - waiting on <0xcd1b9410> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at java.lang.Object.wait(Object.java:474) at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191) - locked <0xcd1b9410> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369) at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445) at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678) at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131) at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709) at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) "http-20226-Processor13" daemon prio=1 tid=0x521be938 nid=0x588 in Object.wait() [0x53a65000..0x53a65ea0] at java.lang.Object.wait(Native Method) - waiting on <0x6ea04b80> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Object.wait(Object.java:474) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656) - locked <0x6ea04b80> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) at java.lang.Thread.run(Thread.java:595) "http-20226-Processor12" daemon prio=1 tid=0x52b13970 nid=0x587 waiting on condition [0x53ae5000..0x53ae6f20] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076) at java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync.wlock(ReentrantReadWriteLock.java:342) at java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock(ReentrantReadWriteLock.java:637) at com.webobjects.eocontrol.EOSharedEditingContext.lock(EOSharedEditingContext.java:736) at com.webobjects.eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java:4648) at com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4051) at com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4428) "http-20226-Processor11" daemon prio=1 tid=0x52b740c8 nid=0x586 in Object.wait() [0x53b67000..0x53b67fa0] at java.lang.Object.wait(Native Method) - waiting on <0xcd1b9410> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at java.lang.Object.wait(Object.java:474) at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191) - locked <0xcd1b9410> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369) at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445) at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678) at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131) at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709) at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) "http-20226-Processor10" daemon prio=1 tid=0x52387828 nid=0x585 runnable [0x53be8000..0x53be9020] at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.read(SocketInputStream.java:129) at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:737) at org.apache.coyote.http11.InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:398) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:827) at org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:664) at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527) at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684) at java.lang.Thread.run(Thread.java:595) "http-20226-Processor9" daemon prio=1 tid=0x523876a0 nid=0x584 in Object.wait() [0x53c69000..0x53c6a0a0] at java.lang.Object.wait(Native Method) - waiting on <0x7b93e440> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at java.lang.Object.wait(Object.java:474) at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191) - locked <0x7b93e440> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369) at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445) at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678) at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131) at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) at com.webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java:695) at javax.servlet.http.HttpServlet.service(HttpServlet.java:709) at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) "http-20226-Processor8" daemon prio=1 tid=0x521f67f0 nid=0x583 in Object.wait() [0x53cea000..0x53ceb120] at java.lang.Object.wait(Native Method) - waiting on <0xaaede7d8> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at java.lang.Object.wait(Object.java:474) at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191) - locked <0xaaede7d8> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369) at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445) at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678) at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131) at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709) at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) "http-20226-Processor7" daemon prio=1 tid=0x521f9ed0 nid=0x582 waiting on condition [0x53de7000..0x53de8da0] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076) at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184) at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256) at com.webobjects.eocontrol.EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) at com.webobjects.eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java:4650) at com.webobjects.eocontrol.EOCustomObject.willReadRelationship(EOCustomObject.java:1270) at com.webobjects.eocontrol._EOMutableKnownKeyDictionary$Initializer$_LazyGenericRecordBinding.valueInObject(_EOMutableKnownKeyDictionary.java:614) at com.webobjects.eocontrol.EOCustomObject.storedValueForKey(EOCustomObject.java:1634) "http-20226-Processor6" daemon prio=1 tid=0x52356090 nid=0x581 in Object.wait() [0x53e69000..0x53e69e20] at java.lang.Object.wait(Native Method) - waiting on <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at java.lang.Object.wait(Object.java:474) at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191) - locked <0x99138c50> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369) at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445) at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678) at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131) at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) at com.webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java:709) at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) "http-20226-Processor5" daemon prio=1 tid=0x52356ff0 nid=0x580 waiting on condition [0x53ee9000..0x53eeaea0] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076) at java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync.wlock(ReentrantReadWriteLock.java:342) at java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock(ReentrantReadWriteLock.java:637) at com.webobjects.eocontrol.EOSharedEditingContext.lock(EOSharedEditingContext.java:736) at com.webobjects.eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java:4648) at com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4051) at com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4428) "http-20226-Processor4" daemon prio=1 tid=0x52691360 nid=0x57f waiting on condition [0x53f6a000..0x53f6bf20] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076) at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184) at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256) at com.webobjects.eocontrol.EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) at com.webobjects.eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java:4650) at com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4051) at com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4428) "http-20226-Processor3" daemon prio=1 tid=0x5262eba8 nid=0x57e waiting on condition [0x53feb000..0x53fecfa0] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076) at java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync.wlock(ReentrantReadWriteLock.java:342) at java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock(ReentrantReadWriteLock.java:637) at com.webobjects.eocontrol.EOSharedEditingContext.lock(EOSharedEditingContext.java:736) at com.webobjects.eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java:4648) at com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4051) at com.webobjects.eocontrol.EOEditingContext.objectsWithFetchSpecification(EOEditingContext.java:4428) "http-20226-Processor2" daemon prio=1 tid=0x52b744e0 nid=0x57d waiting on condition [0x5406c000..0x5406e020] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:746) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1076) at java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:184) at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:256) at com.webobjects.eocontrol.EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) at com.webobjects.eoaccess.EODatabaseContext.registeredDatabaseContextForModel(EODatabaseContext.java:999) at com.webobjects.eoaccess.EODatabaseContext.registeredDatabaseContextForModel(EODatabaseContext.java:1033) at com.webobjects.eoaccess.EOUtilities.databaseContextForModelNamed(EOUtilities.java:814) at com.webobjects.eoaccess.EOUtilities.rawRowsForSQL(EOUtilities.java:585) "http-20226-Processor1" daemon prio=1 tid=0x52ba7b78 nid=0x57c in Object.wait() [0x5333c000..0x5333d0a0] at java.lang.Object.wait(Native Method) - waiting on <0x7b93e440> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at java.lang.Object.wait(Object.java:474) at com.webobjects.appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java:191) - locked <0x7b93e440> (a com.webobjects.appserver.WOSessionStore$TimeoutEntry) at com.webobjects.appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) at com.webobjects.appserver._private.WOComponentRequestHandler._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) at com.webobjects.appserver._private.WOComponentRequestHandler._handleRequest(WOComponentRequestHandler.java:369) at com.webobjects.appserver._private.WOComponentRequestHandler.handleRequest(WOComponentRequestHandler.java:445) at com.webobjects.appserver.WOApplication.dispatchRequest(WOApplication.java:1678) at com.webobjects.jspservlet._WOApplicationWrapper.servletDispatchRequest(_WOApplicationWrapper.java:131) at com.webobjects.jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) at com.webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java:695) at javax.servlet.http.HttpServlet.service(HttpServlet.java:709) at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) "ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon prio=1 tid=0x52321f80 nid=0x57b waiting on condition [0x54102000..0x54102120] at java.lang.Thread.sleep(Native Method) at org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1547) at java.lang.Thread.run(Thread.java:595) "Timer-2" prio=1 tid=0x52b74a20 nid=0x574 in Object.wait() [0x54182000..0x54182f20] at java.lang.Object.wait(Native Method) - waiting on <0x6d201840> (a java.util.TaskQueue) at java.util.TimerThread.mainLoop(Timer.java:509) - locked <0x6d201840> (a java.util.TaskQueue) at java.util.TimerThread.run(Timer.java:462) "Timer-1" prio=1 tid=0x4fa0fb18 nid=0x573 in Object.wait() [0x54203000..0x54203fa0] at java.lang.Object.wait(Native Method) - waiting on <0x6d2018c8> (a java.util.TaskQueue) at java.util.TimerThread.mainLoop(Timer.java:509) - locked <0x6d2018c8> (a java.util.TaskQueue) at java.util.TimerThread.run(Timer.java:462) "Thread-8" prio=1 tid=0x090e20e0 nid=0x56e waiting on condition [0x54284000..0x54285020] at java.lang.Thread.sleep(Native Method) at com.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.client.beans.Timer.run(Timer.java:110) at java.lang.Thread.run(Thread.java:595) "PoolManagerCleanup-20012302" daemon prio=1 tid=0x52357328 nid=0x560 waiting on condition [0x54dfd000..0x54dfd120] at java.lang.Thread.sleep(Native Method) at org.apache.cayenne.conn.PoolManager$PoolMaintenanceThread.run(PoolManager.java:522) "EventDispatchThread-1" daemon prio=1 tid=0x5230da30 nid=0x55f in Object.wait() [0x54e7d000..0x54e7dda0] at java.lang.Object.wait(Native Method) - waiting on <0x6c18b350> (a java.util.Collections$SynchronizedList) at java.lang.Object.wait(Object.java:474) at org.apache.cayenne.event.EventManager$DispatchThread.run(EventManager.java:450) - locked <0x6c18b350> (a java.util.Collections$SynchronizedList) "EventDispatchThread-0" daemon prio=1 tid=0x51c12b20 nid=0x55e in Object.wait() [0x54efe000..0x54efee20] at java.lang.Object.wait(Native Method) - waiting on <0x6c18b350> (a java.util.Collections$SynchronizedList) at java.lang.Object.wait(Object.java:474) at org.apache.cayenne.event.EventManager$DispatchThread.run(EventManager.java:450) - locked <0x6c18b350> (a java.util.Collections$SynchronizedList) "EventDispatchThread-4" daemon prio=1 tid=0x52654e70 nid=0x55d in Object.wait() [0x54305000..0x54305ea0] at java.lang.Object.wait(Native Method) - waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList) at java.lang.Object.wait(Object.java:474) at org.apache.cayenne.event.EventManager$DispatchThread.run(EventManager.java:450) - locked <0x6c133f48> (a java.util.Collections$SynchronizedList) "EventDispatchThread-3" daemon prio=1 tid=0x52bd8860 nid=0x55c in Object.wait() [0x54386000..0x54386f20] at java.lang.Object.wait(Native Method) - waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList) at java.lang.Object.wait(Object.java:474) at org.apache.cayenne.event.EventManager$DispatchThread.run(EventManager.java:450) - locked <0x6c133f48> (a java.util.Collections$SynchronizedList) "EventDispatchThread-2" daemon prio=1 tid=0x526f6880 nid=0x55b in Object.wait() [0x54407000..0x54407fa0] at java.lang.Object.wait(Native Method) - waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList) at java.lang.Object.wait(Object.java:474) at org.apache.cayenne.event.EventManager$DispatchThread.run(EventManager.java:450) - locked <0x6c133f48> (a java.util.Collections$SynchronizedList) "EventDispatchThread-1" daemon prio=1 tid=0x52ba5c08 nid=0x55a in Object.wait() [0x54ba3000..0x54ba4020] at java.lang.Object.wait(Native Method) - waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList) at java.lang.Object.wait(Object.java:474) at org.apache.cayenne.event.EventManager$DispatchThread.run(EventManager.java:450) - locked <0x6c133f48> (a java.util.Collections$SynchronizedList) "EventDispatchThread-0" daemon prio=1 tid=0x51c1af80 nid=0x559 in Object.wait() [0x55dc2000..0x55dc30a0] at java.lang.Object.wait(Native Method) - waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList) at java.lang.Object.wait(Object.java:474) at org.apache.cayenne.event.EventManager$DispatchThread.run(EventManager.java:450) - locked <0x6c133f48> (a java.util.Collections$SynchronizedList) "PoolManagerCleanup-18771651" daemon prio=1 tid=0x52bd8c68 nid=0x558 waiting on condition [0x55ec5000..0x55ec5120] at java.lang.Thread.sleep(Native Method) at org.apache.cayenne.conn.PoolManager$PoolMaintenanceThread.run(PoolManager.java:522) "WrapperStartStopAppMain" prio=1 tid=0x0819d920 nid=0x534 runnable [0x55d41000..0x55d41fa0] at java.net.PlainSocketImpl.socketAccept(Native Method) at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) - locked <0x6e9a3098> (a java.net.SocksSocketImpl) at java.net.ServerSocket.implAccept(ServerSocket.java:450) at java.net.ServerSocket.accept(ServerSocket.java:421) at org.apache.catalina.core.StandardServer.await(StandardServer.java:388) at org.apache.catalina.startup.Catalina.await(Catalina.java:615) at org.apache.catalina.startup.Catalina.start(Catalina.java:575) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:294) at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:432) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.tanukisoftware.wrapper.WrapperStartStopApp.run(WrapperStartStopApp.java:238) at java.lang.Thread.run(Thread.java:595) "DestroyJavaVM" prio=1 tid=0x568d5eb8 nid=0x51c waiting on condition [0x00000000..0xffff9190] "Wrapper-Connection" daemon prio=1 tid=0x568ae0e8 nid=0x532 runnable [0x55e43000..0x55e440a0] at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.read(SocketInputStream.java:129) at java.net.SocketInputStream.read(SocketInputStream.java:182) at java.io.DataInputStream.readByte(DataInputStream.java:241) at org.tanukisoftware.wrapper.WrapperManager.handleSocket(WrapperManager.java:3737) at org.tanukisoftware.wrapper.WrapperManager.run(WrapperManager.java:4084) at java.lang.Thread.run(Thread.java:595) "Wrapper-Control-Event-Monitor" daemon prio=1 tid=0x568ac820 nid=0x530 sleeping[0x55f45000..0x55f45da0] at java.lang.Thread.sleep(Native Method) at org.tanukisoftware.wrapper.WrapperManager$3.run(WrapperManager.java:731) "RMI TCP Accept-0" daemon prio=1 tid=0x5689e660 nid=0x52e runnable [0x5604a000..0x5604aea0] at java.net.PlainSocketImpl.socketAccept(Native Method) at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) - locked <0x68888648> (a java.net.SocksSocketImpl) at java.net.ServerSocket.implAccept(ServerSocket.java:450) at java.net.ServerSocket.accept(ServerSocket.java:421) at sun.rmi.transport.tcp.TCPTransport.run(TCPTransport.java:340) at java.lang.Thread.run(Thread.java:595) "Timer-0" daemon prio=1 tid=0x5689e158 nid=0x52d in Object.wait() [0x560cb000..0x560cbf20] at java.lang.Object.wait(Native Method) - waiting on <0x6a979aa8> (a java.util.TaskQueue) at java.lang.Object.wait(Object.java:474) at java.util.TimerThread.mainLoop(Timer.java:483) - locked <0x6a979aa8> (a java.util.TaskQueue) at java.util.TimerThread.run(Timer.java:462) "Low Memory Detector" daemon prio=1 tid=0x08149ee0 nid=0x52c runnable [0x00000000..0x00000000] "CompilerThread1" daemon prio=1 tid=0x08148a60 nid=0x52b waiting on condition [0x00000000..0x56b01248] "CompilerThread0" daemon prio=1 tid=0x08147a08 nid=0x52a waiting on condition [0x00000000..0x56b822c8] "AdapterThread" daemon prio=1 tid=0x081468d0 nid=0x529 waiting on condition [0x00000000..0x00000000] "Signal Dispatcher" daemon prio=1 tid=0x08145b00 nid=0x528 waiting on condition [0x00000000..0x00000000] "Finalizer" daemon prio=1 tid=0x0813b348 nid=0x527 in Object.wait() [0x56f05000..0x56f05e20] at java.lang.Object.wait(Native Method) - waiting on <0x68958b38> (a java.lang.ref.ReferenceQueue$Lock) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:120) - locked <0x68958b38> (a java.lang.ref.ReferenceQueue$Lock) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:136) at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159) "Reference Handler" daemon prio=1 tid=0x0813ae20 nid=0x526 in Object.wait() [0x56f86000..0x56f86ea0] at java.lang.Object.wait(Native Method) - waiting on <0x6a97a128> (a java.lang.ref.Reference$Lock) at java.lang.Object.wait(Object.java:474) at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116) - locked <0x6a97a128> (a java.lang.ref.Reference$Lock) "VM Thread" prio=1 tid=0x081388d8 nid=0x525 runnable "GC task thread#0 (ParallelGC)" prio=1 tid=0x0807a548 nid=0x51d runnable "GC task thread#1 (ParallelGC)" prio=1 tid=0x0807b5a0 nid=0x51e runnable "GC task thread#2 (ParallelGC)" prio=1 tid=0x0807c1b8 nid=0x51f runnable "GC task thread#3 (ParallelGC)" prio=1 tid=0x0807cdd8 nid=0x520 runnable "GC task thread#4 (ParallelGC)" prio=1 tid=0x0807da10 nid=0x521 runnable "GC task thread#5 (ParallelGC)" prio=1 tid=0x0807e648 nid=0x522 runnable "GC task thread#6 (ParallelGC)" prio=1 tid=0x0807f280 nid=0x523 runnable "GC task thread#7 (ParallelGC)" prio=1 tid=0x0807feb8 nid=0x524 runnable "VM Periodic Task Thread" prio=1 tid=0x568a7868 nid=0x52f waiting on condition Jul 30, 2008 5:30:24 PM org.apache.catalina.core.ApplicationContext log INFO: HTMLManager: list: Listing contexts for virtual host 'localhost' [GC 1968661K->1868524K(2111040K), 0.0176210 secs] Dumping JVM state. Full thread dump Java HotSpot(TM) Server VM (1.5.0_15-b04 mixed mode):
|
|
|
Re: WOSessionStore$TimeoutEntryOn Jul 31, 2008, at 12:25 PM, Fred Larken wrote: > > The thread dumps that do not show that trace of the WOSessionStore > look ok to > me. I don't see any deadlocks or other problems. I will post a dump > at the > bottom of this message. I see threads blocked in EOF. > So I guess our course of action to locate the problem, whether this > is a > symptom or the actual problem, would be to put debuggin info in the > awake, > sleep and terminate methods and maybe even stick the code in that > was posted > in that link? I don't think that will help. > Here is a dump, if you see something that could be the prob, let me > know: > Dumping JVM state. > Full thread dump Java HotSpot(TM) Server VM (1.5.0_15-b04 mixed mode): > > "Thread-450" daemon prio=1 tid=0x4a6b8998 nid=0x34fc waiting on > condition > [0x518bf000..0x518c0020] > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer > .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer > .acquireQueued(AbstractQueuedSynchronizer.java:746) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: > 1076) > at > java.util.concurrent.locks.ReentrantLock > $NonfairSync.lock(ReentrantLock.java:184) > at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: > 256) > at > com > .webobjects > .eocontrol > .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) > at > com > .webobjects > .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: > 4650) > at > com > .webobjects > .eocontrol.EOCustomObject.willReadRelationship(EOCustomObject.java: > 1270) That ya go. Something in your code has locked the object store (EODatabaseContext), and not unlocked it. Either a long running thread (did not see this in the stack trace, but there are a lot of threads and I may have missed it) or something threw an exception that left it locked. Chuck > "http-20226-Processor50" daemon prio=1 tid=0x4ae120a8 nid=0x104d in > Object.wait() [0x4db6d000..0x4db6dfa0] > at java.lang.Object.wait(Native Method) > - waiting on <0x7b93e440> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at java.lang.Object.wait(Object.java:474) > at > com > .webobjects > .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: > 191) > - locked <0x7b93e440> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at > com > .webobjects > .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._handleRequest(WOComponentRequestHandler.java:369) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > .handleRequest(WOComponentRequestHandler.java:445) > at > com > .webobjects > .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) > at > com > .webobjects > .jspservlet > ._WOApplicationWrapper > .servletDispatchRequest(_WOApplicationWrapper.java:131) > at > com > .webobjects > .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) > at > com > .webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java: > 695) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:709) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) > at > org > .apache > .catalina > .core > .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: > 252) > > > "http-20226-Processor49" daemon prio=1 tid=0x4ae11338 nid=0x104c > waiting on > condition [0x4dbed000..0x4dbef020] > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer > .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer > .acquireQueued(AbstractQueuedSynchronizer.java:746) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: > 1076) > at > java.util.concurrent.locks.ReentrantReadWriteLock > $NonfairSync.wlock(ReentrantReadWriteLock.java:342) > at > java.util.concurrent.locks.ReentrantReadWriteLock > $WriteLock.lock(ReentrantReadWriteLock.java:637) > at > com > .webobjects > .eocontrol.EOSharedEditingContext.lock(EOSharedEditingContext.java: > 736) > at > com > .webobjects > .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: > 4648) > at > com > .webobjects > .eocontrol.EOEditingContext.refaultObject(EOEditingContext.java:3984) > at > com > .webobjects > .eocontrol > .EOEditingContext._refaultObjectWithGlobalID(EOEditingContext.java: > 3243) > at > com > .webobjects > .eocontrol > .EOEditingContext > ._refaultLocalObjectWithGlobalID(EOEditingContext.java:3250) > at > com > .webobjects > .eocontrol > .EOEditingContext._refaultObjectsWithGlobalIDs(EOEditingContext.java: > 3275) > at > com > .webobjects > .eocontrol > .EOEditingContext._processObjectStoreChanges(EOEditingContext.java: > 3500) > at sun.reflect.GeneratedMethodAccessor471.invoke(Unknown Source) > at > sun > .reflect > .DelegatingMethodAccessorImpl > .invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:585) > at com.webobjects.foundation.NSSelector.invoke(NSSelector.java:358) > at > com > .webobjects > .foundation.NSSelector._safeInvokeSelector(NSSelector.java:110) > at > com > .webobjects > .eocontrol > .EOEditingContext._processNotificationQueue(EOEditingContext.java: > 4725) > at > com.webobjects.eocontrol.EOEditingContext.lock(EOEditingContext.java: > 4604) > at > com > .webobjects.eocontrol.EOEditingContext.tryLock(EOEditingContext.java: > 4616) > at > com > .webobjects > .eocontrol > .EOEditingContext._sendOrEnqueueNotification(EOEditingContext.java: > 4689) > at > com > .webobjects > .eocontrol > .EOEditingContext._objectsChangedInStore(EOEditingContext.java:3546) > at sun.reflect.GeneratedMethodAccessor470.invoke(Unknown Source) > at > sun > .reflect > .DelegatingMethodAccessorImpl > .invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:585) > at > com > .webobjects.foundation.NSSelector._safeInvokeMethod(NSSelector.java: > 122) > at > com.webobjects.foundation.NSNotificationCenter > $_Entry.invokeMethod(NSNotificationCenter.java:588) > at > com > .webobjects > .foundation > .NSNotificationCenter.postNotification(NSNotificationCenter.java:532) > at > com > .webobjects > .foundation > .NSNotificationCenter.postNotification(NSNotificationCenter.java:562) > at > com > .webobjects > .eocontrol > .EOObjectStoreCoordinator > ._objectsChangedInSubStore(EOObjectStoreCoordinator.java:693) > at sun.reflect.GeneratedMethodAccessor712.invoke(Unknown Source) > at > sun > .reflect > .DelegatingMethodAccessorImpl > .invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:585) > at > com > .webobjects.foundation.NSSelector._safeInvokeMethod(NSSelector.java: > 122) > at > com.webobjects.foundation.NSNotificationCenter > $_Entry.invokeMethod(NSNotificationCenter.java:588) > at > com > .webobjects > .foundation > .NSNotificationCenter.postNotification(NSNotificationCenter.java:532) > at > com > .webobjects > .foundation > .NSNotificationCenter.postNotification(NSNotificationCenter.java:562) > at > com > .webobjects > .eoaccess > .EODatabaseContext > ._snapshotsChangedInDatabase(EODatabaseContext.java:3664) > at sun.reflect.GeneratedMethodAccessor710.invoke(Unknown Source) > at > sun > .reflect > .DelegatingMethodAccessorImpl > .invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:585) > at > com > .webobjects.foundation.NSSelector._safeInvokeMethod(NSSelector.java: > 122) > at > com.webobjects.foundation.NSNotificationCenter > $_Entry.invokeMethod(NSNotificationCenter.java:588) > at > com > .webobjects > .foundation > .NSNotificationCenter.postNotification(NSNotificationCenter.java:532) > at > com > .webobjects > .foundation > .NSNotificationCenter.postNotification(NSNotificationCenter.java:562) > at > com > .webobjects > .eoaccess.EODatabaseContext.commitChanges(EODatabaseContext.java:6418) > at > com > .webobjects > .eocontrol > .EOObjectStoreCoordinator > .saveChangesInEditingContext(EOObjectStoreCoordinator.java:386) > at > com > .webobjects > .eocontrol.EOEditingContext.saveChanges(EOEditingContext.java:3176) > > "http-20226-Processor48" daemon prio=1 tid=0x4ae105c8 nid=0x104b in > Object.wait() [0x4dc6f000..0x4dc700a0] > at java.lang.Object.wait(Native Method) > - waiting on <0x7b93e440> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at java.lang.Object.wait(Object.java:474) > at > com > .webobjects > .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: > 191) > - locked <0x7b93e440> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at > com > .webobjects > .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._handleRequest(WOComponentRequestHandler.java:369) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > .handleRequest(WOComponentRequestHandler.java:445) > at > com > .webobjects > .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) > at > com > .webobjects > .jspservlet > ._WOApplicationWrapper > .servletDispatchRequest(_WOApplicationWrapper.java:131) > at > com > .webobjects > .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) > at > com > .webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java: > 695) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:709) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) > at > org > .apache > .catalina > .core > .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: > 252) > at > org > .apache > .catalina > .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) > > "http-20226-Processor47" daemon prio=1 tid=0x4ae0f858 nid=0x104a > runnable > [0x4dcf0000..0x4dcf1120] > at java.net.SocketInputStream.socketRead0(Native Method) > at java.net.SocketInputStream.read(SocketInputStream.java:129) > at > org > .apache > .coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:737) > at > org > .apache > .coyote > .http11 > .InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:398) > at > org > .apache.coyote.http11.Http11Processor.process(Http11Processor.java: > 827) > at > org.apache.coyote.http11.Http11BaseProtocol > $Http11ConnectionHandler.processConnection(Http11BaseProtocol.java: > 664) > at > org > .apache > .tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java: > 527) > at > org > .apache > .tomcat > .util > .net > .LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80) > at > org.apache.tomcat.util.threads.ThreadPool > $ControlRunnable.run(ThreadPool.java:684) > at java.lang.Thread.run(Thread.java:595) > > "http-20226-Processor46" daemon prio=1 tid=0x4ae0eae8 nid=0x1049 > waiting on > condition [0x4dd70000..0x4dd71da0] > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer > .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer > .acquireQueued(AbstractQueuedSynchronizer.java:746) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: > 1076) > at > java.util.concurrent.locks.ReentrantLock > $NonfairSync.lock(ReentrantLock.java:184) > at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: > 256) > at > com > .webobjects > .eocontrol > .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) > at > com > .webobjects > .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: > 4650) > at > com > .webobjects > .eocontrol.EOCustomObject.willReadRelationship(EOCustomObject.java: > 1270) > at > com.webobjects.eocontrol._EOMutableKnownKeyDictionary$Initializer > $ > _LazyGenericRecordBinding > .valueInObject(_EOMutableKnownKeyDictionary.java:614) > at > com > .webobjects > .eocontrol.EOCustomObject.storedValueForKey(EOCustomObject.java:1634) > > "http-20226-Processor45" daemon prio=1 tid=0x4ae0ddb0 nid=0x1048 in > Object.wait() [0x4ddf2000..0x4ddf2e20] > at java.lang.Object.wait(Native Method) > - waiting on <0x99138c50> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at java.lang.Object.wait(Object.java:474) > at > com > .webobjects > .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: > 191) > - locked <0x99138c50> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at > com > .webobjects > .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._handleRequest(WOComponentRequestHandler.java:369) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > .handleRequest(WOComponentRequestHandler.java:445) > at > com > .webobjects > .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) > at > com > .webobjects > .jspservlet > ._WOApplicationWrapper > .servletDispatchRequest(_WOApplicationWrapper.java:131) > at > com > .webobjects > .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) > at > com > .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: > 709) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) > at > org > .apache > .catalina > .core > .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: > 252) > at > org > .apache > .catalina > .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) > > "http-20226-Processor44" daemon prio=1 tid=0x4ae03f58 nid=0x1047 in > Object.wait() [0x4de73000..0x4de73ea0] > at java.lang.Object.wait(Native Method) > - waiting on <0x99138c50> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at java.lang.Object.wait(Object.java:474) > at > com > .webobjects > .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: > 191) > - locked <0x99138c50> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at > com > .webobjects > .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._handleRequest(WOComponentRequestHandler.java:369) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > .handleRequest(WOComponentRequestHandler.java:445) > at > com > .webobjects > .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) > at > com > .webobjects > .jspservlet > ._WOApplicationWrapper > .servletDispatchRequest(_WOApplicationWrapper.java:131) > at > com > .webobjects > .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) > at > com > .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: > 709) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) > at > org > .apache > .catalina > .core > .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: > 252) > at > org > .apache > .catalina > .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) > > > "http-20226-Processor43" daemon prio=1 tid=0x4ae02390 nid=0x1046 in > Object.wait() [0x4def4000..0x4def4f20] > at java.lang.Object.wait(Native Method) > - waiting on <0x6eec6df0> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at java.lang.Object.wait(Object.java:474) > at > com > .webobjects > .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: > 191) > - locked <0x6eec6df0> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at > com > .webobjects > .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._handleRequest(WOComponentRequestHandler.java:369) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > .handleRequest(WOComponentRequestHandler.java:445) > at > com > .webobjects > .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) > at > com > .webobjects > .jspservlet > ._WOApplicationWrapper > .servletDispatchRequest(_WOApplicationWrapper.java:131) > at > com > .webobjects > .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) > at > com > .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: > 709) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) > at > org > .apache > .catalina > .core > .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: > 252) > at > org > .apache > .catalina > .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) > > > "http-20226-Processor42" daemon prio=1 tid=0x0841e560 nid=0x1045 in > Object.wait() [0x4df75000..0x4df75fa0] > at java.lang.Object.wait(Native Method) > - waiting on <0xcd1b9410> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at java.lang.Object.wait(Object.java:474) > at > com > .webobjects > .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: > 191) > - locked <0xcd1b9410> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at > com > .webobjects > .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._handleRequest(WOComponentRequestHandler.java:369) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > .handleRequest(WOComponentRequestHandler.java:445) > at > com > .webobjects > .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) > at > com > .webobjects > .jspservlet > ._WOApplicationWrapper > .servletDispatchRequest(_WOApplicationWrapper.java:131) > at > com > .webobjects > .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) > at > com > .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: > 709) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) > at > org > .apache > .catalina > .core > .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: > 252) > at > org > .apache > .catalina > .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) > > "http-20226-Processor41" daemon prio=1 tid=0x088eb1a0 nid=0x1044 in > Object.wait() [0x4dff6000..0x4dff7020] > at java.lang.Object.wait(Native Method) > - waiting on <0xcd1b9410> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at java.lang.Object.wait(Object.java:474) > at > com > .webobjects > .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: > 191) > - locked <0xcd1b9410> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at > com > .webobjects > .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._handleRequest(WOComponentRequestHandler.java:369) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > .handleRequest(WOComponentRequestHandler.java:445) > at > com > .webobjects > .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) > at > com > .webobjects > .jspservlet > ._WOApplicationWrapper > .servletDispatchRequest(_WOApplicationWrapper.java:131) > at > com > .webobjects > .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) > at > com > .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: > 709) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) > at > org > .apache > .catalina > .core > .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: > 252) > at > org > .apache > .catalina > .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) > > "http-20226-Processor40" daemon prio=1 tid=0x088e8258 nid=0x1043 > waiting on > condition [0x4e076000..0x4e0780a0] > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer > .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer > .acquireQueued(AbstractQueuedSynchronizer.java:746) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: > 1076) > at > java.util.concurrent.locks.ReentrantLock > $NonfairSync.lock(ReentrantLock.java:184) > at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: > 256) > at > com > .webobjects > .eocontrol > .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) > at > com > .webobjects > .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: > 4650) > at > com > .webobjects > .eocontrol > .EOEditingContext > .objectsWithFetchSpecification(EOEditingContext.java:4051) > at > com > .webobjects > .eocontrol > .EOEditingContext > .objectsWithFetchSpecification(EOEditingContext.java:4428) > > "http-20226-Processor39" daemon prio=1 tid=0x088e7318 nid=0x1042 > runnable > [0x4e0f8000..0x4e0f9120] > at java.net.PlainSocketImpl.socketAccept(Native Method) > at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) > - locked <0x687d18f0> (a java.net.SocksSocketImpl) > at java.net.ServerSocket.implAccept(ServerSocket.java:450) > at java.net.ServerSocket.accept(ServerSocket.java:421) > at > org > .apache > .tomcat > .util > .net > .DefaultServerSocketFactory > .acceptSocket(DefaultServerSocketFactory.java:60) > at > org > .apache > .tomcat.util.net.PoolTcpEndpoint.acceptSocket(PoolTcpEndpoint.java: > 407) > at > org > .apache > .tomcat > .util > .net > .LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:70) > at > org.apache.tomcat.util.threads.ThreadPool > $ControlRunnable.run(ThreadPool.java:684) > at java.lang.Thread.run(Thread.java:595) > > "http-20226-Processor38" daemon prio=1 tid=0x088ec3e0 nid=0x1041 in > Object.wait() [0x4e179000..0x4e179da0] > at java.lang.Object.wait(Native Method) > - waiting on <0x916494d0> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Object.wait(Object.java:474) > at > org.apache.tomcat.util.threads.ThreadPool > $ControlRunnable.run(ThreadPool.java:656) > - locked <0x916494d0> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Thread.run(Thread.java:595) > > "http-20226-Processor37" daemon prio=1 tid=0x088eb500 nid=0x1040 in > Object.wait() [0x4e1fa000..0x4e1fae20] > at java.lang.Object.wait(Native Method) > - waiting on <0x916494b0> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Object.wait(Object.java:474) > at > org.apache.tomcat.util.threads.ThreadPool > $ControlRunnable.run(ThreadPool.java:656) > - locked <0x916494b0> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Thread.run(Thread.java:595) > > "http-20226-Processor36" daemon prio=1 tid=0x091a3938 nid=0x103f in > Object.wait() [0x4e27b000..0x4e27bea0] > at java.lang.Object.wait(Native Method) > - waiting on <0x91649490> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Object.wait(Object.java:474) > at > org.apache.tomcat.util.threads.ThreadPool > $ControlRunnable.run(ThreadPool.java:656) > - locked <0x91649490> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Thread.run(Thread.java:595) > > "http-20226-Processor35" daemon prio=1 tid=0x091a2b80 nid=0x103e in > Object.wait() [0x4e2fc000..0x4e2fcf20] > at java.lang.Object.wait(Native Method) > - waiting on <0x91649470> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Object.wait(Object.java:474) > at > org.apache.tomcat.util.threads.ThreadPool > $ControlRunnable.run(ThreadPool.java:656) > - locked <0x91649470> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Thread.run(Thread.java:595) > > "http-20226-Processor34" daemon prio=1 tid=0x0862cef8 nid=0x103d in > Object.wait() [0x4e37d000..0x4e37dfa0] > at java.lang.Object.wait(Native Method) > - waiting on <0x91649450> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Object.wait(Object.java:474) > at > org.apache.tomcat.util.threads.ThreadPool > $ControlRunnable.run(ThreadPool.java:656) > - locked <0x91649450> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Thread.run(Thread.java:595) > > "http-20226-Processor33" daemon prio=1 tid=0x0921f260 nid=0x103c in > Object.wait() [0x4e3fe000..0x4e3ff020] > at java.lang.Object.wait(Native Method) > - waiting on <0x91649430> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Object.wait(Object.java:474) > at > org.apache.tomcat.util.threads.ThreadPool > $ControlRunnable.run(ThreadPool.java:656) > - locked <0x91649430> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Thread.run(Thread.java:595) > > "http-20226-Processor32" daemon prio=1 tid=0x0921e380 nid=0x103b in > Object.wait() [0x4e5fe000..0x4e5ff0a0] > at java.lang.Object.wait(Native Method) > - waiting on <0x91649410> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Object.wait(Object.java:474) > at > org.apache.tomcat.util.threads.ThreadPool > $ControlRunnable.run(ThreadPool.java:656) > - locked <0x91649410> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Thread.run(Thread.java:595) > > "http-20226-Processor31" daemon prio=1 tid=0x086c6b20 nid=0x103a in > Object.wait() [0x4e7c0000..0x4e7c1120] > at java.lang.Object.wait(Native Method) > - waiting on <0x916493f0> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Object.wait(Object.java:474) > at > org.apache.tomcat.util.threads.ThreadPool > $ControlRunnable.run(ThreadPool.java:656) > - locked <0x916493f0> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Thread.run(Thread.java:595) > > "http-20226-Processor30" daemon prio=1 tid=0x086c5db8 nid=0x1039 in > Object.wait() [0x4e841000..0x4e841da0] > at java.lang.Object.wait(Native Method) > - waiting on <0x916493d0> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Object.wait(Object.java:474) > at > org.apache.tomcat.util.threads.ThreadPool > $ControlRunnable.run(ThreadPool.java:656) > - locked <0x916493d0> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Thread.run(Thread.java:595) > > "http-20226-Processor29" daemon prio=1 tid=0x08249350 nid=0x1038 in > Object.wait() [0x4e8c2000..0x4e8c2e20] > at java.lang.Object.wait(Native Method) > - waiting on <0x916493b0> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Object.wait(Object.java:474) > at > org.apache.tomcat.util.threads.ThreadPool > $ControlRunnable.run(ThreadPool.java:656) > - locked <0x916493b0> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Thread.run(Thread.java:595) > > "http-20226-Processor28" daemon prio=1 tid=0x082489d8 nid=0x1037 in > Object.wait() [0x4f9fe000..0x4f9feea0] > at java.lang.Object.wait(Native Method) > - waiting on <0x91649390> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Object.wait(Object.java:474) > at > org.apache.tomcat.util.threads.ThreadPool > $ControlRunnable.run(ThreadPool.java:656) > - locked <0x91649390> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Thread.run(Thread.java:595) > > "http-20226-Processor27" daemon prio=1 tid=0x09420140 nid=0x1036 in > Object.wait() [0x519fa000..0x519faf20] > at java.lang.Object.wait(Native Method) > - waiting on <0x91649370> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Object.wait(Object.java:474) > at > org.apache.tomcat.util.threads.ThreadPool > $ControlRunnable.run(ThreadPool.java:656) > - locked <0x91649370> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Thread.run(Thread.java:595) > > "http-20226-Processor26" daemon prio=1 tid=0x0941fd28 nid=0x1035 in > Object.wait() [0x51979000..0x51979fa0] > at java.lang.Object.wait(Native Method) > - waiting on <0x91649350> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Object.wait(Object.java:474) > at > org.apache.tomcat.util.threads.ThreadPool > $ControlRunnable.run(ThreadPool.java:656) > - locked <0x91649350> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Thread.run(Thread.java:595) > > "http-20226-Monitor" prio=1 tid=0x51c30138 nid=0x595 in Object.wait() > [0x51a7b000..0x51a7c020] > at java.lang.Object.wait(Native Method) > - waiting on <0x6e6b48e8> (a > org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable) > at > org.apache.tomcat.util.threads.ThreadPool > $MonitorRunnable.run(ThreadPool.java:559) > - locked <0x6e6b48e8> (a > org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable) > at java.lang.Thread.run(Thread.java:595) > > "http-20226-Processor25" daemon prio=1 tid=0x51c2f440 nid=0x594 in > Object.wait() [0x51afc000..0x51afd0a0] > at java.lang.Object.wait(Native Method) > - waiting on <0x99138c50> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at java.lang.Object.wait(Object.java:474) > at > com > .webobjects > .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: > 191) > - locked <0x99138c50> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at > com > .webobjects > .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._handleRequest(WOComponentRequestHandler.java:369) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > .handleRequest(WOComponentRequestHandler.java:445) > at > com > .webobjects > .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) > at > com > .webobjects > .jspservlet > ._WOApplicationWrapper > .servletDispatchRequest(_WOApplicationWrapper.java:131) > at > com > .webobjects > .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) > at > com > .webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java: > 695) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:709) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) > at > org > .apache > .catalina > .core > .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: > 252) > at > org > .apache > .catalina > .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) > > "http-20226-Processor24" daemon prio=1 tid=0x52321880 nid=0x593 in > Object.wait() [0x51b7d000..0x51b7e120] > at java.lang.Object.wait(Native Method) > - waiting on <0xaaede7d8> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at java.lang.Object.wait(Object.java:474) > at > com > .webobjects > .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: > 191) > - locked <0xaaede7d8> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at > com > .webobjects > .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._handleRequest(WOComponentRequestHandler.java:369) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > .handleRequest(WOComponentRequestHandler.java:445) > at > com > .webobjects > .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) > at > com > .webobjects > .jspservlet > ._WOApplicationWrapper > .servletDispatchRequest(_WOApplicationWrapper.java:131) > at > com > .webobjects > .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) > at > com > .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: > 709) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) > at > org > .apache > .catalina > .core > .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: > 252) > at > org > .apache > .catalina > .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) > > "http-20226-Processor23" daemon prio=1 tid=0x52320b70 nid=0x592 in > Object.wait() [0x51bfe000..0x51bfeda0] > at java.lang.Object.wait(Native Method) > - waiting on <0x99138c50> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at java.lang.Object.wait(Object.java:474) > at > com > .webobjects > .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: > 191) > - locked <0x99138c50> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at > com > .webobjects > .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._handleRequest(WOComponentRequestHandler.java:369) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > .handleRequest(WOComponentRequestHandler.java:445) > at > com > .webobjects > .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) > at > com > .webobjects > .jspservlet > ._WOApplicationWrapper > .servletDispatchRequest(_WOApplicationWrapper.java:131) > at > com > .webobjects > .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) > at > com > .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: > 709) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) > at > org > .apache > .catalina > .core > .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: > 252) > at > org > .apache > .catalina > .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) > > "http-20226-Processor22" daemon prio=1 tid=0x521d5e90 nid=0x591 > waiting on > condition [0x51ffd000..0x51ffee20] > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer > .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer > .acquireQueued(AbstractQueuedSynchronizer.java:746) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: > 1076) > at > java.util.concurrent.locks.ReentrantLock > $NonfairSync.lock(ReentrantLock.java:184) > at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: > 256) > at > com > .webobjects > .eocontrol > .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) > at > com > .webobjects > .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: > 4650) > at > com > .webobjects > .eocontrol > .EOEditingContext > .objectsWithFetchSpecification(EOEditingContext.java:4051) > at > com > .webobjects > .eocontrol > .EOEditingContext > .objectsWithFetchSpecification(EOEditingContext.java:4428) > > "http-20226-Processor21" daemon prio=1 tid=0x521d52a0 nid=0x590 in > Object.wait() [0x524fe000..0x524feea0] > at java.lang.Object.wait(Native Method) > - waiting on <0x99138c50> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at java.lang.Object.wait(Object.java:474) > at > com > .webobjects > .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: > 191) > - locked <0x99138c50> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at > com > .webobjects > .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._handleRequest(WOComponentRequestHandler.java:369) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > .handleRequest(WOComponentRequestHandler.java:445) > at > com > .webobjects > .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) > at > com > .webobjects > .jspservlet > ._WOApplicationWrapper > .servletDispatchRequest(_WOApplicationWrapper.java:131) > at > com > .webobjects > .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) > at > com > .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: > 709) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) > at > org > .apache > .catalina > .core > .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: > 252) > at > org > .apache > .catalina > .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) > > "http-20226-Processor20" daemon prio=1 tid=0x52b03bf0 nid=0x58f in > Object.wait() [0x52afe000..0x52afef20] > at java.lang.Object.wait(Native Method) > - waiting on <0xcd1b9410> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at java.lang.Object.wait(Object.java:474) > at > com > .webobjects > .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: > 191) > - locked <0xcd1b9410> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at > com > .webobjects > .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._handleRequest(WOComponentRequestHandler.java:369) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > .handleRequest(WOComponentRequestHandler.java:445) > at > com > .webobjects > .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) > at > com > .webobjects > .jspservlet > ._WOApplicationWrapper > .servletDispatchRequest(_WOApplicationWrapper.java:131) > at > com > .webobjects > .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) > at > com > .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: > 709) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) > at > org > .apache > .catalina > .core > .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: > 252) > at > org > .apache > .catalina > .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) > > "http-20226-Processor19" daemon prio=1 tid=0x52695fb0 nid=0x58e in > Object.wait() [0x52cfe000..0x52cfefa0] > at java.lang.Object.wait(Native Method) > - waiting on <0xaaede7d8> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at java.lang.Object.wait(Object.java:474) > at > com > .webobjects > .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: > 191) > - locked <0xaaede7d8> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at > com > .webobjects > .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._handleRequest(WOComponentRequestHandler.java:369) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > .handleRequest(WOComponentRequestHandler.java:445) > at > com > .webobjects > .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) > at > com > .webobjects > .jspservlet > ._WOApplicationWrapper > .servletDispatchRequest(_WOApplicationWrapper.java:131) > at > com > .webobjects > .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) > at > com > .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: > 709) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) > at > org > .apache > .catalina > .core > .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: > 252) > at > org > .apache > .catalina > .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) > > "http-20226-Processor18" daemon prio=1 tid=0x52b37c50 nid=0x58d > waiting on > condition [0x530fd000..0x530ff020] > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer > .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer > .acquireQueued(AbstractQueuedSynchronizer.java:746) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: > 1076) > at > java.util.concurrent.locks.ReentrantLock > $NonfairSync.lock(ReentrantLock.java:184) > at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: > 256) > at > com > .webobjects > .eocontrol > .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) > at > com > .webobjects > .eoaccess > .EODatabaseContext > .registeredDatabaseContextForModel(EODatabaseContext.java:999) > at > com > .webobjects > .eoaccess > .EODatabaseContext > .registeredDatabaseContextForModel(EODatabaseContext.java:1033) > at > com > .webobjects > .eoaccess.EOUtilities.databaseContextForModelNamed(EOUtilities.java: > 814) > at > com.webobjects.eoaccess.EOUtilities.rawRowsForSQL(EOUtilities.java: > 585) > > "http-20226-Processor17" daemon prio=1 tid=0x526c1980 nid=0x58c in > Object.wait() [0x532bb000..0x532bc0a0] > at java.lang.Object.wait(Native Method) > - waiting on <0xcd1b9410> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at java.lang.Object.wait(Object.java:474) > at > com > .webobjects > .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: > 191) > - locked <0xcd1b9410> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at > com > .webobjects > .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._handleRequest(WOComponentRequestHandler.java:369) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > .handleRequest(WOComponentRequestHandler.java:445) > at > com > .webobjects > .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) > at > com > .webobjects > .jspservlet > ._WOApplicationWrapper > .servletDispatchRequest(_WOApplicationWrapper.java:131) > at > com > .webobjects > .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) > at > com > .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: > 709) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) > at > org > .apache > .catalina > .core > .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: > 252) > at > org > .apache > .catalina > .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) > > "http-20226-Processor16" daemon prio=1 tid=0x4fa0f908 nid=0x58b in > Object.wait() [0x538e2000..0x538e3120] > at java.lang.Object.wait(Native Method) > - waiting on <0x99138c50> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at java.lang.Object.wait(Object.java:474) > at > com > .webobjects > .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: > 191) > - locked <0x99138c50> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at > com > .webobjects > .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._handleRequest(WOComponentRequestHandler.java:369) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > .handleRequest(WOComponentRequestHandler.java:445) > at > com > .webobjects > .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) > at > com > .webobjects > .jspservlet > ._WOApplicationWrapper > .servletDispatchRequest(_WOApplicationWrapper.java:131) > at > com > .webobjects > .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) > at > com > .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: > 709) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) > at > org > .apache > .catalina > .core > .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: > 252) > at > org > .apache > .catalina > .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) > > "http-20226-Processor15" daemon prio=1 tid=0x4fa0f780 nid=0x58a in > Object.wait() [0x53963000..0x53963da0] > at java.lang.Object.wait(Native Method) > - waiting on <0xaaede7d8> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at java.lang.Object.wait(Object.java:474) > at > com > .webobjects > .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: > 191) > - locked <0xaaede7d8> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at > com > .webobjects > .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._handleRequest(WOComponentRequestHandler.java:369) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > .handleRequest(WOComponentRequestHandler.java:445) > at > com > .webobjects > .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) > at > com > .webobjects > .jspservlet > ._WOApplicationWrapper > .servletDispatchRequest(_WOApplicationWrapper.java:131) > at > com > .webobjects > .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) > at > com > .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: > 709) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) > at > org > .apache > .catalina > .core > .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: > 252) > at > org > .apache > .catalina > .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) > > "http-20226-Processor14" daemon prio=1 tid=0x52b74250 nid=0x589 in > Object.wait() [0x539e4000..0x539e4e20] > at java.lang.Object.wait(Native Method) > - waiting on <0xcd1b9410> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at java.lang.Object.wait(Object.java:474) > at > com > .webobjects > .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: > 191) > - locked <0xcd1b9410> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at > com > .webobjects > .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._handleRequest(WOComponentRequestHandler.java:369) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > .handleRequest(WOComponentRequestHandler.java:445) > at > com > .webobjects > .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) > at > com > .webobjects > .jspservlet > ._WOApplicationWrapper > .servletDispatchRequest(_WOApplicationWrapper.java:131) > at > com > .webobjects > .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) > at > com > .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: > 709) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) > at > org > .apache > .catalina > .core > .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: > 252) > at > org > .apache > .catalina > .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) > > "http-20226-Processor13" daemon prio=1 tid=0x521be938 nid=0x588 in > Object.wait() [0x53a65000..0x53a65ea0] > at java.lang.Object.wait(Native Method) > - waiting on <0x6ea04b80> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Object.wait(Object.java:474) > at > org.apache.tomcat.util.threads.ThreadPool > $ControlRunnable.run(ThreadPool.java:656) > - locked <0x6ea04b80> (a > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) > at java.lang.Thread.run(Thread.java:595) > > "http-20226-Processor12" daemon prio=1 tid=0x52b13970 nid=0x587 > waiting on > condition [0x53ae5000..0x53ae6f20] > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer > .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer > .acquireQueued(AbstractQueuedSynchronizer.java:746) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: > 1076) > at > java.util.concurrent.locks.ReentrantReadWriteLock > $NonfairSync.wlock(ReentrantReadWriteLock.java:342) > at > java.util.concurrent.locks.ReentrantReadWriteLock > $WriteLock.lock(ReentrantReadWriteLock.java:637) > at > com > .webobjects > .eocontrol.EOSharedEditingContext.lock(EOSharedEditingContext.java: > 736) > at > com > .webobjects > .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: > 4648) > at > com > .webobjects > .eocontrol > .EOEditingContext > .objectsWithFetchSpecification(EOEditingContext.java:4051) > at > com > .webobjects > .eocontrol > .EOEditingContext > .objectsWithFetchSpecification(EOEditingContext.java:4428) > > "http-20226-Processor11" daemon prio=1 tid=0x52b740c8 nid=0x586 in > Object.wait() [0x53b67000..0x53b67fa0] > at java.lang.Object.wait(Native Method) > - waiting on <0xcd1b9410> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at java.lang.Object.wait(Object.java:474) > at > com > .webobjects > .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: > 191) > - locked <0xcd1b9410> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at > com > .webobjects > .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._handleRequest(WOComponentRequestHandler.java:369) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > .handleRequest(WOComponentRequestHandler.java:445) > at > com > .webobjects > .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) > at > com > .webobjects > .jspservlet > ._WOApplicationWrapper > .servletDispatchRequest(_WOApplicationWrapper.java:131) > at > com > .webobjects > .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) > at > com > .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: > 709) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) > at > org > .apache > .catalina > .core > .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: > 252) > at > org > .apache > .catalina > .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) > > "http-20226-Processor10" daemon prio=1 tid=0x52387828 nid=0x585 > runnable > [0x53be8000..0x53be9020] > at java.net.SocketInputStream.socketRead0(Native Method) > at java.net.SocketInputStream.read(SocketInputStream.java:129) > at > org > .apache > .coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:737) > at > org > .apache > .coyote > .http11 > .InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:398) > at > org > .apache.coyote.http11.Http11Processor.process(Http11Processor.java: > 827) > at > org.apache.coyote.http11.Http11BaseProtocol > $Http11ConnectionHandler.processConnection(Http11BaseProtocol.java: > 664) > at > org > .apache > .tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java: > 527) > at > org > .apache > .tomcat > .util > .net > .LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80) > at > org.apache.tomcat.util.threads.ThreadPool > $ControlRunnable.run(ThreadPool.java:684) > at java.lang.Thread.run(Thread.java:595) > > "http-20226-Processor9" daemon prio=1 tid=0x523876a0 nid=0x584 in > Object.wait() [0x53c69000..0x53c6a0a0] > at java.lang.Object.wait(Native Method) > - waiting on <0x7b93e440> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at java.lang.Object.wait(Object.java:474) > at > com > .webobjects > .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: > 191) > - locked <0x7b93e440> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at > com > .webobjects > .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._handleRequest(WOComponentRequestHandler.java:369) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > .handleRequest(WOComponentRequestHandler.java:445) > at > com > .webobjects > .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) > at > com > .webobjects > .jspservlet > ._WOApplicationWrapper > .servletDispatchRequest(_WOApplicationWrapper.java:131) > at > com > .webobjects > .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) > at > com > .webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java: > 695) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:709) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) > at > org > .apache > .catalina > .core > .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: > 252) > at > org > .apache > .catalina > .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) > > "http-20226-Processor8" daemon prio=1 tid=0x521f67f0 nid=0x583 in > Object.wait() [0x53cea000..0x53ceb120] > at java.lang.Object.wait(Native Method) > - waiting on <0xaaede7d8> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at java.lang.Object.wait(Object.java:474) > at > com > .webobjects > .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: > 191) > - locked <0xaaede7d8> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at > com > .webobjects > .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._handleRequest(WOComponentRequestHandler.java:369) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > .handleRequest(WOComponentRequestHandler.java:445) > at > com > .webobjects > .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) > at > com > .webobjects > .jspservlet > ._WOApplicationWrapper > .servletDispatchRequest(_WOApplicationWrapper.java:131) > at > com > .webobjects > .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) > at > com > .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: > 709) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) > at > org > .apache > .catalina > .core > .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: > 252) > at > org > .apache > .catalina > .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) > > > "http-20226-Processor7" daemon prio=1 tid=0x521f9ed0 nid=0x582 > waiting on > condition [0x53de7000..0x53de8da0] > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer > .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer > .acquireQueued(AbstractQueuedSynchronizer.java:746) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: > 1076) > at > java.util.concurrent.locks.ReentrantLock > $NonfairSync.lock(ReentrantLock.java:184) > at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: > 256) > at > com > .webobjects > .eocontrol > .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) > at > com > .webobjects > .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: > 4650) > at > com > .webobjects > .eocontrol.EOCustomObject.willReadRelationship(EOCustomObject.java: > 1270) > at > com.webobjects.eocontrol._EOMutableKnownKeyDictionary$Initializer > $ > _LazyGenericRecordBinding > .valueInObject(_EOMutableKnownKeyDictionary.java:614) > at > com > .webobjects > .eocontrol.EOCustomObject.storedValueForKey(EOCustomObject.java:1634) > > "http-20226-Processor6" daemon prio=1 tid=0x52356090 nid=0x581 in > Object.wait() [0x53e69000..0x53e69e20] > at java.lang.Object.wait(Native Method) > - waiting on <0x99138c50> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at java.lang.Object.wait(Object.java:474) > at > com > .webobjects > .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: > 191) > - locked <0x99138c50> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at > com > .webobjects > .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._handleRequest(WOComponentRequestHandler.java:369) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > .handleRequest(WOComponentRequestHandler.java:445) > at > com > .webobjects > .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) > at > com > .webobjects > .jspservlet > ._WOApplicationWrapper > .servletDispatchRequest(_WOApplicationWrapper.java:131) > at > com > .webobjects > .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) > at > com > .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: > 709) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) > at > org > .apache > .catalina > .core > .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: > 252) > at > org > .apache > .catalina > .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) > > "http-20226-Processor5" daemon prio=1 tid=0x52356ff0 nid=0x580 > waiting on > condition [0x53ee9000..0x53eeaea0] > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer > .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer > .acquireQueued(AbstractQueuedSynchronizer.java:746) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: > 1076) > at > java.util.concurrent.locks.ReentrantReadWriteLock > $NonfairSync.wlock(ReentrantReadWriteLock.java:342) > at > java.util.concurrent.locks.ReentrantReadWriteLock > $WriteLock.lock(ReentrantReadWriteLock.java:637) > at > com > .webobjects > .eocontrol.EOSharedEditingContext.lock(EOSharedEditingContext.java: > 736) > at > com > .webobjects > .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: > 4648) > at > com > .webobjects > .eocontrol > .EOEditingContext > .objectsWithFetchSpecification(EOEditingContext.java:4051) > at > com > .webobjects > .eocontrol > .EOEditingContext > .objectsWithFetchSpecification(EOEditingContext.java:4428) > > "http-20226-Processor4" daemon prio=1 tid=0x52691360 nid=0x57f > waiting on > condition [0x53f6a000..0x53f6bf20] > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer > .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer > .acquireQueued(AbstractQueuedSynchronizer.java:746) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: > 1076) > at > java.util.concurrent.locks.ReentrantLock > $NonfairSync.lock(ReentrantLock.java:184) > at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: > 256) > at > com > .webobjects > .eocontrol > .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) > at > com > .webobjects > .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: > 4650) > at > com > .webobjects > .eocontrol > .EOEditingContext > .objectsWithFetchSpecification(EOEditingContext.java:4051) > at > com > .webobjects > .eocontrol > .EOEditingContext > .objectsWithFetchSpecification(EOEditingContext.java:4428) > > "http-20226-Processor3" daemon prio=1 tid=0x5262eba8 nid=0x57e > waiting on > condition [0x53feb000..0x53fecfa0] > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer > .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer > .acquireQueued(AbstractQueuedSynchronizer.java:746) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: > 1076) > at > java.util.concurrent.locks.ReentrantReadWriteLock > $NonfairSync.wlock(ReentrantReadWriteLock.java:342) > at > java.util.concurrent.locks.ReentrantReadWriteLock > $WriteLock.lock(ReentrantReadWriteLock.java:637) > at > com > .webobjects > .eocontrol.EOSharedEditingContext.lock(EOSharedEditingContext.java: > 736) > at > com > .webobjects > .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: > 4648) > at > com > .webobjects > .eocontrol > .EOEditingContext > .objectsWithFetchSpecification(EOEditingContext.java:4051) > at > com > .webobjects > .eocontrol > .EOEditingContext > .objectsWithFetchSpecification(EOEditingContext.java:4428) > > "http-20226-Processor2" daemon prio=1 tid=0x52b744e0 nid=0x57d > waiting on > condition [0x5406c000..0x5406e020] > at sun.misc.Unsafe.park(Native Method) > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer > .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer > .acquireQueued(AbstractQueuedSynchronizer.java:746) > at > java > .util > .concurrent > .locks > .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: > 1076) > at > java.util.concurrent.locks.ReentrantLock > $NonfairSync.lock(ReentrantLock.java:184) > at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: > 256) > at > com > .webobjects > .eocontrol > .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) > at > com > .webobjects > .eoaccess > .EODatabaseContext > .registeredDatabaseContextForModel(EODatabaseContext.java:999) > at > com > .webobjects > .eoaccess > .EODatabaseContext > .registeredDatabaseContextForModel(EODatabaseContext.java:1033) > at > com > .webobjects > .eoaccess.EOUtilities.databaseContextForModelNamed(EOUtilities.java: > 814) > at > com.webobjects.eoaccess.EOUtilities.rawRowsForSQL(EOUtilities.java: > 585) > > "http-20226-Processor1" daemon prio=1 tid=0x52ba7b78 nid=0x57c in > Object.wait() [0x5333c000..0x5333d0a0] > at java.lang.Object.wait(Native Method) > - waiting on <0x7b93e440> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at java.lang.Object.wait(Object.java:474) > at > com > .webobjects > .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: > 191) > - locked <0x7b93e440> (a > com.webobjects.appserver.WOSessionStore$TimeoutEntry) > at > com > .webobjects > .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > ._handleRequest(WOComponentRequestHandler.java:369) > at > com > .webobjects > .appserver > ._private > .WOComponentRequestHandler > .handleRequest(WOComponentRequestHandler.java:445) > at > com > .webobjects > .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) > at > com > .webobjects > .jspservlet > ._WOApplicationWrapper > .servletDispatchRequest(_WOApplicationWrapper.java:131) > at > com > .webobjects > .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) > at > com > .webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java: > 695) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:709) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) > at > org > .apache > .catalina > .core > .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: > 252) > at > org > .apache > .catalina > .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) > > "ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon prio=1 > tid=0x52321f80 nid=0x57b waiting on condition [0x54102000..0x54102120] > at java.lang.Thread.sleep(Native Method) > at > org.apache.catalina.core.ContainerBase > $ContainerBackgroundProcessor.run(ContainerBase.java:1547) > at java.lang.Thread.run(Thread.java:595) > > "Timer-2" prio=1 tid=0x52b74a20 nid=0x574 in Object.wait() > [0x54182000..0x54182f20] > at java.lang.Object.wait(Native Method) > - waiting on <0x6d201840> (a java.util.TaskQueue) > at java.util.TimerThread.mainLoop(Timer.java:509) > - locked <0x6d201840> (a java.util.TaskQueue) > at java.util.TimerThread.run(Timer.java:462) > > "Timer-1" prio=1 tid=0x4fa0fb18 nid=0x573 in Object.wait() > [0x54203000..0x54203fa0] > at java.lang.Object.wait(Native Method) > - waiting on <0x6d2018c8> (a java.util.TaskQueue) > at java.util.TimerThread.mainLoop(Timer.java:509) > - locked <0x6d2018c8> (a java.util.TaskQueue) > at java.util.TimerThread.run(Timer.java:462) > > "Thread-8" prio=1 tid=0x090e20e0 nid=0x56e waiting on condition > [0x54284000..0x54285020] > at java.lang.Thread.sleep(Native Method) > at > com > .XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX > .client.beans.Timer.run(Timer.java:110) > at java.lang.Thread.run(Thread.java:595) > > "PoolManagerCleanup-20012302" daemon prio=1 tid=0x52357328 nid=0x560 > waiting > on condition [0x54dfd000..0x54dfd120] > at java.lang.Thread.sleep(Native Method) > at > org.apache.cayenne.conn.PoolManager > $PoolMaintenanceThread.run(PoolManager.java:522) > > "EventDispatchThread-1" daemon prio=1 tid=0x5230da30 nid=0x55f in > Object.wait() [0x54e7d000..0x54e7dda0] > at java.lang.Object.wait(Native Method) > - waiting on <0x6c18b350> (a java.util.Collections$SynchronizedList) > at java.lang.Object.wait(Object.java:474) > at > org.apache.cayenne.event.EventManager > $DispatchThread.run(EventManager.java:450) > - locked <0x6c18b350> (a java.util.Collections$SynchronizedList) > > "EventDispatchThread-0" daemon prio=1 tid=0x51c12b20 nid=0x55e in > Object.wait() [0x54efe000..0x54efee20] > at java.lang.Object.wait(Native Method) > - waiting on <0x6c18b350> (a java.util.Collections$SynchronizedList) > at java.lang.Object.wait(Object.java:474) > at > org.apache.cayenne.event.EventManager > $DispatchThread.run(EventManager.java:450) > - locked <0x6c18b350> (a java.util.Collections$SynchronizedList) > > "EventDispatchThread-4" daemon prio=1 tid=0x52654e70 nid=0x55d in > Object.wait() [0x54305000..0x54305ea0] > at java.lang.Object.wait(Native Method) > - waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList) > at java.lang.Object.wait(Object.java:474) > at > org.apache.cayenne.event.EventManager > $DispatchThread.run(EventManager.java:450) > - locked <0x6c133f48> (a java.util.Collections$SynchronizedList) > > "EventDispatchThread-3" daemon prio=1 tid=0x52bd8860 nid=0x55c in > Object.wait() [0x54386000..0x54386f20] > at java.lang.Object.wait(Native Method) > - waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList) > at java.lang.Object.wait(Object.java:474) > at > org.apache.cayenne.event.EventManager > $DispatchThread.run(EventManager.java:450) > - locked <0x6c133f48> (a java.util.Collections$SynchronizedList) > > "EventDispatchThread-2" daemon prio=1 tid=0x526f6880 nid=0x55b in > Object.wait() [0x54407000..0x54407fa0] > at java.lang.Object.wait(Native Method) > - waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList) > at java.lang.Object.wait(Object.java:474) > at > org.apache.cayenne.event.EventManager > $DispatchThread.run(EventManager.java:450) > - locked <0x6c133f48> (a java.util.Collections$SynchronizedList) > > "EventDispatchThread-1" daemon prio=1 tid=0x52ba5c08 nid=0x55a in > Object.wait() [0x54ba3000..0x54ba4020] > at java.lang.Object.wait(Native Method) > - waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList) > at java.lang.Object.wait(Object.java:474) > at > org.apache.cayenne.event.EventManager > $DispatchThread.run(EventManager.java:450) > - locked <0x6c133f48> (a java.util.Collections$SynchronizedList) > > "EventDispatchThread-0" daemon prio=1 tid=0x51c1af80 nid=0x559 in > Object.wait() [0x55dc2000..0x55dc30a0] > at java.lang.Object.wait(Native Method) > - waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList) > at java.lang.Object.wait(Object.java:474) > at > org.apache.cayenne.event.EventManager > $DispatchThread.run(EventManager.java:450) > - locked <0x6c133f48> (a java.util.Collections$SynchronizedList) > > "PoolManagerCleanup-18771651" daemon prio=1 tid=0x52bd8c68 nid=0x558 > waiting > on condition [0x55ec5000..0x55ec5120] > at java.lang.Thread.sleep(Native Method) > at > org.apache.cayenne.conn.PoolManager > $PoolMaintenanceThread.run(PoolManager.java:522) > > "WrapperStartStopAppMain" prio=1 tid=0x0819d920 nid=0x534 runnable > [0x55d41000..0x55d41fa0] > at java.net.PlainSocketImpl.socketAccept(Native Method) > at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) > - locked <0x6e9a3098> (a java.net.SocksSocketImpl) > at java.net.ServerSocket.implAccept(ServerSocket.java:450) > at java.net.ServerSocket.accept(ServerSocket.java:421) > at > org.apache.catalina.core.StandardServer.await(StandardServer.java:388) > at org.apache.catalina.startup.Catalina.await(Catalina.java:615) > at org.apache.catalina.startup.Catalina.start(Catalina.java:575) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun > .reflect > .NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun > .reflect > .DelegatingMethodAccessorImpl > .invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:585) > at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:294) > at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:432) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun > .reflect > .NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun > .reflect > .DelegatingMethodAccessorImpl > .invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:585) > at > org > .tanukisoftware > .wrapper.WrapperStartStopApp.run(WrapperStartStopApp.java:238) > at java.lang.Thread.run(Thread.java:595) > > "DestroyJavaVM" prio=1 tid=0x568d5eb8 nid=0x51c waiting on condition > [0x00000000..0xffff9190] > > "Wrapper-Connection" daemon prio=1 tid=0x568ae0e8 nid=0x532 runnable > [0x55e43000..0x55e440a0] > at java.net.SocketInputStream.socketRead0(Native Method) > at java.net.SocketInputStream.read(SocketInputStream.java:129) > at java.net.SocketInputStream.read(SocketInputStream.java:182) > at java.io.DataInputStream.readByte(DataInputStream.java:241) > at > org > .tanukisoftware > .wrapper.WrapperManager.handleSocket(WrapperManager.java:3737) > at > org.tanukisoftware.wrapper.WrapperManager.run(WrapperManager.java: > 4084) > at java.lang.Thread.run(Thread.java:595) > > "Wrapper-Control-Event-Monitor" daemon prio=1 tid=0x568ac820 nid=0x530 > sleeping[0x55f45000..0x55f45da0] > at java.lang.Thread.sleep(Native Method) > at org.tanukisoftware.wrapper.WrapperManager > $3.run(WrapperManager.java:731) > > "RMI TCP Accept-0" daemon prio=1 tid=0x5689e660 nid=0x52e runnable > [0x5604a000..0x5604aea0] > at java.net.PlainSocketImpl.socketAccept(Native Method) > at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) > - locked <0x68888648> (a java.net.SocksSocketImpl) > at java.net.ServerSocket.implAccept(ServerSocket.java:450) > at java.net.ServerSocket.accept(ServerSocket.java:421) > at sun.rmi.transport.tcp.TCPTransport.run(TCPTransport.java:340) > at java.lang.Thread.run(Thread.java:595) > > "Timer-0" daemon prio=1 tid=0x5689e158 nid=0x52d in Object.wait() > [0x560cb000..0x560cbf20] > at java.lang.Object.wait(Native Method) > - waiting on <0x6a979aa8> (a java.util.TaskQueue) > at java.lang.Object.wait(Object.java:474) > at java.util.TimerThread.mainLoop(Timer.java:483) > - locked <0x6a979aa8> (a java.util.TaskQueue) > at java.util.TimerThread.run(Timer.java:462) > > "Low Memory Detector" daemon prio=1 tid=0x08149ee0 nid=0x52c runnable > [0x00000000..0x00000000] > > "CompilerThread1" daemon prio=1 tid=0x08148a60 nid=0x52b waiting on > condition [0x00000000..0x56b01248] > > "CompilerThread0" daemon prio=1 tid=0x08147a08 nid=0x52a waiting on > condition [0x00000000..0x56b822c8] > > "AdapterThread" daemon prio=1 tid=0x081468d0 nid=0x529 waiting on > condition > [0x00000000..0x00000000] > > "Signal Dispatcher" daemon prio=1 tid=0x08145b00 nid=0x528 waiting on > condition [0x00000000..0x00000000] > > "Finalizer" daemon prio=1 tid=0x0813b348 nid=0x527 in Object.wait() > [0x56f05000..0x56f05e20] > at java.lang.Object.wait(Native Method) > - waiting on <0x68958b38> (a java.lang.ref.ReferenceQueue$Lock) > at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:120) > - locked <0x68958b38> (a java.lang.ref.ReferenceQueue$Lock) > at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:136) > at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159) > > "Reference Handler" daemon prio=1 tid=0x0813ae20 nid=0x526 in > Object.wait() > [0x56f86000..0x56f86ea0] > at java.lang.Object.wait(Native Method) > - waiting on <0x6a97a128> (a java.lang.ref.Reference$Lock) > at java.lang.Object.wait(Object.java:474) > at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116) > - locked <0x6a97a128> (a java.lang.ref.Reference$Lock) > > "VM Thread" prio=1 tid=0x081388d8 nid=0x525 runnable > > "GC task thread#0 (ParallelGC)" prio=1 tid=0x0807a548 nid=0x51d > runnable > > "GC task thread#1 (ParallelGC)" prio=1 tid=0x0807b5a0 nid=0x51e > runnable > > "GC task thread#2 (ParallelGC)" prio=1 tid=0x0807c1b8 nid=0x51f > runnable > > "GC task thread#3 (ParallelGC)" prio=1 tid=0x0807cdd8 nid=0x520 > runnable > > "GC task thread#4 (ParallelGC)" prio=1 tid=0x0807da10 nid=0x521 > runnable > > "GC task thread#5 (ParallelGC)" prio=1 tid=0x0807e648 nid=0x522 > runnable > > "GC task thread#6 (ParallelGC)" prio=1 tid=0x0807f280 nid=0x523 > runnable > > "GC task thread#7 (ParallelGC)" prio=1 tid=0x0807feb8 nid=0x524 > runnable > > "VM Periodic Task Thread" prio=1 tid=0x568a7868 nid=0x52f waiting on > condition > > Jul 30, 2008 5:30:24 PM org.apache.catalina.core.ApplicationContext > log > INFO: HTMLManager: list: Listing contexts for virtual host 'localhost' > [GC 1968661K->1868524K(2111040K), 0.0176210 secs] > Dumping JVM state. > Full thread dump Java HotSpot(TM) Server VM (1.5.0_15-b04 mixed mode): > > > > Chuck Hill wrote: >> >> >> On Jul 31, 2008, at 10:16 AM, Fred Larken wrote: >> >>> >>> Yes, we are setting this in the code: >>> setAllowsConcurrentRequestHandling(true); >> >> The trace below is probably a symptom then, not the cause. >> >>> The session timeout is set to 30 minutes. >>> >>> How do I find out why a session is hung, or how to fix this? >> >> Check the the thread dumps that don't show this trace. >> >> Check that session's sleep() and terminate() methods can't throw. >> Check awake too for good measure. >> >> >>> I saw one post that said something about adding code to your >>> Application.java >>> Is this the correct way to fix it, or is this problem just a >>> result of >>> something else happening? >>> http://www.mail-archive.com/webobjects-dev@.../msg09497.html >>> http://www.mail-archive.com/webobjects-dev@.../msg09497.html >> >> You could try this if nothing else pans out. >> >> >> Chuck >> >> >>>> >>>> >>>> On Jul 31, 2008, at 9:52 AM, Fred Larken wrote: >>>> >>>>> >>>>> we have a linux server running our web objects app. After a day, >>>>> the >>>>> system >>>>> locks up for 30 mins. It will self-recoverbut in the mean time, >>>>> nobody can >>>>> log in or use the app. I have seen thread dumps during this period >>>>> and I >>>>> have noticed the following trace: >>>>> >>>>> >>>>> "http-20226-Processor24" daemon prio=1 tid=0x52321880 nid=0x593 in >>>>> Object.wait() [0x51b7d000..0x51b7e120] >>>>> at java.lang.Object.wait(Native Method) >>>>> - waiting on <0xaaede7d8> (a >>>>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>>>> at java.lang.Object.wait(Object.java:474) >>>>> at >>>>> com >>>>> .webobjects >>>>> .appserver >>>>> .WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>>>> 191) >>>>> - locked <0xaaede7d8> (a >>>>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>>>> at >>>>> com >>>>> .webobjects >>>>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java: >>>>> 1904) >>>>> >>>>> There are a lot of http threads in this state. There is one lock >>>>> for >>>>> every 4 >>>>> http threads waiting on it. >>>>> >>>>> Can any one explain what the above means? >>>> >>>> Are you dispatching requests concurrently? I am guessing the answer >>>> is >>>> no. Is your session timeout 30 minutes? It looks like a session >>>> is >>>> getting hung and blocking the app until it expires >>>> >>>> Chuck >>>> >>>> >>>> -- >>>> Chuck Hill Senior Consultant / VP Development >>>> >>>> Practical WebObjects - for developers who want to increase their >>>> overall knowledge of WebObjects or who are trying to solve specific >>>> problems. >>>> http://www.global-village.net/products/practical_webobjects >>>> >>>> >>>> >>>> >>>> >>>> >>>> _______________________________________________ >>>> WebObjects-dev mailing list >>>> WebObjects-dev@... >>>> http://www.omnigroup.com/mailman/listinfo/webobjects-dev >>>> >>>> >>> >>> -- >>> View this message in context: >>> http://www.nabble.com/WOSessionStore%24TimeoutEntry-tp18756956p18759318.html >>> Sent from the WebObjects-Dev mailing list archive at Nabble.com. >>> >>> _______________________________________________ >>> WebObjects-dev mailing list >>> WebObjects-dev@... >>> http://www.omnigroup.com/mailman/listinfo/webobjects-dev >>> >> >> -- >> Chuck Hill Senior Consultant / VP Development >> >> Practical WebObjects - for developers who want to increase their >> overall knowledge of WebObjects or who are trying to solve specific >> problems. >> http://www.global-village.net/products/practical_webobjects >> >> >> >> >> >> >> _______________________________________________ >> WebObjects-dev mailing list >> WebObjects-dev@... >> http://www.omnigroup.com/mailman/listinfo/webobjects-dev >> >> > > -- > View this message in context: http://www.nabble.com/WOSessionStore%24TimeoutEntry-tp18756956p18761699.html > Sent from the WebObjects-Dev mailing list archive at Nabble.com. > > _______________________________________________ > WebObjects-dev mailing list > WebObjects-dev@... > http://www.omnigroup.com/mailman/listinfo/webobjects-dev > -- Chuck Hill Senior Consultant / VP Development Practical WebObjects - for developers who want to increase their overall knowledge of WebObjects or who are trying to solve specific problems. http://www.global-village.net/products/practical_webobjects _______________________________________________ WebObjects-dev mailing list WebObjects-dev@... http://www.omnigroup.com/mailman/listinfo/webobjects-dev |
|
|
Re: WOSessionStore$TimeoutEntryHey Chuck, I definitely see that problem. In fact at that time, we took 8 thread dumps (I only posted one) and it was stuck in every one of them. But what confuses me is that that is the only time when the jvm froze up to where an EODatabaseContext was locked.
The jvm locks up once per day, and in the other thread dumps, there isn't that error. The only thing that is consistent is the threads that are locked show up with the WOSessionStore$Timeout
|
|
|
Re: WOSessionStore$TimeoutEntryI've seen things like that when you access the sessions editing
context from a different thread and that session is not checked out, but has an autolocking editing context that requires a request-response loop for unlocking. If that autolock triggers, the session will lockup with something that looks like a session store deadlock when it is checked out the next time and finds its editing context being locked. You might see something different, but at least it's worth thinking about it. On Fri, Aug 1, 2008 at 8:09 AM, Fred Larken <nosterdumbass@...> wrote: > > Hey Chuck, I definitely see that problem. In fact at that time, we took 8 > thread dumps (I only posted one) and it was stuck in every one of them. But > what confuses me is that that is the only time when the jvm froze up to > where an EODatabaseContext was locked. > > The jvm locks up once per day, and in the other thread dumps, there isn't > that error. The only thing that is consistent is the threads that are locked > show up with the WOSessionStore$Timeout > > > > Chuck Hill wrote: >> >> >> On Jul 31, 2008, at 12:25 PM, Fred Larken wrote: >> >>> >>> The thread dumps that do not show that trace of the WOSessionStore >>> look ok to >>> me. I don't see any deadlocks or other problems. I will post a dump >>> at the >>> bottom of this message. >> >> I see threads blocked in EOF. >> >> >>> So I guess our course of action to locate the problem, whether this >>> is a >>> symptom or the actual problem, would be to put debuggin info in the >>> awake, >>> sleep and terminate methods and maybe even stick the code in that >>> was posted >>> in that link? >> >> I don't think that will help. >> >> >>> Here is a dump, if you see something that could be the prob, let me >>> know: >> >>> Dumping JVM state. >>> Full thread dump Java HotSpot(TM) Server VM (1.5.0_15-b04 mixed mode): >>> >>> "Thread-450" daemon prio=1 tid=0x4a6b8998 nid=0x34fc waiting on >>> condition >>> [0x518bf000..0x518c0020] >>> at sun.misc.Unsafe.park(Native Method) >>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .acquireQueued(AbstractQueuedSynchronizer.java:746) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: >>> 1076) >>> at >>> java.util.concurrent.locks.ReentrantLock >>> $NonfairSync.lock(ReentrantLock.java:184) >>> at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: >>> 256) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) >>> at >>> com >>> .webobjects >>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: >>> 4650) >>> at >>> com >>> .webobjects >>> .eocontrol.EOCustomObject.willReadRelationship(EOCustomObject.java: >>> 1270) >> >> That ya go. Something in your code has locked the object store >> (EODatabaseContext), and not unlocked it. Either a long running >> thread (did not see this in the stack trace, but there are a lot of >> threads and I may have missed it) or something threw an exception that >> left it locked. >> >> Chuck >> >> >> >>> "http-20226-Processor50" daemon prio=1 tid=0x4ae120a8 nid=0x104d in >>> Object.wait() [0x4db6d000..0x4db6dfa0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x7b93e440> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0x7b93e440> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java: >>> 695) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> >>> >>> "http-20226-Processor49" daemon prio=1 tid=0x4ae11338 nid=0x104c >>> waiting on >>> condition [0x4dbed000..0x4dbef020] >>> at sun.misc.Unsafe.park(Native Method) >>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .acquireQueued(AbstractQueuedSynchronizer.java:746) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: >>> 1076) >>> at >>> java.util.concurrent.locks.ReentrantReadWriteLock >>> $NonfairSync.wlock(ReentrantReadWriteLock.java:342) >>> at >>> java.util.concurrent.locks.ReentrantReadWriteLock >>> $WriteLock.lock(ReentrantReadWriteLock.java:637) >>> at >>> com >>> .webobjects >>> .eocontrol.EOSharedEditingContext.lock(EOSharedEditingContext.java: >>> 736) >>> at >>> com >>> .webobjects >>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: >>> 4648) >>> at >>> com >>> .webobjects >>> .eocontrol.EOEditingContext.refaultObject(EOEditingContext.java:3984) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext._refaultObjectWithGlobalID(EOEditingContext.java: >>> 3243) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext >>> ._refaultLocalObjectWithGlobalID(EOEditingContext.java:3250) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext._refaultObjectsWithGlobalIDs(EOEditingContext.java: >>> 3275) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext._processObjectStoreChanges(EOEditingContext.java: >>> 3500) >>> at sun.reflect.GeneratedMethodAccessor471.invoke(Unknown Source) >>> at >>> sun >>> .reflect >>> .DelegatingMethodAccessorImpl >>> .invoke(DelegatingMethodAccessorImpl.java:25) >>> at java.lang.reflect.Method.invoke(Method.java:585) >>> at com.webobjects.foundation.NSSelector.invoke(NSSelector.java:358) >>> at >>> com >>> .webobjects >>> .foundation.NSSelector._safeInvokeSelector(NSSelector.java:110) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext._processNotificationQueue(EOEditingContext.java: >>> 4725) >>> at >>> com.webobjects.eocontrol.EOEditingContext.lock(EOEditingContext.java: >>> 4604) >>> at >>> com >>> .webobjects.eocontrol.EOEditingContext.tryLock(EOEditingContext.java: >>> 4616) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext._sendOrEnqueueNotification(EOEditingContext.java: >>> 4689) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext._objectsChangedInStore(EOEditingContext.java:3546) >>> at sun.reflect.GeneratedMethodAccessor470.invoke(Unknown Source) >>> at >>> sun >>> .reflect >>> .DelegatingMethodAccessorImpl >>> .invoke(DelegatingMethodAccessorImpl.java:25) >>> at java.lang.reflect.Method.invoke(Method.java:585) >>> at >>> com >>> .webobjects.foundation.NSSelector._safeInvokeMethod(NSSelector.java: >>> 122) >>> at >>> com.webobjects.foundation.NSNotificationCenter >>> $_Entry.invokeMethod(NSNotificationCenter.java:588) >>> at >>> com >>> .webobjects >>> .foundation >>> .NSNotificationCenter.postNotification(NSNotificationCenter.java:532) >>> at >>> com >>> .webobjects >>> .foundation >>> .NSNotificationCenter.postNotification(NSNotificationCenter.java:562) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOObjectStoreCoordinator >>> ._objectsChangedInSubStore(EOObjectStoreCoordinator.java:693) >>> at sun.reflect.GeneratedMethodAccessor712.invoke(Unknown Source) >>> at >>> sun >>> .reflect >>> .DelegatingMethodAccessorImpl >>> .invoke(DelegatingMethodAccessorImpl.java:25) >>> at java.lang.reflect.Method.invoke(Method.java:585) >>> at >>> com >>> .webobjects.foundation.NSSelector._safeInvokeMethod(NSSelector.java: >>> 122) >>> at >>> com.webobjects.foundation.NSNotificationCenter >>> $_Entry.invokeMethod(NSNotificationCenter.java:588) >>> at >>> com >>> .webobjects >>> .foundation >>> .NSNotificationCenter.postNotification(NSNotificationCenter.java:532) >>> at >>> com >>> .webobjects >>> .foundation >>> .NSNotificationCenter.postNotification(NSNotificationCenter.java:562) >>> at >>> com >>> .webobjects >>> .eoaccess >>> .EODatabaseContext >>> ._snapshotsChangedInDatabase(EODatabaseContext.java:3664) >>> at sun.reflect.GeneratedMethodAccessor710.invoke(Unknown Source) >>> at >>> sun >>> .reflect >>> .DelegatingMethodAccessorImpl >>> .invoke(DelegatingMethodAccessorImpl.java:25) >>> at java.lang.reflect.Method.invoke(Method.java:585) >>> at >>> com >>> .webobjects.foundation.NSSelector._safeInvokeMethod(NSSelector.java: >>> 122) >>> at >>> com.webobjects.foundation.NSNotificationCenter >>> $_Entry.invokeMethod(NSNotificationCenter.java:588) >>> at >>> com >>> .webobjects >>> .foundation >>> .NSNotificationCenter.postNotification(NSNotificationCenter.java:532) >>> at >>> com >>> .webobjects >>> .foundation >>> .NSNotificationCenter.postNotification(NSNotificationCenter.java:562) >>> at >>> com >>> .webobjects >>> .eoaccess.EODatabaseContext.commitChanges(EODatabaseContext.java:6418) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOObjectStoreCoordinator >>> .saveChangesInEditingContext(EOObjectStoreCoordinator.java:386) >>> at >>> com >>> .webobjects >>> .eocontrol.EOEditingContext.saveChanges(EOEditingContext.java:3176) >>> >>> "http-20226-Processor48" daemon prio=1 tid=0x4ae105c8 nid=0x104b in >>> Object.wait() [0x4dc6f000..0x4dc700a0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x7b93e440> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0x7b93e440> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java: >>> 695) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor47" daemon prio=1 tid=0x4ae0f858 nid=0x104a >>> runnable >>> [0x4dcf0000..0x4dcf1120] >>> at java.net.SocketInputStream.socketRead0(Native Method) >>> at java.net.SocketInputStream.read(SocketInputStream.java:129) >>> at >>> org >>> .apache >>> .coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:737) >>> at >>> org >>> .apache >>> .coyote >>> .http11 >>> .InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:398) >>> at >>> org >>> .apache.coyote.http11.Http11Processor.process(Http11Processor.java: >>> 827) >>> at >>> org.apache.coyote.http11.Http11BaseProtocol >>> $Http11ConnectionHandler.processConnection(Http11BaseProtocol.java: >>> 664) >>> at >>> org >>> .apache >>> .tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java: >>> 527) >>> at >>> org >>> .apache >>> .tomcat >>> .util >>> .net >>> .LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:684) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor46" daemon prio=1 tid=0x4ae0eae8 nid=0x1049 >>> waiting on >>> condition [0x4dd70000..0x4dd71da0] >>> at sun.misc.Unsafe.park(Native Method) >>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .acquireQueued(AbstractQueuedSynchronizer.java:746) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: >>> 1076) >>> at >>> java.util.concurrent.locks.ReentrantLock >>> $NonfairSync.lock(ReentrantLock.java:184) >>> at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: >>> 256) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) >>> at >>> com >>> .webobjects >>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: >>> 4650) >>> at >>> com >>> .webobjects >>> .eocontrol.EOCustomObject.willReadRelationship(EOCustomObject.java: >>> 1270) >>> at >>> com.webobjects.eocontrol._EOMutableKnownKeyDictionary$Initializer >>> $ >>> _LazyGenericRecordBinding >>> .valueInObject(_EOMutableKnownKeyDictionary.java:614) >>> at >>> com >>> .webobjects >>> .eocontrol.EOCustomObject.storedValueForKey(EOCustomObject.java:1634) >>> >>> "http-20226-Processor45" daemon prio=1 tid=0x4ae0ddb0 nid=0x1048 in >>> Object.wait() [0x4ddf2000..0x4ddf2e20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor44" daemon prio=1 tid=0x4ae03f58 nid=0x1047 in >>> Object.wait() [0x4de73000..0x4de73ea0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> >>> "http-20226-Processor43" daemon prio=1 tid=0x4ae02390 nid=0x1046 in >>> Object.wait() [0x4def4000..0x4def4f20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6eec6df0> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0x6eec6df0> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> >>> "http-20226-Processor42" daemon prio=1 tid=0x0841e560 nid=0x1045 in >>> Object.wait() [0x4df75000..0x4df75fa0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0xcd1b9410> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0xcd1b9410> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor41" daemon prio=1 tid=0x088eb1a0 nid=0x1044 in >>> Object.wait() [0x4dff6000..0x4dff7020] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0xcd1b9410> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0xcd1b9410> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor40" daemon prio=1 tid=0x088e8258 nid=0x1043 >>> waiting on >>> condition [0x4e076000..0x4e0780a0] >>> at sun.misc.Unsafe.park(Native Method) >>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .acquireQueued(AbstractQueuedSynchronizer.java:746) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: >>> 1076) >>> at >>> java.util.concurrent.locks.ReentrantLock >>> $NonfairSync.lock(ReentrantLock.java:184) >>> at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: >>> 256) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) >>> at >>> com >>> .webobjects >>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: >>> 4650) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext >>> .objectsWithFetchSpecification(EOEditingContext.java:4051) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext >>> .objectsWithFetchSpecification(EOEditingContext.java:4428) >>> >>> "http-20226-Processor39" daemon prio=1 tid=0x088e7318 nid=0x1042 >>> runnable >>> [0x4e0f8000..0x4e0f9120] >>> at java.net.PlainSocketImpl.socketAccept(Native Method) >>> at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) >>> - locked <0x687d18f0> (a java.net.SocksSocketImpl) >>> at java.net.ServerSocket.implAccept(ServerSocket.java:450) >>> at java.net.ServerSocket.accept(ServerSocket.java:421) >>> at >>> org >>> .apache >>> .tomcat >>> .util >>> .net >>> .DefaultServerSocketFactory >>> .acceptSocket(DefaultServerSocketFactory.java:60) >>> at >>> org >>> .apache >>> .tomcat.util.net.PoolTcpEndpoint.acceptSocket(PoolTcpEndpoint.java: >>> 407) >>> at >>> org >>> .apache >>> .tomcat >>> .util >>> .net >>> .LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:70) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:684) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor38" daemon prio=1 tid=0x088ec3e0 nid=0x1041 in >>> Object.wait() [0x4e179000..0x4e179da0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x916494d0> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x916494d0> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor37" daemon prio=1 tid=0x088eb500 nid=0x1040 in >>> Object.wait() [0x4e1fa000..0x4e1fae20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x916494b0> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x916494b0> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor36" daemon prio=1 tid=0x091a3938 nid=0x103f in >>> Object.wait() [0x4e27b000..0x4e27bea0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x91649490> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x91649490> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor35" daemon prio=1 tid=0x091a2b80 nid=0x103e in >>> Object.wait() [0x4e2fc000..0x4e2fcf20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x91649470> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x91649470> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor34" daemon prio=1 tid=0x0862cef8 nid=0x103d in >>> Object.wait() [0x4e37d000..0x4e37dfa0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x91649450> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x91649450> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor33" daemon prio=1 tid=0x0921f260 nid=0x103c in >>> Object.wait() [0x4e3fe000..0x4e3ff020] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x91649430> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x91649430> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor32" daemon prio=1 tid=0x0921e380 nid=0x103b in >>> Object.wait() [0x4e5fe000..0x4e5ff0a0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x91649410> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x91649410> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor31" daemon prio=1 tid=0x086c6b20 nid=0x103a in >>> Object.wait() [0x4e7c0000..0x4e7c1120] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x916493f0> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x916493f0> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor30" daemon prio=1 tid=0x086c5db8 nid=0x1039 in >>> Object.wait() [0x4e841000..0x4e841da0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x916493d0> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x916493d0> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor29" daemon prio=1 tid=0x08249350 nid=0x1038 in >>> Object.wait() [0x4e8c2000..0x4e8c2e20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x916493b0> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x916493b0> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor28" daemon prio=1 tid=0x082489d8 nid=0x1037 in >>> Object.wait() [0x4f9fe000..0x4f9feea0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x91649390> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x91649390> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor27" daemon prio=1 tid=0x09420140 nid=0x1036 in >>> Object.wait() [0x519fa000..0x519faf20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x91649370> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x91649370> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor26" daemon prio=1 tid=0x0941fd28 nid=0x1035 in >>> Object.wait() [0x51979000..0x51979fa0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x91649350> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x91649350> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Monitor" prio=1 tid=0x51c30138 nid=0x595 in Object.wait() >>> [0x51a7b000..0x51a7c020] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6e6b48e8> (a >>> org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $MonitorRunnable.run(ThreadPool.java:559) >>> - locked <0x6e6b48e8> (a >>> org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor25" daemon prio=1 tid=0x51c2f440 nid=0x594 in >>> Object.wait() [0x51afc000..0x51afd0a0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java: >>> 695) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor24" daemon prio=1 tid=0x52321880 nid=0x593 in >>> Object.wait() [0x51b7d000..0x51b7e120] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0xaaede7d8> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0xaaede7d8> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor23" daemon prio=1 tid=0x52320b70 nid=0x592 in >>> Object.wait() [0x51bfe000..0x51bfeda0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor22" daemon prio=1 tid=0x521d5e90 nid=0x591 >>> waiting on >>> condition [0x51ffd000..0x51ffee20] >>> at sun.misc.Unsafe.park(Native Method) >>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .acquireQueued(AbstractQueuedSynchronizer.java:746) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: >>> 1076) >>> at >>> java.util.concurrent.locks.ReentrantLock >>> $NonfairSync.lock(ReentrantLock.java:184) >>> at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: >>> 256) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) >>> at >>> com >>> .webobjects >>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: >>> 4650) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext >>> .objectsWithFetchSpecification(EOEditingContext.java:4051) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext >>> .objectsWithFetchSpecification(EOEditingContext.java:4428) >>> >>> "http-20226-Processor21" daemon prio=1 tid=0x521d52a0 nid=0x590 in >>> Object.wait() [0x524fe000..0x524feea0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor20" daemon prio=1 tid=0x52b03bf0 nid=0x58f in >>> Object.wait() [0x52afe000..0x52afef20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0xcd1b9410> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0xcd1b9410> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor19" daemon prio=1 tid=0x52695fb0 nid=0x58e in >>> Object.wait() [0x52cfe000..0x52cfefa0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0xaaede7d8> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0xaaede7d8> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor18" daemon prio=1 tid=0x52b37c50 nid=0x58d >>> waiting on >>> condition [0x530fd000..0x530ff020] >>> at sun.misc.Unsafe.park(Native Method) >>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .acquireQueued(AbstractQueuedSynchronizer.java:746) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: >>> 1076) >>> at >>> java.util.concurrent.locks.ReentrantLock >>> $NonfairSync.lock(ReentrantLock.java:184) >>> at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: >>> 256) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) >>> at >>> com >>> .webobjects >>> .eoaccess >>> .EODatabaseContext >>> .registeredDatabaseContextForModel(EODatabaseContext.java:999) >>> at >>> com >>> .webobjects >>> .eoaccess >>> .EODatabaseContext >>> .registeredDatabaseContextForModel(EODatabaseContext.java:1033) >>> at >>> com >>> .webobjects >>> .eoaccess.EOUtilities.databaseContextForModelNamed(EOUtilities.java: >>> 814) >>> at >>> com.webobjects.eoaccess.EOUtilities.rawRowsForSQL(EOUtilities.java: >>> 585) >>> >>> "http-20226-Processor17" daemon prio=1 tid=0x526c1980 nid=0x58c in >>> Object.wait() [0x532bb000..0x532bc0a0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0xcd1b9410> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0xcd1b9410> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor16" daemon prio=1 tid=0x4fa0f908 nid=0x58b in >>> Object.wait() [0x538e2000..0x538e3120] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor15" daemon prio=1 tid=0x4fa0f780 nid=0x58a in >>> Object.wait() [0x53963000..0x53963da0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0xaaede7d8> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0xaaede7d8> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor14" daemon prio=1 tid=0x52b74250 nid=0x589 in >>> Object.wait() [0x539e4000..0x539e4e20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0xcd1b9410> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0xcd1b9410> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor13" daemon prio=1 tid=0x521be938 nid=0x588 in >>> Object.wait() [0x53a65000..0x53a65ea0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6ea04b80> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x6ea04b80> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor12" daemon prio=1 tid=0x52b13970 nid=0x587 >>> waiting on >>> condition [0x53ae5000..0x53ae6f20] >>> at sun.misc.Unsafe.park(Native Method) >>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .acquireQueued(AbstractQueuedSynchronizer.java:746) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: >>> 1076) >>> at >>> java.util.concurrent.locks.ReentrantReadWriteLock >>> $NonfairSync.wlock(ReentrantReadWriteLock.java:342) >>> at >>> java.util.concurrent.locks.ReentrantReadWriteLock >>> $WriteLock.lock(ReentrantReadWriteLock.java:637) >>> at >>> com >>> .webobjects >>> .eocontrol.EOSharedEditingContext.lock(EOSharedEditingContext.java: >>> 736) >>> at >>> com >>> .webobjects >>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: >>> 4648) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext >>> .objectsWithFetchSpecification(EOEditingContext.java:4051) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext >>> .objectsWithFetchSpecification(EOEditingContext.java:4428) >>> >>> "http-20226-Processor11" daemon prio=1 tid=0x52b740c8 nid=0x586 in >>> Object.wait() [0x53b67000..0x53b67fa0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0xcd1b9410> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0xcd1b9410> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor10" daemon prio=1 tid=0x52387828 nid=0x585 >>> runnable >>> [0x53be8000..0x53be9020] >>> at java.net.SocketInputStream.socketRead0(Native Method) >>> at java.net.SocketInputStream.read(SocketInputStream.java:129) >>> at >>> org >>> .apache >>> .coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:737) >>> at >>> org >>> .apache >>> .coyote >>> .http11 >>> .InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:398) >>> at >>> org >>> .apache.coyote.http11.Http11Processor.process(Http11Processor.java: >>> 827) >>> at >>> org.apache.coyote.http11.Http11BaseProtocol >>> $Http11ConnectionHandler.processConnection(Http11BaseProtocol.java: >>> 664) >>> at >>> org >>> .apache >>> .tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java: >>> 527) >>> at >>> org >>> .apache >>> .tomcat >>> .util >>> .net >>> .LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:684) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor9" daemon prio=1 tid=0x523876a0 nid=0x584 in >>> Object.wait() [0x53c69000..0x53c6a0a0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x7b93e440> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0x7b93e440> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java: >>> 695) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor8" daemon prio=1 tid=0x521f67f0 nid=0x583 in >>> Object.wait() [0x53cea000..0x53ceb120] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0xaaede7d8> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0xaaede7d8> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> >>> "http-20226-Processor7" daemon prio=1 tid=0x521f9ed0 nid=0x582 >>> waiting on >>> condition [0x53de7000..0x53de8da0] >>> at sun.misc.Unsafe.park(Native Method) >>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .acquireQueued(AbstractQueuedSynchronizer.java:746) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: >>> 1076) >>> at >>> java.util.concurrent.locks.ReentrantLock >>> $NonfairSync.lock(ReentrantLock.java:184) >>> at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: >>> 256) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) >>> at >>> com >>> .webobjects >>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: >>> 4650) >>> at >>> com >>> .webobjects >>> .eocontrol.EOCustomObject.willReadRelationship(EOCustomObject.java: >>> 1270) >>> at >>> com.webobjects.eocontrol._EOMutableKnownKeyDictionary$Initializer >>> $ >>> _LazyGenericRecordBinding >>> .valueInObject(_EOMutableKnownKeyDictionary.java:614) >>> at >>> com >>> .webobjects >>> .eocontrol.EOCustomObject.storedValueForKey(EOCustomObject.java:1634) >>> >>> "http-20226-Processor6" daemon prio=1 tid=0x52356090 nid=0x581 in >>> Object.wait() [0x53e69000..0x53e69e20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor5" daemon prio=1 tid=0x52356ff0 nid=0x580 >>> waiting on >>> condition [0x53ee9000..0x53eeaea0] >>> at sun.misc.Unsafe.park(Native Method) >>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .acquireQueued(AbstractQueuedSynchronizer.java:746) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: >>> 1076) >>> at >>> java.util.concurrent.locks.ReentrantReadWriteLock >>> $NonfairSync.wlock(ReentrantReadWriteLock.java:342) >>> at >>> java.util.concurrent.locks.ReentrantReadWriteLock >>> $WriteLock.lock(ReentrantReadWriteLock.java:637) >>> at >>> com >>> .webobjects >>> .eocontrol.EOSharedEditingContext.lock(EOSharedEditingContext.java: >>> 736) >>> at >>> com >>> .webobjects >>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: >>> 4648) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext >>> .objectsWithFetchSpecification(EOEditingContext.java:4051) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext >>> .objectsWithFetchSpecification(EOEditingContext.java:4428) >>> >>> "http-20226-Processor4" daemon prio=1 tid=0x52691360 nid=0x57f >>> waiting on >>> condition [0x53f6a000..0x53f6bf20] >>> at sun.misc.Unsafe.park(Native Method) >>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .acquireQueued(AbstractQueuedSynchronizer.java:746) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: >>> 1076) >>> at >>> java.util.concurrent.locks.ReentrantLock >>> $NonfairSync.lock(ReentrantLock.java:184) >>> at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: >>> 256) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) >>> at >>> com >>> .webobjects >>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: >>> 4650) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext >>> .objectsWithFetchSpecification(EOEditingContext.java:4051) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext >>> .objectsWithFetchSpecification(EOEditingContext.java:4428) >>> >>> "http-20226-Processor3" daemon prio=1 tid=0x5262eba8 nid=0x57e >>> waiting on >>> condition [0x53feb000..0x53fecfa0] >>> at sun.misc.Unsafe.park(Native Method) >>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .acquireQueued(AbstractQueuedSynchronizer.java:746) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: >>> 1076) >>> at >>> java.util.concurrent.locks.ReentrantReadWriteLock >>> $NonfairSync.wlock(ReentrantReadWriteLock.java:342) >>> at >>> java.util.concurrent.locks.ReentrantReadWriteLock >>> $WriteLock.lock(ReentrantReadWriteLock.java:637) >>> at >>> com >>> .webobjects >>> .eocontrol.EOSharedEditingContext.lock(EOSharedEditingContext.java: >>> 736) >>> at >>> com >>> .webobjects >>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: >>> 4648) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext >>> .objectsWithFetchSpecification(EOEditingContext.java:4051) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext >>> .objectsWithFetchSpecification(EOEditingContext.java:4428) >>> >>> "http-20226-Processor2" daemon prio=1 tid=0x52b744e0 nid=0x57d >>> waiting on >>> condition [0x5406c000..0x5406e020] >>> at sun.misc.Unsafe.park(Native Method) >>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .acquireQueued(AbstractQueuedSynchronizer.java:746) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: >>> 1076) >>> at >>> java.util.concurrent.locks.ReentrantLock >>> $NonfairSync.lock(ReentrantLock.java:184) >>> at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: >>> 256) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) >>> at >>> com >>> .webobjects >>> .eoaccess >>> .EODatabaseContext >>> .registeredDatabaseContextForModel(EODatabaseContext.java:999) >>> at >>> com >>> .webobjects >>> .eoaccess >>> .EODatabaseContext >>> .registeredDatabaseContextForModel(EODatabaseContext.java:1033) >>> at >>> com >>> .webobjects >>> .eoaccess.EOUtilities.databaseContextForModelNamed(EOUtilities.java: >>> 814) >>> at >>> com.webobjects.eoaccess.EOUtilities.rawRowsForSQL(EOUtilities.java: >>> 585) >>> >>> "http-20226-Processor1" daemon prio=1 tid=0x52ba7b78 nid=0x57c in >>> Object.wait() [0x5333c000..0x5333d0a0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x7b93e440> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0x7b93e440> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java: >>> 695) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon prio=1 >>> tid=0x52321f80 nid=0x57b waiting on condition [0x54102000..0x54102120] >>> at java.lang.Thread.sleep(Native Method) >>> at >>> org.apache.catalina.core.ContainerBase >>> $ContainerBackgroundProcessor.run(ContainerBase.java:1547) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "Timer-2" prio=1 tid=0x52b74a20 nid=0x574 in Object.wait() >>> [0x54182000..0x54182f20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6d201840> (a java.util.TaskQueue) >>> at java.util.TimerThread.mainLoop(Timer.java:509) >>> - locked <0x6d201840> (a java.util.TaskQueue) >>> at java.util.TimerThread.run(Timer.java:462) >>> >>> "Timer-1" prio=1 tid=0x4fa0fb18 nid=0x573 in Object.wait() >>> [0x54203000..0x54203fa0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6d2018c8> (a java.util.TaskQueue) >>> at java.util.TimerThread.mainLoop(Timer.java:509) >>> - locked <0x6d2018c8> (a java.util.TaskQueue) >>> at java.util.TimerThread.run(Timer.java:462) >>> >>> "Thread-8" prio=1 tid=0x090e20e0 nid=0x56e waiting on condition >>> [0x54284000..0x54285020] >>> at java.lang.Thread.sleep(Native Method) >>> at >>> com >>> .XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX >>> .client.beans.Timer.run(Timer.java:110) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "PoolManagerCleanup-20012302" daemon prio=1 tid=0x52357328 nid=0x560 >>> waiting >>> on condition [0x54dfd000..0x54dfd120] >>> at java.lang.Thread.sleep(Native Method) >>> at >>> org.apache.cayenne.conn.PoolManager >>> $PoolMaintenanceThread.run(PoolManager.java:522) >>> >>> "EventDispatchThread-1" daemon prio=1 tid=0x5230da30 nid=0x55f in >>> Object.wait() [0x54e7d000..0x54e7dda0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6c18b350> (a java.util.Collections$SynchronizedList) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.cayenne.event.EventManager >>> $DispatchThread.run(EventManager.java:450) >>> - locked <0x6c18b350> (a java.util.Collections$SynchronizedList) >>> >>> "EventDispatchThread-0" daemon prio=1 tid=0x51c12b20 nid=0x55e in >>> Object.wait() [0x54efe000..0x54efee20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6c18b350> (a java.util.Collections$SynchronizedList) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.cayenne.event.EventManager >>> $DispatchThread.run(EventManager.java:450) >>> - locked <0x6c18b350> (a java.util.Collections$SynchronizedList) >>> >>> "EventDispatchThread-4" daemon prio=1 tid=0x52654e70 nid=0x55d in >>> Object.wait() [0x54305000..0x54305ea0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.cayenne.event.EventManager >>> $DispatchThread.run(EventManager.java:450) >>> - locked <0x6c133f48> (a java.util.Collections$SynchronizedList) >>> >>> "EventDispatchThread-3" daemon prio=1 tid=0x52bd8860 nid=0x55c in >>> Object.wait() [0x54386000..0x54386f20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.cayenne.event.EventManager >>> $DispatchThread.run(EventManager.java:450) >>> - locked <0x6c133f48> (a java.util.Collections$SynchronizedList) >>> >>> "EventDispatchThread-2" daemon prio=1 tid=0x526f6880 nid=0x55b in >>> Object.wait() [0x54407000..0x54407fa0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.cayenne.event.EventManager >>> $DispatchThread.run(EventManager.java:450) >>> - locked <0x6c133f48> (a java.util.Collections$SynchronizedList) >>> >>> "EventDispatchThread-1" daemon prio=1 tid=0x52ba5c08 nid=0x55a in >>> Object.wait() [0x54ba3000..0x54ba4020] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.cayenne.event.EventManager >>> $DispatchThread.run(EventManager.java:450) >>> - locked <0x6c133f48> (a java.util.Collections$SynchronizedList) >>> >>> "EventDispatchThread-0" daemon prio=1 tid=0x51c1af80 nid=0x559 in >>> Object.wait() [0x55dc2000..0x55dc30a0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.cayenne.event.EventManager >>> $DispatchThread.run(EventManager.java:450) >>> - locked <0x6c133f48> (a java.util.Collections$SynchronizedList) >>> >>> "PoolManagerCleanup-18771651" daemon prio=1 tid=0x52bd8c68 nid=0x558 >>> waiting >>> on condition [0x55ec5000..0x55ec5120] >>> at java.lang.Thread.sleep(Native Method) >>> at >>> org.apache.cayenne.conn.PoolManager >>> $PoolMaintenanceThread.run(PoolManager.java:522) >>> >>> "WrapperStartStopAppMain" prio=1 tid=0x0819d920 nid=0x534 runnable >>> [0x55d41000..0x55d41fa0] >>> at java.net.PlainSocketImpl.socketAccept(Native Method) >>> at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) >>> - locked <0x6e9a3098> (a java.net.SocksSocketImpl) >>> at java.net.ServerSocket.implAccept(ServerSocket.java:450) >>> at java.net.ServerSocket.accept(ServerSocket.java:421) >>> at >>> org.apache.catalina.core.StandardServer.await(StandardServer.java:388) >>> at org.apache.catalina.startup.Catalina.await(Catalina.java:615) >>> at org.apache.catalina.startup.Catalina.start(Catalina.java:575) >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>> at >>> sun >>> .reflect >>> .NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) >>> at >>> sun >>> .reflect >>> .DelegatingMethodAccessorImpl >>> .invoke(DelegatingMethodAccessorImpl.java:25) >>> at java.lang.reflect.Method.invoke(Method.java:585) >>> at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:294) >>> at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:432) >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>> at >>> sun >>> .reflect >>> .NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) >>> at >>> sun >>> .reflect >>> .DelegatingMethodAccessorImpl >>> .invoke(DelegatingMethodAccessorImpl.java:25) >>> at java.lang.reflect.Method.invoke(Method.java:585) >>> at >>> org >>> .tanukisoftware >>> .wrapper.WrapperStartStopApp.run(WrapperStartStopApp.java:238) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "DestroyJavaVM" prio=1 tid=0x568d5eb8 nid=0x51c waiting on condition >>> [0x00000000..0xffff9190] >>> >>> "Wrapper-Connection" daemon prio=1 tid=0x568ae0e8 nid=0x532 runnable >>> [0x55e43000..0x55e440a0] >>> at java.net.SocketInputStream.socketRead0(Native Method) >>> at java.net.SocketInputStream.read(SocketInputStream.java:129) >>> at java.net.SocketInputStream.read(SocketInputStream.java:182) >>> at java.io.DataInputStream.readByte(DataInputStream.java:241) >>> at >>> org >>> .tanukisoftware >>> .wrapper.WrapperManager.handleSocket(WrapperManager.java:3737) >>> at >>> org.tanukisoftware.wrapper.WrapperManager.run(WrapperManager.java: >>> 4084) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "Wrapper-Control-Event-Monitor" daemon prio=1 tid=0x568ac820 nid=0x530 >>> sleeping[0x55f45000..0x55f45da0] >>> at java.lang.Thread.sleep(Native Method) >>> at org.tanukisoftware.wrapper.WrapperManager >>> $3.run(WrapperManager.java:731) >>> >>> "RMI TCP Accept-0" daemon prio=1 tid=0x5689e660 nid=0x52e runnable >>> [0x5604a000..0x5604aea0] >>> at java.net.PlainSocketImpl.socketAccept(Native Method) >>> at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) >>> - locked <0x68888648> (a java.net.SocksSocketImpl) >>> at java.net.ServerSocket.implAccept(ServerSocket.java:450) >>> at java.net.ServerSocket.accept(ServerSocket.java:421) >>> at sun.rmi.transport.tcp.TCPTransport.run(TCPTransport.java:340) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "Timer-0" daemon prio=1 tid=0x5689e158 nid=0x52d in Object.wait() >>> [0x560cb000..0x560cbf20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6a979aa8> (a java.util.TaskQueue) >>> at java.lang.Object.wait(Object.java:474) >>> at java.util.TimerThread.mainLoop(Timer.java:483) >>> - locked <0x6a979aa8> (a java.util.TaskQueue) >>> at java.util.TimerThread.run(Timer.java:462) >>> >>> "Low Memory Detector" daemon prio=1 tid=0x08149ee0 nid=0x52c runnable >>> [0x00000000..0x00000000] >>> >>> "CompilerThread1" daemon prio=1 tid=0x08148a60 nid=0x52b waiting on >>> condition [0x00000000..0x56b01248] >>> >>> "CompilerThread0" daemon prio=1 tid=0x08147a08 nid=0x52a waiting on >>> condition [0x00000000..0x56b822c8] >>> >>> "AdapterThread" daemon prio=1 tid=0x081468d0 nid=0x529 waiting on >>> condition >>> [0x00000000..0x00000000] >>> >>> "Signal Dispatcher" daemon prio=1 tid=0x08145b00 nid=0x528 waiting on >>> condition [0x00000000..0x00000000] >>> >>> "Finalizer" daemon prio=1 tid=0x0813b348 nid=0x527 in Object.wait() >>> [0x56f05000..0x56f05e20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x68958b38> (a java.lang.ref.ReferenceQueue$Lock) >>> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:120) >>> - locked <0x68958b38> (a java.lang.ref.ReferenceQueue$Lock) >>> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:136) >>> at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159) >>> >>> "Reference Handler" daemon prio=1 tid=0x0813ae20 nid=0x526 in >>> Object.wait() >>> [0x56f86000..0x56f86ea0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6a97a128> (a java.lang.ref.Reference$Lock) >>> at java.lang.Object.wait(Object.java:474) >>> at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116) >>> - locked <0x6a97a128> (a java.lang.ref.Reference$Lock) >>> >>> "VM Thread" prio=1 tid=0x081388d8 nid=0x525 runnable >>> >>> "GC task thread#0 (ParallelGC)" prio=1 tid=0x0807a548 nid=0x51d >>> runnable >>> >>> "GC task thread#1 (ParallelGC)" prio=1 tid=0x0807b5a0 nid=0x51e >>> runnable >>> >>> "GC task thread#2 (ParallelGC)" prio=1 tid=0x0807c1b8 nid=0x51f >>> runnable >>> >>> "GC task thread#3 (ParallelGC)" prio=1 tid=0x0807cdd8 nid=0x520 >>> runnable >>> >>> "GC task thread#4 (ParallelGC)" prio=1 tid=0x0807da10 nid=0x521 >>> runnable >>> >>> "GC task thread#5 (ParallelGC)" prio=1 tid=0x0807e648 nid=0x522 >>> runnable >>> >>> "GC task thread#6 (ParallelGC)" prio=1 tid=0x0807f280 nid=0x523 >>> runnable >>> >>> "GC task thread#7 (ParallelGC)" prio=1 tid=0x0807feb8 nid=0x524 >>> runnable >>> >>> "VM Periodic Task Thread" prio=1 tid=0x568a7868 nid=0x52f waiting on >>> condition >>> >>> Jul 30, 2008 5:30:24 PM org.apache.catalina.core.ApplicationContext >>> log >>> INFO: HTMLManager: list: Listing contexts for virtual host 'localhost' >>> [GC 1968661K->1868524K(2111040K), 0.0176210 secs] >>> Dumping JVM state. >>> Full thread dump Java HotSpot(TM) Server VM (1.5.0_15-b04 mixed mode): >>> >>> >>> >>> Chuck Hill wrote: >>>> >>>> >>>> On Jul 31, 2008, at 10:16 AM, Fred Larken wrote: >>>> >>>>> >>>>> Yes, we are setting this in the code: >>>>> setAllowsConcurrentRequestHandling(true); >>>> >>>> The trace below is probably a symptom then, not the cause. >>>> >>>>> The session timeout is set to 30 minutes. >>>>> >>>>> How do I find out why a session is hung, or how to fix this? >>>> >>>> Check the the thread dumps that don't show this trace. >>>> >>>> Check that session's sleep() and terminate() methods can't throw. >>>> Check awake too for good measure. >>>> >>>> >>>>> I saw one post that said something about adding code to your >>>>> Application.java >>>>> Is this the correct way to fix it, or is this problem just a >>>>> result of >>>>> something else happening? >>>>> http://www.mail-archive.com/webobjects-dev@.../msg09497.html >>>>> http://www.mail-archive.com/webobjects-dev@.../msg09497.html >>>> >>>> You could try this if nothing else pans out. >>>> >>>> >>>> Chuck >>>> >>>> >>>>>> >>>>>> >>>>>> On Jul 31, 2008, at 9:52 AM, Fred Larken wrote: >>>>>> >>>>>>> >>>>>>> we have a linux server running our web objects app. After a day, >>>>>>> the >>>>>>> system >>>>>>> locks up for 30 mins. It will self-recoverbut in the mean time, >>>>>>> nobody can >>>>>>> log in or use the app. I have seen thread dumps during this period >>>>>>> and I >>>>>>> have noticed the following trace: >>>>>>> >>>>>>> >>>>>>> "http-20226-Processor24" daemon prio=1 tid=0x52321880 nid=0x593 in >>>>>>> Object.wait() [0x51b7d000..0x51b7e120] >>>>>>> at java.lang.Object.wait(Native Method) >>>>>>> - waiting on <0xaaede7d8> (a >>>>>>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>>>>>> at java.lang.Object.wait(Object.java:474) >>>>>>> at >>>>>>> com >>>>>>> .webobjects >>>>>>> .appserver >>>>>>> .WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>>>>>> 191) >>>>>>> - locked <0xaaede7d8> (a >>>>>>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>>>>>> at >>>>>>> com >>>>>>> .webobjects >>>>>>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java: >>>>>>> 1904) >>>>>>> >>>>>>> There are a lot of http threads in this state. There is one lock >>>>>>> for >>>>>>> every 4 >>>>>>> http threads waiting on it. >>>>>>> >>>>>>> Can any one explain what the above means? >>>>>> >>>>>> Are you dispatching requests concurrently? I am guessing the answer >>>>>> is >>>>>> no. Is your session timeout 30 minutes? It looks like a session >>>>>> is >>>>>> getting hung and blocking the app until it expires >>>>>> >>>>>> Chuck >>>>>> >>>>>> >>>>>> -- >>>>>> Chuck Hill Senior Consultant / VP Development >>>>>> >>>>>> Practical WebObjects - for developers who want to increase their >>>>>> overall knowledge of WebObjects or who are trying to solve specific >>>>>> problems. >>>>>> http://www.global-village.net/products/practical_webobjects >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> WebObjects-dev mailing list >>>>>> WebObjects-dev@... >>>>>> http://www.omnigroup.com/mailman/listinfo/webobjects-dev >>>>>> >>>>>> >>>>> >>>>> -- >>>>> View this message in context: >>>>> http://www.nabble.com/WOSessionStore%24TimeoutEntry-tp18756956p18759318.html >>>>> Sent from the WebObjects-Dev mailing list archive at Nabble.com. >>>>> >>>>> _______________________________________________ >>>>> WebObjects-dev mailing list >>>>> WebObjects-dev@... >>>>> http://www.omnigroup.com/mailman/listinfo/webobjects-dev >>>>> >>>> >>>> -- >>>> Chuck Hill Senior Consultant / VP Development >>>> >>>> Practical WebObjects - for developers who want to increase their >>>> overall knowledge of WebObjects or who are trying to solve specific >>>> problems. >>>> http://www.global-village.net/products/practical_webobjects >>>> >>>> >>>> >>>> >>>> >>>> >>>> _______________________________________________ >>>> WebObjects-dev mailing list >>>> WebObjects-dev@... >>>> http://www.omnigroup.com/mailman/listinfo/webobjects-dev >>>> >>>> >>> >>> -- >>> View this message in context: >>> http://www.nabble.com/WOSessionStore%24TimeoutEntry-tp18756956p18761699.html >>> Sent from the WebObjects-Dev mailing list archive at Nabble.com. >>> >>> _______________________________________________ >>> WebObjects-dev mailing list >>> WebObjects-dev@... >>> http://www.omnigroup.com/mailman/listinfo/webobjects-dev >>> >> >> -- >> Chuck Hill Senior Consultant / VP Development >> >> Practical WebObjects - for developers who want to increase their >> overall knowledge of WebObjects or who are trying to solve specific >> problems. >> http://www.global-village.net/products/practical_webobjects >> >> >> >> >> >> >> _______________________________________________ >> WebObjects-dev mailing list >> WebObjects-dev@... >> http://www.omnigroup.com/mailman/listinfo/webobjects-dev >> >> > > -- > View this message in context: http://www.nabble.com/WOSessionStore%24TimeoutEntry-tp18756956p18775137.html > Sent from the WebObjects-Dev mailing list archive at Nabble.com. > > _______________________________________________ > WebObjects-dev mailing list > WebObjects-dev@... > http://www.omnigroup.com/mailman/listinfo/webobjects-dev > WebObjects-dev mailing list WebObjects-dev@... http://www.omnigroup.com/mailman/listinfo/webobjects-dev |
| Free embeddable forum powered by Nabble | Forum Help |