|

»

"Document id and proxy id differ" error message

View: New views

8 Messages — Rating Filter: Alert me

	"Document id and proxy id differ" error message by andrew.harwood :: Rate this Message: Reply to Author \| View Threaded \| Show Only this Message We are running the 1.4RC version of exist. We have a python script that re-loads the exist database with content from a postgres database overnight. It has occasionally failed, but has always been 'fixed' by either re-running the script, re-generating the exist index files, or (as a last measure) completely removing all the exist database files and starting from scratch. However, now it has stopped working and nothing I do will get it working again. The script does not always fail in the same place. However, most times it generates a 'document id and proxy id differ' error message. I have included below the relevant section of the exist.log file, plus the output generated by the script for the latest failure. Regards, Andrew Exist.log output ================ 2009-10-21 01:47:26,313 [P1-8] DEBUG (AtomProtocol.java [doPost]:219) - Adding entry to /db/atoms/published/deployment_data/ 2009-10-21 01:47:26,324 [P1-8] DEBUG (AtomProtocol.java [doPost]:248) - Acquiring lock on feed document... 2009-10-21 01:47:26,324 [P1-8] DEBUG (Collection.java [getDocument]:524) - Document 0e8a6dcc-9804-47ef-a324-25485d7f8304.entry.atom not found! 2009-10-21 01:47:26,325 [P1-8] DEBUG (Collection.java [validateXMLResourceInternal]:1200) - Scanning document /db/atoms/published/deployment_data/.feed.entry/0e8a6dcc-9804-47ef-a324- 25485d7f8304.entry.atom 2009-10-21 01:47:26,325 [P1-7] DEBUG (NativeBroker.java [getOrCreateCollection]:626) - Creating collection '/db/system/temp'... 2009-10-21 01:47:26,325 [P1-8] DEBUG (Collection.java [storeXMLInternal]:1018) - storing document 459 ... 2009-10-21 01:47:26,326 [P1-8] ERROR (AtomServlet.java [service]:464) - Document id ('18343') and proxy id ('459') differ ! java.lang.IllegalArgumentException: Document id ('18343') and proxy id ('459') differ ! at org.exist.storage.NativeElementIndex.flush(NativeElementIndex.java:223) at org.exist.storage.NativeBroker.notifyFlush(NativeBroker.java:340) at org.exist.storage.NativeBroker.flush(NativeBroker.java:3130) at org.exist.collections.Collection.storeXMLInternal(Collection.java:1028) at org.exist.collections.Collection.store(Collection.java:994) at org.exist.atom.modules.AtomProtocol.doPost(AtomProtocol.java:266) at org.exist.atom.modules.AtomModuleBase.process(AtomModuleBase.java:55) at org.exist.atom.http.AtomServlet.service(AtomServlet.java:445) at javax.servlet.http.HttpServlet.service(HttpServlet.java:856) at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:428) at org.mortbay.jetty.servlet.WebApplicationHandler$CachedChain.doFilter(Web ApplicationHandler.java:830) at org.exist.http.urlrewrite.PassThrough.doRewrite(PassThrough.java:44) at org.exist.http.urlrewrite.XQueryURLRewrite.doFilter(XQueryURLRewrite.jav a:321) at org.mortbay.jetty.servlet.WebApplicationHandler$CachedChain.doFilter(Web ApplicationHandler.java:821) at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationH andler.java:471) at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:568) at org.mortbay.http.HttpContext.handle(HttpContext.java:1530) at org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationCon text.java:633) at org.mortbay.http.HttpContext.handle(HttpContext.java:1482) at org.mortbay.http.HttpServer.service(HttpServer.java:909) at org.mortbay.http.HttpConnection.service(HttpConnection.java:820) at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:986) at org.mortbay.http.HttpConnection.handle(HttpConnection.java:837) at org.mortbay.http.SocketListener.handleConnection(SocketListener.java:245 ) at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357) at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534) 2009-10-21 01:47:26,326 [P1-7] WARN (NativeBroker.java [storeTempResource]:1520) - Failed to store temporary fragment: Document id ('18343') and proxy id ('459') differ ! java.lang.IllegalArgumentException: Document id ('18343') and proxy id ('459') differ ! at org.exist.storage.NativeElementIndex.flush(NativeElementIndex.java:223) at org.exist.storage.NativeBroker.notifyFlush(NativeBroker.java:340) at org.exist.storage.NativeBroker.flush(NativeBroker.java:3130) at org.exist.storage.NativeBroker.storeTempResource(NativeBroker.java:1510) at org.exist.xquery.XQueryContext.storeTemporaryDoc(XQueryContext.java:2459 ) at org.exist.memtree.DocumentImpl.makePersistent(DocumentImpl.java:1208) at org.exist.xquery.value.ValueSequence.toNodeSet(ValueSequence.java:233) at org.exist.xmlrpc.RpcConnection.summary(RpcConnection.java:3812) at org.exist.xmlrpc.RpcConnection.querySummary(RpcConnection.java:4609) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor Impl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.xmlrpc.server.ReflectiveXmlRpcHandler.invoke(ReflectiveXmlRpc Handler.java:115) at org.apache.xmlrpc.server.ReflectiveXmlRpcHandler.execute(ReflectiveXmlRp cHandler.java:106) at org.apache.xmlrpc.server.XmlRpcServerWorker.execute(XmlRpcServerWorker.j ava:46) at org.apache.xmlrpc.server.XmlRpcServer.execute(XmlRpcServer.java:86) at org.apache.xmlrpc.server.XmlRpcStreamServer.execute(XmlRpcStreamServer.j ava:200) at org.apache.xmlrpc.webserver.XmlRpcServletServer.execute(XmlRpcServletSer ver.java:112) at org.apache.xmlrpc.webserver.XmlRpcServlet.doPost(XmlRpcServlet.java:196) at org.exist.xmlrpc.RpcServlet.doPost(RpcServlet.java:57) at javax.servlet.http.HttpServlet.service(HttpServlet.java:763) at javax.servlet.http.HttpServlet.service(HttpServlet.java:856) at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:428) at org.mortbay.jetty.servlet.WebApplicationHandler$CachedChain.doFilter(Web ApplicationHandler.java:830) at org.exist.http.urlrewrite.PassThrough.doRewrite(PassThrough.java:44) at org.exist.http.urlrewrite.XQueryURLRewrite.doFilter(XQueryURLRewrite.jav a:321) at org.mortbay.jetty.servlet.WebApplicationHandler$CachedChain.doFilter(Web ApplicationHandler.java:821) at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationH andler.java:471) at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:568) at org.mortbay.http.HttpContext.handle(HttpContext.java:1530) at org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationCon text.java:633) at org.mortbay.http.HttpContext.handle(HttpContext.java:1482) at org.mortbay.http.HttpServer.service(HttpServer.java:909) at org.mortbay.http.HttpConnection.service(HttpConnection.java:820) at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:986) at org.mortbay.http.HttpConnection.handle(HttpConnection.java:837) at org.mortbay.http.SocketListener.handleConnection(SocketListener.java:245 ) at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357) at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534) 2009-10-21 01:47:26,327 [P1-8] ERROR (XQueryURLRewrite.java [doFilter]:376) - An error occurred: Document id ('18343') and proxy id ('459') differ ! javax.servlet.ServletException: An error occurred: Document id ('18343') and proxy id ('459') differ ! at org.exist.atom.http.AtomServlet.service(AtomServlet.java:465) at javax.servlet.http.HttpServlet.service(HttpServlet.java:856) at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:428) at org.mortbay.jetty.servlet.WebApplicationHandler$CachedChain.doFilter(Web ApplicationHandler.java:830) at org.exist.http.urlrewrite.PassThrough.doRewrite(PassThrough.java:44) at org.exist.http.urlrewrite.XQueryURLRewrite.doFilter(XQueryURLRewrite.jav a:321) at org.mortbay.jetty.servlet.WebApplicationHandler$CachedChain.doFilter(Web ApplicationHandler.java:821) at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationH andler.java:471) at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:568) at org.mortbay.http.HttpContext.handle(HttpContext.java:1530) at org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationCon text.java:633) at org.mortbay.http.HttpContext.handle(HttpContext.java:1482) at org.mortbay.http.HttpServer.service(HttpServer.java:909) at org.mortbay.http.HttpConnection.service(HttpConnection.java:820) at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:986) at org.mortbay.http.HttpConnection.handle(HttpConnection.java:837) at org.mortbay.http.SocketListener.handleConnection(SocketListener.java:245 ) at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357) at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534) Script output ============== 2009-10-21 01:47:26,267 crudclient.py:145 INFO Setting up eXist collections 2009-10-21 01:47:26,267 crudclient.py:147 DEBUG Creating collection, '/db/atoms/published/deployment_data/neodc.nerc.ac.uk/' 2009-10-21 01:47:26,267 xmlrpcclient.py:208 INFO Creating collection: '/db/atoms/published/deployment_data/neodc.nerc.ac.uk/' 2009-10-21 01:47:26,270 xmlrpcclient.py:210 INFO Collection created 2009-10-21 01:47:26,270 crudclient.py:149 INFO All collections set up 2009-10-21 01:47:26,270 xmlrpcclient.py:248 DEBUG Running parse operation on '/db/atoms/published/deployment_data/neodc.nerc.ac.uk//activity_11900769 55620906.atom' (overwrite=1) 2009-10-21 01:47:26,281 xmlrpcclient.py:250 DEBUG Parse operation completed on '/db/atoms/published/deployment_data/neodc.nerc.ac.uk//activity_11900769 55620906.atom' 2009-10-21 01:47:26,281 crudclient.py:178 INFO File added to eXist 2009-10-21 01:47:26,282 atomclient.py:304 INFO Atom created in eXist 2009-10-21 01:47:26,282 atomclient.py:331 DEBUG ASH publistAtom 2009-10-21 01:47:26,282 feedclient.py:232 INFO Adding link to atom (http://badc.nerc.ac.uk/view/neodc.nerc.ac.uk__ATOM__activity_1190076955 620906) as entry in atom feed, /db/atoms/ 2009-10-21 01:47:26,282 feedclient.py:71 DEBUG Setting up POST Request to eXist 2009-10-21 01:47:26,282 feedclient.py:83 DEBUG Get response... 2009-10-21 01:47:26,300 feedclient.py:85 DEBUG Response retrieved 2009-10-21 01:47:26,300 feedclient.py:90 INFO Successfully posted atom to eXist feed 2009-10-21 01:47:26,300 feedclient.py:234 INFO Successfully added new feed entry 2009-10-21 01:47:26,300 Atom.py:446 DEBUG Getting collection path for atom entity type 2009-10-21 01:47:26,300 Atom.py:435 DEBUG Getting collection path for atom publication state 2009-10-21 01:47:26,300 Atom.py:437 DEBUG Returning publication state collection, '/db/atoms/published/' 2009-10-21 01:47:26,300 Atom.py:459 DEBUG Returning entity collection, '/db/atoms/published/deployment_data/' 2009-10-21 01:47:26,301 feedclient.py:232 INFO Adding link to atom (http://badc.nerc.ac.uk/view/neodc.nerc.ac.uk__ATOM__activity_1190076955 620906) as entry in atom feed, /db/atoms/published/deployment_data/ 2009-10-21 01:47:26,301 feedclient.py:71 DEBUG Setting up POST Request to eXist 2009-10-21 01:47:26,301 feedclient.py:83 DEBUG Get response... 2009-10-21 01:47:26,330 feedclient.py:85 DEBUG Response retrieved 2009-10-21 01:47:26,331 feedclient.py:94 DEBUG Response error: <html> <head> <title>Error 500 An error occurred: An error occurred: Document id ('18343') and proxy id ('459') differ !</title> </head> <body> <h2>HTTP ERROR: 500</h2><pre>An error occurred: An error occurred: Document id ('18343') and proxy id ('459') differ !</pre> <p>RequestURI=/exist/atom/edit/db/atoms/published/deployment_data/</p> <p><i><small><a href="http://jetty.mortbay.org">Powered by Jetty://</a></small></i></p> </body> </html> 2009-10-21 01:47:26,331 feedclient.py:22 ERROR Error encountered: 'An+error+occurred%3A+An+error+occurred%3A+Document+id+%28%2718343%27%29 +and+proxy+id+%28%27459%27%29+differ+%21' could not import Image ----------------------------- RUNNING: migrator.py - data migration mode ON ----------------------------- Traceback (most recent call last): File "/home/badc/software/infrastructure/moles/migrator/src/molesGranulator/m igrator.py", line 195, in <module> migrator() File "/home/badc/software/infrastructure/moles/migrator/src/molesGranulator/m igrator.py", line 113, in __init__ actAtomiser.createAllActivityAtoms() File "/misc/damp2/software/infrastructure/moles/migrator/src/molesGranulator/ ActivityAtomiser.py", line 43, in createAllActivityAtoms self.createActivityAtomByType(result, type) File "/misc/damp2/software/infrastructure/moles/migrator/src/molesGranulator/ ActivityAtomiser.py", line 138, in createActivityAtomByType self._addLogosKeywordsWriteFilesAndUploadToExist() File "/misc/damp2/software/infrastructure/moles/migrator/src/molesGranulator/ AbstractAtomiser.py", line 241, in _addLogosKeywordsWriteFilesAndUploadToExist self._eXist.createAtom(self._atom, runAsynch = False) File "/usr/local/lib/python2.5/site-packages/ndgCommon-0.1.2.dev_r5402-py2.5. egg/ndg/common/src/clients/xmldb/eXist/atomclient.py", line 312, in createAtom self.__publishAtom(atom) File "/usr/local/lib/python2.5/site-packages/ndgCommon-0.1.2.dev_r5402-py2.5. egg/ndg/common/src/clients/xmldb/eXist/atomclient.py", line 337, in __publishAtom self.feedClient.addAtomToFeeds(atom) File "/usr/local/lib/python2.5/site-packages/ndgCommon-0.1.2.dev_r5402-py2.5. egg/ndg/common/src/clients/xmldb/eXist/feedclient.py", line 145, in addAtomToFeeds self.createAtomFeedEntry(atom.getDefaultEntityCollectionPath(), atom) File "/usr/local/lib/python2.5/site-packages/ndgCommon-0.1.2.dev_r5402-py2.5. egg/ndg/common/src/clients/xmldb/eXist/feedclient.py", line 233, in createAtomFeedEntry self.__postEditAtomFeed(collection, entryXML) File "/usr/local/lib/python2.5/site-packages/ndgCommon-0.1.2.dev_r5402-py2.5. egg/ndg/common/src/clients/xmldb/eXist/feedclient.py", line 95, in __postEditAtomFeed raise FeedClientError("Error encountered: '%s'" %response.reason) ndg.common.src.clients.xmldb.eXist.feedclient.FeedClientError: Error encountered: 'An+error+occurred%3A+An+error+occurred%3A+Document+id+%28%2718343%27%29 +and+proxy+id+%28%27459%27%29+differ+%21' -- Scanned by iCritical. ------------------------------------------------------------------------------ Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference _______________________________________________ Exist-open mailing list Exist-open@... https://lists.sourceforge.net/lists/listinfo/exist-open
	Re: "Document id and proxy id differ" error message by Martin Holmes :: Rate this Message: Reply to Author \| View Threaded \| Show Only this Message andrew.harwood@... wrote: > most times it generates a 'document id and proxy id > differ' error message. Take a look at these previous message threads on this -- this is one: <http://article.gmane.org/gmane.text.xml.exist/17850> Wolfgang thought it was fixed in February 2008, but it resurfaced with 1.2 in June; during that discussion, Wolfgang suggests that it's caused by insufficient memory, or a cache size problem. Later, it was reported again with 1.2, but was thought not to be an issue with 1.4: <http://article.gmane.org/gmane.text.xml.exist/22449> Perhaps the error message results from index corruption, and the index corruption may result from more than one cause -- one being a reproducible bug in 1.2 and below, and another possibly being an incorrect or insufficient memory situation that may also affect 1.4. We're suffering from it a lot on our old 1.1.1 installation, and hoping that 1.4 will fix it, so I'm hoping the devs can pin this one down before the final release. Cheers, Martin ------------------------------------------------------------------------------ Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference _______________________________________________ Exist-open mailing list Exist-open@... https://lists.sourceforge.net/lists/listinfo/exist-open
	Re: "Document id and proxy id differ" error message by Wolfgang Meier-2 :: Rate this Message: Reply to Author \| View Threaded \| Show Only this Message > Perhaps the error message results from index corruption, and the index > corruption may result from more than one cause -- one being a > reproducible bug in 1.2 and below, and another possibly being an > incorrect or insufficient memory situation that may also affect 1.4. The "Document id and proxy id differ" message is a symptom: it occurs if the indexing process was interrupted during an earlier operation for reasons we don't know. It may have different causes, running out of memory just being one of them. What caught my attention in Andrew's bug report was the start of the second log message in the log: "Failed to store temporary fragment"! The 1.4 version should not use temporary fragments anymore. Those temp fragments have been a reliable source of trouble in the past. I thus thought I need to find out why those temp fragments are still created and fix that. This should be possible from the stack traces. I will work on it at the weekend. Wolfgang ------------------------------------------------------------------------------ Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference _______________________________________________ Exist-open mailing list Exist-open@... https://lists.sourceforge.net/lists/listinfo/exist-open
	Re: "Document id and proxy id differ" error message by Martin Holmes :: Rate this Message: Reply to Author \| View Threaded \| Show Only this Message Wolfgang wrote: > What caught my attention in Andrew's bug report was the start of the > second log message in the log: "Failed to store temporary fragment"! The > 1.4 version should not use temporary fragments anymore. Those temp > fragments have been a reliable source of trouble in the past. > > I thus thought I need to find out why those temp fragments are still > created and fix that. This should be possible from the stack traces. I > will work on it at the weekend. Did you figure this one out? It seems a bit of a showstopper. Cheers, Martin ------------------------------------------------------------------------------ Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference _______________________________________________ Exist-open mailing list Exist-open@... https://lists.sourceforge.net/lists/listinfo/exist-open
	Re: "Document id and proxy id differ" error message by Wolfgang Meier-2 :: Rate this Message: Reply to Author \| View Threaded \| Show Only this Message > Did you figure this one out? It seems a bit of a showstopper. I had no time to look into it yet. It is on the todo for the release. Do you get the error with the 1.4rc as well or is it just the 1.2.x series? Andrew had the 1.4rc. Wolfgang ------------------------------------------------------------------------------ Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference _______________________________________________ Exist-open mailing list Exist-open@... https://lists.sourceforge.net/lists/listinfo/exist-open
	Re: "Document id and proxy id differ" error message by Martin Holmes :: Rate this Message: Reply to Author \| View Threaded \| Show Only this Message Wolfgang Meier wrote: >> Did you figure this one out? It seems a bit of a showstopper. > > I had no time to look into it yet. It is on the todo for the release. > Do you get the error with the 1.4rc as well or is it just the 1.2.x > series? Andrew had the 1.4rc. We haven't yet managed to get a working 1.4rc that we can use; the current svn trunk won't build (see my other message today). Cheers, Martin ------------------------------------------------------------------------------ Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference _______________________________________________ Exist-open mailing list Exist-open@... https://lists.sourceforge.net/lists/listinfo/exist-open
	Re: "Document id and proxy id differ" error message by Dannes Wessels-2 :: Rate this Message: Reply to Author \| View Threaded \| Show Only this Message Hi, On Wed, Oct 28, 2009 at 12:34 AM, Martin Holmes <mholmes@...> wrote: We haven't yet managed to get a working 1.4rc that we can use; the current svn trunk won't build (see my other message today). it should be OK again. Maybe you need to perform a clean of classes first..... regards Dannes -- eXist-db Native XML Database - http://exist-db.org Join us on linked-in: http://www.linkedin.com/groups?gid=35624 ------------------------------------------------------------------------------ Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference _______________________________________________ Exist-open mailing list Exist-open@... https://lists.sourceforge.net/lists/listinfo/exist-open
	Re: "Document id and proxy id differ" error message by Wolfgang Meier-2 :: Rate this Message: Reply to Author \| View Threaded \| Show Only this Message > I thus thought I need to find out why those temp fragments are still created > and fix that. I fixed the temp fragments issue shown in your logs (which is known to cause problems). I also introduced additional checks to avoid the "document id and proxy id differ" type of error - just in case it pops up again somewhere. The indexer now tries to detect and clean up the incomplete index operations which led to this error. I hope this helps. The fixes will go into 1.4 final. Wolfgang ------------------------------------------------------------------------------ Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference _______________________________________________ Exist-open mailing list Exist-open@... https://lists.sourceforge.net/lists/listinfo/exist-open