ValueError: corrupted record when calling GetObject

[Izak Burger-2]

Hi all,

On one of our relatively highly loaded zope instances we occasionally
get this problem. It runs fine for several days and then all of a sudden
it breaks with this traceback:

     * Module Products.ZCatalog.CatalogBrains, line 86, in getObject
     * Module ZODB.Connection, line 761, in setstate
     * Module ZODB.Connection, line 819, in _setstate
     * Module ZODB.serialize, line 604, in setGhostState
     * Module ZODB.serialize, line 597, in getState
     * Module ZODB.serialize, line 471, in _persistent_load
     * Module ZODB.serialize, line 537, in load_oid
     * Module ZODB.Connection, line 213, in get
     * Module ZEO.ClientStorage, line 727, in load
     * Module ZEO.ClientStorage, line 732, in loadEx
     * Module ZEO.cache, line 189, in load
     * Module ZEO.cache, line 1010, in access
     * Module ZEO.cache, line 618, in fromFile

A restart "fixes" the problem. Its running version 3.7.1 of ZEO/ZODB.

regards,
Izak
_______________________________________________
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/

ZODB-Dev mailing list  -  ZODB-Dev@...
https://mail.zope.org/mailman/listinfo/zodb-dev

[Chris Withers]

Izak Burger wrote:
> A restart "fixes" the problem. Its running version 3.7.1 of ZEO/ZODB.

I have a feeling some problems in this area were fixed recently.
Can you try ZODB 3.8 or 3.9?

cheers,

Chris

--
Simplistix - Content Management, Batch Processing & Python Consulting
            - http://www.simplistix.co.uk
_______________________________________________
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/

ZODB-Dev mailing list  -  ZODB-Dev@...
https://mail.zope.org/mailman/listinfo/zodb-dev

[Tres Seaver]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Izak Burger wrote:

> Hi all,
>
> On one of our relatively highly loaded zope instances we occasionally
> get this problem. It runs fine for several days and then all of a sudden
> it breaks with this traceback:
>
>      * Module Products.ZCatalog.CatalogBrains, line 86, in getObject
>      * Module ZODB.Connection, line 761, in setstate
>      * Module ZODB.Connection, line 819, in _setstate
>      * Module ZODB.serialize, line 604, in setGhostState
>      * Module ZODB.serialize, line 597, in getState
>      * Module ZODB.serialize, line 471, in _persistent_load
>      * Module ZODB.serialize, line 537, in load_oid
>      * Module ZODB.Connection, line 213, in get
>      * Module ZEO.ClientStorage, line 727, in load
>      * Module ZEO.ClientStorage, line 732, in loadEx
>      * Module ZEO.cache, line 189, in load
>      * Module ZEO.cache, line 1010, in access
>      * Module ZEO.cache, line 618, in fromFile
>
> A restart "fixes" the problem. Its running version 3.7.1 of ZEO/ZODB.

That isn't the full traceback:  we can't see see the error itself.


Tres.
- --
===================================================================
Tres Seaver          [phone]          tseaver@...
Palladion Software   "Excellence by Design"    http://palladion.com
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iEYEARECAAYFAkrvNBUACgkQ+gerLs4ltQ5sZACfR4gOD1A327rVyGBTWRFcAwFr
2WMAn3HrHfaSTrMbxm2DAooblbIIGk/D
=czmU
-----END PGP SIGNATURE-----

_______________________________________________
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/

ZODB-Dev mailing list  -  ZODB-Dev@...
https://mail.zope.org/mailman/listinfo/zodb-dev

[Izak Burger-2]

Tres Seaver wrote:
> That isn't the full traceback:  we can't see see the error itself.

The error is: ValueError: corrupted record, version. Also in the subject
above :-)

regards,
Izak
_______________________________________________
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/

ZODB-Dev mailing list  -  ZODB-Dev@...
https://mail.zope.org/mailman/listinfo/zodb-dev

[Tres Seaver]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Izak Burger wrote:
> Tres Seaver wrote:
>> That isn't the full traceback:  we can't see see the error itself.
>
> The error is: ValueError: corrupted record, version. Also in the subject
> above :-)

Not the ':version' part, anyway.  But the error is clearly one where
something is stepping on your ZEO disk cache.  Could you possibly have
more than one appserver sharing the file?  Is it configured as a
"persistent" cache?  Any disk-related errors in the system logs?


Tres.
- --
===================================================================
Tres Seaver          [phone]          tseaver@...
Palladion Software   "Excellence by Design"    http://palladion.com
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iEYEARECAAYFAkrwPcMACgkQ+gerLs4ltQ4okgCfZ+QKvzHt8E/7YwAGiDJY8jOD
Z7AAn331GuU4ODDV5rdkyiorCD7/7BQR
=gJXK
-----END PGP SIGNATURE-----

_______________________________________________
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/

ZODB-Dev mailing list  -  ZODB-Dev@...
https://mail.zope.org/mailman/listinfo/zodb-dev

[Chris Withers]

Tres Seaver wrote:
> Not the ':version' part, anyway.  But the error is clearly one where
> something is stepping on your ZEO disk cache.  Could you possibly have
> more than one appserver sharing the file?  Is it configured as a
> "persistent" cache?  Any disk-related errors in the system logs?

I used to routinely see these errors on older ZODB versions with
persistent caches to the point where I stopped using persistent caches
and have lost faith in them.

cheers,

Chris

--
Simplistix - Content Management, Batch Processing & Python Consulting
            - http://www.simplistix.co.uk
_______________________________________________
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/

ZODB-Dev mailing list  -  ZODB-Dev@...
https://mail.zope.org/mailman/listinfo/zodb-dev