ZODB 3.8.3b1

[Jim Fulton]

I just released ZODB 3.8.3b1.  The most important feature of this
release is a new utility, strip_versions, which can be used to strip
version data from database file. This is important for databases that
contain version data.  ZODB 3.9 doesn't support versions and won't
open databases containing version data.

It would be great if people who have databases with version data would
try the utility out.

Jim

--
Jim Fulton
_______________________________________________
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/

ZODB-Dev mailing list  -  ZODB-Dev@...
http://mail.zope.org/mailman/listinfo/zodb-dev

[Chris Withers]

Jim Fulton wrote:
> It would be great if people who have databases with version data would
> try the utility out.

Where's tfm for the utility? :-)

Chris

--
Simplistix - Content Management, Batch Processing & Python Consulting
            - http://www.simplistix.co.uk
_______________________________________________
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/

ZODB-Dev mailing list  -  ZODB-Dev@...
http://mail.zope.org/mailman/listinfo/zodb-dev

[Jim Fulton]

On Sat, Aug 15, 2009 at 8:04 AM, Chris Withers<chris@...> wrote:
> Jim Fulton wrote:
>>
>> It would be great if people who have databases with version data would
>> try the utility out.
>
> Where's tfm for the utility? :-)

Use the -h option. There really isn't much to it. (There's also a
doctest in the ZODB/scripts directory.)

Jim

--
Jim Fulton
_______________________________________________
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/

ZODB-Dev mailing list  -  ZODB-Dev@...
http://mail.zope.org/mailman/listinfo/zodb-dev

[Chris Withers]

Jim Fulton wrote:
> On Sat, Aug 15, 2009 at 8:04 AM, Chris Withers<chris@...> wrote:
>> Jim Fulton wrote:
>>> It would be great if people who have databases with version data would
>>> try the utility out.
>> Where's tfm for the utility? :-)
>
> Use the -h option. There really isn't much to it. (There's also a
> doctest in the ZODB/scripts directory.)

-h assumes I have a script to run, which is what I was hoping the manual
would lead me too...

I have a buildout with version 2.12.0a3 of zope2 specified as an egg,
extending
http://svn.zope.org/*checkout*/Zope/tags/2.12.0a3/versions.cfg?rev=99292.

I guess I need to specify ZODB3=3.8.3b1 in my [versions] section, but
then what do I do?

(hmmm, zope2 2.12.0a3 relies on ZODB3 3.9.0a12, is it safe to downgrade
this for the duration of running this script? will this script not work
with ZODB3 3.9.x?)

Chris

--
Simplistix - Content Management, Batch Processing & Python Consulting
            - http://www.simplistix.co.uk
_______________________________________________
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/

ZODB-Dev mailing list  -  ZODB-Dev@...
http://mail.zope.org/mailman/listinfo/zodb-dev

[Jim Fulton]

On Sat, Aug 15, 2009 at 8:23 AM, Chris Withers<chris@...> wrote:

> Jim Fulton wrote:
>>
>> On Sat, Aug 15, 2009 at 8:04 AM, Chris Withers<chris@...>
>> wrote:
>>>
>>> Jim Fulton wrote:
>>>>
>>>> It would be great if people who have databases with version data would
>>>> try the utility out.
>>>
>>> Where's tfm for the utility? :-)
>>
>> Use the -h option. There really isn't much to it. (There's also a
>> doctest in the ZODB/scripts directory.)
>
> -h assumes I have a script to run, which is what I was hoping the manual
> would lead me too...
>
> I have a buildout with version 2.12.0a3 of zope2 specified as an egg,
> extending
> http://svn.zope.org/*checkout*/Zope/tags/2.12.0a3/versions.cfg?rev=99292.
>
> I guess I need to specify ZODB3=3.8.3b1 in my [versions] section, but then
> what do I do?
>
> (hmmm, zope2 2.12.0a3 relies on ZODB3 3.9.0a12, is it safe to downgrade this
> for the duration of running this script? will this script not work with
> ZODB3 3.9.x?)

If you install ZODB3 3.8.3b1 normally, you'll get a strip_versions
script in your bin directory. I'm not familar with the Zope 2 buildout
or whether you can use ZODB 3.8 with Zope 2.12.

Jim

--
Jim Fulton
_______________________________________________
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/

ZODB-Dev mailing list  -  ZODB-Dev@...
http://mail.zope.org/mailman/listinfo/zodb-dev

[Chris Withers]

Jim Fulton wrote:
> If you install ZODB3 3.8.3b1 normally, you'll get a strip_versions
> script in your bin directory. I'm not familar with the Zope 2 buildout
> or whether you can use ZODB 3.8 with Zope 2.12.

Hmm, okay, I'll play it safe then...

If I have a normal source install of Zope 2.9.10, how do I install ZODB
3.8.3b1 such that the zope instance will actually use it?

Or do I just need to install it into site-packages of an appropriate
python version so I can run the script on the data.fs file?

(sorry, having to guess here since I don't know how the script works -
is it over a zeo connection? does it modify the .fs in place? does in
generate a new .fs from an old .fs? Is it safe to use on a .fs in use by
a storage server?)

cheers,

Chris

--
Simplistix - Content Management, Batch Processing & Python Consulting
            - http://www.simplistix.co.uk
_______________________________________________
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/

ZODB-Dev mailing list  -  ZODB-Dev@...
http://mail.zope.org/mailman/listinfo/zodb-dev

[Jim Fulton]

On Sat, Aug 15, 2009 at 8:41 AM, Chris Withers<chris@...> wrote:

> Jim Fulton wrote:
>>
>> If you install ZODB3 3.8.3b1 normally, you'll get a strip_versions
>> script in your bin directory. I'm not familar with the Zope 2 buildout
>> or whether you can use ZODB 3.8 with Zope 2.12.
>
> Hmm, okay, I'll play it safe then...
>
> If I have a normal source install of Zope 2.9.10, how do I install ZODB
> 3.8.3b1 such that the zope instance will actually use it?
>
> Or do I just need to install it into site-packages of an appropriate python
> version so I can run the script on the data.fs file?

Sure, or in a virtualenv, or in a buildout.


>
> (sorry, having to guess here since I don't know how the script works - is it
> over a zeo connection? does it modify the .fs in place? does in generate a
> new .fs from an old .fs? Is it safe to use on a .fs in use by a storage
> server?)

Here's the help text.

$ bin/strip_versions -h
usage: strip_versions input output

Remove version records by copying input to output, stripping any
version records seen in input.

The input and output arguments are file-storage file names.  If the -c
option is used, then the input and output arguments must be storage
configuration files.


options:
  -h, --help    show this help message and exit
  -c, --config  Treat the input and output names as configuration file names,
                rather than file-storage file names

The text should say that if configuration files are used to use an
input storage other than a file storage, then the input storage must
support iteration.  I don't know off hand is any other storages
support iteration in 3.8. :)  ZEO client storages support iteration in
3.9, but not 3.8. (Although the iteration implementation for ZEO is
painfully slow.)

Jim

--
Jim Fulton
_______________________________________________
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/

ZODB-Dev mailing list  -  ZODB-Dev@...
http://mail.zope.org/mailman/listinfo/zodb-dev

[Chris Withers]

Jim Fulton wrote:
> $ bin/strip_versions -h
> usage: strip_versions input output
>
> Remove version records by copying input to output, stripping any
> version records seen in input.
>
> The input and output arguments are file-storage file names.  If the -c
> option is used, then the input and output arguments must be storage
> configuration files.

So is this safe to use on a Data.fs that's in use by a storage server?

Chris

--
Simplistix - Content Management, Batch Processing & Python Consulting
            - http://www.simplistix.co.uk
_______________________________________________
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/

ZODB-Dev mailing list  -  ZODB-Dev@...
http://mail.zope.org/mailman/listinfo/zodb-dev

[Jim Fulton]

On Sat, Aug 15, 2009 at 11:19 AM, Chris Withers<chris@...> wrote:

> Jim Fulton wrote:
>>
>> $ bin/strip_versions -h
>> usage: strip_versions input output
>>
>> Remove version records by copying input to output, stripping any
>> version records seen in input.
>>
>> The input and output arguments are file-storage file names.  If the -c
>> option is used, then the input and output arguments must be storage
>> configuration files.
>
> So is this safe to use on a Data.fs that's in use by a storage server?

Yup, where I assume you mean using the in-use storage as input. The
script makes a new copy.  After making the copy, you can change the
server to use that. Of course, changes made after copying won't be in
the copy, but if you just want to try the script out, you can just
point it at an in-use file. I did.

Jim

--
Jim Fulton
_______________________________________________
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/

ZODB-Dev mailing list  -  ZODB-Dev@...
http://mail.zope.org/mailman/listinfo/zodb-dev

[Chris Withers]

Jim Fulton wrote:
> Yup, where I assume you mean using the in-use storage as input. The
> script makes a new copy.  After making the copy, you can change the
> server to use that. Of course, changes made after copying won't be in
> the copy, but if you just want to try the script out, you can just
> point it at an in-use file. I did.

Initial testing suggests this works just fine :-)

I used the following buildout to get the right version of ZODB in
isolation and so didn't have to worry about affecting either the old or
new Zope instances involved:

[buildout]
parts =
   fixer
versions = versions

[versions]
ZODB3 = 3.8.3b1

[fixer]
recipe = zc.recipe.egg
eggs = ZODB3

cheers,

Chris

--
Simplistix - Content Management, Batch Processing & Python Consulting
            - http://www.simplistix.co.uk
_______________________________________________
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/

ZODB-Dev mailing list  -  ZODB-Dev@...
http://mail.zope.org/mailman/listinfo/zodb-dev

[Jim Fulton]

Thanks for trying it out.  I plan to release 3.8.3 next week.

Jim

On Tue, Aug 25, 2009 at 12:53 PM, Chris Withers<chris@...> wrote:

> Jim Fulton wrote:
>>
>> Yup, where I assume you mean using the in-use storage as input. The
>> script makes a new copy.  After making the copy, you can change the
>> server to use that. Of course, changes made after copying won't be in
>> the copy, but if you just want to try the script out, you can just
>> point it at an in-use file. I did.
>
> Initial testing suggests this works just fine :-)
>
> I used the following buildout to get the right version of ZODB in isolation
> and so didn't have to worry about affecting either the old or new Zope
> instances involved:
>
> [buildout]
> parts =
>  fixer
> versions = versions
>
> [versions]
> ZODB3 = 3.8.3b1
>
> [fixer]
> recipe = zc.recipe.egg
> eggs = ZODB3
>
> cheers,
>
> Chris
>
> --
> Simplistix - Content Management, Batch Processing & Python Consulting
>           - http://www.simplistix.co.uk
>

--
Jim Fulton
_______________________________________________
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/

ZODB-Dev mailing list  -  ZODB-Dev@...
http://mail.zope.org/mailman/listinfo/zodb-dev