« Return to Thread: Error During Repository Load

Re: Error During Repository Load

by Alexander Kitaev-3 :: Rate this Message:

Reply to Author | View in Thread

Dear Greg,

> Further investigation revealed a curiously corrupt dump file.
Was it corrupted by some external reasons, or could we suspect that
SVNKit generated it incorrectly?

> Just FYI, I wrote some ANT tasks which will do the same thing
> (extract some SVN revisions) but through the SVNKit API for dump file
> handling instead of raw file access.  It's based on the dumpfilter
> implementation in 1.3.0.  I'm happy to send you (privately) BSD licensed
> code for that, that you could add to SVNKit if you want.
I'm not sure we'll add that code to the SVNKit itself, but probably
everyone would benefit from it being published as an example. Would you
agree on that?

Alexander Kitaev,
TMate Software,
http://svnkit.com/ - Java [Sub]Versioning Library!

Greg Gibeling wrote:

> Further investigation revealed a curiously corrupt dump file.  I'm
> currently re-running the overall test with more debugging enabled.
> Thanks for the python script and the help.
> Just FYI, I wrote some ANT tasks which will do the same thing
> (extract some SVN revisions) but through the SVNKit API for dump file
> handling instead of raw file access.  It's based on the dumpfilter
> implementation in 1.3.0.  I'm happy to send you (privately) BSD licensed
> code for that, that you could add to SVNKit if you want.
>
> -Greg
>
>> -----Original Message-----
>> From: Alexander Sinyushkin [mailto:Alexander.Sinyushkin@...]
>> Sent: Monday, May 18, 2009 8:32 AM
>> To: svnkit-users@...
>> Subject: Re: Error During Repository Load
>>
>> What is the error that SVN reports you about?
>>
>> You can use the following attached python script getDumpRev.py to get
>> the contents of a certain revision, but you need to have python
>> installed on your system.
>>
>> It must be launched this way:
>>
>> ./getDumpRev.py pathToDumpFile revStart revEnd
>>
>> Say, if you want to get the contents of revision 1, then
>>
>> launch the script in the following way:
>>
>> ./getDumpRev.py dump2 1 2
>>
>>
>> ----
>> Alexander Sinyushkin,
>> TMate Software,
>> http://svnkit.com/ - Java [Sub]Versioning Library!
>>
>> Greg Gibeling wrote:
>>> The load only takes a few hours, thankfully.  I did try with
>> command
>>> line SVN, and it failed, but at a later revision and on a different
>>> kind of error.  I'm trying to sort that out right now, so it'll be a
>>> day or two before I get back to SVNKit.
>>> I do not have real logs (oops), but I'll generate them as soon as
>> I
>>> can.  Oh, and FYI I can easily build the SVNKit JARs if that makes
>> any
>>> difference.
>>>
>>> The thing I wanted to ask: is there any way short of grepping to
>> find
>>> the "E*"?  I know the revision of course, I'm just really hoping not
>> to
>>> have to search a 25GB file for those characters...
>>>
>>> -Greg
>>>
>>>> -----Original Message-----
>>>> From: Alexander Sinyushkin [mailto:Alexander.Sinyushkin@...]
>>>> Sent: Friday, May 15, 2009 9:28 AM
>>>> To: svnkit-users@...
>>>> Subject: Re: Error During Repository Load
>>>>
>>>> Hello Greg,
>>>>
>>>> Have you tried loading the same dump file with SVN 1.6?
>>>> I think such a load takes several days of continuous loading but
>>>> still it can help us in finding the problem.
>>>> Also I would like to ask you to search for E* string in the dump
>> file
>>>> and send us the revision snippet where you'll meet it first (I mean
>>>> the entire snippet containing that E* string). If nothing helps I'll
>>>> send you a new svnkit jar with enhanced logging to investigate the
>> problem.
>>>> Thank you.
>>>>
>>>> P.S: do you have SVNKit logs with the problem\stack trace? If yes,
>>>> then send them to us, please.
>>>>
>>>> ----
>>>> Alexander Sinyushkin,
>>>> TMate Software,
>>>> http://svnkit.com/ - Java [Sub]Versioning Library!
>>>>
>>>> Greg Gibeling wrote:
>>>>> While loading a 25GB repository dump into a fresh reposistory I
>>>> got
>>>>> the following exception "org.tmatesoft.svn.core.SVNException: svn:
>>>> Dump
>>>>> stream contains a malformed header (with no ':') at 'E*'" from
>>>>> svnkit
>>>> 1.3.0.
>>>>> The dump was created by command line svnadmin version 1.1.x.  I
>>>> didn't
>>>>> capture the rest of the error message, so I'm sure that's not
>> enough
>>>>> information to say anything useful, but I thought I'd check before
>>>> diving
>>>>> into a huge debugging cycle.
>>>>> Obviously I still have both the dump and the partially loaded
>>>>> repository, and I can re-run the load.  Is there any information
>>>>> that
>>>> I
>>>>> might be able to provide (aside from the complete exception) to
>> help
>>>> debug
>>>>> this?
>>>>>
>>>>> -Greg
>>>>>
>>>>>
>>>>> -------------------------------------------------------------------
>> -
>>>>> - To unsubscribe, e-mail: svnkit-users-unsubscribe@...
>>>>> For additional commands, e-mail: svnkit-users-help@...
>>>>>
>>>>>
>>>>>
>>>> --------------------------------------------------------------------
>> -
>>>> To unsubscribe, e-mail: svnkit-users-unsubscribe@...
>>>> For additional commands, e-mail: svnkit-users-help@...
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: svnkit-users-unsubscribe@...
>>> For additional commands, e-mail: svnkit-users-help@...
>>>
>>>
>>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: svnkit-users-unsubscribe@...
> For additional commands, e-mail: svnkit-users-help@...
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: svnkit-users-unsubscribe@...
For additional commands, e-mail: svnkit-users-help@...

 « Return to Thread: Error During Repository Load