|
»
»
»
« Return to Thread: Error During Repository Load
RE: Error During Repository Load
by Greg Gibeling-2
::
Rate this Message:
It's definitely not the fault of SVNKit. SVNKit and command line
SVN agreed on the point of corruption. I misread the errors originally, but
the two of them fail on exactly the same file and revision with a checksum
mismatch. My current suspect is the ANT <tar> task, which appears to have
problems with large files and is well outside SVNKit.
The code will end up as part of an open source package soon enough
on my end, so I'd rather just wait for that since it'll be a supported
package.
-Greg
> -----Original Message-----
> From: Alexander Kitaev [mailto:Alexander.Kitaev@...]
> Sent: Wednesday, May 20, 2009 5:37 AM
> To: svnkit-users@...
> Subject: Re: Error During Repository Load
>
> Dear Greg,
>
> > Further investigation revealed a curiously corrupt dump file.
> Was it corrupted by some external reasons, or could we suspect that
> SVNKit generated it incorrectly?
>
> > Just FYI, I wrote some ANT tasks which will do the same thing
> > (extract some SVN revisions) but through the SVNKit API for dump file
> > handling instead of raw file access. It's based on the dumpfilter
> > implementation in 1.3.0. I'm happy to send you (privately) BSD
> licensed
> > code for that, that you could add to SVNKit if you want.
> I'm not sure we'll add that code to the SVNKit itself, but probably
> everyone would benefit from it being published as an example. Would you
> agree on that?
>
> Alexander Kitaev,
> TMate Software,
> http://svnkit.com/ - Java [Sub]Versioning Library!
>
> Greg Gibeling wrote:
> > Further investigation revealed a curiously corrupt dump file.
> I'm
> > currently re-running the overall test with more debugging enabled.
> > Thanks for the python script and the help.
> > Just FYI, I wrote some ANT tasks which will do the same thing
> > (extract some SVN revisions) but through the SVNKit API for dump file
> > handling instead of raw file access. It's based on the dumpfilter
> > implementation in 1.3.0. I'm happy to send you (privately) BSD
> licensed
> > code for that, that you could add to SVNKit if you want.
> >
> > -Greg
> >
> >> -----Original Message-----
> >> From: Alexander Sinyushkin [mailto:Alexander.Sinyushkin@...]
> >> Sent: Monday, May 18, 2009 8:32 AM
> >> To: svnkit-users@...
> >> Subject: Re: Error During Repository Load
> >>
> >> What is the error that SVN reports you about?
> >>
> >> You can use the following attached python script getDumpRev.py to
> get
> >> the contents of a certain revision, but you need to have python
> >> installed on your system.
> >>
> >> It must be launched this way:
> >>
> >> ./getDumpRev.py pathToDumpFile revStart revEnd
> >>
> >> Say, if you want to get the contents of revision 1, then
> >>
> >> launch the script in the following way:
> >>
> >> ./getDumpRev.py dump2 1 2
> >>
> >>
> >> ----
> >> Alexander Sinyushkin,
> >> TMate Software,
> >> http://svnkit.com/ - Java [Sub]Versioning Library!
> >>
> >> Greg Gibeling wrote:
> >>> The load only takes a few hours, thankfully. I did try with
> >> command
> >>> line SVN, and it failed, but at a later revision and on a different
> >>> kind of error. I'm trying to sort that out right now, so it'll be
> a
> >>> day or two before I get back to SVNKit.
> >>> I do not have real logs (oops), but I'll generate them as soon as
> >> I
> >>> can. Oh, and FYI I can easily build the SVNKit JARs if that makes
> >> any
> >>> difference.
> >>>
> >>> The thing I wanted to ask: is there any way short of grepping to
> >> find
> >>> the "E*"? I know the revision of course, I'm just really hoping
> not
> >> to
> >>> have to search a 25GB file for those characters...
> >>>
> >>> -Greg
> >>>
> >>>> -----Original Message-----
> >>>> From: Alexander Sinyushkin
> [mailto:Alexander.Sinyushkin@...]
> >>>> Sent: Friday, May 15, 2009 9:28 AM
> >>>> To: svnkit-users@...
> >>>> Subject: Re: Error During Repository Load
> >>>>
> >>>> Hello Greg,
> >>>>
> >>>> Have you tried loading the same dump file with SVN 1.6?
> >>>> I think such a load takes several days of continuous loading but
> >>>> still it can help us in finding the problem.
> >>>> Also I would like to ask you to search for E* string in the dump
> >> file
> >>>> and send us the revision snippet where you'll meet it first (I
> mean
> >>>> the entire snippet containing that E* string). If nothing helps
> I'll
> >>>> send you a new svnkit jar with enhanced logging to investigate the
> >> problem.
> >>>> Thank you.
> >>>>
> >>>> P.S: do you have SVNKit logs with the problem\stack trace? If yes,
> >>>> then send them to us, please.
> >>>>
> >>>> ----
> >>>> Alexander Sinyushkin,
> >>>> TMate Software,
> >>>> http://svnkit.com/ - Java [Sub]Versioning Library!
> >>>>
> >>>> Greg Gibeling wrote:
> >>>>> While loading a 25GB repository dump into a fresh
> reposistory I
> >>>> got
> >>>>> the following exception "org.tmatesoft.svn.core.SVNException:
> svn:
> >>>> Dump
> >>>>> stream contains a malformed header (with no ':') at 'E*'" from
> >>>>> svnkit
> >>>> 1.3.0.
> >>>>> The dump was created by command line svnadmin version 1.1.x. I
> >>>> didn't
> >>>>> capture the rest of the error message, so I'm sure that's not
> >> enough
> >>>>> information to say anything useful, but I thought I'd check
> before
> >>>> diving
> >>>>> into a huge debugging cycle.
> >>>>> Obviously I still have both the dump and the partially
> loaded
> >>>>> repository, and I can re-run the load. Is there any information
> >>>>> that
> >>>> I
> >>>>> might be able to provide (aside from the complete exception) to
> >> help
> >>>> debug
> >>>>> this?
> >>>>>
> >>>>> -Greg
> >>>>>
> >>>>>
> >>>>> -----------------------------------------------------------------
> --
> >> -
> >>>>> - To unsubscribe, e-mail: svnkit-users-unsubscribe@...
> >>>>> For additional commands, e-mail: svnkit-users-help@...
> >>>>>
> >>>>>
> >>>>>
> >>>> ------------------------------------------------------------------
> --
> >> -
> >>>> To unsubscribe, e-mail: svnkit-users-unsubscribe@...
> >>>> For additional commands, e-mail: svnkit-users-help@...
> >>>
> >>>
> >>> -------------------------------------------------------------------
> --
> >>> To unsubscribe, e-mail: svnkit-users-unsubscribe@...
> >>> For additional commands, e-mail: svnkit-users-help@...
> >>>
> >>>
> >>>
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: svnkit-users-unsubscribe@...
> > For additional commands, e-mail: svnkit-users-help@...
> >
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: svnkit-users-unsubscribe@...
> For additional commands, e-mail: svnkit-users-help@...
---------------------------------------------------------------------
To unsubscribe, e-mail: svnkit-users-unsubscribe@...
For additional commands, e-mail: svnkit-users-help@...
SVN agreed on the point of corruption. I misread the errors originally, but
the two of them fail on exactly the same file and revision with a checksum
mismatch. My current suspect is the ANT <tar> task, which appears to have
problems with large files and is well outside SVNKit.
The code will end up as part of an open source package soon enough
on my end, so I'd rather just wait for that since it'll be a supported
package.
-Greg
> -----Original Message-----
> From: Alexander Kitaev [mailto:Alexander.Kitaev@...]
> Sent: Wednesday, May 20, 2009 5:37 AM
> To: svnkit-users@...
> Subject: Re: Error During Repository Load
>
> Dear Greg,
>
> > Further investigation revealed a curiously corrupt dump file.
> Was it corrupted by some external reasons, or could we suspect that
> SVNKit generated it incorrectly?
>
> > Just FYI, I wrote some ANT tasks which will do the same thing
> > (extract some SVN revisions) but through the SVNKit API for dump file
> > handling instead of raw file access. It's based on the dumpfilter
> > implementation in 1.3.0. I'm happy to send you (privately) BSD
> licensed
> > code for that, that you could add to SVNKit if you want.
> I'm not sure we'll add that code to the SVNKit itself, but probably
> everyone would benefit from it being published as an example. Would you
> agree on that?
>
> Alexander Kitaev,
> TMate Software,
> http://svnkit.com/ - Java [Sub]Versioning Library!
>
> Greg Gibeling wrote:
> > Further investigation revealed a curiously corrupt dump file.
> I'm
> > currently re-running the overall test with more debugging enabled.
> > Thanks for the python script and the help.
> > Just FYI, I wrote some ANT tasks which will do the same thing
> > (extract some SVN revisions) but through the SVNKit API for dump file
> > handling instead of raw file access. It's based on the dumpfilter
> > implementation in 1.3.0. I'm happy to send you (privately) BSD
> licensed
> > code for that, that you could add to SVNKit if you want.
> >
> > -Greg
> >
> >> -----Original Message-----
> >> From: Alexander Sinyushkin [mailto:Alexander.Sinyushkin@...]
> >> Sent: Monday, May 18, 2009 8:32 AM
> >> To: svnkit-users@...
> >> Subject: Re: Error During Repository Load
> >>
> >> What is the error that SVN reports you about?
> >>
> >> You can use the following attached python script getDumpRev.py to
> get
> >> the contents of a certain revision, but you need to have python
> >> installed on your system.
> >>
> >> It must be launched this way:
> >>
> >> ./getDumpRev.py pathToDumpFile revStart revEnd
> >>
> >> Say, if you want to get the contents of revision 1, then
> >>
> >> launch the script in the following way:
> >>
> >> ./getDumpRev.py dump2 1 2
> >>
> >>
> >> ----
> >> Alexander Sinyushkin,
> >> TMate Software,
> >> http://svnkit.com/ - Java [Sub]Versioning Library!
> >>
> >> Greg Gibeling wrote:
> >>> The load only takes a few hours, thankfully. I did try with
> >> command
> >>> line SVN, and it failed, but at a later revision and on a different
> >>> kind of error. I'm trying to sort that out right now, so it'll be
> a
> >>> day or two before I get back to SVNKit.
> >>> I do not have real logs (oops), but I'll generate them as soon as
> >> I
> >>> can. Oh, and FYI I can easily build the SVNKit JARs if that makes
> >> any
> >>> difference.
> >>>
> >>> The thing I wanted to ask: is there any way short of grepping to
> >> find
> >>> the "E*"? I know the revision of course, I'm just really hoping
> not
> >> to
> >>> have to search a 25GB file for those characters...
> >>>
> >>> -Greg
> >>>
> >>>> -----Original Message-----
> >>>> From: Alexander Sinyushkin
> [mailto:Alexander.Sinyushkin@...]
> >>>> Sent: Friday, May 15, 2009 9:28 AM
> >>>> To: svnkit-users@...
> >>>> Subject: Re: Error During Repository Load
> >>>>
> >>>> Hello Greg,
> >>>>
> >>>> Have you tried loading the same dump file with SVN 1.6?
> >>>> I think such a load takes several days of continuous loading but
> >>>> still it can help us in finding the problem.
> >>>> Also I would like to ask you to search for E* string in the dump
> >> file
> >>>> and send us the revision snippet where you'll meet it first (I
> mean
> >>>> the entire snippet containing that E* string). If nothing helps
> I'll
> >>>> send you a new svnkit jar with enhanced logging to investigate the
> >> problem.
> >>>> Thank you.
> >>>>
> >>>> P.S: do you have SVNKit logs with the problem\stack trace? If yes,
> >>>> then send them to us, please.
> >>>>
> >>>> ----
> >>>> Alexander Sinyushkin,
> >>>> TMate Software,
> >>>> http://svnkit.com/ - Java [Sub]Versioning Library!
> >>>>
> >>>> Greg Gibeling wrote:
> >>>>> While loading a 25GB repository dump into a fresh
> reposistory I
> >>>> got
> >>>>> the following exception "org.tmatesoft.svn.core.SVNException:
> svn:
> >>>> Dump
> >>>>> stream contains a malformed header (with no ':') at 'E*'" from
> >>>>> svnkit
> >>>> 1.3.0.
> >>>>> The dump was created by command line svnadmin version 1.1.x. I
> >>>> didn't
> >>>>> capture the rest of the error message, so I'm sure that's not
> >> enough
> >>>>> information to say anything useful, but I thought I'd check
> before
> >>>> diving
> >>>>> into a huge debugging cycle.
> >>>>> Obviously I still have both the dump and the partially
> loaded
> >>>>> repository, and I can re-run the load. Is there any information
> >>>>> that
> >>>> I
> >>>>> might be able to provide (aside from the complete exception) to
> >> help
> >>>> debug
> >>>>> this?
> >>>>>
> >>>>> -Greg
> >>>>>
> >>>>>
> >>>>> -----------------------------------------------------------------
> --
> >> -
> >>>>> - To unsubscribe, e-mail: svnkit-users-unsubscribe@...
> >>>>> For additional commands, e-mail: svnkit-users-help@...
> >>>>>
> >>>>>
> >>>>>
> >>>> ------------------------------------------------------------------
> --
> >> -
> >>>> To unsubscribe, e-mail: svnkit-users-unsubscribe@...
> >>>> For additional commands, e-mail: svnkit-users-help@...
> >>>
> >>>
> >>> -------------------------------------------------------------------
> --
> >>> To unsubscribe, e-mail: svnkit-users-unsubscribe@...
> >>> For additional commands, e-mail: svnkit-users-help@...
> >>>
> >>>
> >>>
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: svnkit-users-unsubscribe@...
> > For additional commands, e-mail: svnkit-users-help@...
> >
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: svnkit-users-unsubscribe@...
> For additional commands, e-mail: svnkit-users-help@...
---------------------------------------------------------------------
To unsubscribe, e-mail: svnkit-users-unsubscribe@...
For additional commands, e-mail: svnkit-users-help@...
« Return to Thread: Error During Repository Load
| Free embeddable forum powered by Nabble | Forum Help |
