checkout problem with Chinese filenames on linux

View: New views
6 Messages — Rating Filter:   Alert me  

checkout problem with Chinese filenames on linux

by Zsolt Koppany :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi,

We found checkout problems (on linux) if the repository contains Chinese
filenames. We also figured out that the checkout works if some environment
variables are set.

In the attachment you find the shell script and also the repository dump.

We tested with svn-1.1.2.

Zsolt



locale-test.tar.gz (1M) Download Attachment

Parent Message unknown Re: checkout problem with Chinese filenames on linux

by Alexander Kitaev-3 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hello Zsolt,

Thank you for reporting this problem, we will take care of it. Recently
you've reported similar one (loading of repository dump that included
non-ASCII file names) that was fixed after 1.1.2 release (rev 3027 in
"trunk"). There is a possibility that this fix also fixes problem with
checkout you're reporting now.

Could you please repeat the test with the recent version of SVNKit
(http://www.svnkit.com/oorg.tmatesoft.svn_1.1.2_3027.standalone.zip)?
Thanks!

Alexander Kitaev,
TMate Software,
http://svnkit.com/ - Java [Sub]Versioning Library!

Zsolt Koppany wrote:

> Hi,
>
> We found checkout problems (on linux) if the repository contains Chinese
> filenames. We also figured out that the checkout works if some environment
> variables are set.
>
> In the attachment you find the shell script and also the repository dump.
>
> We tested with svn-1.1.2.
>
> Zsolt

RE: checkout problem with Chinese filenames on linux

by Zsolt Koppany :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Alexander,

even rebuilding svnkit from trunk didn't help.

Zsolt

> -----Original Message-----
> From: Alexander Kitaev [mailto:Alexander.Kitaev@...]
> Sent: Friday, April 20, 2007 7:09 PM
> To: javasvn-users@...
> Subject: Re: checkout problem with Chinese filenames on linux
>
> Hello Zsolt,
>
> Thank you for reporting this problem, we will take care of it. Recently
> you've reported similar one (loading of repository dump that included
> non-ASCII file names) that was fixed after 1.1.2 release (rev 3027 in
> "trunk"). There is a possibility that this fix also fixes problem with
> checkout you're reporting now.
>
> Could you please repeat the test with the recent version of SVNKit
> (http://www.svnkit.com/oorg.tmatesoft.svn_1.1.2_3027.standalone.zip)?
> Thanks!
>
> Alexander Kitaev,
> TMate Software,
> http://svnkit.com/ - Java [Sub]Versioning Library!
>
> Zsolt Koppany wrote:
> > Hi,
> >
> > We found checkout problems (on linux) if the repository contains Chinese
> > filenames. We also figured out that the checkout works if some
> environment
> > variables are set.
> >
> > In the attachment you find the shell script and also the repository
> dump.
> >
> > We tested with svn-1.1.2.
> >
> > Zsolt


Parent Message unknown Re: checkout problem with Chinese filenames on linux

by Alexander Sinyushkin :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hello Zsolt,

What is the exact problem - checkout doesn't work at all or works but
spoils Chinese filenames? If it doesn't work at all I suppose there
should be an exception you get running checkout. If so, send us a stack
trace, please. Another question: is this problem only Linux specific?
Have you tried to do checkout on Windows? It may also appear to be of
great use to know what environment variables causes checkout to run
without problems. Thank you.

----
Alexander Sinyushkin,
TMate Software,
http://svnkit.com/ - Java [Sub]Versioning Library!

Zsolt Koppany wrote:

> Hi,
>
> We found checkout problems (on linux) if the repository contains Chinese
> filenames. We also figured out that the checkout works if some environment
> variables are set.
>
> In the attachment you find the shell script and also the repository dump.
>
> We tested with svn-1.1.2.
>
> Zsolt
>

RE: checkout problem with Chinese filenames on linux

by Zsolt Koppany :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Alexander,

the problem happens only on linux and if the environment variables are not
pointing to UTF8. This is a problem for us because our application must NOT
rely on environment variables that we cannot control.

The filenames of working copies are wrong.

Zsolt

> -----Original Message-----
> From: Alexander Sinyushkin [mailto:Alexander.Sinyushkin@...]
> Sent: Monday, April 23, 2007 7:45 AM
> To: javasvn-users@...
> Subject: Re: checkout problem with Chinese filenames on linux
>
> Hello Zsolt,
>
> What is the exact problem - checkout doesn't work at all or works but
> spoils Chinese filenames? If it doesn't work at all I suppose there
> should be an exception you get running checkout. If so, send us a stack
> trace, please. Another question: is this problem only Linux specific?
> Have you tried to do checkout on Windows? It may also appear to be of
> great use to know what environment variables causes checkout to run
> without problems. Thank you.
>
> ----
> Alexander Sinyushkin,
> TMate Software,
> http://svnkit.com/ - Java [Sub]Versioning Library!
>
> Zsolt Koppany wrote:
> > Hi,
> >
> > We found checkout problems (on linux) if the repository contains Chinese
> > filenames. We also figured out that the checkout works if some
> environment
> > variables are set.
> >
> > In the attachment you find the shell script and also the repository
> dump.
> >
> > We tested with svn-1.1.2.
> >
> > Zsolt
> >


Parent Message unknown Re: checkout problem with Chinese filenames on linux

by Alexander Sinyushkin :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hello Zsolt.

After we discussed possible reasons of the problem you have encountered
with we think that there can be the following reasons why you've got
wrong filenames:

1) it may be the current locale of the OS that makes your filenames look
strange. For example, on my Windows I also do not see Chinese
hieroglyphs as I've got a different locale. But if I browse my file
system in firefox I see correct names (see the picture attached). So, if
this is the problem of a locale (you may try to look your files in a
browser just like we did) then it's not the problem of SVNKit, since
locales of our users is out of our response.

2) it may be the problem of a file system: it's possible that a
particular file system stores filenames in ASCII only charset (using one
byte per symbol). In this case if the first point is not the reason we
would ask you to tell us what file system the problem is reproduced on -
we will check this hypotheses.

3) if both previous cases appear to be wrong, there's the last and most
undesirable case - the problem resides somewhere
in SVNKit. Here we will advise you to locate the source of the problem:
after you get your dump file loaded

/jsvnadmin load testrepo <svnUTF8FileNames.dump

check your repository with a web browser if possible (or try to change
the locale to utf-8 and browse it with Subversion command line client).
If jsvnadmin load is not the source you will see correct Chinese
filenames and the problem is in the SVNKit update engine.

And yet one more question - maybe the most important one: how does
Subversion command line client behave in the same environment where
SVNKit update spoils (?) filenames?

Thank you.

----
Alexander Sinyushkin,
TMate Software,
http://svnkit.com/ - Java [Sub]Versioning Library!

Zsolt Koppany wrote:

> Alexander,
>
> the problem happens only on linux and if the environment variables are not
> pointing to UTF8. This is a problem for us because our application must NOT
> rely on environment variables that we cannot control.
>
> The filenames of working copies are wrong.
>
> Zsolt
>
>> -----Original Message-----
>> From: Alexander Sinyushkin [mailto:Alexander.Sinyushkin@...]
>> Sent: Monday, April 23, 2007 7:45 AM
>> To: javasvn-users@...
>> Subject: Re: checkout problem with Chinese filenames on linux
>>
>> Hello Zsolt,
>>
>> What is the exact problem - checkout doesn't work at all or works but
>> spoils Chinese filenames? If it doesn't work at all I suppose there
>> should be an exception you get running checkout. If so, send us a stack
>> trace, please. Another question: is this problem only Linux specific?
>> Have you tried to do checkout on Windows? It may also appear to be of
>> great use to know what environment variables causes checkout to run
>> without problems. Thank you.
>>
>> ----
>> Alexander Sinyushkin,
>> TMate Software,
>> http://svnkit.com/ - Java [Sub]Versioning Library!
>>
>> Zsolt Koppany wrote:
>>> Hi,
>>>
>>> We found checkout problems (on linux) if the repository contains Chinese
>>> filenames. We also figured out that the checkout works if some
>> environment
>>> variables are set.
>>>
>>> In the attachment you find the shell script and also the repository
>> dump.
>>> We tested with svn-1.1.2.
>>>
>>> Zsolt
>>>
>
>
>


locale-test.PNG (60K) Download Attachment