Swedish character problem after version 1.4.15

[Johan Ankarloo]

Hi

After trying to upgrade to version 1.4.17 I am having problem with some
special swedish characters, åäöÅÄÖ.

After some testing I have nailed it down to be something that got
introduced between version 1.4.15-rc1 and 1.4.15. In the changelog I can
read the following:

Version 1.4.15 - 23 May 2008
----------------------------
  - Fix saving of Read Receipts to Sent folder.
  - Converted Romanian (ro_RO) to UTF-8.
  - Converted Slovak (sk_SK) to UTF-8.
  - Converted Swedish (sv_SE) to UTF-8.

So perhaps this has something to do with converting to UTF-8.

Problem description:

* All IMAP folders containing special characters are displayed in the
wrong way in squirrelmail version 1.4.15 and above but ok in thunderbird
or in squirrelmail version 1.4.13 and below.

* I can create a new folder with special characters and that looks ok in
squirrelmail version 1.4.15 and above but not in thunderbird or in
squirrelmail version 1.4.13 and below.

Br
Johan


------------------------------------------------------------------------------
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
-----
squirrelmail-i18n mailing list
Posting guidelines: http://squirrelmail.org/postingguidelines
Information about translations: http://squirrelmail.org/wiki/LanguageTranslation
Statistics for translations: http://l10n-stats.squirrelmail.org/
List address: squirrelmail-i18n@...
List archives: http://news.gmane.org/gmane.mail.squirrelmail.internationalization
List info (subscribe/unsubscribe/change options): https://lists.sourceforge.net/lists/listinfo/squirrelmail-i18n

[Mucibirahman İLBUĞA]

Hi,
I had the same problem with the Turkish charactes... And Mr. Tomas
Kuliavas suggested me to add mstring support in my php setup. I did and
problem disappeared... Maybe you have the same problem???

Kind regards,
Mucip ILBUGA



Johan Ankarloo yazm?s,:

> Hi
>
> After trying to upgrade to version 1.4.17 I am having problem with some
> special swedish characters, åäöÅÄÖ.
>
> After some testing I have nailed it down to be something that got
> introduced between version 1.4.15-rc1 and 1.4.15. In the changelog I can
> read the following:
>
> Version 1.4.15 - 23 May 2008
> ----------------------------
>   - Fix saving of Read Receipts to Sent folder.
>   - Converted Romanian (ro_RO) to UTF-8.
>   - Converted Slovak (sk_SK) to UTF-8.
>   - Converted Swedish (sv_SE) to UTF-8.
>
> So perhaps this has something to do with converting to UTF-8.
>
> Problem description:
>
> * All IMAP folders containing special characters are displayed in the
> wrong way in squirrelmail version 1.4.15 and above but ok in thunderbird
> or in squirrelmail version 1.4.13 and below.
>
> * I can create a new folder with special characters and that looks ok in
> squirrelmail version 1.4.15 and above but not in thunderbird or in
> squirrelmail version 1.4.13 and below.
>
> Br
> Johan
>
>
> ------------------------------------------------------------------------------
> Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
> -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
> -Strategies to boost innovation and cut costs with open source participation
> -Receive a $600 discount off the registration fee with the source code: SFAD
> http://p.sf.net/sfu/XcvMzF8H
> -----
> squirrelmail-i18n mailing list
> Posting guidelines: http://squirrelmail.org/postingguidelines
> Information about translations: http://squirrelmail.org/wiki/LanguageTranslation
> Statistics for translations: http://l10n-stats.squirrelmail.org/
> List address: squirrelmail-i18n@...
> List archives: http://news.gmane.org/gmane.mail.squirrelmail.internationalization
> List info (subscribe/unsubscribe/change options): https://lists.sourceforge.net/lists/listinfo/squirrelmail-i18n
>
>  

------------------------------------------------------------------------------
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
-----
squirrelmail-i18n mailing list
Posting guidelines: http://squirrelmail.org/postingguidelines
Information about translations: http://squirrelmail.org/wiki/LanguageTranslation
Statistics for translations: http://l10n-stats.squirrelmail.org/
List address: squirrelmail-i18n@...
List archives: http://news.gmane.org/gmane.mail.squirrelmail.internationalization
List info (subscribe/unsubscribe/change options): https://lists.sourceforge.net/lists/listinfo/squirrelmail-i18n

[Johan Ankarloo]

I have now added the php-mbstring packet and restarted httpd and it did
solve the issue, thanks.

Then the question is more why it works as it does when you don't have
php-mbstring installed? Somehow squirrelmail is using some other format
and what is that and can it be fixed or is it a requirement from version
1.4.15 to have that packet installed?

Br
Johan

> Hi,
> I had the same problem with the Turkish charactes... And Mr. Tomas
> Kuliavas suggested me to add mstring support in my php setup. I did and
> problem disappeared... Maybe you have the same problem???
>
> Kind regards,
> Mucip ILBUGA
>
>
>
> Johan Ankarloo yazm?s,:
>> Hi
>>
>> After trying to upgrade to version 1.4.17 I am having problem with some
>> special swedish characters, åäöÅÄÖ.
>>
>> After some testing I have nailed it down to be something that got
>> introduced between version 1.4.15-rc1 and 1.4.15. In the changelog I can
>> read the following:
>>
>> Version 1.4.15 - 23 May 2008
>> ----------------------------
>>   - Fix saving of Read Receipts to Sent folder.
>>   - Converted Romanian (ro_RO) to UTF-8.
>>   - Converted Slovak (sk_SK) to UTF-8.
>>   - Converted Swedish (sv_SE) to UTF-8.
>>
>> So perhaps this has something to do with converting to UTF-8.
>>
>> Problem description:
>>
>> * All IMAP folders containing special characters are displayed in the
>> wrong way in squirrelmail version 1.4.15 and above but ok in thunderbird
>> or in squirrelmail version 1.4.13 and below.
>>
>> * I can create a new folder with special characters and that looks ok in
>> squirrelmail version 1.4.15 and above but not in thunderbird or in
>> squirrelmail version 1.4.13 and below.
>>
>> Br
>> Johan
>>
>>
>> ------------------------------------------------------------------------------
>> Open Source Business Conference (OSBC), March 24-25, 2009, San
>> Francisco, CA
>> -OSBC tackles the biggest issue in open source: Open Sourcing the
>> Enterprise
>> -Strategies to boost innovation and cut costs with open source
>> participation
>> -Receive a $600 discount off the registration fee with the source code:
>> SFAD
>> http://p.sf.net/sfu/XcvMzF8H
>> -----
>> squirrelmail-i18n mailing list
>> Posting guidelines: http://squirrelmail.org/postingguidelines
>> Information about translations:
>> http://squirrelmail.org/wiki/LanguageTranslation
>> Statistics for translations: http://l10n-stats.squirrelmail.org/
>> List address: squirrelmail-i18n@...
>> List archives:
>> http://news.gmane.org/gmane.mail.squirrelmail.internationalization
>> List info (subscribe/unsubscribe/change options):
>> https://lists.sourceforge.net/lists/listinfo/squirrelmail-i18n
>>
>>
>
> ------------------------------------------------------------------------------
> Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco,
> CA
> -OSBC tackles the biggest issue in open source: Open Sourcing the
> Enterprise
> -Strategies to boost innovation and cut costs with open source
> participation
> -Receive a $600 discount off the registration fee with the source code:
> SFAD
> http://p.sf.net/sfu/XcvMzF8H
> -----
> squirrelmail-i18n mailing list
> Posting guidelines: http://squirrelmail.org/postingguidelines
> Information about translations:
> http://squirrelmail.org/wiki/LanguageTranslation
> Statistics for translations: http://l10n-stats.squirrelmail.org/
> List address: squirrelmail-i18n@...
> List archives:
> http://news.gmane.org/gmane.mail.squirrelmail.internationalization
> List info (subscribe/unsubscribe/change options):
> https://lists.sourceforge.net/lists/listinfo/squirrelmail-i18n
>

------------------------------------------------------------------------------
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
-----
squirrelmail-i18n mailing list
Posting guidelines: http://squirrelmail.org/postingguidelines
Information about translations: http://squirrelmail.org/wiki/LanguageTranslation
Statistics for translations: http://l10n-stats.squirrelmail.org/
List address: squirrelmail-i18n@...
List archives: http://news.gmane.org/gmane.mail.squirrelmail.internationalization
List info (subscribe/unsubscribe/change options): https://lists.sourceforge.net/lists/listinfo/squirrelmail-i18n

[Tomas Kuliavas]

2009.02.17 11:27 Johan Ankarloo rašė:
> I have now added the php-mbstring packet and restarted httpd and it did
> solve the issue, thanks.
>
> Then the question is more why it works as it does when you don't have
> php-mbstring installed? Somehow squirrelmail is using some other format
> and what is that and can it be fixed or is it a requirement from version
> 1.4.15 to have that packet installed?

SquirrelMail has two routines for UTF7-IMAP character set conversion.
Routine written in pure PHP functions is broken and works only for
utf7-imap <-> iso8859-1 conversions. Other routine requires PHP with
mbstring support. UTF7-IMAP <-> UTF8 support can be written in pure PHP,
but current SquirrelMail translations are not UTF-8 only and correct
UTF7-IMAP decoder might need support of other charsets. CJK charsets
required by Chinese and Korean are very complex. They will cause serious
performance issues if implemented in pure PHP.

--
Tomas


------------------------------------------------------------------------------
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
-----
squirrelmail-i18n mailing list
Posting guidelines: http://squirrelmail.org/postingguidelines
Information about translations: http://squirrelmail.org/wiki/LanguageTranslation
Statistics for translations: http://l10n-stats.squirrelmail.org/
List address: squirrelmail-i18n@...
List archives: http://news.gmane.org/gmane.mail.squirrelmail.internationalization
List info (subscribe/unsubscribe/change options): https://lists.sourceforge.net/lists/listinfo/squirrelmail-i18n

[Johan Ankarloo]

I see. So then there mbstring support is required in squirrelmail from
version 1.4.15 for all non english characters.

Perhaps that could be further explained in the "Administrators manual" and
in the configtest.php script.

Thanks for your support and quick response. Keep up the good work!

Br
Johan

> 2009.02.17 11:27 Johan Ankarloo rašė:
>> I have now added the php-mbstring packet and restarted httpd and it did
>> solve the issue, thanks.
>>
>> Then the question is more why it works as it does when you don't have
>> php-mbstring installed? Somehow squirrelmail is using some other format
>> and what is that and can it be fixed or is it a requirement from version
>> 1.4.15 to have that packet installed?
>
> SquirrelMail has two routines for UTF7-IMAP character set conversion.
> Routine written in pure PHP functions is broken and works only for
> utf7-imap <-> iso8859-1 conversions. Other routine requires PHP with
> mbstring support. UTF7-IMAP <-> UTF8 support can be written in pure PHP,
> but current SquirrelMail translations are not UTF-8 only and correct
> UTF7-IMAP decoder might need support of other charsets. CJK charsets
> required by Chinese and Korean are very complex. They will cause serious
> performance issues if implemented in pure PHP.
>
> --
> Tomas
>
>
> ------------------------------------------------------------------------------
> Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco,
> CA
> -OSBC tackles the biggest issue in open source: Open Sourcing the
> Enterprise
> -Strategies to boost innovation and cut costs with open source
> participation
> -Receive a $600 discount off the registration fee with the source code:
> SFAD
> http://p.sf.net/sfu/XcvMzF8H
> -----
> squirrelmail-i18n mailing list
> Posting guidelines: http://squirrelmail.org/postingguidelines
> Information about translations:
> http://squirrelmail.org/wiki/LanguageTranslation
> Statistics for translations: http://l10n-stats.squirrelmail.org/
> List address: squirrelmail-i18n@...
> List archives:
> http://news.gmane.org/gmane.mail.squirrelmail.internationalization
> List info (subscribe/unsubscribe/change options):
> https://lists.sourceforge.net/lists/listinfo/squirrelmail-i18n

------------------------------------------------------------------------------
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
-----
squirrelmail-i18n mailing list
Posting guidelines: http://squirrelmail.org/postingguidelines
Information about translations: http://squirrelmail.org/wiki/LanguageTranslation
Statistics for translations: http://l10n-stats.squirrelmail.org/
List address: squirrelmail-i18n@...
List archives: http://news.gmane.org/gmane.mail.squirrelmail.internationalization
List info (subscribe/unsubscribe/change options): https://lists.sourceforge.net/lists/listinfo/squirrelmail-i18n

2009/2/17 Tomas Kuliavas <tokul@...>:
>
> SquirrelMail has two routines for UTF7-IMAP character set conversion.
> Routine written in pure PHP functions is broken and works only for
> utf7-imap <-> iso8859-1 conversions. Other routine requires PHP with
> mbstring support. UTF7-IMAP <-> UTF8 support can be written in pure PHP,

If that's easily doable, I'll definitely vote for it. More and more
translations are
switching to UTF-8 (recently the Czech translators approved that as well)
so having a native conversion routine in pure PHP might be very useful.
It might perhaps also motivate others to switch to UTF-8 :-)

Petr

------------------------------------------------------------------------------
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
-----
squirrelmail-i18n mailing list
Posting guidelines: http://squirrelmail.org/postingguidelines
Information about translations: http://squirrelmail.org/wiki/LanguageTranslation
Statistics for translations: http://l10n-stats.squirrelmail.org/
List address: squirrelmail-i18n@...
List archives: http://news.gmane.org/gmane.mail.squirrelmail.internationalization
List info (subscribe/unsubscribe/change options): https://lists.sourceforge.net/lists/listinfo/squirrelmail-i18n

[Tomas Kuliavas]

Petr Hroudný-2 wrote:

2009/2/17 Tomas Kuliavas <[e-mail]>:
>
> SquirrelMail has two routines for UTF7-IMAP character set conversion.
> Routine written in pure PHP functions is broken and works only for
> utf7-imap <-> iso8859-1 conversions. Other routine requires PHP with
> mbstring support. UTF7-IMAP <-> UTF8 support can be written in pure PHP,

If that's easily doable, I'll definitely vote for it. More and more
translations are
switching to UTF-8 (recently the Czech translators approved that as well)
so having a native conversion routine in pure PHP might be very useful.
It might perhaps also motivate others to switch to UTF-8 :-)

Petr

If issue is only about proper utf7-imap support, then it is easy doable. Such code already exists, but it is not part of SquirrelMail.

Other things broken without mbstring extension are not as noticeable as broken folder tree. mbstring functions are used to calculate symbol length in header encoding and word wrapping functions.

--
Tomas