Nabble - Php - Internationalization (i18n)

Re: Problems passing variables to gettext

2009-12-23T03:49:30Z

Hi!

Lumiere de Lune wrote:

> $sitetitle= _('My beautiful site') ; in variables.php
> And echo $sitetitle in the second file, which is my template.
>
> As it did not work, I imagined the translation of the variable did not work

You mean the translation of the constant expression, whose result gets
assigned to a variable? There is no reason why the translation should
fail because of a (later) assignment of its result.

> But the other strings are in other files, so this is the only case where I
> define a variable that has to be translated.

Other files? Are you sure locale setting/domain/path are set for *this*
file, too?

Might $sitetitle be re-set after the translation assignment?

If not: Would it be possible to boil down a test case?

HPO

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

RE: Problems passing variables to gettext

2009-12-23T03:30:09Z

Hello :)

HPO wrote

> Marie-Aude wrote:

>> $sitetitle= _('My beautiful site') ;
>[...]
>> the echo _($sitetitle) does not work.

>Are you actually trying to translate your site's title twice?

>If not, gettext problems usually arise from not/wrongly setting the
>domain and the path gettext is expecting. If you have a look at the
>php manual for the gettext function, there is a complete example.

Actually no :) though it looks like.
At first I had
$sitetitle= _('My beautiful site') ; in variables.php
And echo $sitetitle in the second file, which is my template.

As it did not work, I imagined the translation of the variable did not work
as non translated value was shown, and I tried to re-translate it.
I tried both configurations (you know when you are despaired because you
can't grab why it does not work.
It is definitively not a path or configuration problem, because all other
strings are correctly translated.
But the other strings are in other files, so this is the only case where I
define a variable that has to be translated.
--
Marie-Aude

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

Re: Problems passing variables to gettext

2009-12-23T02:50:31Z

Hi!

Marie-Aude wrote:

> $sitetitle= _('My beautiful site') ;
[...]
> the echo _($sitetitle) does not work.

Are you actually trying to translate your site's title twice?

If not, gettext problems usually arise from not/wrongly setting the
domain and the path gettext is expecting. If you have a look at the
php manual for the gettext function, there is a complete example.

Greets
HPO

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

Problems passing variables to gettext

2009-12-22T19:48:26Z

Hello, I have a problem using gettext in php that I can't solve, I've been through the different posts, and can't get it.

I have a file of string variables for a site, like address, phone, etc, of which one of them has to be translated.
So I put in the variables.php file
$sitetitle= _('My beautiful site') ;

Translated it in the po files (through PO edit)

Now in my index page, I set the locales, and call my variables.
And I can't get $sitetitle to be translated, it still stays in the original language (which means the variable is recognized, but not translated)

the echo _($sitetitle) does not work.

Any idea ?

intl / resourcebundle: Invitation to comment

2009-12-22T15:42:23Z

Hi!

After helpful feedback from Stanislav I tried to implement libicu's
ResourceBundle - meaning a class/functions to read them.

You can find current developments incl. a diff to intl 1.0.3 at
https://saintcyr.oeri.ch/trac/php-intl

Please dont hesitate to comment or suggest improvements
HPO

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

Re: intl 1.0.3: Trying to understand the internal error functions

2009-12-21T13:07:09Z

Hi!

> In order to "synchronize" global and individual errors, there are three
> functions (plural of error):
> intl_errors_reset
> intl_errors_set_custom_msg
> intl_errors_set_code
>
> However, the first and the third are NEVER referenced. The second is
> only used in connection with intl_error_set_code (note singular error!)
>
> All this seems not to add up. Are there any docs available somewhere?

OK, so there is two places where errors are kept - global error state
and local error state for each object. When error happens, if we have an
object we set both objects' state and global state, when we don't have
object, only global state. Plural functions set both object's state and
global state. Singular functions set only one state, specified by err,
which is global if err is NULL.
--
Stanislav Malyshev, Zend Software Architect
stas@... http://www.zend.com/
(408)253-8829 MSN: stas@...

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

Re: PATCH intl 1.0.3 normalizer: intl_error_reset gets called twice

2009-12-21T12:13:45Z

Hi!

> Going through intl/normalizer I found that intl_error_reset gets called
> twice - once in a macro, once explicitely.

You are right, committed the fix.
--
Stanislav Malyshev, Zend Software Architect
stas@... http://www.zend.com/
(408)253-8829 MSN: stas@...

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

intl 1.0.3: Trying to understand the internal error functions

2009-12-20T11:21:49Z

Hi!

intl_error.h defines common error handling functions and "global"
variables - in addition to those in the respective objects.

In order to "synchronize" global and individual errors, there are three
functions (plural of error):
intl_errors_reset
intl_errors_set_custom_msg
intl_errors_set_code

However, the first and the third are NEVER referenced. The second is
only used in connection with intl_error_set_code (note singular error!)

All this seems not to add up. Are there any docs available somewhere?

HPO

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

PATCH intl 1.0.3 normalizer: intl_error_reset gets called twice

2009-12-20T10:46:27Z

Hi!

Going through intl/normalizer I found that intl_error_reset gets called
twice - once in a macro, once explicitely.

HPO

diff -r ddff919cd2c0 normalizer/normalizer_class.h
--- a/normalizer/normalizer_class.h Sun Dec 20 16:12:59 2009 +0100
+++ b/normalizer/normalizer_class.h Sun Dec 20 19:42:54 2009 +0100
@@ -44,9 +44,4 @@

extern zend_class_entry *Normalizer_ce_ptr;

-/* Auxiliary macros */
-
-#define NORMALIZER_METHOD_INIT_VARS \
- intl_error_reset( NULL TSRMLS_CC ); \
-
#endif // #ifndef NORMALIZER_CLASS_H
diff -r ddff919cd2c0 normalizer/normalizer_normalize.c
--- a/normalizer/normalizer_normalize.c Sun Dec 20 16:12:59 2009 +0100
+++ b/normalizer/normalizer_normalize.c Sun Dec 20 19:42:54 2009 +0100
@@ -49,8 +49,6 @@
int32_t ret_len = 0;

int32_t size_needed;
-
- NORMALIZER_METHOD_INIT_VARS

intl_error_reset( NULL TSRMLS_CC );

@@ -180,8 +178,6 @@
UErrorCode status = U_ZERO_ERROR;

UBool uret = FALSE;
-
- NORMALIZER_METHOD_INIT_VARS

intl_error_reset( NULL TSRMLS_CC );

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

Новорязанское ш. лесные участки

2009-10-20T23:00:47Z

Участки в новом коттеджном поселке 30 км от МКАД по Новорязанскому ш.
Участки по 12 соток, заросшие березками по 8-12 м на опушке большого леса (Бронницкое охотхозяйство). Электричество подведено, газ проходит в 50 м от поселка (будет разведен сразу после сдачи в эксплуатацию 3-4 коттеджей). Предварительная оценка стоимости газа - 300 000 руб на участок.
Стоимость участка с 9 квт электроэнергии - 1 950 000 руб

Тел: 974 - 17 - 96

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

Re: International characters look OK in PHP app, not in MySQL GUI

2009-10-14T11:54:11Z

Thanks for this, Darren.

It turns out that, although I had already explicitly set the character set and collation for the table I was updating/viewing, that wasn't enough.

I reset the MySQL server variables to use utf8 for the default character set, then dropped and recreated the database, explicitly setting the character set and collation. Then I reloaded the data. (Fortunately it wasn't a large database.)

That proved enough for the Mac OS X development environment. On a Solaris server, I had to go one step further: explicitly set the connection character set (using "SET NAMES 'utf8'") immediately after establishing the mysqli connection. Now all is well.

I'm a bit curious why the connection character set apparently defaulted to utf8 on the Mac but not on Solaris. Perhaps the former is more utf8-friendly (or utf8-centric)?

On 10/12/09 6:37 PM, "Darren Cook" <darren@...> wrote:

> The problem in the PHP app is that they don't sort in the correct order. For
> ex., capital E with any accent sorts between A and B.

That's a curious symptom. I've no suggestion, but the other information
you didn't give was:

a) do you have the mbstring extension installed (and if so, what is the
internal_encoding, and the other settings)?

b) do you have the intl extension installed (and, again, what settings)?

c) what is the server's locale setting?

The first two you can get from a phpinfo() page. For the 3rd I think
$_ENV["LANG"] is it, or this should confirm it:
print_r(setlocale(LC_ALL,"0"));

Also take a look at http://jp.php.net/setlocale and try setting
"en_US.UTF8" explicitly at the top of your script. The comments say Mac
requires "UTF-8", so you might also want to try:
setlocale(LC_ALL,Array("en_US.UTF8","en_US.UTF-8"));

(untested)

Darren

P.S. On the MySQL side have a look at the collation setting of the database.

--
Darren Cook, Software Researcher/Developer
http://dcook.org/gobet/ (Shodan Go Bet - who will win?)
http://dcook.org/mlsn/ (Multilingual open source semantic network)
http://dcook.org/work/ (About me and my work)
http://dcook.org/blogs.html (My blogs and articles)

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

--
Michael R. Boudreau
Senior Publishing Technology Analyst
The University of Chicago Press
1427 E. 60th Street
Chicago, IL 60637
(773) 753-3298 fax: (773) 753-3383

Re: International characters look OK in PHP app, not in MySQL GUI

2009-10-12T16:37:59Z

> The problem in the PHP app is that they don't sort in the correct order. For
> ex., capital E with any accent sorts between A and B.

That's a curious symptom. I've no suggestion, but the other information
you didn't give was:

a) do you have the mbstring extension installed (and if so, what is the
internal_encoding, and the other settings)?

b) do you have the intl extension installed (and, again, what settings)?

c) what is the server's locale setting?

The first two you can get from a phpinfo() page. For the 3rd I think
$_ENV["LANG"] is it, or this should confirm it:
print_r(setlocale(LC_ALL,"0"));

Also take a look at http://jp.php.net/setlocale and try setting
"en_US.UTF8" explicitly at the top of your script. The comments say Mac
requires "UTF-8", so you might also want to try:
setlocale(LC_ALL,Array("en_US.UTF8","en_US.UTF-8"));

(untested)

Darren

P.S. On the MySQL side have a look at the collation setting of the database.

--
Darren Cook, Software Researcher/Developer
http://dcook.org/gobet/ (Shodan Go Bet - who will win?)
http://dcook.org/mlsn/ (Multilingual open source semantic network)
http://dcook.org/work/ (About me and my work)
http://dcook.org/blogs.html (My blogs and articles)

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

International characters look OK in PHP app, not in MySQL GUI

2009-10-12T09:41:07Z

Hi all,

I have a problem with inconsistent display of international characters
between my PHP application and several MySQL GUI applications: the
characters look OK but sort incorrectly in the PHP app, and they look
scrambled in the MySQL GUI.

I'm developing a database of book and publisher information on Mac OS X
(10.6.1) with PHP 5.3 and MySQL 5.1.39.

The people using the application need to be able to enter book titles and
publisher names, among other things, in French, German, and other European
languages.

My PHP pages all include

<meta http-equiv="content-type" content="text/html; charset=UTF-8" />

and the MySQL table holding the data uses UTF-8 as its default character
set.

When accented letters are entered using the Mac OS X "Special Characters"
palette or the Windows "Character Map" utility, or even copied and pasted
from a Word document, they go into the PHP app and are displayed back
correctly.

The problem in the PHP app is that they don't sort in the correct order. For
ex., capital E with any accent sorts between A and B.

When I use any GUI to view the MySQL database itself (such as CocoaMySQL or
Sequel Pro or MySQL Query Browser), the accented letters are represented by
_two_ completely different accented letters. (However, oddly, if I query the
database from the command-line 'mysql' utility in Mac OS X Terminal, the
letters look correct.)

Further, when I use the same system utilities (OS X Special Characters
palette or Windows Character Map) to edit values directly in the MySQL GUI,
they appear correct in the GUI but break my PHP app (I get an error message
from htmlspecialchars() about an illegal multibyte value).

I'd be grateful for any advice you can give.

--
Michael R. Boudreau
Senior Publishing Technology Analyst
The University of Chicago Press
1427 E. 60th Street
Chicago, IL 60637
(773) 753-3298 fax: (773) 753-3383

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

RE: PHP support of Unicode?

2009-10-11T09:55:10Z

You may also want to check out http://pecl.php.net/package/intl
Works with PHP 5.2 and PHP 5.3 and delivers a lot of functionality
(assumes it receives UTF-8).
There's also an intro article on Zend's devzone about it
http://devzone.zend.com/article/4799-Internationalization-in-PHP-5.3

Andi

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

Re: PHP support of Unicode?

2009-10-07T19:32:57Z

> encoding. But using PHP with other languages, is that possible? I
> mean, does PHP support Unicode at present time?

Yes, PHP is an excellent choice for unicode work, both for websites and
commandline utilities.

> As I understand it, the following statement is true: "PHP supports
> Unicode only as long as it is encoded as UTF-8"

UTF-8 is usually what you want. Browser and tool and editor support is
most widespread for UTF-8 (especially on linux).

Even using a Microsoft SQL Server database, which I believe was using
UCS-2LE internally, I give it the data in UTF-8, and the database
connection handles the conversion behind the scenes for me.

Be aware if you go down the UTF-16 route you have to start caring about
LE vs. BE, and also need to understand the difference between UTF-16 and
UCS-2.

> Is that correct, or does PHP also support UTF-16?

If using the mbstring extension then UTF-16 is supported (including for
regexes apparently):
http://jp.php.net/manual/en/mbstring.supported-encodings.php

mbstring has been on all shared hosts I've used, so it is usually fine
to rely on it.

Darren

--
Darren Cook, Software Researcher/Developer
http://dcook.org/gobet/ (Shodan Go Bet - who will win?)
http://dcook.org/mlsn/ (Multilingual open source semantic network)
http://dcook.org/work/ (About me and my work)
http://dcook.org/blogs.html (My blogs and articles)

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

Re: iconv - bad encoding

2009-10-04T22:49:47Z

2009/10/5 Moriyoshi Koizumi <mozo@...>

> Are you sure that $text was really encoded in UTF-8 when the output
> was garbled? try dumping bin2hex($text) to see if there's any
> difference.
>
> Regards,
> Moriyoshi
>
> 2009/10/2 Jarosek <jarosek1@...>:
> > Hello
> >
> > I noticed a problem using iconv, but investigation showed, that this is
> > not exectly the iconv itself, but something like php encoding.
> >
> > From the beginning:
> >
> > a hava an incoming variable $text;
> > it has some Polish diactics 'strona główna'.
> > I expect to remove diactics : 'strona glowna'.
> >
> > So I use iconv: iconv('utf-8', 'us-ascii//TRANSLIT', $text)
> >
> > and unfortunetly i get: 'strona g??wna' ... But only under apache, in
> > browser
> >
> > The same file, command, etc run from bash gives: 'strona glowna' ... OK
> > So i think : "bad config", but double checked and configs are
> > identical... (cli and apache2)
> >
> > Best part: for 2 or 3 times after starting computer (debian), it didn't
> > worker until I did: (apache start && apache stop - not apache restart),
> > then it worked. Now it doesn't work any more. No other config (except
> > php was changed).
> >
> > Any ideas?
> >
> >
> >
> >
> > --
> > PHP Unicode & I18N Mailing List (http://www.php.net/)
> > To unsubscribe, visit: http://www.php.net/unsub.php
> >
> >
>

Thank's for the replay. I needed to set locale to pl_PL.UTF-8 . Strange
think is that it worked without it under the cli... with the same
configuration. Well... it works now.

Best regards
JJ

Re: iconv - bad encoding

2009-10-04T18:30:32Z

Are you sure that $text was really encoded in UTF-8 when the output
was garbled? try dumping bin2hex($text) to see if there's any
difference.

Regards,
Moriyoshi

2009/10/2 Jarosek <jarosek1@...>:

> Hello
>
> I noticed a problem using iconv, but investigation showed, that this is
> not exectly the iconv itself, but something like php encoding.
>
> From the beginning:
>
> a hava an incoming variable $text;
> it has some Polish diactics 'strona główna'.
> I expect to remove diactics : 'strona glowna'.
>
> So I use iconv: iconv('utf-8', 'us-ascii//TRANSLIT', $text)
>
> and unfortunetly i get: 'strona g??wna' ... But only under apache, in
> browser
>
> The same file, command, etc run from bash gives: 'strona glowna' ... OK
> So i think : "bad config", but double checked and configs are
> identical... (cli and apache2)
>
> Best part: for 2 or 3 times after starting computer (debian), it didn't
> worker until I did: (apache start && apache stop - not apache restart),
> then it worked. Now it doesn't work any more. No other config (except
> php was changed).
>
> Any ideas?
>
>
>
>
> --
> PHP Unicode & I18N Mailing List (http://www.php.net/)
> To unsubscribe, visit: http://www.php.net/unsub.php
>
>

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

RE: PHP support of Unicode?

2009-10-03T19:28:21Z

Rasmus, Gunnar,

When Rasmus says "manipulate", it means to me "modify". Perhaps that is not
Rasmus' meaning.

However, you may need to be aware of the encoding if you are testing,
comparing, searching values, etc. as well.
For example a case-insensitive search would need to be aware of the encoding
to use the right values for upper and lower case.

More generally you should be aware of the encoding, label it properly, and
potentially convert encodings appropriately to/from processes or I/O that
may require another encoding.

My answer to Gunnar's question is that UTF-8 is a perfectly valid form of
Unicode (UTF-16, UTF-32 being others) and you don't need to favor utf-16.
PHP 5.3 has more functions for internationalization that are utf-8 and
locale based. You might look into those.

tex

-----Original Message-----
From: Rasmus Lerdorf [mailto:rasmus@...]
Sent: Saturday, October 03, 2009 9:59 AM
To: Gunnar Vestergaard
Cc: php-i18n@...
Subject: Re: [PHP-I18N] PHP support of Unicode?

Gunnar Vestergaard wrote:
> When using PHP, writing content in my local language and my neighbouring
> contries' language, ISO 8859-1 has been sufficient as a character
> encoding. But using PHP with other languages, is that possible? I mean,
> does PHP support Unicode at present time? As I understand it, the
> following statement is true:
> "PHP supports Unicode only as long as it is encoded as UTF-8"
>
> Is that correct, or does PHP also support UTF-16?

It depends what you are doing. PCRE, our regex library, only speaks
UTF-8 and there are functions like json_encode() that assume utf-8 as
well. If you are just doing pass-through stuff, you can use whatever
you want. It is only if you want to manipulate the text in some manner
that you need to worry about the encoding.

-Rasmus

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

Re: PHP support of Unicode?

2009-10-03T09:58:36Z

Gunnar Vestergaard wrote:
> When using PHP, writing content in my local language and my neighbouring
> contries' language, ISO 8859-1 has been sufficient as a character
> encoding. But using PHP with other languages, is that possible? I mean,
> does PHP support Unicode at present time? As I understand it, the
> following statement is true:
> "PHP supports Unicode only as long as it is encoded as UTF-8"
>
> Is that correct, or does PHP also support UTF-16?

It depends what you are doing. PCRE, our regex library, only speaks
UTF-8 and there are functions like json_encode() that assume utf-8 as
well. If you are just doing pass-through stuff, you can use whatever
you want. It is only if you want to manipulate the text in some manner
that you need to worry about the encoding.

-Rasmus

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

PHP support of Unicode?

2009-10-03T09:45:28Z

When using PHP, writing content in my local language and my neighbouring
contries' language, ISO 8859-1 has been sufficient as a character
encoding. But using PHP with other languages, is that possible? I mean,
does PHP support Unicode at present time? As I understand it, the
following statement is true:
"PHP supports Unicode only as long as it is encoded as UTF-8"

Is that correct, or does PHP also support UTF-16?

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

iconv - bad encoding

2009-10-01T22:54:59Z

Hello

I noticed a problem using iconv, but investigation showed, that this is
not exectly the iconv itself, but something like php encoding.

From the beginning:

a hava an incoming variable $text;
it has some Polish diactics 'strona główna'.
I expect to remove diactics : 'strona glowna'.

So I use iconv: iconv('utf-8', 'us-ascii//TRANSLIT', $text)

and unfortunetly i get: 'strona g??wna' ... But only under apache, in
browser

The same file, command, etc run from bash gives: 'strona glowna' ... OK
So i think : "bad config", but double checked and configs are
identical... (cli and apache2)

Best part: for 2 or 3 times after starting computer (debian), it didn't
worker until I did: (apache start && apache stop - not apache restart),
then it worked. Now it doesn't work any more. No other config (except
php was changed).

Any ideas?

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

Re: Problem using international characters

2009-06-29T23:57:19Z

On Mon, 29 Jun 2009 06:52:23 +0100, Nicholas Robinson wrote:

> I have a mysql database and use a php application that captures, stores,
> retrieves and displays data correctly - including French language words
> with accents. It has been running for around five years. I've recently
> written an extension that creates an openoffice writer document using
> this data. Everything works apart from the these wretched French
> characters!!! If I unzip the odt package and examine content.xml, then
> the characters are wrong - but simply cutting and pasting correct ones
> in gives me a working document, so the error is definitely in the way I
> am creating the content using php.
>
> An example of the problem is Côte. As I've just typed it, the o has a
> circumflex accent or 'hat' on it. Within the odt file, the o-circumflex
> is shown as Ã´. Piping this to od -c gives 303 203 302 264. If I take
> the o-circumflex character from gnome charmap and od -c this, then I get
> 303 264. If I copy the character from my php/web app then it is correct.
> Where are these two middle bytes coming from? I've tried various
> combinations of mbstring functions and ini file settings but without
> joy.

Hexadecimal is easier on my eyes, so:

303 203 302 264 == c3 83 c2 b4
303 264 == c3 b4

These are UTF-8 encodings:

<c3 83><c2 b4> == U+00C3 (LATIN CAPITAL LETTER A WITH TILDE),
U+00B4 (ACUTE ACCENT)
<c3 b4> == U+00F4 (LATIN SMALL LETTER O WITH CIRCUMFLEX)

In other words, somewhere in the process, a perfectly fine
UTF-8 encoded character:

<c3 b4> (U+00F4)

has been (incorrectly) converted from ISO-8859-1 (or similar)
to UTF-8, resulting in:

<c3 83><c2 b4> (U+00C3, U+00B4)

Perhaps this gives you some idea of what's going wrong.

/Nisse

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

Problem using international characters

2009-06-28T22:52:23Z

I have a mysql database and use a php application that captures, stores,
retrieves and displays data correctly - including French language words
with accents. It has been running for around five years. I've recently
written an extension that creates an openoffice writer document using
this data. Everything works apart from the these wretched French
characters!!! If I unzip the odt package and examine content.xml, then
the characters are wrong - but simply cutting and pasting correct ones
in gives me a working document, so the error is definitely in the way I
am creating the content using php.

An example of the problem is Côte. As I've just typed it, the o has a
circumflex accent or 'hat' on it. Within the odt file, the o-circumflex
is shown as Ã´. Piping this to od -c gives 303 203 302 264. If I take
the o-circumflex character from gnome charmap and od -c this, then I get
303 264. If I copy the character from my php/web app then it is correct.
Where are these two middle bytes coming from? I've tried various
combinations of mbstring functions and ini file settings but without
joy.

Thanks for any help you can give me.

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

Система минимизации топливных расходов для АВТО

2009-06-01T03:02:03Z

Экономь на бензине с нашей водородной установкой. 40 % гарантируем. Приглашаем к сотрудничеству автомагазины, авто-центры, инвесторов, дилеров, регионы.

http://ecotop10.ru

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

Re: problem with utf8_encode

2009-03-22T09:52:17Z

Make sure which version of PCRE you are using and ask PCRE guys if you
really want to stick to preg_match().

You can validate the encoding by either iconv() or
mb_convert_encoding() by specifying UTF-8 both to the "from" encoding
and "to" encoding. If the string contains a wrong UTF-8 byte sequence,
it fails and then return false.

Moriyoshi

2009/3/23 Valkum <valkum@...>:

> When i follow the way on:
>
> http://bugs.php.net/bugs-generating-backtrace.php
>
> i get this:
>
> Core was generated by `/usr/bin/php ./test.php'.
> Program terminated with signal 11, Segmentation fault.
> [New process 5913]
> #0 0xb7cecd43 in ?? () from /usr/lib/libpcre.so.3
> (gdb) bt
> #0 0xb7cecd43 in ?? () from /usr/lib/libpcre.so.3
> Cannot access memory at address 0xbf43fb90
>
> So it is a pcre bug?? How can i fix it or when the pcre devs fix the bug?
>
> Greetz Valkum
>
>
>
> Moriyoshi Koizumi schrieb:
>
> Hi,
>
> That appears to be a PCRE's problem.
> Try running it on gdb following the instruction:
> http://bugs.php.net/bugs-generating-backtrace.php
>
> Regards,
> Moriyoshi
>
> 2009/3/22 Valkum <valkum@...>:
>
>
> Hello,
>
> i have a big problem.
>
> When i try to encode a big string to utf8 i got a core dump
>
> her is my code.
>
>
> <?php
> function is_utf8($string) {
> // From http://w3.org/International/questions/qa-forms-utf-8.html
> return preg_match('%^(?:
> [\x09\x0A\x0D\x20-\x7E] # ASCII
> | [\xC2-\xDF][\x80-\xBF] # non-overlong 2-byte
> | \xE0[\xA0-\xBF][\x80-\xBF] # excluding overlongs
> | [\xE1-\xEC\xEE\xEF][\x80-\xBF]{2} # straight 3-byte
> | \xED[\x80-\x9F][\x80-\xBF] # excluding surrogates
> | \xF0[\x90-\xBF][\x80-\xBF]{2} # planes 1-3
> | [\xF1-\xF3][\x80-\xBF]{3} # planes 4-15
> | \xF4[\x80-\x8F][\x80-\xBF]{2} # plane 16
> )*$%xs', $string);
> }
>
> function output($string)
> {
> if(!is_utf8($string))
> $string = utf8_encode($string);
> return addslashes($string);
> }
>
> $string = <<<EOH
> <div align="justify">
> <p>- Im Aufbau -</p>
> <h3 id="aventurien">Aventurien</h3>
> <div style="border: 1px none ; margin: 5px 5px 5px 10px; float:
> right; width: 100px;"><strong>Navigation</strong> <br />
> <br />
> <a href="#aventurien">Aventurien</a><br />
> <a href="#ferdok">Die Stadt Ferdok</a><br />
> <a href="#weitere">Weitere Ziele</a></div>
> <p>{mosimage} Aventurien ist ein Kontinent der Welt Dere und
> Ausgangspunkt für die meisten Abenteuer in der Welt von <em>Das
> Schwarze Auge</em>. Von Nord nach Süd erstreckt sich der
> Kontinent ca. über 3000 Meilen, von Ost nach West sind es
> immerhin noch 2000 Meilen. Von den Tundren Thorwals bis zur
> Wüste Khom kann man so ziemlich alle Klimazonen in Aventurien
> finden.</p>
> <p>Im Herzen Aventuriens liegt das Kaiserreich, auch das Mittelreich
> genannt, mit seiner Hauptstadt Gareth (rot umrandeter Bereich). Die
> Kultur erinnert entfernt an das mittelalterliche Europa. Die
> Handlung Drakensangs wird zu großen Teilen im Mittelreich
> spielen, genauer gesagt, in der Umgebung der Stadt Ferdok (s.u.).
> Doch auch andere, exotischere Orte sollen Ziel der Reise werden.</p>
> <p>Zahlreiche Völker und Rassen bewohnen den Kontinent, allen
> voran natürlich die Menschenvölker, die die Mehrheit der
> Bewohner stellen. Unter den Menschen gibt es zahlreiche
> unterschiedliche Kulturen, z. B. die wikingerähnlichen
> Thorwaler, das Nomadenvolk der Nivesen oder eben die
> Mittelländer. Daneben gibt es natürlich noch
> fantastischere Völker wie die Elfen (mit mehrern Untergruppen),
> Zwerge, Orks und mehr, eben alles, was eine Fantasywelt zu bieten
> hat.</p>
> <p> </p>
> <h3 id="ferdok">Ferdok</h3>
> <p><a target="_blank" href="images/stories/stadtplan_g.jpg">
> {mosimage}</a></p>
> <p>Ferdok ist eine Grafenstadt im Mittelreich, etwas westlich der
> Hauptstadt Gareth, und hat etwa 3000 Einwohner. Sie gehört zu
> den ältesten menschlichen Siedlungen des Kosch. Im Laufe der
> Geschichte mußte die Stadt jedoch wegen einer Änderung
> des Flußlaufes des Großen Flußes im Jahre 270 BF
> verlegt werden, da die Stadt in der Bedeutungslosigkeit zu versinken
> drohte. Heute liegt Ferdok wieder direkt an der Einmündung des
> Rakula in den Großen Fluß. Obwohl die Stadt die
> frühere Bedeutung längst verloren hat, hat sich Ferdok als
> ein wichtiger Handelshafen etabliert (weltberühmt: Ferdoker
> Bier). Hier werden die Waren von Gareth umgeschlagen, die über
> die große Handelsstraße von und nach Ferdok verfrachtet
> werden. Ferdok ist damit eines der Tore zum Westen und
> ermöglicht schnelle Reisen in andere Teile der Aventuriens.</p>
> <p>Verwaltungstechnisch gehört Ferdok zum Fürstentum
> Kosch, dessen Hauptstadt sie langezeit war. Mittlerweile hat sie
> diesen Status jedoch an Angbar verloren. Trotz seiner wichtigen
> Rolle als Handelsort sind die Bewohner Ferdoks ein eher biederes
> Völkchen und hängen der Erinnerung an die ruhmreichere
> Vergangenheit hinterher. Nachts muss man auf den Straßen
> neuerdings aufpassen. Zur Handlungszeit verunsichert nämlich
> eine grauenhafte Mordserie die Bewohner Ferdoks und lässt die
> Bevölkerung nachts nicht richtig schlafen. Einige Bereiche
> sollte man dann grundsätzlich nicht mehr besuchen, wenn einem
> die eigene Gesundheit am Herzen liegt.</p>
> <p>Die Stadt wird eine zentrale Anlaufstelle in Drakensang sein,
> weswegen sie auch vollständig, nach den Vorgaben des
> DSA-Regelwerks in das Spiel eingebaut wird. Der Stadtplan (zum
> Vergrößern anklicken) wurde von Radon Labs dem Regelwerk
> direkt entnommen und wird Euch auch für Drakensang gute Dienste
> leisten.</p>
> <br />
> <h3 id="weitere">Weitere Reiseziele des Spiels</h3>
> <a target="_blank"
> href="images/stories/artikel/map.jpg">{mosimage}</a> Insgesamt soll
> es 12 Hauptregionen geben, die jeweils ca. 1 Quadratkilometer
> groß sind. Alle diese Regionen unterteilen sich nochmal in
> über 50 kleinere Gebiete. Bekannt sind neben Ferdok bislang:
> <ul>
> <li>Avestreu (kleines Dorf südöstl. von Ferdok)</li>
> <li>Dunkelwald (südl. von Ferdok)</li>
> <li>Ruine Blutberge (südl. von Ferdok, am Rand des
> Dunkelwaldes)</li>
> <li>Moorbrück (südl. des Dunkelwaldes)</li>
> <li>Burg Grimmzahn (westl. von Moorbrück)</li>
> <li>Murolosch (eine Zwergenstadt)</li>
> <li>der Berg Drachensang / Drakensang (im Amboss-Gebirge
> gelegen)</li>
> </ul>
> <p> </p>
> <p> </p>
> <p>Ausführlichere Infos:</p>
> <p><a title="Wiki Aventurica" target="_blank"
> href="http://dsa4.de/wiki">Wiki Aventurica </a>(externer Link)<br />
> <a href="http://www.eychgras.de/koschwiki/index.php"
> target="_blank">KoschWiki</a> (externer Link)</p>
> <p> </p>
> </div>
> EOH;
> print_r(output($string));
> ?>
>
> Please help me. When i delete some code from <ul> to </div> at the end, i
> get no core dump. only with the full text.
>
> What is the problem??
>
> Greetz Valkum
>
>
>
>
>

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

Re: problem with utf8_encode

2009-03-22T09:29:55Z

When i follow the way on:

http://bugs.php.net/bugs-generating-backtrace.php

i get this:

Core was generated by `/usr/bin/php ./test.php'.
Program terminated with signal 11, Segmentation fault.
[New process 5913]
#0 0xb7cecd43 in ?? () from /usr/lib/libpcre.so.3
(gdb) bt
#0 0xb7cecd43 in ?? () from /usr/lib/libpcre.so.3
Cannot access memory at address 0xbf43fb90

So it is a pcre bug?? How can i fix it or when the pcre devs fix the bug?

Greetz Valkum

Moriyoshi Koizumi schrieb:

> Hi,
>
> That appears to be a PCRE's problem.
> Try running it on gdb following the instruction:
> http://bugs.php.net/bugs-generating-backtrace.php
>
> Regards,
> Moriyoshi
>
> 2009/3/22 Valkum <valkum@...>:
>
>> Hello,
>>
>> i have a big problem.
>>
>> When i try to encode a big string to utf8 i got a core dump
>>
>> her is my code.
>>
>>
>> <?php
>> function is_utf8($string) {
>> // From http://w3.org/International/questions/qa-forms-utf-8.html
>> return preg_match('%^(?:
>> [\x09\x0A\x0D\x20-\x7E] # ASCII
>> | [\xC2-\xDF][\x80-\xBF] # non-overlong 2-byte
>> | \xE0[\xA0-\xBF][\x80-\xBF] # excluding overlongs
>> | [\xE1-\xEC\xEE\xEF][\x80-\xBF]{2} # straight 3-byte
>> | \xED[\x80-\x9F][\x80-\xBF] # excluding surrogates
>> | \xF0[\x90-\xBF][\x80-\xBF]{2} # planes 1-3
>> | [\xF1-\xF3][\x80-\xBF]{3} # planes 4-15
>> | \xF4[\x80-\x8F][\x80-\xBF]{2} # plane 16
>> )*$%xs', $string);
>> }
>>
>> function output($string)
>> {
>> if(!is_utf8($string))
>> $string = utf8_encode($string);
>> return addslashes($string);
>> }
>>
>> $string = <<<EOH
>> <div align="justify">
>> <p>- Im Aufbau -</p>
>> <h3 id="aventurien">Aventurien</h3>
>> <div style="border: 1px none ; margin: 5px 5px 5px 10px; float:
>> right; width: 100px;"><strong>Navigation</strong> <br />
>> <br />
>> <a href="#aventurien">Aventurien</a><br />
>> <a href="#ferdok">Die Stadt Ferdok</a><br />
>> <a href="#weitere">Weitere Ziele</a></div>
>> <p>{mosimage} Aventurien ist ein Kontinent der Welt Dere und
>> Ausgangspunkt für die meisten Abenteuer in der Welt von <em>Das
>> Schwarze Auge</em>. Von Nord nach Süd erstreckt sich der
>> Kontinent ca. über 3000 Meilen, von Ost nach West sind es
>> immerhin noch 2000 Meilen. Von den Tundren Thorwals bis zur
>> Wüste Khom kann man so ziemlich alle Klimazonen in Aventurien
>> finden.</p>
>> <p>Im Herzen Aventuriens liegt das Kaiserreich, auch das Mittelreich
>> genannt, mit seiner Hauptstadt Gareth (rot umrandeter Bereich). Die
>> Kultur erinnert entfernt an das mittelalterliche Europa. Die
>> Handlung Drakensangs wird zu großen Teilen im Mittelreich
>> spielen, genauer gesagt, in der Umgebung der Stadt Ferdok (s.u.).
>> Doch auch andere, exotischere Orte sollen Ziel der Reise werden.</p>
>> <p>Zahlreiche Völker und Rassen bewohnen den Kontinent, allen
>> voran natürlich die Menschenvölker, die die Mehrheit der
>> Bewohner stellen. Unter den Menschen gibt es zahlreiche
>> unterschiedliche Kulturen, z. B. die wikingerähnlichen
>> Thorwaler, das Nomadenvolk der Nivesen oder eben die
>> Mittelländer. Daneben gibt es natürlich noch
>> fantastischere Völker wie die Elfen (mit mehrern Untergruppen),
>> Zwerge, Orks und mehr, eben alles, was eine Fantasywelt zu bieten
>> hat.</p>
>> <p> </p>
>> <h3 id="ferdok">Ferdok</h3>
>> <p><a target="_blank" href="images/stories/stadtplan_g.jpg">
>> {mosimage}</a></p>
>> <p>Ferdok ist eine Grafenstadt im Mittelreich, etwas westlich der
>> Hauptstadt Gareth, und hat etwa 3000 Einwohner. Sie gehört zu
>> den ältesten menschlichen Siedlungen des Kosch. Im Laufe der
>> Geschichte mußte die Stadt jedoch wegen einer Änderung
>> des Flußlaufes des Großen Flußes im Jahre 270 BF
>> verlegt werden, da die Stadt in der Bedeutungslosigkeit zu versinken
>> drohte. Heute liegt Ferdok wieder direkt an der Einmündung des
>> Rakula in den Großen Fluß. Obwohl die Stadt die
>> frühere Bedeutung längst verloren hat, hat sich Ferdok als
>> ein wichtiger Handelshafen etabliert (weltberühmt: Ferdoker
>> Bier). Hier werden die Waren von Gareth umgeschlagen, die über
>> die große Handelsstraße von und nach Ferdok verfrachtet
>> werden. Ferdok ist damit eines der Tore zum Westen und
>> ermöglicht schnelle Reisen in andere Teile der Aventuriens.</p>
>> <p>Verwaltungstechnisch gehört Ferdok zum Fürstentum
>> Kosch, dessen Hauptstadt sie langezeit war. Mittlerweile hat sie
>> diesen Status jedoch an Angbar verloren. Trotz seiner wichtigen
>> Rolle als Handelsort sind die Bewohner Ferdoks ein eher biederes
>> Völkchen und hängen der Erinnerung an die ruhmreichere
>> Vergangenheit hinterher. Nachts muss man auf den Straßen
>> neuerdings aufpassen. Zur Handlungszeit verunsichert nämlich
>> eine grauenhafte Mordserie die Bewohner Ferdoks und lässt die
>> Bevölkerung nachts nicht richtig schlafen. Einige Bereiche
>> sollte man dann grundsätzlich nicht mehr besuchen, wenn einem
>> die eigene Gesundheit am Herzen liegt.</p>
>> <p>Die Stadt wird eine zentrale Anlaufstelle in Drakensang sein,
>> weswegen sie auch vollständig, nach den Vorgaben des
>> DSA-Regelwerks in das Spiel eingebaut wird. Der Stadtplan (zum
>> Vergrößern anklicken) wurde von Radon Labs dem Regelwerk
>> direkt entnommen und wird Euch auch für Drakensang gute Dienste
>> leisten.</p>
>> <br />
>> <h3 id="weitere">Weitere Reiseziele des Spiels</h3>
>> <a target="_blank"
>> href="images/stories/artikel/map.jpg">{mosimage}</a> Insgesamt soll
>> es 12 Hauptregionen geben, die jeweils ca. 1 Quadratkilometer
>> groß sind. Alle diese Regionen unterteilen sich nochmal in
>> über 50 kleinere Gebiete. Bekannt sind neben Ferdok bislang:
>> <ul>
>> <li>Avestreu (kleines Dorf südöstl. von Ferdok)</li>
>> <li>Dunkelwald (südl. von Ferdok)</li>
>> <li>Ruine Blutberge (südl. von Ferdok, am Rand des
>> Dunkelwaldes)</li>
>> <li>Moorbrück (südl. des Dunkelwaldes)</li>
>> <li>Burg Grimmzahn (westl. von Moorbrück)</li>
>> <li>Murolosch (eine Zwergenstadt)</li>
>> <li>der Berg Drachensang / Drakensang (im Amboss-Gebirge
>> gelegen)</li>
>> </ul>
>> <p> </p>
>> <p> </p>
>> <p>Ausführlichere Infos:</p>
>> <p><a title="Wiki Aventurica" target="_blank"
>> href="http://dsa4.de/wiki">Wiki Aventurica </a>(externer Link)<br />
>> <a href="http://www.eychgras.de/koschwiki/index.php"
>> target="_blank">KoschWiki</a> (externer Link)</p>
>> <p> </p>
>> </div>
>> EOH;
>> print_r(output($string));
>> ?>
>>
>> Please help me. When i delete some code from <ul> to </div> at the end, i
>> get no core dump. only with the full text.
>>
>> What is the problem??
>>
>> Greetz Valkum
>>
>>
>
>

Re: problem with utf8_encode

2009-03-22T01:54:16Z

Hi,

That appears to be a PCRE's problem.
Try running it on gdb following the instruction:
http://bugs.php.net/bugs-generating-backtrace.php

Regards,
Moriyoshi

2009/3/22 Valkum <valkum@...>:

> Hello,
>
> i have a big problem.
>
> When i try to encode a big string to utf8 i got a core dump
>
> her is my code.
>
>
> <?php
> function is_utf8($string) {
> // From http://w3.org/International/questions/qa-forms-utf-8.html
> return preg_match('%^(?:
> [\x09\x0A\x0D\x20-\x7E] # ASCII
> | [\xC2-\xDF][\x80-\xBF] # non-overlong 2-byte
> | \xE0[\xA0-\xBF][\x80-\xBF] # excluding overlongs
> | [\xE1-\xEC\xEE\xEF][\x80-\xBF]{2} # straight 3-byte
> | \xED[\x80-\x9F][\x80-\xBF] # excluding surrogates
> | \xF0[\x90-\xBF][\x80-\xBF]{2} # planes 1-3
> | [\xF1-\xF3][\x80-\xBF]{3} # planes 4-15
> | \xF4[\x80-\x8F][\x80-\xBF]{2} # plane 16
> )*$%xs', $string);
> }
>
> function output($string)
> {
> if(!is_utf8($string))
> $string = utf8_encode($string);
> return addslashes($string);
> }
>
> $string = <<<EOH
> <div align="justify">
> <p>- Im Aufbau -</p>
> <h3 id="aventurien">Aventurien</h3>
> <div style="border: 1px none ; margin: 5px 5px 5px 10px; float:
> right; width: 100px;"><strong>Navigation</strong> <br />
> <br />
> <a href="#aventurien">Aventurien</a><br />
> <a href="#ferdok">Die Stadt Ferdok</a><br />
> <a href="#weitere">Weitere Ziele</a></div>
> <p>{mosimage} Aventurien ist ein Kontinent der Welt Dere und
> Ausgangspunkt für die meisten Abenteuer in der Welt von <em>Das
> Schwarze Auge</em>. Von Nord nach Süd erstreckt sich der
> Kontinent ca. über 3000 Meilen, von Ost nach West sind es
> immerhin noch 2000 Meilen. Von den Tundren Thorwals bis zur
> Wüste Khom kann man so ziemlich alle Klimazonen in Aventurien
> finden.</p>
> <p>Im Herzen Aventuriens liegt das Kaiserreich, auch das Mittelreich
> genannt, mit seiner Hauptstadt Gareth (rot umrandeter Bereich). Die
> Kultur erinnert entfernt an das mittelalterliche Europa. Die
> Handlung Drakensangs wird zu großen Teilen im Mittelreich
> spielen, genauer gesagt, in der Umgebung der Stadt Ferdok (s.u.).
> Doch auch andere, exotischere Orte sollen Ziel der Reise werden.</p>
> <p>Zahlreiche Völker und Rassen bewohnen den Kontinent, allen
> voran natürlich die Menschenvölker, die die Mehrheit der
> Bewohner stellen. Unter den Menschen gibt es zahlreiche
> unterschiedliche Kulturen, z. B. die wikingerähnlichen
> Thorwaler, das Nomadenvolk der Nivesen oder eben die
> Mittelländer. Daneben gibt es natürlich noch
> fantastischere Völker wie die Elfen (mit mehrern Untergruppen),
> Zwerge, Orks und mehr, eben alles, was eine Fantasywelt zu bieten
> hat.</p>
> <p> </p>
> <h3 id="ferdok">Ferdok</h3>
> <p><a target="_blank" href="images/stories/stadtplan_g.jpg">
> {mosimage}</a></p>
> <p>Ferdok ist eine Grafenstadt im Mittelreich, etwas westlich der
> Hauptstadt Gareth, und hat etwa 3000 Einwohner. Sie gehört zu
> den ältesten menschlichen Siedlungen des Kosch. Im Laufe der
> Geschichte mußte die Stadt jedoch wegen einer Änderung
> des Flußlaufes des Großen Flußes im Jahre 270 BF
> verlegt werden, da die Stadt in der Bedeutungslosigkeit zu versinken
> drohte. Heute liegt Ferdok wieder direkt an der Einmündung des
> Rakula in den Großen Fluß. Obwohl die Stadt die
> frühere Bedeutung längst verloren hat, hat sich Ferdok als
> ein wichtiger Handelshafen etabliert (weltberühmt: Ferdoker
> Bier). Hier werden die Waren von Gareth umgeschlagen, die über
> die große Handelsstraße von und nach Ferdok verfrachtet
> werden. Ferdok ist damit eines der Tore zum Westen und
> ermöglicht schnelle Reisen in andere Teile der Aventuriens.</p>
> <p>Verwaltungstechnisch gehört Ferdok zum Fürstentum
> Kosch, dessen Hauptstadt sie langezeit war. Mittlerweile hat sie
> diesen Status jedoch an Angbar verloren. Trotz seiner wichtigen
> Rolle als Handelsort sind die Bewohner Ferdoks ein eher biederes
> Völkchen und hängen der Erinnerung an die ruhmreichere
> Vergangenheit hinterher. Nachts muss man auf den Straßen
> neuerdings aufpassen. Zur Handlungszeit verunsichert nämlich
> eine grauenhafte Mordserie die Bewohner Ferdoks und lässt die
> Bevölkerung nachts nicht richtig schlafen. Einige Bereiche
> sollte man dann grundsätzlich nicht mehr besuchen, wenn einem
> die eigene Gesundheit am Herzen liegt.</p>
> <p>Die Stadt wird eine zentrale Anlaufstelle in Drakensang sein,
> weswegen sie auch vollständig, nach den Vorgaben des
> DSA-Regelwerks in das Spiel eingebaut wird. Der Stadtplan (zum
> Vergrößern anklicken) wurde von Radon Labs dem Regelwerk
> direkt entnommen und wird Euch auch für Drakensang gute Dienste
> leisten.</p>
> <br />
> <h3 id="weitere">Weitere Reiseziele des Spiels</h3>
> <a target="_blank"
> href="images/stories/artikel/map.jpg">{mosimage}</a> Insgesamt soll
> es 12 Hauptregionen geben, die jeweils ca. 1 Quadratkilometer
> groß sind. Alle diese Regionen unterteilen sich nochmal in
> über 50 kleinere Gebiete. Bekannt sind neben Ferdok bislang:
> <ul>
> <li>Avestreu (kleines Dorf südöstl. von Ferdok)</li>
> <li>Dunkelwald (südl. von Ferdok)</li>
> <li>Ruine Blutberge (südl. von Ferdok, am Rand des
> Dunkelwaldes)</li>
> <li>Moorbrück (südl. des Dunkelwaldes)</li>
> <li>Burg Grimmzahn (westl. von Moorbrück)</li>
> <li>Murolosch (eine Zwergenstadt)</li>
> <li>der Berg Drachensang / Drakensang (im Amboss-Gebirge
> gelegen)</li>
> </ul>
> <p> </p>
> <p> </p>
> <p>Ausführlichere Infos:</p>
> <p><a title="Wiki Aventurica" target="_blank"
> href="http://dsa4.de/wiki">Wiki Aventurica </a>(externer Link)<br />
> <a href="http://www.eychgras.de/koschwiki/index.php"
> target="_blank">KoschWiki</a> (externer Link)</p>
> <p> </p>
> </div>
> EOH;
> print_r(output($string));
> ?>
>
> Please help me. When i delete some code from <ul> to </div> at the end, i
> get no core dump. only with the full text.
>
> What is the problem??
>
> Greetz Valkum
>

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

Re: mb_check_encoding

2009-03-22T01:52:44Z

Hi,

mb_check_encoding() without the first parameter is never supposed to
work properly.
I'm thinking of removing this feature.

Regards,
Moriyoshi

On Sat, Mar 21, 2009 at 7:10 AM, Giacomo Mazzocato <gmazzocato@...> wrote:

> if (mb_check_encoding()) {
> echo "request encoding ok" ;
> } else {
> echo "request encoding not ok" ;
> }
> echo "</p>" ;
> ?>
>
> </body>
> </html>
>
> If you post the value from your browser, all is ok because the
> encoding of the page is recognized by the browser as utf-8 (I think).
> But if I call that page with curl simulating an Invalid encoding
> attack,
> I get the same result(request encoding ok) while I should get request encoding
> not ok.
> Here's the command I used :
> curl --data-urlencode $'foo=prov\xef'
> http://localhost/mine/test/encoding.php
> Thank you in advance
> Bye,
> Giacomo
>
> --
> PHP Unicode & I18N Mailing List (http://www.php.net/)
> To unsubscribe, visit: http://www.php.net/unsub.php
>
>

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

problem with utf8_encode

2009-03-21T15:35:29Z

Hello,

i have a big problem.

When i try to encode a big string to utf8 i got a core dump

her is my code.

<?php
function is_utf8($string) {
// From http://w3.org/International/questions/qa-forms-utf-8.html
return preg_match('%^(?:
[\x09\x0A\x0D\x20-\x7E] # ASCII
| [\xC2-\xDF][\x80-\xBF] # non-overlong 2-byte
| \xE0[\xA0-\xBF][\x80-\xBF] # excluding overlongs
| [\xE1-\xEC\xEE\xEF][\x80-\xBF]{2} # straight 3-byte
| \xED[\x80-\x9F][\x80-\xBF] # excluding surrogates
| \xF0[\x90-\xBF][\x80-\xBF]{2} # planes 1-3
| [\xF1-\xF3][\x80-\xBF]{3} # planes 4-15
| \xF4[\x80-\x8F][\x80-\xBF]{2} # plane 16
)*$%xs', $string);
}

function output($string)
{
if(!is_utf8($string))
$string = utf8_encode($string);
return addslashes($string);
}

$string = <<<EOH
<div align="justify">
<p>- Im Aufbau -</p>
<h3 id="aventurien">Aventurien</h3>
<div style="border: 1px none ; margin: 5px 5px 5px 10px; float:
right; width: 100px;"><strong>Navigation</strong> <br />
<br />
<a href="#aventurien">Aventurien</a><br />
<a href="#ferdok">Die Stadt Ferdok</a><br />
<a href="#weitere">Weitere Ziele</a></div>
<p>{mosimage} Aventurien ist ein Kontinent der Welt Dere und
Ausgangspunkt für die meisten Abenteuer in der Welt von <em>Das
Schwarze Auge</em>. Von Nord nach Süd erstreckt sich der
Kontinent ca. über 3000 Meilen, von Ost nach West sind es
immerhin noch 2000 Meilen. Von den Tundren Thorwals bis zur
Wüste Khom kann man so ziemlich alle Klimazonen in Aventurien
finden.</p>
<p>Im Herzen Aventuriens liegt das Kaiserreich, auch das Mittelreich
genannt, mit seiner Hauptstadt Gareth (rot umrandeter Bereich). Die
Kultur erinnert entfernt an das mittelalterliche Europa. Die
Handlung Drakensangs wird zu großen Teilen im Mittelreich
spielen, genauer gesagt, in der Umgebung der Stadt Ferdok (s.u.).
Doch auch andere, exotischere Orte sollen Ziel der Reise werden.</p>
<p>Zahlreiche Völker und Rassen bewohnen den Kontinent, allen
voran natürlich die Menschenvölker, die die Mehrheit der
Bewohner stellen. Unter den Menschen gibt es zahlreiche
unterschiedliche Kulturen, z. B. die wikingerähnlichen
Thorwaler, das Nomadenvolk der Nivesen oder eben die
Mittelländer. Daneben gibt es natürlich noch
fantastischere Völker wie die Elfen (mit mehrern Untergruppen),
Zwerge, Orks und mehr, eben alles, was eine Fantasywelt zu bieten
hat.</p>
<p> </p>
<h3 id="ferdok">Ferdok</h3>
<p><a target="_blank" href="images/stories/stadtplan_g.jpg">
{mosimage}</a></p>
<p>Ferdok ist eine Grafenstadt im Mittelreich, etwas westlich der
Hauptstadt Gareth, und hat etwa 3000 Einwohner. Sie gehört zu
den ältesten menschlichen Siedlungen des Kosch. Im Laufe der
Geschichte mußte die Stadt jedoch wegen einer Änderung
des Flußlaufes des Großen Flußes im Jahre 270 BF
verlegt werden, da die Stadt in der Bedeutungslosigkeit zu versinken
drohte. Heute liegt Ferdok wieder direkt an der Einmündung des
Rakula in den Großen Fluß. Obwohl die Stadt die
frühere Bedeutung längst verloren hat, hat sich Ferdok als
ein wichtiger Handelshafen etabliert (weltberühmt: Ferdoker
Bier). Hier werden die Waren von Gareth umgeschlagen, die über
die große Handelsstraße von und nach Ferdok verfrachtet
werden. Ferdok ist damit eines der Tore zum Westen und
ermöglicht schnelle Reisen in andere Teile der Aventuriens.</p>
<p>Verwaltungstechnisch gehört Ferdok zum Fürstentum
Kosch, dessen Hauptstadt sie langezeit war. Mittlerweile hat sie
diesen Status jedoch an Angbar verloren. Trotz seiner wichtigen
Rolle als Handelsort sind die Bewohner Ferdoks ein eher biederes
Völkchen und hängen der Erinnerung an die ruhmreichere
Vergangenheit hinterher. Nachts muss man auf den Straßen
neuerdings aufpassen. Zur Handlungszeit verunsichert nämlich
eine grauenhafte Mordserie die Bewohner Ferdoks und lässt die
Bevölkerung nachts nicht richtig schlafen. Einige Bereiche
sollte man dann grundsätzlich nicht mehr besuchen, wenn einem
die eigene Gesundheit am Herzen liegt.</p>
<p>Die Stadt wird eine zentrale Anlaufstelle in Drakensang sein,
weswegen sie auch vollständig, nach den Vorgaben des
DSA-Regelwerks in das Spiel eingebaut wird. Der Stadtplan (zum
Vergrößern anklicken) wurde von Radon Labs dem Regelwerk
direkt entnommen und wird Euch auch für Drakensang gute Dienste
leisten.</p>
<br />
<h3 id="weitere">Weitere Reiseziele des Spiels</h3>
<a target="_blank"
href="images/stories/artikel/map.jpg">{mosimage}</a> Insgesamt soll
es 12 Hauptregionen geben, die jeweils ca. 1 Quadratkilometer
groß sind. Alle diese Regionen unterteilen sich nochmal in
über 50 kleinere Gebiete. Bekannt sind neben Ferdok bislang:
<ul>
<li>Avestreu (kleines Dorf südöstl. von Ferdok)</li>
<li>Dunkelwald (südl. von Ferdok)</li>
<li>Ruine Blutberge (südl. von Ferdok, am Rand des
Dunkelwaldes)</li>
<li>Moorbrück (südl. des Dunkelwaldes)</li>
<li>Burg Grimmzahn (westl. von Moorbrück)</li>
<li>Murolosch (eine Zwergenstadt)</li>
<li>der Berg Drachensang / Drakensang (im Amboss-Gebirge
gelegen)</li>
</ul>
<p> </p>
<p> </p>
<p>Ausführlichere Infos:</p>
<p><a title="Wiki Aventurica" target="_blank"
href="http://dsa4.de/wiki">Wiki Aventurica </a>(externer Link)<br />
<a href="http://www.eychgras.de/koschwiki/index.php"
target="_blank">KoschWiki</a> (externer Link)</p>
<p> </p>
</div>
EOH;
print_r(output($string));
?>

Please help me. When i delete some code from <ul> to </div> at the end,
i get no core dump. only with the full text.

What is the problem??

Greetz Valkum

mb_check_encoding

2009-03-20T15:10:44Z

Hi,
I'm having some problems with mb_check_encoding.
When it's invoked without parameters does it check
all the REQUEST variables to see if their values have the same
encoding
as mb_internal_encoding() ? (This is what I understood from the
manual)
As far as I know that doesn't happen.
Here's an example file :
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html>
<head>
<title>Help needed</title>
<meta http-equiv="Content-Type" content=
"text/html; charset=utf-8" />
</head>
<body>
<form action="?" method="post">
<input type="text" name="foo" value="" />
<input type="submit" value="submit" />
</form>
<?php
mb_internal_encoding("UTF-8");
var_dump($_REQUEST) ;
echo "<p>" ;
if (mb_check_encoding()) {
echo "request encoding ok" ;
} else {
echo "request encoding not ok" ;
}
echo "</p>" ;
?>

</body>
</html>

If you post the value from your browser, all is ok because the
encoding of the page is recognized by the browser as utf-8 (I think).
But if I call that page with curl simulating an Invalid encoding
attack,
I get the same result(request encoding ok) while I should get request encoding
not ok.
Here's the command I used :
curl --data-urlencode $'foo=prov\xef'
http://localhost/mine/test/encoding.php
Thank you in advance
Bye,
Giacomo

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

mb_check_encoding

2009-03-20T14:51:52Z

Hi,
I'm having some problems with mb_check_encoding.
When it's invoked without parameters does it check
all the REQUEST variables to see if their values have the same
encoding
as mb_internal_encoding() ? (This is what I understood from the
manual)
As far as I know that doesn't happen.
Here's an example file :
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html>
<head>
<title>Help needed</title>
<meta http-equiv="Content-Type" content=
"text/html; charset=utf-8" />
</head>
<body>
<form action="?" method="post">
<input type="text" name="foo" value="" />
<input type="submit" value="submit" />
</form>
<?php
mb_internal_encoding("UTF-8");
var_dump($_REQUEST) ;
echo "<p>" ;
if (mb_check_encoding()) {
echo "request encoding ok" ;
} else {
echo "request encoding not ok" ;
}
echo "</p>" ;
?>

</body>
</html>

If you post the value from your browser, all is ok because the
encoding of the page is recognized by the browser as utf-8 (I think).
But if I call that page with curl simulating an Invalid encoding
attack,
I get the same result(request encoding ok).
Here's the command I used :
curl --data-urlencode $'foo=prov\xef'
http://localhost/mine/test/encoding.php
Thank you in advance
Bye,
Giacomo

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

mb_check_encoding

2009-03-20T14:45:43Z

Hi,
I'm having some problems with mb_check_encoding.
When it's invoked without parameters does it check
all the REQUEST variables to see if their values have the same
encoding
as mb_internal_encoding() ? (This is what I understood from the
manual)
As far as I know that doesn't happen.
Here's an example file :
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html>
<head>
<title>Help needed</title>
<meta http-equiv="Content-Type" content=
"text/html; charset=utf-8" />
</head>
<body>
<form action="?" method="post">
<input type="text" name="foo" value="" />
<input type="submit" value="submit" />
</form>
<?php
mb_internal_encoding("UTF-8");
var_dump($_REQUEST) ;
echo "<p>" ;
if (mb_check_encoding()) {
echo "request encoding ok" ;
} else {
echo "request encoding not ok" ;
}
echo "</p>" ;
?>

</body>
</html>

If you post the value from your browser, all is ok because the
encoding of the page is recognized by the browser as utf-8 (I think).
But if I call that page with curl simulating an Invalid encoding
attack,
I get the same result(request encoding ok) but I should get request
encoding not ok
Here's the command I used :
curl --data-urlencode $'foo=prov\xef'
http://localhost/mine/test/encoding.php
Thank you in advance
Bye,
Giacomo
--
Using Opera's revolutionary e-mail client: http://www.opera.com/mail/

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

The Secret of Making Up - By The Author

2009-03-19T04:44:04Z

Hello Dear!

My name is T.W. Jackson and I am the author of the most commented relationships book lately "The Magic of Making Up".

If you have broken up and want to get your guy or girl back, obviously I can't talk too or be with everyone, I just don't have enough time. But I have done what I believe to be the next best thing - I have put my years of experience into a really easy to follow love recipe for "getting back together" and again I forewarn you right now - these are techniques and strategies that are NOT conventional wisdom and I doubt you have ever read or heard these techniques before.

...and I'll tell you that this stuff works! ...maybe too well?

If you want to read and learn more, and you are interested in having my book, just send me a reply to 14842goy.gwenith@... so I can send you more information.

Best Regards,
T. Jackson

------------------------------------------------------------------
This email has been written and proved to be in compliance with the recently established can-spam act law in US. We are not provoking or forcing any person in any way to participate in our programs. To participate is your own decision and you carry the responsibility of taking further part in this promotion. Anyway, if you don't want to receive more good offers from us, you can simply Unsubscribe by sending us a notification email to get.me_out_now@... with a mail-subject and text "Unsubscribe me", and we will get your email out of our list within 10 days.

This message is STRICTLY CONFIDENTIAL and is solely for the individual or organisation to whom it is addressed. It may contain PRIVILEGED and CONFIDENTIAL information. If you are not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication and its contents is strictly prohibited. If you are not the intended recipient you should not read, copy, distribute, disclose or otherwise use the information in this email. Email may be susceptible to data corruption, interception and unauthorised amendment, and we do not accept liability for any such corruption, interception or amendment or the consequences thereof or your reliance on any information contained therein if you are not the intended recipient. If you are not interested in the offered promotions, please just don't answer. If you think you have received this message and its contents in error, please delete it from your computer, or follow the unsubscribing procedure shown above.
------------------------------------------------------------------

Re: Intl String Resource Formats

2009-03-12T12:24:46Z

Hi!

> Since the intl implementation is still some way off, what would you
> recommend to use as a string resource format? Right now we are planning on
> just having files with large php arrays in them (one file per locale) and
> then including the appropriate file at system startup. Is there a better
> way? We can't use the php gettext extension, since it doesn't support the
> Linux gettext's context sensitivity.

You may want to look at Zend Framework implementation of locale data and
translations here:
http://framework.zend.com/manual/en/zend.locale.html
http://framework.zend.com/manual/en/zend.translate.html

Maybe it will fit your purposes.
--
Stanislav Malyshev, Zend Software Architect
stas@... http://www.zend.com/
(408)253-8829 MSN: stas@...

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

Re: Intl String Resource Formats

2009-03-12T12:00:03Z

Stas and Ed,

Since the intl implementation is still some way off, what would you
recommend to use as a string resource format? Right now we are planning on
just having files with large php arrays in them (one file per locale) and
then including the appropriate file at system startup. Is there a better
way? We can't use the php gettext extension, since it doesn't support the
Linux gettext's context sensitivity.

Any information would be appreciated.

Thanks again.

--Joel Sahleen

On 3/12/09 12:13 PM, "Stanislav Malyshev" <stas@...> wrote:

> Hi!
>
>> was wondering if anyone could tell me what resource formats (e.g., XLIFF or
>> TMX) the intl extension might someday support. I would also be interested in
>
> The formatand APIs would probably follow the ones ICU library uses,
> which are described here:
> http://userguide.icu-project.org/locale/resources
> http://userguide.icu-project.org/icudata

--
PHP Unicode & I18N Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php