Web servers and unicode support?

[Fred Janon]

Hi,

I want to design a web application with support for European,  Asian
languages as well as English, meaning Unicode. I am very interested in doing
that in Erlang with Mnesia or MySQL or Postgres (when I figure out if I can
use Mnesia), but what would I need to use (web server, extensions) to
support these languages/Unicode? I saw a few posting about not so great
String support in Erlang, therefore even less for Unicode. What's the
status?

Thanks

Fred

[Dmitry Belyaev]

If you don't need any string manipulation (I didn't need for my site)
you can treat all strings as binaries.

Besides, there are asn1rt:utf8_list_to_binary/1 and
asn1rt:utf8_list_to_binary/1 functions.

On Sat, 2009-11-07 at 10:08 +0800, Fred Janon wrote:

> Hi,
>
> I want to design a web application with support for European,  Asian
> languages as well as English, meaning Unicode. I am very interested in doing
> that in Erlang with Mnesia or MySQL or Postgres (when I figure out if I can
> use Mnesia), but what would I need to use (web server, extensions) to
> support these languages/Unicode? I saw a few posting about not so great
> String support in Erlang, therefore even less for Unicode. What's the
> status?
>
> Thanks
>
> Fred

________________________________________________________________
erlang-questions mailing list. See http://www.erlang.org/faq.html
erlang-questions (at) erlang.org

[Kevin A. Smith-2]

There's also the unicode module in later releases (R13B-0 and later, I  
think).

--Kevin
On Nov 6, 2009, at 9:19 PM, Rumata wrote:

> If you don't need any string manipulation (I didn't need for my site)
> you can treat all strings as binaries.
>
> Besides, there are asn1rt:utf8_list_to_binary/1 and
> asn1rt:utf8_list_to_binary/1 functions.
>
> On Sat, 2009-11-07 at 10:08 +0800, Fred Janon wrote:
>> Hi,
>>
>> I want to design a web application with support for European,  Asian
>> languages as well as English, meaning Unicode. I am very interested  
>> in doing
>> that in Erlang with Mnesia or MySQL or Postgres (when I figure out  
>> if I can
>> use Mnesia), but what would I need to use (web server, extensions) to
>> support these languages/Unicode? I saw a few posting about not so  
>> great
>> String support in Erlang, therefore even less for Unicode. What's the
>> status?
>>
>> Thanks
>>
>> Fred
>
>
>
> ________________________________________________________________
> erlang-questions mailing list. See http://www.erlang.org/faq.html
> erlang-questions (at) erlang.org
>

________________________________________________________________
erlang-questions mailing list. See http://www.erlang.org/faq.html
erlang-questions (at) erlang.org

[Rapsey]

I'm writing a website in yaws/erlydtl/erlmongo right now and it works with
UTF-8 just fine.


Sergej


On Sat, Nov 7, 2009 at 5:13 AM, Kevin A. Smith <kevin@...>wrote:

> There's also the unicode module in later releases (R13B-0 and later, I
> think).
>
> --Kevin
>
> On Nov 6, 2009, at 9:19 PM, Rumata wrote:
>
>  If you don't need any string manipulation (I didn't need for my site)
>> you can treat all strings as binaries.
>>
>> Besides, there are asn1rt:utf8_list_to_binary/1 and
>> asn1rt:utf8_list_to_binary/1 functions.
>>
>> On Sat, 2009-11-07 at 10:08 +0800, Fred Janon wrote:
>>
>>> Hi,
>>>
>>> I want to design a web application with support for European,  Asian
>>> languages as well as English, meaning Unicode. I am very interested in
>>> doing
>>> that in Erlang with Mnesia or MySQL or Postgres (when I figure out if I
>>> can
>>> use Mnesia), but what would I need to use (web server, extensions) to
>>> support these languages/Unicode? I saw a few posting about not so great
>>> String support in Erlang, therefore even less for Unicode. What's the
>>> status?
>>>
>>> Thanks
>>>
>>> Fred
>>>
>>
>>
>>
>> ________________________________________________________________
>> erlang-questions mailing list. See http://www.erlang.org/faq.html
>> erlang-questions (at) erlang.org
>>
>>
>
> ________________________________________________________________
> erlang-questions mailing list. See http://www.erlang.org/faq.html
> erlang-questions (at) erlang.org
>
>

[Bryan Fink-2]

On Fri, Nov 6, 2009 at 9:08 PM, Fred Janon <fjanon@...> wrote:
> I want to design a web application with support for European,  Asian
> languages as well as English, meaning Unicode. I am very interested in doing
> that in Erlang with Mnesia or MySQL or Postgres (when I figure out if I can
> use Mnesia), but what would I need to use (web server, extensions) to
> support these languages/Unicode? I saw a few posting about not so great
> String support in Erlang, therefore even less for Unicode. What's the
> status?

Hi, Fred.  Like a few others here, I also have a website running on
Erlang (mochiweb/webmachine/mnesia) right now, and it also handles
UTF-8 just fine.  For what it's worth, UTF-16 would have worked just
as well, but UTF-8 was more convenient, given the set of services the
website communicates with (solr, facebook, browsers, ...).

For actually working with unicode text (not just storing & fetching),
I've found the Starling project's links to the ICU library to be quite
helpful:

http://12monkeys.co.uk/starling/

The unpublicized xmerl_ucs module included with Erlang releases also
has some useful tools for converting among character encodings, if
you're unable to use R13B's unicode module.

-Bryan

________________________________________________________________
erlang-questions mailing list. See http://www.erlang.org/faq.html
erlang-questions (at) erlang.org

[Fred Janon]

Thanks everyone for your answers and pointers, really appreciated. I'll
start working on it as soon as my present project permits, then.

Fred

On Sat, Nov 7, 2009 at 21:00, Bryan Fink <bryan.fink@...> wrote:

> On Fri, Nov 6, 2009 at 9:08 PM, Fred Janon <fjanon@...> wrote:
> > I want to design a web application with support for European,  Asian
> > languages as well as English, meaning Unicode. I am very interested in
> doing
> > that in Erlang with Mnesia or MySQL or Postgres (when I figure out if I
> can
> > use Mnesia), but what would I need to use (web server, extensions) to
> > support these languages/Unicode? I saw a few posting about not so great
> > String support in Erlang, therefore even less for Unicode. What's the
> > status?
>
> Hi, Fred.  Like a few others here, I also have a website running on
> Erlang (mochiweb/webmachine/mnesia) right now, and it also handles
> UTF-8 just fine.  For what it's worth, UTF-16 would have worked just
> as well, but UTF-8 was more convenient, given the set of services the
> website communicates with (solr, facebook, browsers, ...).
>
> For actually working with unicode text (not just storing & fetching),
> I've found the Starling project's links to the ICU library to be quite
> helpful:
>
> http://12monkeys.co.uk/starling/
>
> The unpublicized xmerl_ucs module included with Erlang releases also
> has some useful tools for converting among character encodings, if
> you're unable to use R13B's unicode module.
>
> -Bryan
>
> ________________________________________________________________
> erlang-questions mailing list. See http://www.erlang.org/faq.html
> erlang-questions (at) erlang.org
>
>