tag:old.nabble.com,2006:forum-14219Nabble - ICU2009-10-11T18:19:25Z<b>ICU</b> is a mature, widely used set of C/C++ and Java libraries for Unicode support, software internationalization and globalization (i18n/g11n).<br>
It grew out of the JDK 1.1 internationalization APIs, which the ICU team contributed, and the project continues to be developed for the most advanced Unicode/i18n support.<br>
ICU home is <a href="http://icu.sourceforge.net/" target="_top" rel="nofollow">here</a>.tag:old.nabble.com,2006:post-25849429Re: One error in pattern applying2009-10-11T18:19:25Z2009-10-11T18:19:25ZgeelpheelsNobody knows! Unblievable!<img class='smiley' src='http://old.nabble.com/images/smiley/smiley_sad.gif' /><p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-25842096One error in pattern applying2009-10-11T03:08:50Z2009-10-11T03:08:50ZgeelpheelsI have already ported icu4.2 to a platfrom. But when runnning the code, it exited uncorrectly.
<br><br>It was happened in the applyPropertyPattern function in the uniset_props.cpp file.
<br><br>the applyPropertyPattern function is as follows:
<br>UnicodeSet& UnicodeSet::applyPropertyPattern(const UnicodeString& pattern,
<br> ParsePosition& ppos,
<br> UErrorCode &ec)
<br>......
<br><br> // Look for an '=' sign. If this is present, we will parse a
<br> // medium \p{gc=Cf} or long \p{GeneralCategory=Format}
<br> // pattern.
<br> int32_t equals = pattern.indexOf(EQUALS, pos);
<br> UnicodeString propName, valueName;
<br> if (equals >= 0 && equals < close && !isName) {
<br> // Equals seen; parse medium/long pattern
<br> pattern.extractBetween(pos, equals, propName);
<br> pattern.extractBetween(equals+1, close, valueName);
<br> }
<br><br> else {
<br> // Handle case where no '=' is seen, and \N{}
<br> pattern.extractBetween(pos, close, propName);
<br>
<br> // Handle \N{name}
<br><b> if (isName) {
<br> // This is a little inefficient since it means we have to
<br> // parse NAME_PROP back to UCHAR_NAME even though we already
<br> // know it's UCHAR_NAME. If we refactor the API to
<br> // support args of (UProperty, char*) then we can remove
<br> // NAME_PROP and make this a little more efficient.
<br> valueName = propName;
<br> propName = UnicodeString(NAME_PROP, NAME_PROP_LENGTH, US_INV);
<br> }</b> }
<br><br> applyPropertyAlias(propName, valueName, ec);
<br><br>......
<br><br>the pattern being applied is
<br><br>static const UChar gIsWordPattern[] = {
<br>// [ \ p { A l p h a b e t i c }
<br> 0x5b, 0x5c, 0x70, 0x7b, 0x61, 0x6c, 0x70, 0x68, 0x61, 0x62, 0x65, 0x74, 0x69, 0x63, 0x7d,
<br>// \ p { M } Mark
<br> 0x5c, 0x70, 0x7b, 0x4d, 0x7d,
<br>// \ p { N d } Digit_Numeric
<br> 0x5c, 0x70, 0x7b, 0x4e, 0x64, 0x7d,
<br>// \ p { P c } ] Connector_Punctuation
<br> 0x5c, 0x70, 0x7b, 0x50, 0x63, 0x7d, 0x5d, 0};
<br><br>becuase the bold lines never entered.
<br><br>it was firstly called in this line of file regexst.cpp in function RegexStaticSets::RegexStaticSets(UErrorCode *status):
<br><br> fPropSets[URX_ISWORD_SET] = new UnicodeSet(UnicodeString(TRUE, gIsWordPattern, -1), *status);
<br><br>I think it goes to the wrong direction, then what is the cause?
<br><p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-25531095u_strFromWCS() returns U_ILLEGAL_ARGUMENT_ERROR for a "wstring input data" in HP UX, but works perfectly in Windows2009-09-23T04:40:02Z2009-09-24T17:58:13ZMrVKHi,
<br><br>We use ICU library in our project for I18N support. We use the "u_strFromWCS()" to convert a "wstring data" to "UChar array" in order to convert the wstring data to a UnicodeString. The "u_strFromWCS()" function returns "U_ILLEGAL_ARGUMENT_ERROR" when used with a wstring containing Unicode Han character in HP UX platform. But the same runs successfully in Windows platform.
<br><br>I found another related post [<a href="http://www.nabble.com/u_strFromWCS()-----can-it-be-used-for-Cyrillic%2C-German%2C-...---td2643515r0.html" target="_top">http://www.nabble.com/u_strFromWCS()-----can-it-be-used-for-Cyrillic%2C-German%2C-...---td2643515r0.html</a>] in the forum, but they seem to get some other error.
<br><br>Any pointers or direction would be really helpful. And Thanks in advance .
<br><br>Regards,
<br>Vijay Kumar K.<p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-25052189pkgdata in dll mode using MS Visual Studio 2005 ICU 4.2 not working2009-08-19T14:22:38Z2009-08-20T07:02:33ZSteve@SAPWe are in the process of moving from VS 2003 to VS 2005 and moving from ICU 3.0 to 4.2<br>
<br>
In VS 2003 and ICU 3.0 the creation of a resource DLL using pkgdata worked fine. With the move to VS 2005 and ICU 4.2 it does not.<br>
<br>
I even tried the ufortune example without success.<br>
<br>
I also noticed in the 4.2 version of pkgdata it does not output the .mak file it generates.<br>
<br>
This is what I get when running $(ICU)\source\samples\ufortune\resources\fortune_resources.mak<br>
<br>
<i>D:\icu_src\icu\source\samples\ufortune\resources>nmake -f fortune_resources<br>
<br>
Microsoft (R) Program Maintenance Utility Version 8.00.50727.762<br>
Copyright (C) Microsoft Corporation. All rights reserved.<br>
<br>
d:\icu\bin\pkgdata --name fortune_resources -v --mode dll -d . res-list.txt<br>
# Reading res-file-list.txt..<br>
genccode: --match-arch cpu=332 bits=32 big-endian=0<br>
<b>LINK : fatal error LNK1181: cannot open input file '.obj'</b><br>
NMAKE : fatal error U1077: 'd:\icu\bin\pkgdata.EXE' : return code '0x49d'<br>
Stop.</i><br>
<br>
This same sample with VS 2003 and ICU 3.2 works fine.<br>
<br>
the contents of the directory after executing nmake -f fortune_resources is:<br>
<br>
<i>D:\icu_src\icu\source\samples\ufortune\resources>dir<br>
Volume in drive D is New Volume<br>
Volume Serial Number is 6C0B-324E<br>
<br>
Directory of D:\icu_src\icu\source\samples\ufortune\resources<br>
<br>
08/19/2009 04:18 PM <DIR> .<br>
08/19/2009 04:18 PM <DIR> ..<br>
08/19/2009 04:06 PM 31,624 es.res<br>
07/01/2009 11:50 AM 16,883 es.txt<br>
08/19/2009 04:18 PM 45,120 fortune_resources.dat<br>
08/19/2009 04:06 PM 1,409 fortune_resources.mak<br>
08/19/2009 04:18 PM <b>45,301 fortune_resources_dat.obj</b><br>
07/01/2009 11:50 AM 1,883 Makefile<br>
07/01/2009 11:50 AM 18 res-file-list.txt<br>
08/19/2009 04:06 PM 13,364 root.res<br>
07/01/2009 11:50 AM 7,540 root.txt<br>
9 File(s) 163,142 bytes<br>
2 Dir(s) 128,876,777,472 bytes free<br>
</i><br>
<br>
It makes me think the link line created by pkgdata is not correct (i.e. has a , or ; instead of a space between components).<br>
<br>
Any ideas?<br>
<br>
Thanks!<br>
<br>
Steve<br><p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-23826724Building ICU on AIX without archives2009-06-01T22:31:04Z2009-06-01T22:31:04Zkarthik.kHi,
<br><br> Typically, on AIX, ICU packages the shared objects (like libicuio42.so, libicuuc42.so) inside the archive files. I am trying to build ICU on AIX without archive files. I noticed while building on AIX that, it creates the .so ICU shared libraries followed by executing "ar" command with which they package them into an archive file (libicuio.a). I am wondering if there are configuration parameters on AIX to avoid building the archives and leave them with just the .so files.
<br><br>-Thanks
<br>Karthik<p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-20810141Combining two unicode characters2008-12-03T02:13:59Z2008-12-03T02:13:59ZPriyaSI want to combine to unicode characters into a single representation form.eg to combine '/u0D15' and '/u0D3E'.
<br><br>i am using the icu library for this.
<br>here prev is a consonant character and current character is a vowel so i have to combine together.
<br>{code}
<br> char[] newChar={c,(char)prev };
<br> String newStr=newChar.toString();
<br> String comStr=Normalizer.compose(newStr,true );
<br><br>{code}
<br>But this method doesnt work...Can any one suggest me some method for doing the same.Thanks.<p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-20414049UTF-8 format2008-11-09T20:01:50Z2008-11-09T20:01:50ZrijnahtsHI,
<br> I am very new to ICU. As a part of my work i need to store data in UTF8 format. But i have one question here. As a part of my implementation in linux i will be using the DOM Parser to read the xml file, and parser provides the ouput strings as wchar32 types. As linux supports wchar_t as 32 bit wide, the wide characters uses the UFT32 encoding.
<br><br>Does ICU provides the API to convert wchart_t (32 bit) into UTF-8 format.
<br><br>Thanks for help in advance....
<br><br><p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-18579736u_setDataDirectory and Unicode Directory Names2008-07-21T16:36:10Z2008-07-21T16:36:10ZJaceTheAceI created a resource package, called TestPackage.dat, and have successfully loaded the package and pulled strings out of it using the following code:
<br><br> .
<br> .
<br> UErrorCode status = U_ZERO_ERROR;
<br><br> u_setDataDirectory("C:\\Sub1\\Sub2\\Sub3");
<br><br> ResourceBundle resourceBundle("TestPackage", Locale("en"), status);
<br><br> UnicodeString testString = resourceBundle.getStringEx("test", status));
<br> .
<br> .
<br><br>Now that I'm implementing this in a production application I need to support data directory names containing unicode characters, but u_setDataDirectory only accepts a 'char *'. Is there a way to call u_setDataDirectory with a unicode directory name?
<br><br>I've searched everywhere and can't find any documentation on this.
<br><br>- Jason<p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-14274499How to implement collation element using ICU4j for new language??2007-12-11T06:05:23Z2007-12-11T06:05:23ZFirojHi, we are trying to implement collation element using ICU4j by the format
<br><br>0985.0020.0002.297C instead of \u0985 < \u0986 format
<br><br>is there any way in icu4j to do it??
<br><br>Thanks in advance for help
<br><br>Firoj<p>From forum: <a href="http://old.nabble.com/ICU---Design-f14222.html" embed="fixTarget[14222]" target="_top" >ICU - Design</a></p>tag:old.nabble.com,2006:post-12052719Text wrapping and services2007-08-08T07:00:39Z2007-08-08T07:00:39Zimran saleemHi
<br>I am using third party font engine to render images for my application. But now i have to do is to implement standard formatting options like wrapping alignment etc. So can any body tel me where to start from.and how to use <b>ICU</b> for my application. and i am new to ICU so please tell me how can do all of this.<p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-11683871ICU license question2007-07-19T01:43:09Z2007-07-19T01:43:09ZazjackHi,
<br><br>We plan to use ICU components for integration with DB2.
<br>May I know is ICU an open source software, which is free to use and deploy?
<br>Where can find the license info?
<br><br>Most grateful if anyone can advise. Thanks so much. <p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-10716731Unable to create Transliterator in C2007-05-21T05:03:53Z2007-05-21T05:03:53ZFelix ChanI have coded this "utrans_openU_3_6("Latin-Katakana",.....)", but it returns <b>U_INVALID_ID</b> error. I have also tried to list out the system transliterators. There is only 25 but not this one. I see from demo of ICU homepage, this is a system transliterator.<br>
<br>
Could anyone please tell me what's wrong with me. Thank you so much.<br>
<br>
I have subscribed the mailing list. I don't know why I have to include the version number in the function other I cannot linkedit utrans_openU to my COBOL program.<br>
<br>
This is the export symbol after I got from compilation of ICU. There is no utrans_openU.<br>
<br>
IMPORT CODE,'IXMI36IN','utrans_openIDs_3_6' <br>
IMPORT CODE,'IXMI36IN','utrans_openU_3_6' <br>
IMPORT CODE,'IXMI36IN','utrans_register_3_6' <br>
IMPORT CODE,'IXMI36IN','utrans_rep_caseContextIterator_3_6'<br>
IMPORT CODE,'IXMI36IN','utrans_setFilter_3_6' <br>
IMPORT CODE,'IXMI36IN','utrans_stripRules_3_6' <br>
IMPORT CODE,'IXMI36IN','utrans_trans_3_6' <br>
IMPORT CODE,'IXMI36IN','utrans_transIncremental_3_6' <br>
IMPORT CODE,'IXMI36IN','utrans_transIncrementalUChars_3_6' <br>
<p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-10633147Re: Case and accent insensitive string search2007-05-15T17:20:29Z2007-05-15T17:20:29ZDeborah Goldsmith> Right now I'm thinking of subclassing CharacterIterator
<br><br>Presumably any rework would use UText rather than CharacterIterator...
<br><br>Deborah
<br><br>On May 15, 2007, at 2:17 PM, Doug Doole wrote:
<br><div class='shrinkable-quote'><br>>> I'm continuing to look into alternate C/C++ search implementations
<br>>> that should eliminate the problems with the existing one. But there
<br>>> are some things going on that I don't understand having to do with
<br>>> expansions, matching the German ß with ss, for example. The issues
<br>>> here do affect the current implementation and are not restricted to
<br>>> the ends of the string. I'll let you know what comes of it.
<br>>
<br>> That's great Andy.
<br>>
<br>> One thing that I haven't started playing with yet is string search
<br>> over
<br>> very large data (like multiple gigabytes). Bringing the entire
<br>> string into
<br>> memory at one time is not a realistic option. Right now I'm
<br>> thinking of
<br>> subclassing CharacterIterator (it will only have a small piece of the
<br>> string in memory at a time) and using that interface to string
<br>> search. As
<br>> you're looking at a redesign, please allow for something like this.
<br>> (As I
<br>> start playing with the new code, I may have more suggestions on
<br>> this front.
<br>> ;-)
<br>>
<br>>
<br>> ----------------------------------------------------------------------
<br>> ---
<br>> This SF.net email is sponsored by DB2 Express
<br>> Download DB2 Express C - the FREE version of DB2 express and take
<br>> control of your XML. No limits. Just data. Click to get it now.
<br>> <a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>> _______________________________________________
<br>> icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10633147&i=0" target="_top" rel="nofollow">icu-support@...</a>
<br>> To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-</a>
<br>> support
</div><br><br>-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>_______________________________________________
<br>icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10633147&i=1" target="_top" rel="nofollow">icu-support@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br><p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-10631564Re: What is the difference between two Big5-HKSCS conversion table?2007-05-15T15:29:56Z2007-05-15T15:29:56ZGeorge RhotenOkay, I've taken a closer look at the Windows Vista implementation and the
<br>fine print on the Microsoft web site. Windows Vista does not support
<br>codepage conversion to Big5-HKSCS-2004 or Big5-HKSCS-2001, but it does
<br>support the characters from Unicode 4.1, which contains the characters
<br>from Big5-HKSCS. Basically Windows has the fonts and the IME to use the
<br>characters in Big5-HKSCS-2004.
<br><br>The add-on from the Microsoft website is for Big5-HKSCS-2001, and the site
<br>provides code to convert the PUA characters from Big5-HKSCS-2001 to
<br>Unicode 4.1.
<br><br>So CCSID 1375 with the newer Unicode mappings will be used to denote
<br>Big5-HKSCS-2004 in ICU. CCSID 5471 with the older Unicode mappings will
<br>be used to denote Big5-HKSCS-2001 and big5-hkscs:unicode3.0 in ICU.
<br><br>ICU's usage of CCSID 1375 will convert Big5-HKSCS in a way that will be
<br>viewable by Windows Vista. This will be the default when you generically
<br>request Big5-HKSCS. ICU's usage of CCSID 5417 will convert Big5-HKSCS in
<br>a way that is compatible with the Microsoft Windows add-on, and the
<br>results *may not* be 100% viewable by Windows Vista due to the font
<br>support.
<br><br>If you read between the lines on the Microsoft Big5-HKSCS pages, they're
<br>saying that you should migrate your Big5-HKSCS data to Unicode 4.1. This
<br>is a perfectly reasonable migration strategy :-) You should keep that in
<br>mind, if you are concerned about compatibility with Windows Vista.
<br><br>George Rhoten
<br>IBM Globalization Center of Competency/ICU San José, CA, USA
<br><a href="http://www.icu-project.org/" target="_top" rel="nofollow">http://www.icu-project.org/</a><br><br><br><br>George Rhoten/San Jose/IBM@IBMUS
<br>Sent by: <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10631564&i=0" target="_top" rel="nofollow">icu-support-bounces@...</a>
<br>05/15/2007 10:10 AM
<br>Please respond to
<br>ICU support mailing list <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10631564&i=1" target="_top" rel="nofollow">icu-support@...</a>>
<br><br><br>To
<br>ICU support mailing list <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10631564&i=2" target="_top" rel="nofollow">icu-support@...</a>>
<br>cc
<br><br>Subject
<br>Re: [icu-support] What is the difference between two Big5-HKSCS
<br>conversion table?
<br><br><br><br><br><br><br>> What is the version of HKSCS? HKSCS-2004 or HKSCS-2001 or HKSCS-1999?
<br>>
<br>> CCSID 5471 contains the character set for HKSCS-2001 and CCSID 1375
<br>> contains HKSCS-2004 character set.
<br><br>I didn't realize that. I had incorrectly assumed that the update of CCSID
<br>1375 was 5471 because many of the other updates to a CCSID have 4096 added
<br><br>to the CCSID (e.g. 1255 -> 5354 -> 9447). The CDRA database within IBM was
<br><br>missing this information in the description. This is helpful information.
<br><br>> Does this mean that to keep compatibility with Windows, CCSID1375 with
<br>the
<br>> Unicode 3.0 behavior should be used?
<br>>
<br>> Yes, I think so.
<br><br>Actually no. I had used
<br><a href="http://www.icu-project.org/charts/charset/roundtripIndex.html#windows-950_hkscs-2001" target="_top" rel="nofollow">http://www.icu-project.org/charts/charset/roundtripIndex.html#windows-950_hkscs-2001</a>
<br><br>to determine the correct CCSID to use. After closer inspection CCSID 5471
<br>should be used with the Unicode 3.0 mappings (ibm-5471_P100-2006). The
<br>Microsoft implementation typically will map unused characters to random
<br>Unicode characters. When you use the Microsoft API to discover their
<br>behavior, you don't get an error for valid but "unmapped" byte sequences.
<br>The differences between Microsoft's Big5-HKSCS and ibm-5471_P100-2006 is
<br>mainly how the Unicode PUA is used.
<br><br>When the original Big5-HKSCS mapping was collected from Windows XP, the
<br>patch at <a href="http://www.microsoft.com/hk/hkscs/" target="_top" rel="nofollow">http://www.microsoft.com/hk/hkscs/</a> was used. This uses
<br>Big5-HKSCS-2001. The page now states that Big5-HKSCS-2004 is natively
<br>supported in Windows Vista. So I'll have to inspect the Windows Vista
<br>behavior to determine the correct table to use. It's likely that CCSID
<br>1375 will be used for the Windows compatible implementation, and a newer
<br>Unicode mapping will be used. So it may be an alternate CCSID 1375. I
<br>don't know yet.
<br><br>So whatever you see in ICU's trunk is incorrect. This is post ICU 3.6
<br>work. Don't use it for any decisions on your implementation.
<br><br>-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>_______________________________________________
<br>icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10631564&i=3" target="_top" rel="nofollow">icu-support@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br><br><br><br>-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>_______________________________________________
<br>icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10631564&i=4" target="_top" rel="nofollow">icu-support@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br><p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-10631358Re: Case and accent insensitive string search2007-05-15T15:17:18Z2007-05-15T15:17:18ZDoug Doole> I'm continuing to look into alternate C/C++ search implementations
<br>> that should eliminate the problems with the existing one. But there
<br>> are some things going on that I don't understand having to do with
<br>> expansions, matching the German ß with ss, for example. The issues
<br>> here do affect the current implementation and are not restricted to
<br>> the ends of the string. I'll let you know what comes of it.
<br><br>That's great Andy.
<br><br>One thing that I haven't started playing with yet is string search over
<br>very large data (like multiple gigabytes). Bringing the entire string into
<br>memory at one time is not a realistic option. Right now I'm thinking of
<br>subclassing CharacterIterator (it will only have a small piece of the
<br>string in memory at a time) and using that interface to string search. As
<br>you're looking at a redesign, please allow for something like this. (As I
<br>start playing with the new code, I may have more suggestions on this front.
<br>;-)
<br><br><br>-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>_______________________________________________
<br>icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10631358&i=0" target="_top" rel="nofollow">icu-support@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br><p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-10630833Geoffrey HC Chow/Hong Kong/Contr/IBM is out of the office.2007-05-15T14:47:22Z2007-05-15T14:47:22ZGeoffrey HC Chow<html><body>
<p>I will be out of the office starting 05/16/2007 and will not return until 05/17/2007.<br>
<br>
I will respond to your message when I return. For any urgent issues, please support hotline at 8205 8288.</body></html><br />-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br />_______________________________________________
<br>icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10630833&i=0" target="_top" rel="nofollow">icu-support@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br><p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-10627002Re: What is the difference between two Big5-HKSCS conversion table?2007-05-15T11:10:22Z2007-05-15T11:10:22ZGeorge Rhoten> What is the version of HKSCS? HKSCS-2004 or HKSCS-2001 or HKSCS-1999?
<br>>
<br>> CCSID 5471 contains the character set for HKSCS-2001 and CCSID 1375
<br>> contains HKSCS-2004 character set.
<br><br>I didn't realize that. I had incorrectly assumed that the update of CCSID
<br>1375 was 5471 because many of the other updates to a CCSID have 4096 added
<br>to the CCSID (e.g. 1255 -> 5354 -> 9447). The CDRA database within IBM was
<br>missing this information in the description. This is helpful information.
<br><br>> Does this mean that to keep compatibility with Windows, CCSID1375 with
<br>the
<br>> Unicode 3.0 behavior should be used?
<br>>
<br>> Yes, I think so.
<br><br>Actually no. I had used
<br><a href="http://www.icu-project.org/charts/charset/roundtripIndex.html#windows-950_hkscs-2001" target="_top" rel="nofollow">http://www.icu-project.org/charts/charset/roundtripIndex.html#windows-950_hkscs-2001</a>
<br>to determine the correct CCSID to use. After closer inspection CCSID 5471
<br>should be used with the Unicode 3.0 mappings (ibm-5471_P100-2006). The
<br>Microsoft implementation typically will map unused characters to random
<br>Unicode characters. When you use the Microsoft API to discover their
<br>behavior, you don't get an error for valid but "unmapped" byte sequences.
<br>The differences between Microsoft's Big5-HKSCS and ibm-5471_P100-2006 is
<br>mainly how the Unicode PUA is used.
<br><br>When the original Big5-HKSCS mapping was collected from Windows XP, the
<br>patch at <a href="http://www.microsoft.com/hk/hkscs/" target="_top" rel="nofollow">http://www.microsoft.com/hk/hkscs/</a> was used. This uses
<br>Big5-HKSCS-2001. The page now states that Big5-HKSCS-2004 is natively
<br>supported in Windows Vista. So I'll have to inspect the Windows Vista
<br>behavior to determine the correct table to use. It's likely that CCSID
<br>1375 will be used for the Windows compatible implementation, and a newer
<br>Unicode mapping will be used. So it may be an alternate CCSID 1375. I
<br>don't know yet.
<br><br>So whatever you see in ICU's trunk is incorrect. This is post ICU 3.6
<br>work. Don't use it for any decisions on your implementation.
<br><br>-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>_______________________________________________
<br>icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10627002&i=0" target="_top" rel="nofollow">icu-support@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br><p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-10623793Re: Proposal for rule based time zone (ticket#5454)2007-05-15T08:20:56Z2007-05-15T08:20:56Zyoshito_umaoka<div class='shrinkable-quote'>> Yoshito, please do:
<br>>
<br>> svn propset svn:mime-type text/html filename.html
<br>> svn commit filename.html
<br>>
<br>>
<br>> to set the mime type, also check your svn configuration file to make
<br>> sure text/html and others are properly tagged on creation
<br>>
<br>> -s
</div><br>Steven, thanks. I set text/html to all of *.html files.
<br>Mark, you should be able to browse the JavaDoc files now.
<br><br>-Yoshito
<br><br>-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>_______________________________________________
<br>icu-design mailing list
<br><a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10623793&i=0" target="_top" rel="nofollow">icu-design@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-design" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-design</a><br><p>From forum: <a href="http://old.nabble.com/ICU---Design-f14222.html" embed="fixTarget[14222]" target="_top" >ICU - Design</a></p>tag:old.nabble.com,2006:post-10619666Re: What is the difference between two Big5-HKSCS conversion table?2007-05-15T03:34:25Z2007-05-15T03:34:25Zyandong.yaosorry, i checked the wrong file, 5471 do contain this code point.
<br><br>thanks.
<br><br>Regards,
<br>Yandong
<br><br>Tetsuji Orita 写道:
<div class='shrinkable-quote'><br>> Hello,
<br>> 0xC87A should be in Unicode table for CCSID 5471. CCSID 5471 table that I
<br>> have here contains 0xC87A. I do not know why the table you are looking does
<br>> not contain it.
<br>>
<br>> Best regards,
<br>> Tetsuji Orita (U+7E54,U+7530,U+54F2,U+6CBB),
<br>> Globalization Center of Competency - Yamato, IBM Japan
<br>> T/L: 1808-5425, TEL: +81-46-215-5425, FAX:+81-46-273-7497
<br>> e-Mail: <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619666&i=0" target="_top" rel="nofollow">orita@...</a>
<br>>
<br>>
<br>>
<br>>
<br>> Yandong Yao
<br>> <Yandong.Yao@Sun.
<br>> COM> To
<br>> Sent by: ICU support mailing list
<br>> icu-support-bounc <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619666&i=1" target="_top" rel="nofollow">icu-support@...</a>>
<br>> <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619666&i=2" target="_top" rel="nofollow">es@...</a> cc
<br>> rge.net
<br>> Subject
<br>> Re: [icu-support] What is the
<br>> 2007/05/15 17:47 difference between two
<br>> Big5-HKSCS conversion table?
<br>>
<br>> Please respond to
<br>> <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619666&i=3" target="_top" rel="nofollow">Yandong.Yao@...</a>
<br>> OM; Please
<br>> respond to
<br>> ICU support
<br>> mailing list
<br>> <icu-support@list
<br>> s.sourceforge.net
<br>> >
<br>>
<br>>
<br>>
<br>>
<br>>
<br>>
<br>> Hi Tetsuji,
<br>>
<br>> Tetsuji Orita 写道:
<br>>
<br>>> Hello,
<br>>>
<br>>> What is the version of HKSCS? HKSCS-2004 or HKSCS-2001 or HKSCS-1999?
<br>>>
<br>>> CCSID 5471 contains the character set for HKSCS-2001 and CCSID 1375
<br>>> contains HKSCS-2004 character set.
<br>>>
<br>>>
<br>> then 0xC87A which is in HKSCS-1999 and HKSCS-2001 is not in
<br>> ibm-5471_P100-2007.ucm.
<br>> is this a bug?
<br>>
<br>>> Does this mean that to keep compatibility with Windows, CCSID1375 with
<br>>>
<br>> the
<br>>
<br>>> Unicode 3.0 behavior should be used?
<br>>>
<br>>> Yes, I think so.
<br>>>
<br>>>
<br>> thanks.
<br>>
<br>> Regards,
<br>> Yandong
<br>>
<br>>> Best regards,
<br>>> Tetsuji Orita (U+7E54,U+7530,U+54F2,U+6CBB),
<br>>> Globalization Center of Competency - Yamato, IBM Japan
<br>>> T/L: 1808-5425, TEL: +81-46-215-5425, FAX:+81-46-273-7497
<br>>> e-Mail: <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619666&i=4" target="_top" rel="nofollow">orita@...</a>
<br>>>
<br>>>
<br>>>
<br>>>
<br>>>
<br>>
<br>>
<br>>> Yandong Yao
<br>>>
<br>>
<br>>
<br>>> <Yandong.Yao@Sun.
<br>>>
<br>>
<br>>
<br>>> COM>
<br>>>
<br>> To
<br>>
<br>>> Sent by: ICU support mailing list
<br>>>
<br>>
<br>>
<br>>> icu-support-bounc
<br>>>
<br>> <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619666&i=5" target="_top" rel="nofollow">icu-support@...</a>>
<br>>
<br>>> <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619666&i=6" target="_top" rel="nofollow">es@...</a>
<br>>>
<br>> cc
<br>>
<br>>> rge.net
<br>>>
<br>>
<br>>
<br>> Subject
<br>>
<br>>> Re: [icu-support] What is the
<br>>>
<br>>
<br>>
<br>>> 2007/05/15 16:23 difference between two Big5-HKSCS
<br>>>
<br>>
<br>>
<br>>> conversion table?
<br>>>
<br>>
<br>>
<br>>
<br>>
<br>>> Please respond to
<br>>>
<br>>
<br>>
<br>>> <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619666&i=7" target="_top" rel="nofollow">Yandong.Yao@...</a>
<br>>>
<br>>
<br>>
<br>>> OM; Please
<br>>>
<br>>
<br>>
<br>>> respond to
<br>>>
<br>>
<br>>
<br>>> ICU support
<br>>>
<br>>
<br>>
<br>>> mailing list
<br>>>
<br>>
<br>>
<br>>> <icu-support@list
<br>>>
<br>>
<br>>
<br>>> s.sourceforge.net
<br>>>
<br>>
<br>>
<br>>> >
<br>>>
<br>>
<br>>
<br>>
<br>>
<br>>
<br>>
<br>>>
<br>>>
<br>>> Hi George,
<br>>>
<br>>> George Rhoten 写道:
<br>>>
<br>>>
<br>>>> You're looking at behavior that is not available in any release of ICU
<br>>>> yet. You're looking at the future ICU 3.8 behavior.
<br>>>>
<br>>>> Unfortunately, that CDRA page hasn't been updated with the latest
<br>>>> information. CCSID 5417 is Big5-HKSCS.
<br>>>>
<br>>>>
<br>>> What is the version of HKSCS? HKSCS-2004 or HKSCS-2001 or HKSCS-1999?
<br>>> From
<br>>>
<br>>>
<br>> <a href="http://www.info.gov.hk/digital21/eng/hkscs/download/hkscs-2004-chr-incl.txt" target="_top" rel="nofollow">http://www.info.gov.hk/digital21/eng/hkscs/download/hkscs-2004-chr-incl.txt</a><br>>
<br>>> ,
<br>>> 0xC87A was added
<br>>> into HKSCS-1999, but I can not find it in ibm-5471_P100-2007.ucm.
<br>>>
<br>>>
<br>>>
<br>>>> CCSID 1375 is Big5-HKSCS with
<br>>>> Microsoft extensions. Each have two alternate mapping tables that map
<br>>>>
<br>>>>
<br>>> the
<br>>>
<br>>>
<br>>>> codepoints to Unicode 3.0 and Unicode 3.1.
<br>>>>
<br>>>>
<br>>> How to get two mapping table from one file?
<br>>>
<br>>>
<br>>>> So there are at least 4
<br>>>> mapping tables for these two CCSIDs. There's actually a total of 6
<br>>>>
<br>>>>
<br>>> tables
<br>>>
<br>>>
<br>>>> for the 2 CCSIDs, but the other 2 aren't relevant to this discussion.
<br>>>>
<br>>>> The last time I checked, Windows has a patch that modifies windows-950
<br>>>>
<br>> to
<br>>
<br>>>
<br>>>> support the HKSCS characters, but it's for Unicode 3.0. This means that
<br>>>> many characters are mapped to the private use area of Unicode. So this
<br>>>> behavior is mapped to CCSID 1375 with the Unicode 3.0 behavior. This is
<br>>>> also similar to some implementations on Solaris and HP-UX.
<br>>>>
<br>>>>
<br>>>>
<br>>> Does this mean that to keep compatibility with Windows, CCSID1375 with
<br>>> the Unicode 3.0 behavor
<br>>> should be used?
<br>>>
<br>>> Thank you very much!
<br>>>
<br>>> Regards,
<br>>> Yandong
<br>>>
<br>>>
<br>>>> CCSID 5417 tries to match the Big5-HKSCS specification without so many
<br>>>> extensions. I've also picked the variant table with the Unicode 3.1
<br>>>> mappings, since the Unicode 3.0 mapping table usually isn't used without
<br>>>> the Microsoft extensions. The official description can be found at <
<br>>>> <a href="http://www.info.gov.hk/digital21/eng/hkscs/" target="_top" rel="nofollow">http://www.info.gov.hk/digital21/eng/hkscs/</a> >. It's very similar to Mac
<br>>>> OS X's implementation. It can also be considered a "proper"
<br>>>> implementation because it's using the Unicode supplementary characters.
<br>>>>
<br>>>> The glibc implementation of Big5-HKSCS is significantly different from
<br>>>> other implementations. It's Big5-HKSCS with a lot of Unicode 3.1
<br>>>> mappings, but it's incomplete. It doesn't map some characters that are
<br>>>> mapped in other Big5-HKSCS implementations. It also maps some
<br>>>>
<br>> characters
<br>>
<br>>>
<br>>>> to different Unicode private use codepoints. It's closer to CCSID 5417
<br>>>> with Unicode 3.1 mappings.
<br>>>>
<br>>>> George Rhoten
<br>>>> IBM Globalization Center of Competency/ICU San Jos?, CA, USA
<br>>>> <a href="http://www.icu-project.org/" target="_top" rel="nofollow">http://www.icu-project.org/</a><br>>>>
<br>>>>
<br>>>>
<br>>>> Yandong Yao <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619666&i=8" target="_top" rel="nofollow">Yandong.Yao@...</a>>
<br>>>> Sent by: <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619666&i=9" target="_top" rel="nofollow">icu-support-bounces@...</a>
<br>>>> 05/14/2007 08:20 PM
<br>>>> Please respond to
<br>>>> <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619666&i=10" target="_top" rel="nofollow">Yandong.Yao@...</a>; Please respond to
<br>>>> ICU support mailing list <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619666&i=11" target="_top" rel="nofollow">icu-support@...</a>>
<br>>>>
<br>>>>
<br>>>> To
<br>>>> <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619666&i=12" target="_top" rel="nofollow">icu-support@...</a>
<br>>>> cc
<br>>>>
<br>>>> Subject
<br>>>> [icu-support] What is the difference between two Big5-HKSCS
<br>>>>
<br>>>>
<br>>> conversion
<br>>>
<br>>>
<br>>>> table?
<br>>>>
<br>>>>
<br>>>>
<br>>>>
<br>>>>
<br>>>>
<br>>>> Hi guys,
<br>>>>
<br>>>> >From icu/source/data/mappings/convrtrs.txt, I found below two
<br>>>>
<br>> conversion
<br>>
<br>>>> tables for Big5-HKSCS, and I have not found the explanation for ibm-5471
<br>>>> from
<br>>>> <a href="http://www-306.ibm.com/software/globalization/ccsid/ccsid_registered.jsp" target="_top" rel="nofollow">http://www-306.ibm.com/software/globalization/ccsid/ccsid_registered.jsp</a><br>>>>
<br>> .
<br>>
<br>>>> Could you help to clarify that what is the difference between them and
<br>>>> which one should be used at what context?
<br>>>>
<br>>>> Thank you very much!
<br>>>>
<br>>>> ---------------------------------------------
<br>>>> ibm-5471_P100-2007 { UTR22* } # This uses supplementary characters.
<br>>>> ibm-5471 { IBM* }
<br>>>> Big5-HKSCS { IANA* JAVA* }
<br>>>> big5hk { JAVA }
<br>>>> HKSCS-BIG5 # From <a href="http://www.openi18n.org/localenameguide/" target="_top" rel="nofollow">http://www.openi18n.org/localenameguide/</a><br>>>> ibm-1375_P100-2006 { UTR22* } # IBM's interpretation of Windows' Taiwan
<br>>>> Big-5 w/ HKSCS extensions
<br>>>> ibm-1375 { IBM* }
<br>>>> Big5-HKSCS
<br>>>> MS950_HKSCS { JAVA* }
<br>>>> hkbig5 # from HP-UX 11i, which can't handle supplementary characters.
<br>>>> big5-hkscs:unicode3.0
<br>>>> # windows-950 # Windows-950 can be w/ or w/o HKSCS extensions. By
<br>>>> default it's not.
<br>>>> # windows-950_hkscs
<br>>>> ------------------------------------------------
<br>>>>
<br>>>> Regards,
<br>>>> Yandong
<br>>>>
<br>>>>
<br>>>>
<br>>>>
<br>>>>
<br>> -------------------------------------------------------------------------
<br>>
<br>>>> This SF.net email is sponsored by DB2 Express
<br>>>> Download DB2 Express C - the FREE version of DB2 express and take
<br>>>> control of your XML. No limits. Just data. Click to get it now.
<br>>>> <a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>>>> _______________________________________________
<br>>>> icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619666&i=13" target="_top" rel="nofollow">icu-support@...</a>
<br>>>> To Un/Subscribe:
<br>>>>
<br>> <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br>>
<br>>>>
<br>>> -------------------------------------------------------------------------
<br>>> This SF.net email is sponsored by DB2 Express
<br>>> Download DB2 Express C - the FREE version of DB2 express and take
<br>>> control of your XML. No limits. Just data. Click to get it now.
<br>>> <a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>>> _______________________________________________
<br>>> icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619666&i=14" target="_top" rel="nofollow">icu-support@...</a>
<br>>> To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br>>>
<br>>>
<br>>>
<br>>> -------------------------------------------------------------------------
<br>>> This SF.net email is sponsored by DB2 Express
<br>>> Download DB2 Express C - the FREE version of DB2 express and take
<br>>> control of your XML. No limits. Just data. Click to get it now.
<br>>> <a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>>> _______________________________________________
<br>>> icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619666&i=15" target="_top" rel="nofollow">icu-support@...</a>
<br>>> To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br>>>
<br>>>
<br>>
<br>>
<br>> -------------------------------------------------------------------------
<br>> This SF.net email is sponsored by DB2 Express
<br>> Download DB2 Express C - the FREE version of DB2 express and take
<br>> control of your XML. No limits. Just data. Click to get it now.
<br>> <a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>> _______________________________________________
<br>> icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619666&i=16" target="_top" rel="nofollow">icu-support@...</a>
<br>> To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br>>
<br>>
<br>>
<br>> -------------------------------------------------------------------------
<br>> This SF.net email is sponsored by DB2 Express
<br>> Download DB2 Express C - the FREE version of DB2 express and take
<br>> control of your XML. No limits. Just data. Click to get it now.
<br>> <a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>> _______________________________________________
<br>> icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619666&i=17" target="_top" rel="nofollow">icu-support@...</a>
<br>> To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br>>
</div><br><br>-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>_______________________________________________
<br>icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619666&i=18" target="_top" rel="nofollow">icu-support@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br><p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-10619388Re: What is the difference between two Big5-HKSCS conversion table?2007-05-15T03:16:15Z2007-05-15T03:16:15ZTetsuji OritaHello,
<br>0xC87A should be in Unicode table for CCSID 5471. CCSID 5471 table that I
<br>have here contains 0xC87A. I do not know why the table you are looking does
<br>not contain it.
<br><br>Best regards,
<br>Tetsuji Orita (U+7E54,U+7530,U+54F2,U+6CBB),
<br>Globalization Center of Competency - Yamato, IBM Japan
<br>T/L: 1808-5425, TEL: +81-46-215-5425, FAX:+81-46-273-7497
<br>e-Mail: <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619388&i=0" target="_top" rel="nofollow">orita@...</a>
<br><br><br><br>
<br> Yandong Yao
<br> <Yandong.Yao@Sun.
<br> COM> To
<br> Sent by: ICU support mailing list
<br> icu-support-bounc <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619388&i=1" target="_top" rel="nofollow">icu-support@...</a>>
<br> <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619388&i=2" target="_top" rel="nofollow">es@...</a> cc
<br> rge.net
<br> Subject
<br> Re: [icu-support] What is the
<br> 2007/05/15 17:47 difference between two
<br> Big5-HKSCS conversion table?
<br>
<br> Please respond to
<br> <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619388&i=3" target="_top" rel="nofollow">Yandong.Yao@...</a>
<br> OM; Please
<br> respond to
<br> ICU support
<br> mailing list
<br> <icu-support@list
<br> s.sourceforge.net
<br> >
<br>
<br>
<br><br><br><br><br>Hi Tetsuji,
<br><br>Tetsuji Orita 写道:
<br>> Hello,
<br>>
<br>> What is the version of HKSCS? HKSCS-2004 or HKSCS-2001 or HKSCS-1999?
<br>>
<br>> CCSID 5471 contains the character set for HKSCS-2001 and CCSID 1375
<br>> contains HKSCS-2004 character set.
<br>>
<br>then 0xC87A which is in HKSCS-1999 and HKSCS-2001 is not in
<br>ibm-5471_P100-2007.ucm.
<br>is this a bug?
<br>> Does this mean that to keep compatibility with Windows, CCSID1375 with
<br>the
<br>> Unicode 3.0 behavior should be used?
<br>>
<br>> Yes, I think so.
<br>>
<br>thanks.
<br><br>Regards,
<br>Yandong
<br>> Best regards,
<br>> Tetsuji Orita (U+7E54,U+7530,U+54F2,U+6CBB),
<br>> Globalization Center of Competency - Yamato, IBM Japan
<br>> T/L: 1808-5425, TEL: +81-46-215-5425, FAX:+81-46-273-7497
<br>> e-Mail: <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619388&i=4" target="_top" rel="nofollow">orita@...</a>
<br>>
<br>>
<br>>
<br>>
<br><br>> Yandong Yao
<br><br>> <Yandong.Yao@Sun.
<br><br>> COM>
<br>To
<br>> Sent by: ICU support mailing list
<br><br>> icu-support-bounc
<br><<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619388&i=5" target="_top" rel="nofollow">icu-support@...</a>>
<br>> <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619388&i=6" target="_top" rel="nofollow">es@...</a>
<br>cc
<br>> rge.net
<br><br>>
<br>Subject
<br>> Re: [icu-support] What is the
<br><br>> 2007/05/15 16:23 difference between two Big5-HKSCS
<br><br>> conversion table?
<br><br>>
<br><br>> Please respond to
<br><br>> <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619388&i=7" target="_top" rel="nofollow">Yandong.Yao@...</a>
<br><br>> OM; Please
<br><br>> respond to
<br><br>> ICU support
<br><br>> mailing list
<br><br>> <icu-support@list
<br><br>> s.sourceforge.net
<br><br>> >
<br><br>>
<br><br>>
<br><div class='shrinkable-quote'><br>>
<br>>
<br>>
<br>>
<br>> Hi George,
<br>>
<br>> George Rhoten 写道:
<br>>
<br>>> You're looking at behavior that is not available in any release of ICU
<br>>> yet. You're looking at the future ICU 3.8 behavior.
<br>>>
<br>>> Unfortunately, that CDRA page hasn't been updated with the latest
<br>>> information. CCSID 5417 is Big5-HKSCS.
<br>>>
<br>> What is the version of HKSCS? HKSCS-2004 or HKSCS-2001 or HKSCS-1999?
<br>> From
<br>>
</div><a href="http://www.info.gov.hk/digital21/eng/hkscs/download/hkscs-2004-chr-incl.txt" target="_top" rel="nofollow">http://www.info.gov.hk/digital21/eng/hkscs/download/hkscs-2004-chr-incl.txt</a><div class='shrinkable-quote'><br>> ,
<br>> 0xC87A was added
<br>> into HKSCS-1999, but I can not find it in ibm-5471_P100-2007.ucm.
<br>>
<br>>
<br>>> CCSID 1375 is Big5-HKSCS with
<br>>> Microsoft extensions. Each have two alternate mapping tables that map
<br>>>
<br>> the
<br>>
<br>>> codepoints to Unicode 3.0 and Unicode 3.1.
<br>>>
<br>> How to get two mapping table from one file?
<br>>
<br>>> So there are at least 4
<br>>> mapping tables for these two CCSIDs. There's actually a total of 6
<br>>>
<br>> tables
<br>>
<br>>> for the 2 CCSIDs, but the other 2 aren't relevant to this discussion.
<br>>>
<br>>> The last time I checked, Windows has a patch that modifies windows-950
</div>to
<div class='shrinkable-quote'><br>>>
<br>>
<br>>
<br>>> support the HKSCS characters, but it's for Unicode 3.0. This means that
<br>>> many characters are mapped to the private use area of Unicode. So this
<br>>> behavior is mapped to CCSID 1375 with the Unicode 3.0 behavior. This is
<br>>> also similar to some implementations on Solaris and HP-UX.
<br>>>
<br>>>
<br>> Does this mean that to keep compatibility with Windows, CCSID1375 with
<br>> the Unicode 3.0 behavor
<br>> should be used?
<br>>
<br>> Thank you very much!
<br>>
<br>> Regards,
<br>> Yandong
<br>>
<br>>> CCSID 5417 tries to match the Big5-HKSCS specification without so many
<br>>> extensions. I've also picked the variant table with the Unicode 3.1
<br>>> mappings, since the Unicode 3.0 mapping table usually isn't used without
<br>>> the Microsoft extensions. The official description can be found at <
<br>>> <a href="http://www.info.gov.hk/digital21/eng/hkscs/" target="_top" rel="nofollow">http://www.info.gov.hk/digital21/eng/hkscs/</a> >. It's very similar to Mac
<br>>> OS X's implementation. It can also be considered a "proper"
<br>>> implementation because it's using the Unicode supplementary characters.
<br>>>
<br>>> The glibc implementation of Big5-HKSCS is significantly different from
<br>>> other implementations. It's Big5-HKSCS with a lot of Unicode 3.1
<br>>> mappings, but it's incomplete. It doesn't map some characters that are
<br>>> mapped in other Big5-HKSCS implementations. It also maps some
</div>characters
<div class='shrinkable-quote'><br>>>
<br>>
<br>>
<br>>> to different Unicode private use codepoints. It's closer to CCSID 5417
<br>>> with Unicode 3.1 mappings.
<br>>>
<br>>> George Rhoten
<br>>> IBM Globalization Center of Competency/ICU San Jos?, CA, USA
<br>>> <a href="http://www.icu-project.org/" target="_top" rel="nofollow">http://www.icu-project.org/</a><br>>>
<br>>>
<br>>>
<br>>> Yandong Yao <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619388&i=8" target="_top" rel="nofollow">Yandong.Yao@...</a>>
<br>>> Sent by: <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619388&i=9" target="_top" rel="nofollow">icu-support-bounces@...</a>
<br>>> 05/14/2007 08:20 PM
<br>>> Please respond to
<br>>> <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619388&i=10" target="_top" rel="nofollow">Yandong.Yao@...</a>; Please respond to
<br>>> ICU support mailing list <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619388&i=11" target="_top" rel="nofollow">icu-support@...</a>>
<br>>>
<br>>>
<br>>> To
<br>>> <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619388&i=12" target="_top" rel="nofollow">icu-support@...</a>
<br>>> cc
<br>>>
<br>>> Subject
<br>>> [icu-support] What is the difference between two Big5-HKSCS
<br>>>
<br>> conversion
<br>>
<br>>> table?
<br>>>
<br>>>
<br>>>
<br>>>
<br>>>
<br>>>
<br>>> Hi guys,
<br>>>
<br>>> >From icu/source/data/mappings/convrtrs.txt, I found below two
</div>conversion
<br>>> tables for Big5-HKSCS, and I have not found the explanation for ibm-5471
<br>>> from
<br>>> <a href="http://www-306.ibm.com/software/globalization/ccsid/ccsid_registered.jsp" target="_top" rel="nofollow">http://www-306.ibm.com/software/globalization/ccsid/ccsid_registered.jsp</a><br>.
<div class='shrinkable-quote'><br>>> Could you help to clarify that what is the difference between them and
<br>>> which one should be used at what context?
<br>>>
<br>>> Thank you very much!
<br>>>
<br>>> ---------------------------------------------
<br>>> ibm-5471_P100-2007 { UTR22* } # This uses supplementary characters.
<br>>> ibm-5471 { IBM* }
<br>>> Big5-HKSCS { IANA* JAVA* }
<br>>> big5hk { JAVA }
<br>>> HKSCS-BIG5 # From <a href="http://www.openi18n.org/localenameguide/" target="_top" rel="nofollow">http://www.openi18n.org/localenameguide/</a><br>>> ibm-1375_P100-2006 { UTR22* } # IBM's interpretation of Windows' Taiwan
<br>>> Big-5 w/ HKSCS extensions
<br>>> ibm-1375 { IBM* }
<br>>> Big5-HKSCS
<br>>> MS950_HKSCS { JAVA* }
<br>>> hkbig5 # from HP-UX 11i, which can't handle supplementary characters.
<br>>> big5-hkscs:unicode3.0
<br>>> # windows-950 # Windows-950 can be w/ or w/o HKSCS extensions. By
<br>>> default it's not.
<br>>> # windows-950_hkscs
<br>>> ------------------------------------------------
<br>>>
<br>>> Regards,
<br>>> Yandong
<br>>>
<br>>>
<br>>>
<br>>>
</div>-------------------------------------------------------------------------
<br>>> This SF.net email is sponsored by DB2 Express
<br>>> Download DB2 Express C - the FREE version of DB2 express and take
<br>>> control of your XML. No limits. Just data. Click to get it now.
<br>>> <a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>>> _______________________________________________
<br>>> icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619388&i=13" target="_top" rel="nofollow">icu-support@...</a>
<br>>> To Un/Subscribe:
<br><a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><div class='shrinkable-quote'><br>>>
<br>>>
<br>>
<br>>
<br>> -------------------------------------------------------------------------
<br>> This SF.net email is sponsored by DB2 Express
<br>> Download DB2 Express C - the FREE version of DB2 express and take
<br>> control of your XML. No limits. Just data. Click to get it now.
<br>> <a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>> _______________________________________________
<br>> icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619388&i=14" target="_top" rel="nofollow">icu-support@...</a>
<br>> To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br>>
<br>>
<br>>
<br>> -------------------------------------------------------------------------
<br>> This SF.net email is sponsored by DB2 Express
<br>> Download DB2 Express C - the FREE version of DB2 express and take
<br>> control of your XML. No limits. Just data. Click to get it now.
<br>> <a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>> _______________________________________________
<br>> icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619388&i=15" target="_top" rel="nofollow">icu-support@...</a>
<br>> To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br>>
</div><br><br>-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>_______________________________________________
<br>icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619388&i=16" target="_top" rel="nofollow">icu-support@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br><br><br><br>-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>_______________________________________________
<br>icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10619388&i=17" target="_top" rel="nofollow">icu-support@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br><p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-10618997Re: What is the difference between two Big5-HKSCS conversion table?2007-05-15T02:47:33Z2007-05-15T02:47:33Zyandong.yaoHi Tetsuji,
<br><br>Tetsuji Orita 写道:
<br>> Hello,
<br>>
<br>> What is the version of HKSCS? HKSCS-2004 or HKSCS-2001 or HKSCS-1999?
<br>>
<br>> CCSID 5471 contains the character set for HKSCS-2001 and CCSID 1375
<br>> contains HKSCS-2004 character set.
<br>>
<br>then 0xC87A which is in HKSCS-1999 and HKSCS-2001 is not in
<br>ibm-5471_P100-2007.ucm.
<br>is this a bug?
<br>> Does this mean that to keep compatibility with Windows, CCSID1375 with the
<br>> Unicode 3.0 behavior should be used?
<br>>
<br>> Yes, I think so.
<br>>
<br>thanks.
<br><br>Regards,
<br>Yandong
<div class='shrinkable-quote'><br>> Best regards,
<br>> Tetsuji Orita (U+7E54,U+7530,U+54F2,U+6CBB),
<br>> Globalization Center of Competency - Yamato, IBM Japan
<br>> T/L: 1808-5425, TEL: +81-46-215-5425, FAX:+81-46-273-7497
<br>> e-Mail: <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10618997&i=0" target="_top" rel="nofollow">orita@...</a>
<br>>
<br>>
<br>>
<br>>
<br>> Yandong Yao
<br>> <Yandong.Yao@Sun.
<br>> COM> To
<br>> Sent by: ICU support mailing list
<br>> icu-support-bounc <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10618997&i=1" target="_top" rel="nofollow">icu-support@...</a>>
<br>> <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10618997&i=2" target="_top" rel="nofollow">es@...</a> cc
<br>> rge.net
<br>> Subject
<br>> Re: [icu-support] What is the
<br>> 2007/05/15 16:23 difference between two Big5-HKSCS
<br>> conversion table?
<br>>
<br>> Please respond to
<br>> <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10618997&i=3" target="_top" rel="nofollow">Yandong.Yao@...</a>
<br>> OM; Please
<br>> respond to
<br>> ICU support
<br>> mailing list
<br>> <icu-support@list
<br>> s.sourceforge.net
<br>> >
<br>>
<br>>
<br>>
<br>>
<br>>
<br>>
<br>> Hi George,
<br>>
<br>> George Rhoten 写道:
<br>>
<br>>> You're looking at behavior that is not available in any release of ICU
<br>>> yet. You're looking at the future ICU 3.8 behavior.
<br>>>
<br>>> Unfortunately, that CDRA page hasn't been updated with the latest
<br>>> information. CCSID 5417 is Big5-HKSCS.
<br>>>
<br>> What is the version of HKSCS? HKSCS-2004 or HKSCS-2001 or HKSCS-1999?
<br>> From
<br>> <a href="http://www.info.gov.hk/digital21/eng/hkscs/download/hkscs-2004-chr-incl.txt" target="_top" rel="nofollow">http://www.info.gov.hk/digital21/eng/hkscs/download/hkscs-2004-chr-incl.txt</a><br>> ,
<br>> 0xC87A was added
<br>> into HKSCS-1999, but I can not find it in ibm-5471_P100-2007.ucm.
<br>>
<br>>
<br>>> CCSID 1375 is Big5-HKSCS with
<br>>> Microsoft extensions. Each have two alternate mapping tables that map
<br>>>
<br>> the
<br>>
<br>>> codepoints to Unicode 3.0 and Unicode 3.1.
<br>>>
<br>> How to get two mapping table from one file?
<br>>
<br>>> So there are at least 4
<br>>> mapping tables for these two CCSIDs. There's actually a total of 6
<br>>>
<br>> tables
<br>>
<br>>> for the 2 CCSIDs, but the other 2 aren't relevant to this discussion.
<br>>>
<br>>> The last time I checked, Windows has a patch that modifies windows-950 to
<br>>>
<br>>
<br>>
<br>>> support the HKSCS characters, but it's for Unicode 3.0. This means that
<br>>> many characters are mapped to the private use area of Unicode. So this
<br>>> behavior is mapped to CCSID 1375 with the Unicode 3.0 behavior. This is
<br>>> also similar to some implementations on Solaris and HP-UX.
<br>>>
<br>>>
<br>> Does this mean that to keep compatibility with Windows, CCSID1375 with
<br>> the Unicode 3.0 behavor
<br>> should be used?
<br>>
<br>> Thank you very much!
<br>>
<br>> Regards,
<br>> Yandong
<br>>
<br>>> CCSID 5417 tries to match the Big5-HKSCS specification without so many
<br>>> extensions. I've also picked the variant table with the Unicode 3.1
<br>>> mappings, since the Unicode 3.0 mapping table usually isn't used without
<br>>> the Microsoft extensions. The official description can be found at <
<br>>> <a href="http://www.info.gov.hk/digital21/eng/hkscs/" target="_top" rel="nofollow">http://www.info.gov.hk/digital21/eng/hkscs/</a> >. It's very similar to Mac
<br>>> OS X's implementation. It can also be considered a "proper"
<br>>> implementation because it's using the Unicode supplementary characters.
<br>>>
<br>>> The glibc implementation of Big5-HKSCS is significantly different from
<br>>> other implementations. It's Big5-HKSCS with a lot of Unicode 3.1
<br>>> mappings, but it's incomplete. It doesn't map some characters that are
<br>>> mapped in other Big5-HKSCS implementations. It also maps some characters
<br>>>
<br>>
<br>>
<br>>> to different Unicode private use codepoints. It's closer to CCSID 5417
<br>>> with Unicode 3.1 mappings.
<br>>>
<br>>> George Rhoten
<br>>> IBM Globalization Center of Competency/ICU San Jos?, CA, USA
<br>>> <a href="http://www.icu-project.org/" target="_top" rel="nofollow">http://www.icu-project.org/</a><br>>>
<br>>>
<br>>>
<br>>> Yandong Yao <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10618997&i=4" target="_top" rel="nofollow">Yandong.Yao@...</a>>
<br>>> Sent by: <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10618997&i=5" target="_top" rel="nofollow">icu-support-bounces@...</a>
<br>>> 05/14/2007 08:20 PM
<br>>> Please respond to
<br>>> <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10618997&i=6" target="_top" rel="nofollow">Yandong.Yao@...</a>; Please respond to
<br>>> ICU support mailing list <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10618997&i=7" target="_top" rel="nofollow">icu-support@...</a>>
<br>>>
<br>>>
<br>>> To
<br>>> <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10618997&i=8" target="_top" rel="nofollow">icu-support@...</a>
<br>>> cc
<br>>>
<br>>> Subject
<br>>> [icu-support] What is the difference between two Big5-HKSCS
<br>>>
<br>> conversion
<br>>
<br>>> table?
<br>>>
<br>>>
<br>>>
<br>>>
<br>>>
<br>>>
<br>>> Hi guys,
<br>>>
<br>>> >From icu/source/data/mappings/convrtrs.txt, I found below two conversion
<br>>> tables for Big5-HKSCS, and I have not found the explanation for ibm-5471
<br>>> from
<br>>> <a href="http://www-306.ibm.com/software/globalization/ccsid/ccsid_registered.jsp" target="_top" rel="nofollow">http://www-306.ibm.com/software/globalization/ccsid/ccsid_registered.jsp</a>.
<br>>> Could you help to clarify that what is the difference between them and
<br>>> which one should be used at what context?
<br>>>
<br>>> Thank you very much!
<br>>>
<br>>> ---------------------------------------------
<br>>> ibm-5471_P100-2007 { UTR22* } # This uses supplementary characters.
<br>>> ibm-5471 { IBM* }
<br>>> Big5-HKSCS { IANA* JAVA* }
<br>>> big5hk { JAVA }
<br>>> HKSCS-BIG5 # From <a href="http://www.openi18n.org/localenameguide/" target="_top" rel="nofollow">http://www.openi18n.org/localenameguide/</a><br>>> ibm-1375_P100-2006 { UTR22* } # IBM's interpretation of Windows' Taiwan
<br>>> Big-5 w/ HKSCS extensions
<br>>> ibm-1375 { IBM* }
<br>>> Big5-HKSCS
<br>>> MS950_HKSCS { JAVA* }
<br>>> hkbig5 # from HP-UX 11i, which can't handle supplementary characters.
<br>>> big5-hkscs:unicode3.0
<br>>> # windows-950 # Windows-950 can be w/ or w/o HKSCS extensions. By
<br>>> default it's not.
<br>>> # windows-950_hkscs
<br>>> ------------------------------------------------
<br>>>
<br>>> Regards,
<br>>> Yandong
<br>>>
<br>>>
<br>>>
<br>>> -------------------------------------------------------------------------
<br>>> This SF.net email is sponsored by DB2 Express
<br>>> Download DB2 Express C - the FREE version of DB2 express and take
<br>>> control of your XML. No limits. Just data. Click to get it now.
<br>>> <a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>>> _______________________________________________
<br>>> icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10618997&i=9" target="_top" rel="nofollow">icu-support@...</a>
<br>>> To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br>>>
<br>>>
<br>>
<br>>
<br>> -------------------------------------------------------------------------
<br>> This SF.net email is sponsored by DB2 Express
<br>> Download DB2 Express C - the FREE version of DB2 express and take
<br>> control of your XML. No limits. Just data. Click to get it now.
<br>> <a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>> _______________________________________________
<br>> icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10618997&i=10" target="_top" rel="nofollow">icu-support@...</a>
<br>> To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br>>
<br>>
<br>>
<br>> -------------------------------------------------------------------------
<br>> This SF.net email is sponsored by DB2 Express
<br>> Download DB2 Express C - the FREE version of DB2 express and take
<br>> control of your XML. No limits. Just data. Click to get it now.
<br>> <a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>> _______________________________________________
<br>> icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10618997&i=11" target="_top" rel="nofollow">icu-support@...</a>
<br>> To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br>>
</div><br><br>-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>_______________________________________________
<br>icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10618997&i=12" target="_top" rel="nofollow">icu-support@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br><p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-10618405Re: What is the difference between two Big5-HKSCS conversion table?2007-05-15T02:02:41Z2007-05-15T02:02:41ZTetsuji OritaHello,
<br><br>What is the version of HKSCS? HKSCS-2004 or HKSCS-2001 or HKSCS-1999?
<br><br> CCSID 5471 contains the character set for HKSCS-2001 and CCSID 1375
<br> contains HKSCS-2004 character set.
<br><br>Does this mean that to keep compatibility with Windows, CCSID1375 with the
<br>Unicode 3.0 behavior should be used?
<br><br> Yes, I think so.
<br><br>Best regards,
<br>Tetsuji Orita (U+7E54,U+7530,U+54F2,U+6CBB),
<br>Globalization Center of Competency - Yamato, IBM Japan
<br>T/L: 1808-5425, TEL: +81-46-215-5425, FAX:+81-46-273-7497
<br>e-Mail: <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10618405&i=0" target="_top" rel="nofollow">orita@...</a>
<br><br><br><br>
<br> Yandong Yao
<br> <Yandong.Yao@Sun.
<br> COM> To
<br> Sent by: ICU support mailing list
<br> icu-support-bounc <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10618405&i=1" target="_top" rel="nofollow">icu-support@...</a>>
<br> <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10618405&i=2" target="_top" rel="nofollow">es@...</a> cc
<br> rge.net
<br> Subject
<br> Re: [icu-support] What is the
<br> 2007/05/15 16:23 difference between two Big5-HKSCS
<br> conversion table?
<br>
<br> Please respond to
<br> <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10618405&i=3" target="_top" rel="nofollow">Yandong.Yao@...</a>
<br> OM; Please
<br> respond to
<br> ICU support
<br> mailing list
<br> <icu-support@list
<br> s.sourceforge.net
<br> >
<br>
<br>
<br><br><br><br><br>Hi George,
<br><br>George Rhoten 写道:
<br>> You're looking at behavior that is not available in any release of ICU
<br>> yet. You're looking at the future ICU 3.8 behavior.
<br>>
<br>> Unfortunately, that CDRA page hasn't been updated with the latest
<br>> information. CCSID 5417 is Big5-HKSCS.
<br>What is the version of HKSCS? HKSCS-2004 or HKSCS-2001 or HKSCS-1999?
<br> From
<br><a href="http://www.info.gov.hk/digital21/eng/hkscs/download/hkscs-2004-chr-incl.txt" target="_top" rel="nofollow">http://www.info.gov.hk/digital21/eng/hkscs/download/hkscs-2004-chr-incl.txt</a><br>,
<br>0xC87A was added
<br>into HKSCS-1999, but I can not find it in ibm-5471_P100-2007.ucm.
<br><br>> CCSID 1375 is Big5-HKSCS with
<br>> Microsoft extensions. Each have two alternate mapping tables that map
<br>the
<br>> codepoints to Unicode 3.0 and Unicode 3.1.
<br>How to get two mapping table from one file?
<br>> So there are at least 4
<br>> mapping tables for these two CCSIDs. There's actually a total of 6
<br>tables
<br>> for the 2 CCSIDs, but the other 2 aren't relevant to this discussion.
<br>>
<br>> The last time I checked, Windows has a patch that modifies windows-950 to
<br><br>> support the HKSCS characters, but it's for Unicode 3.0. This means that
<br>> many characters are mapped to the private use area of Unicode. So this
<br>> behavior is mapped to CCSID 1375 with the Unicode 3.0 behavior. This is
<br>> also similar to some implementations on Solaris and HP-UX.
<br>>
<br>Does this mean that to keep compatibility with Windows, CCSID1375 with
<br>the Unicode 3.0 behavor
<br>should be used?
<br><br>Thank you very much!
<br><br>Regards,
<br>Yandong
<div class='shrinkable-quote'><br>> CCSID 5417 tries to match the Big5-HKSCS specification without so many
<br>> extensions. I've also picked the variant table with the Unicode 3.1
<br>> mappings, since the Unicode 3.0 mapping table usually isn't used without
<br>> the Microsoft extensions. The official description can be found at <
<br>> <a href="http://www.info.gov.hk/digital21/eng/hkscs/" target="_top" rel="nofollow">http://www.info.gov.hk/digital21/eng/hkscs/</a> >. It's very similar to Mac
<br>> OS X's implementation. It can also be considered a "proper"
<br>> implementation because it's using the Unicode supplementary characters.
<br>>
<br>> The glibc implementation of Big5-HKSCS is significantly different from
<br>> other implementations. It's Big5-HKSCS with a lot of Unicode 3.1
<br>> mappings, but it's incomplete. It doesn't map some characters that are
<br>> mapped in other Big5-HKSCS implementations. It also maps some characters
</div><div class='shrinkable-quote'><br>> to different Unicode private use codepoints. It's closer to CCSID 5417
<br>> with Unicode 3.1 mappings.
<br>>
<br>> George Rhoten
<br>> IBM Globalization Center of Competency/ICU San Jos?, CA, USA
<br>> <a href="http://www.icu-project.org/" target="_top" rel="nofollow">http://www.icu-project.org/</a><br>>
<br>>
<br>>
<br>> Yandong Yao <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10618405&i=4" target="_top" rel="nofollow">Yandong.Yao@...</a>>
<br>> Sent by: <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10618405&i=5" target="_top" rel="nofollow">icu-support-bounces@...</a>
<br>> 05/14/2007 08:20 PM
<br>> Please respond to
<br>> <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10618405&i=6" target="_top" rel="nofollow">Yandong.Yao@...</a>; Please respond to
<br>> ICU support mailing list <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10618405&i=7" target="_top" rel="nofollow">icu-support@...</a>>
<br>>
<br>>
<br>> To
<br>> <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10618405&i=8" target="_top" rel="nofollow">icu-support@...</a>
<br>> cc
<br>>
<br>> Subject
<br>> [icu-support] What is the difference between two Big5-HKSCS
</div>conversion
<div class='shrinkable-quote'><br>> table?
<br>>
<br>>
<br>>
<br>>
<br>>
<br>>
<br>> Hi guys,
<br>>
<br>> >From icu/source/data/mappings/convrtrs.txt, I found below two conversion
<br>> tables for Big5-HKSCS, and I have not found the explanation for ibm-5471
<br>> from
<br>> <a href="http://www-306.ibm.com/software/globalization/ccsid/ccsid_registered.jsp" target="_top" rel="nofollow">http://www-306.ibm.com/software/globalization/ccsid/ccsid_registered.jsp</a>.
<br>> Could you help to clarify that what is the difference between them and
<br>> which one should be used at what context?
<br>>
<br>> Thank you very much!
<br>>
<br>> ---------------------------------------------
<br>> ibm-5471_P100-2007 { UTR22* } # This uses supplementary characters.
<br>> ibm-5471 { IBM* }
<br>> Big5-HKSCS { IANA* JAVA* }
<br>> big5hk { JAVA }
<br>> HKSCS-BIG5 # From <a href="http://www.openi18n.org/localenameguide/" target="_top" rel="nofollow">http://www.openi18n.org/localenameguide/</a><br>> ibm-1375_P100-2006 { UTR22* } # IBM's interpretation of Windows' Taiwan
<br>> Big-5 w/ HKSCS extensions
<br>> ibm-1375 { IBM* }
<br>> Big5-HKSCS
<br>> MS950_HKSCS { JAVA* }
<br>> hkbig5 # from HP-UX 11i, which can't handle supplementary characters.
<br>> big5-hkscs:unicode3.0
<br>> # windows-950 # Windows-950 can be w/ or w/o HKSCS extensions. By
<br>> default it's not.
<br>> # windows-950_hkscs
<br>> ------------------------------------------------
<br>>
<br>> Regards,
<br>> Yandong
<br>>
<br>>
<br>>
<br>> -------------------------------------------------------------------------
<br>> This SF.net email is sponsored by DB2 Express
<br>> Download DB2 Express C - the FREE version of DB2 express and take
<br>> control of your XML. No limits. Just data. Click to get it now.
<br>> <a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>> _______________________________________________
<br>> icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10618405&i=9" target="_top" rel="nofollow">icu-support@...</a>
<br>> To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br>>
</div><br><br>-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>_______________________________________________
<br>icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10618405&i=10" target="_top" rel="nofollow">icu-support@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br><br><br><br>-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>_______________________________________________
<br>icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10618405&i=11" target="_top" rel="nofollow">icu-support@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br><p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-10617878Re: What is the difference between two Big5-HKSCS conversion table?2007-05-15T01:23:59Z2007-05-15T01:23:59Zyandong.yaoHi George,
<br><br>George Rhoten 写道:
<br>> You're looking at behavior that is not available in any release of ICU
<br>> yet. You're looking at the future ICU 3.8 behavior.
<br>>
<br>> Unfortunately, that CDRA page hasn't been updated with the latest
<br>> information. CCSID 5417 is Big5-HKSCS.
<br>What is the version of HKSCS? HKSCS-2004 or HKSCS-2001 or HKSCS-1999?
<br> From
<br><a href="http://www.info.gov.hk/digital21/eng/hkscs/download/hkscs-2004-chr-incl.txt" target="_top" rel="nofollow">http://www.info.gov.hk/digital21/eng/hkscs/download/hkscs-2004-chr-incl.txt</a>,
<br>0xC87A was added
<br>into HKSCS-1999, but I can not find it in ibm-5471_P100-2007.ucm.
<br><br>> CCSID 1375 is Big5-HKSCS with
<br>> Microsoft extensions. Each have two alternate mapping tables that map the
<br>> codepoints to Unicode 3.0 and Unicode 3.1.
<br>How to get two mapping table from one file?
<div class='shrinkable-quote'><br>> So there are at least 4
<br>> mapping tables for these two CCSIDs. There's actually a total of 6 tables
<br>> for the 2 CCSIDs, but the other 2 aren't relevant to this discussion.
<br>>
<br>> The last time I checked, Windows has a patch that modifies windows-950 to
<br>> support the HKSCS characters, but it's for Unicode 3.0. This means that
<br>> many characters are mapped to the private use area of Unicode. So this
<br>> behavior is mapped to CCSID 1375 with the Unicode 3.0 behavior. This is
<br>> also similar to some implementations on Solaris and HP-UX.
<br>>
</div>Does this mean that to keep compatibility with Windows, CCSID1375 with
<br>the Unicode 3.0 behavor
<br>should be used?
<br><br>Thank you very much!
<br><br>Regards,
<br>Yandong
<div class='shrinkable-quote'><br>> CCSID 5417 tries to match the Big5-HKSCS specification without so many
<br>> extensions. I've also picked the variant table with the Unicode 3.1
<br>> mappings, since the Unicode 3.0 mapping table usually isn't used without
<br>> the Microsoft extensions. The official description can be found at <
<br>> <a href="http://www.info.gov.hk/digital21/eng/hkscs/" target="_top" rel="nofollow">http://www.info.gov.hk/digital21/eng/hkscs/</a> >. It's very similar to Mac
<br>> OS X's implementation. It can also be considered a "proper"
<br>> implementation because it's using the Unicode supplementary characters.
<br>>
<br>> The glibc implementation of Big5-HKSCS is significantly different from
<br>> other implementations. It's Big5-HKSCS with a lot of Unicode 3.1
<br>> mappings, but it's incomplete. It doesn't map some characters that are
<br>> mapped in other Big5-HKSCS implementations. It also maps some characters
<br>> to different Unicode private use codepoints. It's closer to CCSID 5417
<br>> with Unicode 3.1 mappings.
<br>>
<br>> George Rhoten
<br>> IBM Globalization Center of Competency/ICU San José, CA, USA
<br>> <a href="http://www.icu-project.org/" target="_top" rel="nofollow">http://www.icu-project.org/</a><br>>
<br>>
<br>>
<br>> Yandong Yao <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10617878&i=0" target="_top" rel="nofollow">Yandong.Yao@...</a>>
<br>> Sent by: <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10617878&i=1" target="_top" rel="nofollow">icu-support-bounces@...</a>
<br>> 05/14/2007 08:20 PM
<br>> Please respond to
<br>> <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10617878&i=2" target="_top" rel="nofollow">Yandong.Yao@...</a>; Please respond to
<br>> ICU support mailing list <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10617878&i=3" target="_top" rel="nofollow">icu-support@...</a>>
<br>>
<br>>
<br>> To
<br>> <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10617878&i=4" target="_top" rel="nofollow">icu-support@...</a>
<br>> cc
<br>>
<br>> Subject
<br>> [icu-support] What is the difference between two Big5-HKSCS conversion
<br>> table?
<br>>
<br>>
<br>>
<br>>
<br>>
<br>>
<br>> Hi guys,
<br>>
<br>> >From icu/source/data/mappings/convrtrs.txt, I found below two conversion
<br>> tables for Big5-HKSCS, and I have not found the explanation for ibm-5471
<br>> from
<br>> <a href="http://www-306.ibm.com/software/globalization/ccsid/ccsid_registered.jsp" target="_top" rel="nofollow">http://www-306.ibm.com/software/globalization/ccsid/ccsid_registered.jsp</a>.
<br>> Could you help to clarify that what is the difference between them and
<br>> which one should be used at what context?
<br>>
<br>> Thank you very much!
<br>>
<br>> ---------------------------------------------
<br>> ibm-5471_P100-2007 { UTR22* } # This uses supplementary characters.
<br>> ibm-5471 { IBM* }
<br>> Big5-HKSCS { IANA* JAVA* }
<br>> big5hk { JAVA }
<br>> HKSCS-BIG5 # From <a href="http://www.openi18n.org/localenameguide/" target="_top" rel="nofollow">http://www.openi18n.org/localenameguide/</a><br>> ibm-1375_P100-2006 { UTR22* } # IBM's interpretation of Windows' Taiwan
<br>> Big-5 w/ HKSCS extensions
<br>> ibm-1375 { IBM* }
<br>> Big5-HKSCS
<br>> MS950_HKSCS { JAVA* }
<br>> hkbig5 # from HP-UX 11i, which can't handle supplementary characters.
<br>> big5-hkscs:unicode3.0
<br>> # windows-950 # Windows-950 can be w/ or w/o HKSCS extensions. By
<br>> default it's not.
<br>> # windows-950_hkscs
<br>> ------------------------------------------------
<br>>
<br>> Regards,
<br>> Yandong
<br>>
<br>>
<br>>
<br>> -------------------------------------------------------------------------
<br>> This SF.net email is sponsored by DB2 Express
<br>> Download DB2 Express C - the FREE version of DB2 express and take
<br>> control of your XML. No limits. Just data. Click to get it now.
<br>> <a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>> _______________________________________________
<br>> icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10617878&i=5" target="_top" rel="nofollow">icu-support@...</a>
<br>> To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br>>
</div><br><br>-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>_______________________________________________
<br>icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10617878&i=6" target="_top" rel="nofollow">icu-support@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br><p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-10616678Re: Case and accent insensitive string search2007-05-14T23:07:00Z2007-05-14T23:07:00ZAndy HeningerOn 5/10/07, Doug Doole <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10616678&i=0" target="_top" rel="nofollow">doole@...</a>> wrote:
<br> [snip]
<br>> However I'm stuck with the broken code for now. You wouldn't happen to know
<br>> a good work around for the unable to match leading/trailing characters bugs
<br>> (see bugs 5024, 5420)? (It seems that adding a space at the beginning and
<br>> ending of the text to be searched solves the problem, but that's a big
<br>> pain.)
<br>>
<br><br>I'm continuing to look into alternate C/C++ search implementations
<br>that should eliminate the problems with the existing one. But there
<br>are some things going on that I don't understand having to do with
<br>expansions, matching the German ß with ss, for example. The issues
<br>here do affect the current implementation and are not restricted to
<br>the ends of the string. I'll let you know what comes of it.
<br><br> -- Andy
<br><br><br> -- Andy
<br><br>-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>_______________________________________________
<br>icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10616678&i=1" target="_top" rel="nofollow">icu-support@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br><p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-10616644Re: What is the difference between two Big5-HKSCS conversion table?2007-05-14T23:01:47Z2007-05-14T23:01:47ZGeorge RhotenYou're looking at behavior that is not available in any release of ICU
<br>yet. You're looking at the future ICU 3.8 behavior.
<br><br>Unfortunately, that CDRA page hasn't been updated with the latest
<br>information. CCSID 5417 is Big5-HKSCS. CCSID 1375 is Big5-HKSCS with
<br>Microsoft extensions. Each have two alternate mapping tables that map the
<br>codepoints to Unicode 3.0 and Unicode 3.1. So there are at least 4
<br>mapping tables for these two CCSIDs. There's actually a total of 6 tables
<br>for the 2 CCSIDs, but the other 2 aren't relevant to this discussion.
<br><br>The last time I checked, Windows has a patch that modifies windows-950 to
<br>support the HKSCS characters, but it's for Unicode 3.0. This means that
<br>many characters are mapped to the private use area of Unicode. So this
<br>behavior is mapped to CCSID 1375 with the Unicode 3.0 behavior. This is
<br>also similar to some implementations on Solaris and HP-UX.
<br><br>CCSID 5417 tries to match the Big5-HKSCS specification without so many
<br>extensions. I've also picked the variant table with the Unicode 3.1
<br>mappings, since the Unicode 3.0 mapping table usually isn't used without
<br>the Microsoft extensions. The official description can be found at <
<br><a href="http://www.info.gov.hk/digital21/eng/hkscs/" target="_top" rel="nofollow">http://www.info.gov.hk/digital21/eng/hkscs/</a> >. It's very similar to Mac
<br>OS X's implementation. It can also be considered a "proper"
<br>implementation because it's using the Unicode supplementary characters.
<br><br>The glibc implementation of Big5-HKSCS is significantly different from
<br>other implementations. It's Big5-HKSCS with a lot of Unicode 3.1
<br>mappings, but it's incomplete. It doesn't map some characters that are
<br>mapped in other Big5-HKSCS implementations. It also maps some characters
<br>to different Unicode private use codepoints. It's closer to CCSID 5417
<br>with Unicode 3.1 mappings.
<br><br>George Rhoten
<br>IBM Globalization Center of Competency/ICU San José, CA, USA
<br><a href="http://www.icu-project.org/" target="_top" rel="nofollow">http://www.icu-project.org/</a><br><br><br><br>Yandong Yao <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10616644&i=0" target="_top" rel="nofollow">Yandong.Yao@...</a>>
<br>Sent by: <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10616644&i=1" target="_top" rel="nofollow">icu-support-bounces@...</a>
<br>05/14/2007 08:20 PM
<br>Please respond to
<br><a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10616644&i=2" target="_top" rel="nofollow">Yandong.Yao@...</a>; Please respond to
<br>ICU support mailing list <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10616644&i=3" target="_top" rel="nofollow">icu-support@...</a>>
<br><br><br>To
<br><a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10616644&i=4" target="_top" rel="nofollow">icu-support@...</a>
<br>cc
<br><br>Subject
<br>[icu-support] What is the difference between two Big5-HKSCS conversion
<br>table?
<br><br><br><br><br><br><br>Hi guys,
<br><br>>From icu/source/data/mappings/convrtrs.txt, I found below two conversion
<br>tables for Big5-HKSCS, and I have not found the explanation for ibm-5471
<br>from
<br><a href="http://www-306.ibm.com/software/globalization/ccsid/ccsid_registered.jsp" target="_top" rel="nofollow">http://www-306.ibm.com/software/globalization/ccsid/ccsid_registered.jsp</a>.
<br>Could you help to clarify that what is the difference between them and
<br>which one should be used at what context?
<br><br>Thank you very much!
<br><br>---------------------------------------------
<br>ibm-5471_P100-2007 { UTR22* } # This uses supplementary characters.
<br>ibm-5471 { IBM* }
<br>Big5-HKSCS { IANA* JAVA* }
<br>big5hk { JAVA }
<br>HKSCS-BIG5 # From <a href="http://www.openi18n.org/localenameguide/" target="_top" rel="nofollow">http://www.openi18n.org/localenameguide/</a><br>ibm-1375_P100-2006 { UTR22* } # IBM's interpretation of Windows' Taiwan
<br>Big-5 w/ HKSCS extensions
<br>ibm-1375 { IBM* }
<br>Big5-HKSCS
<br>MS950_HKSCS { JAVA* }
<br>hkbig5 # from HP-UX 11i, which can't handle supplementary characters.
<br>big5-hkscs:unicode3.0
<br># windows-950 # Windows-950 can be w/ or w/o HKSCS extensions. By
<br>default it's not.
<br># windows-950_hkscs
<br>------------------------------------------------
<br><br>Regards,
<br>Yandong
<br><br><br><br>-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>_______________________________________________
<br>icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10616644&i=5" target="_top" rel="nofollow">icu-support@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br><p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-10616167Re: Proposal for rule based time zone (ticket#5454)2007-05-14T21:49:12Z2007-05-14T21:49:12ZSteven R. LoomisYoshito, please do:
<br><br>svn propset svn:mime-type text/html filename.html
<br>svn commit filename.html
<br><br><br>to set the mime type, also check your svn configuration file to make
<br>sure text/html and others are properly tagged on creation
<br><br>-s
<br><br><br>On May 14, 2007, at 8:38 PM, Mark Davis wrote:
<br><div class='shrinkable-quote'><br>> Looks good to me; however, I wasn't able to see
<br>>
<br>> <a href="http://source.icu-project.org/repos/icu/icuhtml/trunk/design/rbtz/" target="_top" rel="nofollow">http://source.icu-project.org/repos/icu/icuhtml/trunk/design/rbtz/</a>
<br>> ICU4J_JavaDoc/index.html
<br>>
<br>> the link opens up a view into raw HTML.
<br>>
<br>> Mark
<br>>
<br>> On 5/14/07, <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10616167&i=0" target="_top" rel="nofollow">yoshito_umaoka@...</a> < <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10616167&i=1" target="_top" rel="nofollow">yoshito_umaoka@...</a>>
<br>> wrote:
<br>> This is a design proposal for "Rule based time zone" -> http://
<br>> bugs.icu-project.org/trac/ticket/5454
<br>> Please review this design proposal and provide your feedback.
<br>>
<br>> Thanks
<br>> Yoshito
<br>> -----------------------------------------------------
<br>>
<br>> Scope of the RFE
<br>>
<br>> 1) ICU uses timezone.res which is generated from Olson tzdata.
<br>> Although you can get UTC offset of local time, you cannot get when
<br>> the offset is changed. For example, some ICU clients may want to
<br>> get next daylight saving time start/end date for some reasons. For
<br>> now, what ICU clients can do is to probe UTC offset at a certain
<br>> date, then find the point of time when the offset is changed by
<br>> binary search. The ICU internal time zone data actually contains
<br>> the time of transitions or rule used for getting the transitions.
<br>> But there are no APIs to access the transitions at this moment.
<br>>
<br>> 2) ICU clients may want to define their own time zones. For now,
<br>> SimpleTimeZone is only the class which you can use to create a
<br>> custom time zone. SimpleTimeZone does not support historical rule
<br>> changes. If you really want to define a time zone with historical
<br>> rule changes, you will need to subclass TimeZone and write your own
<br>> TimeZone class.
<br>>
<br>> 3) iCalendar is a standard calendar protocol and has its own way to
<br>> represent time zones. When you develop a calendar application, you
<br>> may need to extract offset transition rules for a time zone when
<br>> composing an iCalendar message. Also, when parsing an iCalendar
<br>> message, you will need to parse the time zone definitions in
<br>> RFC2445 format and create a TimeZone object to be used in your
<br>> code. Technically, if above 2 items are supported (extracting
<br>> transition rules/generating a time zone object by historical
<br>> rules), you can write your own RFC2445 VTIMEZONE formatter/parser.
<br>> But implementing the formatter/parser is not a trivial work, so ICU
<br>> clients may want to have the implementation in ICU itself.
<br>>
<br>>
<br>> Overview of proposed APIs
<br>>
<br>> The proposed API documentation is found here -> <a href="http://source.icu-" target="_top" rel="nofollow">http://source.icu-</a>
<br>> project.org/repos/icu/icuhtml/trunk/design/rbtz/ICU4J_JavaDoc/
<br>> index.html
<br>> ICU4C APIs will be added soon.
<br>>
<br>> 1) TimeZoneRule/AnnualTimeZoneRule/TimeArrayTimeZoneRule
<br>>
<br>> TimeZoneRule is a class representing a rule for a time zone.
<br>> TimeZoneRule has next 3 fields - name, standard offset and daylight
<br>> saving. For example, US Eastern Daylight Saving Time may be
<br>> represented by name = "EDT" / standard offset = -18000000
<br>> (milliseconds) / daylight saving = 3600000. There are two
<br>> subclasses of TimeZoneRule - AnnualTimeZoneRule and
<br>> TimeArrayTimeZoneRule.
<br>>
<br>> AnnualTimeZoneRule defines start times by an instance of
<br>> AnnualDateTimeRule. AnnualDateTimeRule is a class representing a
<br>> rule date/time. The rule date can be specified by 4 different ways
<br>> (day of month, Nth weekday in month, first weekday after day of
<br>> month, last weekday before day of month). The time rule can be
<br>> specified 3 different type - WALL_TIME, STANDARD_TIME and
<br>> UNIVERSAL_TIME. They are equivalent to rules which are currently
<br>> used in SimpleTimeZone internally. AnnualTimeZoneRule also defines
<br>> applicable year range.
<br>>
<br>> For example, US Eastern Daylight Saving time since 1987 is
<br>> represented by next two AnnualTimeZoneRule instances.
<br>>
<br>> // First Sunday on or after April 1st, 2AM at local wall time
<br>> AnnualDateTimeRule dtRule1 = new AnnualDateTimeRule(Calendar.APRIL,
<br>> 1, Calendar.SUNDAY, true,
<br>> 2*60*60*1000,
<br>> AnnualDateTimeRule.WALL_TIME);
<br>> // First Sunday on or after March 8th, 2AM at local wall time
<br>> AnnualDateTimeRule dtRule2 = new AnnualDateTimeRule(Calendar.MARCH,
<br>> 8, Calendar.SUNDAY, true,
<br>> 2*60*60*1000,
<br>> AnnualDateTimeRule.WALL_TIME);
<br>>
<br>> // Rule for 1987 - 2006
<br>> AnnualTimeZoneRule tzRule1 = new AnnualTimeZoneRule("EDT", // name
<br>> of time zone
<br>>
<br>> -5*60*60*1000, // standard UTC offset -5 hours
<br>>
<br>> 1*60*60*1000, // daylight saving
<br>> dtRule1, //
<br>> annual date time rule
<br>> 1987, // start
<br>> year
<br>> 2006); // end year
<br>> // Rule for 2007 -
<br>> AnnualTimeZoneRule tzRule1 = new AnnualTimeZoneRule("EDT", // name
<br>> of time zone
<br>>
<br>> -5*60*60*1000, // standard UTC offset -5 hours
<br>>
<br>> 1*60*60*1000, // daylight saving
<br>> dtRule2, //
<br>> annual date time rule
<br>> 2007, // start
<br>> year
<br>>
<br>> AnnualTimeZoneRule.MAX_YEAR); // end year - forever
<br>>
<br>>
<br>> TimeArrayTimeZoneRule defines start times by an array of
<br>> milliseconds since UTC epoch time (Jan 1, 1970 00:00:00).
<br>>
<br>>
<br>> 2) TimeZoneTransition
<br>>
<br>> TimeZoneTransition is a class repesenting a single time
<br>> transition. A TimeZoneTransition has 3 fields - time, time zone
<br>> rule before/after the time. TimeZoneTransition objects are used as
<br>> return type in new APIs.
<br>>
<br>>
<br>> 3) HasTimeZoneTransitions
<br>>
<br>> HasTimeZoneTransitions is an interface which defines two methods -
<br>>
<br>> public TimeZoneTransition getNextTransition(long base);
<br>> public TimeZoneTransition getPreviousTransition(long base);
<br>>
<br>> TimeZone Implementation classes - SimpleTimeZone and OlsonTimeZone
<br>> - will implement the interface to allow ICU clients to get exact
<br>> time when time is changed. For example, next Java code snipet will
<br>> return the next time transition in time zone "America/New_York".
<br>>
<br>> SimpleDateFormat sdf = new SimpleDateFormat("yyyy-MM-
<br>> dd'T'HH:mm:ssZ", ULocale.ROOT);
<br>> sdf.setTimeZone(TimeZone.getTimeZone("UTC"));
<br>>
<br>> TimeZoneTransition nextTT = TimeZone.getTimeZone("America/
<br>> New_York").getNextTransition(System.currentTimeMillis());
<br>>
<br>> System.out.println("Next transition time: " + sdf.format(new Date
<br>> (nextTT.getTime())));
<br>> System.out.println("From: " + nextTT.getFrom().getStdOffset() + "/"
<br>> + nextTT.getFrom().getDstSaving());
<br>> System.out.println("To: " + nextTT.getTo().getStdOffset() + "/" +
<br>> nextTT.getTo().getDstSaving());
<br>>
<br>> Above code snipet will print out the results below (as of now) -
<br>>
<br>> Next transition time: 2007-11-04T06:00:00Z
<br>> From: -18000000/3600000
<br>> To: -18000000/0
<br>>
<br>>
<br>> 4) RuleBasedTimeZone
<br>>
<br>> RuleBasedTimeZone is a subclass of TimeZone for creating a custom
<br>> time zone by rules. The constructor takes 4 arguments - time zone
<br>> ID, initial time name/standard offset/daylight saving. When the
<br>> instance is created, it has fixed UTC offset. Then you can add
<br>> your own rules defined by AnnualTimeZoneRule and/or
<br>> TimeArrayTimeZoneRule objects. Below is a coding example of
<br>> RuleBasedTimeZone representing US Eastern time since 1967.
<br>>
<br>> int HOUR = 60*60*1000;
<br>>
<br>> RuleBasedTimeZone rbtz = new RuleBasedTimeZone("US_Eastern", "EST",
<br>> -5*HOUR, 0);
<br>>
<br>> AnnualDateTimeRule dtr;
<br>> AnnualTimeZoneRule tzr;
<br>>
<br>> // Standard time
<br>> dtr = new AnnualDateTimeRule(Calendar.OCTOBER, -1, Calendar.SUNDAY,
<br>> 2*HOUR, AnnualDateTimeRule.WALL_TIME);
<br>> tzr = new AnnualTimeZoneRule("EST", -5*HOUR, 0, dtr, 1967, 2006);
<br>> rbtz.addRule(tzr);
<br>>
<br>> dtr = new AnnualDateTimeRule(Calendar.NOVEMBER, 1, Calendar.SUNDAY,
<br>> true, 2*HOUR, AnnualDateTimeRule.WALL_TIME);
<br>> tzr = new AnnualTimeZoneRule("EST", -5*HOUR, 0, dtr, 2007,
<br>> AnnualTimeZoneRule.MAX_YEAR);
<br>> rbtz.addRule(tzr);
<br>>
<br>> // Daylight saving time
<br>> dtr = new AnnualDateTimeRule(Calendar.APRIL, -1, Calendar.SUNDAY,
<br>> 2*HOUR, AnnualDateTimeRule.WALL_TIME);
<br>> tzr = new AnnualTimeZoneRule("EDT", -5*HOUR, 1*HOUR, dtr, 1967, 1973);
<br>> rbtz.addRule(tzr);
<br>>
<br>> dtr = new AnnualDateTimeRule(Calendar.JANUARY, 6, 2*HOUR,
<br>> AnnualDateTimeRule.WALL_TIME);
<br>> tzr = new AnnualTimeZoneRule("EDT", -5*HOUR, 1*HOUR, dtr, 1974, 1974);
<br>> rbtz.addRule(tzr);
<br>>
<br>> dtr = new AnnualDateTimeRule(Calendar.FEBRUARY, 23, 2*HOUR,
<br>> AnnualDateTimeRule.WALL_TIME);
<br>> tzr = new AnnualTimeZoneRule("EDT", -5*HOUR, 1*HOUR, dtr, 1975, 1975);
<br>> rbtz.addRule(tzr);
<br>>
<br>> dtr = new AnnualDateTimeRule(Calendar.APRIL, -1, Calendar.SUNDAY,
<br>> 2*HOUR, AnnualDateTimeRule.WALL_TIME);
<br>> tzr = new AnnualTimeZoneRule("EDT", -5*HOUR, 1*HOUR, dtr, 1976, 1986);
<br>> rbtz.addRule(tzr);
<br>>
<br>> dtr = new AnnualDateTimeRule(Calendar.APRIL, 1, Calendar.SUNDAY,
<br>> true, 2*HOUR, AnnualDateTimeRule.WALL_TIME);
<br>> tzr = new AnnualTimeZoneRule("EDT", -5*HOUR, 1*HOUR, dtr, 1987, 2006);
<br>> rbtz.addRule(tzr);
<br>>
<br>> dtr = new AnnualDateTimeRule(Calendar.MARCH, 8, Calendar.SUNDAY,
<br>> true, 2*HOUR, AnnualDateTimeRule.WALL_TIME);
<br>> tzr = new AnnualTimeZoneRule("EDT", -5*HOUR, 1*HOUR, dtr, 2007,
<br>> AnnualTimeZoneRule.MAX_YEAR);
<br>> rbtz.addRule(tzr);
<br>>
<br>>
<br>> 5) VTimeZone
<br>>
<br>> VTimeZone is a subclass of TimeZone implementing RFC2445 iCalendar
<br>> VTIMEZONE. There are two ways to create an instance of VTimeZone -
<br>> one from ICU/Olson time zone ID and another from VTIMEZONE data
<br>> stream. VTimeZone has a private member which store store either
<br>> OlsonTimeZone or RuleBasedTimeZone. When a VTimeZone object is
<br>> created from ID, OlsonTimeZone is created for the ID. When it is
<br>> created from RFC2445 VTIMEZONE data stream, an instance of
<br>> RuleBasedTimeZone is created and initialized by parsing rules in
<br>> the RFC format. VTimeZone provides two write methods in addition
<br>> to TimeZone public APIs.
<br>>
<br>> public boolean write(Writer writer)
<br>> public boolean write(Writer writer, long start, long end)
<br>>
<br>> In general, all of historical transitions used by an ICU
<br>> OlsonTimeZone is not necessary in iCalendar applications. When you
<br>> create an iCalendar message, you may only need time zone rules
<br>> including the event times. The second write method allow you to
<br>> filter the rules and only pick rules applicable to the specified
<br>> time range. By doing so, you can reduce the size of VTIMEZONE data
<br>> block in the iCalendar message.
<br>>
<br>>
<br>> Development note - design consideration, question, limitation and etc.
<br>>
<br>> 1) In last year, I proposed APIs supporting RuleBasedTimeZone and
<br>> VTimeZone. At that time, I designed APIs under strong ifluence of
<br>> RFC2445 VTIMEZONE. However, I realized the initial implementation
<br>> was not ideal for supporting zic (Olson tzdata) source files.
<br>> Although implementing zic compiler was not an important goal, I
<br>> wanted to reconsider the design to be able to support zic source
<br>> files with less efforts. The big difference between VTIMEZONE and
<br>> zic syntax is - a time zone in VTIMEZONE has an attribute
<br>> "TZOFFSETFROM". Although the time of zone transition is specified
<br>> by local wall time, you can get the exact UTC time when the rule
<br>> starts without looking into other rules. On the other hand, a
<br>> single zic rule may only tell you the starts in local wall time
<br>> without previous offset. That means, to process rule/zone
<br>> definitions in zic source format, you have to walk through the
<br>> historical transitions from the begining. Actually, VTIMEZONE
<br>> syntax is somewhat error prone, because "to offset" may not match
<br>> the next time's "from offset". In the new proposal, I removed
<br>> "from offset" in AnnualTimeZoneRule. It allows you to transform
<br>> zic source into the rule without looking into other past rules.
<br>>
<br>> 2) Although it is possible to use these APIs to implement a parser
<br>> to create a TimeZone from zic source format, it is still not a
<br>> trivial work. With the zic syntax, standard offset transitions are
<br>> separated from daylight saving transitions (Zone line vs. Rule
<br>> line). On the other hand, TimeZoneRule represent both standard
<br>> offset and start times in a single object. Thus, to implement zic
<br>> parser, you need to go through both Zone lines and Rule lines to
<br>> detect any changes including standard offset. For example, the
<br>> next zic source data -
<br>>
<br>> # Rule NAME FROM TO TYPE
<br>> IN ON AT SAVE LETTER
<br>> Rule FOO 1950 2000 - Apr 1 1:00 1:00 D
<br>> Rule FOO 1950 max - Oct 31 1:00 0:00 S
<br>> Rule FOO 2001 max - Mar 1 1:00 1:00 D
<br>>
<br>> # Rule NAME FROM TO TYPE
<br>> IN ON AT SAVE LETTER
<br>> Rule BAR 1950 max - Apr 2 2:00 1:00 D
<br>> Rule BAR 1950 max - Oct 30 2:00 0:00 S
<br>>
<br>> # Zone NAME GMTOFF RULES
<br>> FORMAT [UNTIL]
<br>> Zone Custom1 2:34:56 - LMT 1960
<br>> 2:30 BAR B%sT 1990
<br>> 2:00 FOO F%sT
<br>>
<br>> will be parsed into
<br>>
<br>> - RuleBasedTimeZone constructed with initial name "LMT" with
<br>> standard offset 1:23:45
<br>> - AnnualTimeZoneRule for daylight saving time (std 2:30/sav 1:00)
<br>> starting on Apr 2 at 2am from 1961 to 1990 with name "BDT"
<br>> - AnnualTimeZoneRule for standard time (std 2:30/sav 0:00) starting
<br>> on Oct 30 at 2am from 1961 to 1990 with name "BST"
<br>> - AnnualTimeZoneRule for daylight saving time (std 2:00/sav 1:00)
<br>> on Apr 1 at 1am from 1991 to 2000 with name "FDT"
<br>> - AnnualTimeZoneRule for standard time (std 2:00/sav 0:00) on Oct
<br>> 31 at 1am from 1991 to max with name "FST"
<br>> - AnnualTimeZoneRule for daylight saving time (std 2:00/sav 1:00)
<br>> on Mar 1 at 1am from 2001 to max with name "FDT"
<br>>
<br>> Does anyone want to have the zic parser implemented in ICU?
<br>>
<br>> 3) When you create VTimeZone instance from zone ID such as "America/
<br>> New_York" and write out the rule into RFC2445 format, you will see
<br>> historical transitions are represented by a list of date time,
<br>> instead of the original rule such as 1st Sunday in April. When ICU
<br>> imports Olson tzdata into timezone.res, the tool already resolves
<br>> historical transition times in UTC and they are no longer in mont/
<br>> day rule format. Only the latest rules might be represented in the
<br>> format originally from tzdata.
<br>>
<br>> 4) RuleBasedTimeZone is a subclass of TimeZone, thus, it has
<br>> getRawOffset(), setRawOffset(int), getDaylightSaving() and
<br>> useDaylightTime(). These APIs do not make sense much in TimeZone
<br>> implementation which supports historical transitions. The
<br>> implementation may try to return a result based on the currently
<br>> active - except setRawOffset, which may do nothing.
<br>>
<br>>
<br>> ----------------------------------------------------------------------
<br>> ---
<br>> This SF.net email is sponsored by DB2 Express
<br>> Download DB2 Express C - the FREE version of DB2 express and take
<br>> control of your XML. No limits. Just data. Click to get it now.
<br>> <a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>> _______________________________________________
<br>> icu-design mailing list
<br>> <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10616167&i=2" target="_top" rel="nofollow">icu-design@...</a>
<br>> To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-</a>
<br>> design
<br>>
<br>>
<br>>
<br>> --
<br>> Mark
<br>> ----------------------------------------------------------------------
<br>> ---
<br>> This SF.net email is sponsored by DB2 Express
<br>> Download DB2 Express C - the FREE version of DB2 express and take
<br>> control of your XML. No limits. Just data. Click to get it now.
<br>> <a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a>
<br>> _______________________________________________
<br>> icu-design mailing list
<br>> <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10616167&i=3" target="_top" rel="nofollow">icu-design@...</a>
<br>> To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-</a>
<br>> design
</div><br><br>-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>_______________________________________________
<br>icu-design mailing list
<br><a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10616167&i=4" target="_top" rel="nofollow">icu-design@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-design" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-design</a><br><p>From forum: <a href="http://old.nabble.com/ICU---Design-f14222.html" embed="fixTarget[14222]" target="_top" >ICU - Design</a></p>tag:old.nabble.com,2006:post-10616107Re: Proposal for rule based time zone (ticket#5454)2007-05-14T21:38:20Z2007-05-14T21:38:20ZMark Davis-2Looks good to me; however, I wasn't able to see <br><br><a href="http://source.icu-project.org/repos/icu/icuhtml/trunk/design/rbtz/ICU4J_JavaDoc/index.html" target="_top" rel="nofollow">http://source.icu-project.org/repos/icu/icuhtml/trunk/design/rbtz/ICU4J_JavaDoc/index.html
</a><br><br>the link opens up a view into raw HTML.<br><br>Mark<br><br><div><span class="gmail_quote">On 5/14/07, <b class="gmail_sendername"><a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10616107&i=0" target="_top" rel="nofollow">yoshito_umaoka@...</a></b> <
<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10616107&i=1" target="_top" rel="nofollow">yoshito_umaoka@...</a>> wrote:</span><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
<br><font face="sans-serif" size="2">This is a design proposal for "Rule
based time zone" -> <a href="http://bugs.icu-project.org/trac/ticket/5454" target="_blank" rel="nofollow">http://bugs.icu-project.org/trac/ticket/5454</a></font>
<br><font face="sans-serif" size="2">Please review this design proposal and
provide your feedback.</font>
<br>
<br><font face="sans-serif" size="2">Thanks</font>
<br><font face="sans-serif" size="2">Yoshito</font>
<br><font face="sans-serif" size="2">-----------------------------------------------------</font>
<br>
<br><font face="sans-serif" size="2"><b>Scope of the RFE</b></font>
<br>
<br><font face="sans-serif" size="2">1) ICU uses timezone.res which is generated
from Olson tzdata. Although you can get UTC offset of local time,
you cannot get when the offset is changed. For example, some ICU
clients may want to get next daylight saving time start/end date for some
reasons. For now, what ICU clients can do is to probe UTC offset
at a certain date, then find the point of time when the offset is changed
by binary search. The ICU internal time zone data actually contains
the time of transitions or rule used for getting the transitions. But
there are no APIs to access the transitions at this moment.</font>
<br>
<br><font face="sans-serif" size="2">2) ICU clients may want to define their
own time zones. For now, SimpleTimeZone is only the class which you
can use to create a custom time zone. SimpleTimeZone does not support
historical rule changes. If you really want to define a time zone
with historical rule changes, you will need to subclass TimeZone and write
your own TimeZone class.</font>
<br>
<br><font face="sans-serif" size="2">3) iCalendar is a standard calendar
protocol and has its own way to represent time zones. When you develop
a calendar application, you may need to extract offset transition rules
for a time zone when composing an iCalendar message. Also, when parsing
an iCalendar message, you will need to parse the time zone definitions
in RFC2445 format and create a TimeZone object to be used in your code.
Technically, if above 2 items are supported (extracting transition
rules/generating a time zone object by historical rules), you can write
your own RFC2445 VTIMEZONE formatter/parser. But implementing the
formatter/parser is not a trivial work, so ICU clients may want to have
the implementation in ICU itself.</font>
<br>
<br>
<br><font face="sans-serif" size="2"><b>Overview of proposed APIs</b></font>
<br>
<br><font face="sans-serif" size="2">The proposed API documentation is found
here -> <a href="http://source.icu-project.org/repos/icu/icuhtml/trunk/design/rbtz/ICU4J_JavaDoc/index.html" target="_blank" rel="nofollow">http://source.icu-project.org/repos/icu/icuhtml/trunk/design/rbtz/ICU4J_JavaDoc/index.html
</a></font>
<br><font face="sans-serif" size="2">ICU4C APIs will be added soon.</font>
<br>
<br><font face="sans-serif" size="2">1) TimeZoneRule/AnnualTimeZoneRule/TimeArrayTimeZoneRule</font>
<br>
<br><font face="sans-serif" size="2">TimeZoneRule is a class representing
a rule for a time zone. TimeZoneRule has next 3 fields - name, standard
offset and daylight saving. For example, US Eastern Daylight Saving
Time may be represented by name = "EDT" / standard offset = -18000000
(milliseconds) / daylight saving = 3600000. There are two subclasses
of TimeZoneRule - AnnualTimeZoneRule and TimeArrayTimeZoneRule.</font>
<br>
<br><font face="sans-serif" size="2">AnnualTimeZoneRule defines start
times by an instance of AnnualDateTimeRule. AnnualDateTimeRule is
a class representing a rule date/time. The rule date can be specified
by 4 different ways (day of month, Nth weekday in month, first weekday
after day of month, last weekday before day of month). The time rule
can be specified 3 different type - WALL_TIME, STANDARD_TIME and UNIVERSAL_TIME.
They are equivalent to rules which are currently used in SimpleTimeZone
internally. AnnualTimeZoneRule also defines applicable year range.</font>
<br>
<br><font face="sans-serif" size="2">For example, US Eastern Daylight Saving
time since 1987 is represented by next two AnnualTimeZoneRule instances.</font>
<br>
<br><font face="Courier" size="2">// First Sunday on or after April 1st,
2AM at local wall time</font>
<br><font face="Courier" size="2">AnnualDateTimeRule dtRule1 = new AnnualDateTimeRule(Calendar.APRIL,
1, Calendar.SUNDAY, true,</font>
<br><font face="Courier" size="2">
2*60*60*1000,
AnnualDateTimeRule.WALL_TIME);</font>
<br><font face="Courier" size="2">// First Sunday on or after March 8th,
2AM at local wall time</font>
<br><font face="Courier" size="2">AnnualDateTimeRule dtRule2 = new AnnualDateTimeRule(Calendar.MARCH,
8, Calendar.SUNDAY, true,</font>
<br><font face="Courier" size="2">
2*60*60*1000,
AnnualDateTimeRule.WALL_TIME);</font>
<br>
<br><font face="Courier" size="2">// Rule for 1987 - 2006</font>
<br><font face="Courier" size="2">AnnualTimeZoneRule tzRule1 = new AnnualTimeZoneRule("EDT",
// name of time zone</font>
<br><font face="Courier" size="2">
-5*60*60*1000,
// standard UTC offset -5 hours</font>
<br><font face="Courier" size="2">
1*60*60*1000,
// daylight saving</font>
<br><font face="Courier" size="2">
dtRule1,
// annual date time rule</font>
<br><font face="Courier" size="2">
1987, //
start year</font>
<br><font face="Courier" size="2">
2006); //
end year</font>
<br><font face="Courier" size="2">// Rule for 2007 - </font>
<br><font face="Courier" size="2">AnnualTimeZoneRule tzRule1 = new AnnualTimeZoneRule("EDT",
// name of time zone</font>
<br><font face="Courier" size="2">
-5*60*60*1000,
// standard UTC offset -5 hours</font>
<br><font face="Courier" size="2">
1*60*60*1000,
// daylight saving</font>
<br><font face="Courier" size="2">
dtRule2,
// annual date time rule</font>
<br><font face="Courier" size="2">
2007, //
start year</font>
<br><font face="Courier" size="2">
AnnualTimeZoneRule.MAX_YEAR);
// end year - forever</font>
<br>
<br>
<br><font face="sans-serif" size="2">TimeArrayTimeZoneRule defines start
times by an array of milliseconds since UTC epoch time (Jan 1, 1970
00:00:00).</font>
<br>
<br>
<br><font face="sans-serif" size="2">2) TimeZoneTransition</font>
<br>
<br><font face="sans-serif" size="2">TimeZoneTransition is a class repesenting
a single time transition. A TimeZoneTransition has 3 fields - time,
time zone rule before/after the time. TimeZoneTransition objects
are used as return type in new APIs.</font>
<br>
<br>
<br><font face="sans-serif" size="2">3) HasTimeZoneTransitions</font>
<br>
<br><font face="sans-serif" size="2">HasTimeZoneTransitions is an interface
which defines two methods -</font>
<br>
<br><font face="Courier" size="2">public TimeZoneTransition getNextTransition(long
base);</font>
<br><font face="Courier" size="2">public TimeZoneTransition getPreviousTransition(long
base);</font>
<br>
<br><font face="sans-serif" size="2">TimeZone Implementation classes - SimpleTimeZone
and OlsonTimeZone - will implement the interface to allow ICU clients to
get exact time when time is changed. For example, next Java code
snipet will return the next time transition in time zone "America/New_York".</font>
<br>
<br><font face="Courier" size="2">SimpleDateFormat sdf = new SimpleDateFormat("yyyy-MM-dd'T'HH:mm:ssZ",
ULocale.ROOT);</font>
<br><font face="Courier" size="2">sdf.setTimeZone(TimeZone.getTimeZone("UTC"));</font>
<br>
<br><font face="Courier" size="2">TimeZoneTransition nextTT = TimeZone.getTimeZone("America/New_York").getNextTransition(System.currentTimeMillis());</font>
<br>
<br><font face="Courier" size="2">System.out.println("Next transition
time: " + sdf.format(new Date(nextTT.getTime())));</font>
<br><font face="Courier" size="2">System.out.println("From: " +
nextTT.getFrom().getStdOffset() + "/" + nextTT.getFrom().getDstSaving());</font>
<br><font face="Courier" size="2">System.out.println("To: "
+ nextTT.getTo().getStdOffset() + "/" + nextTT.getTo().getDstSaving());</font>
<br>
<br><font face="sans-serif" size="2">Above code snipet will print out the
results below (as of now) -</font>
<br>
<br><font face="Courier New" size="2">Next transition time: 2007-11-04T06:00:00Z</font>
<br><font face="Courier New" size="2">From: -18000000/3600000</font>
<br><font face="Courier New" size="2">To: -18000000/0</font>
<br>
<br>
<br><font face="sans-serif" size="2">4) RuleBasedTimeZone</font>
<br>
<br><font face="sans-serif" size="2">RuleBasedTimeZone is a subclass of TimeZone
for creating a custom time zone by rules. The constructor takes 4
arguments - time zone ID, initial time name/standard offset/daylight saving.
When the instance is created, it has fixed UTC offset. Then
you can add your own rules defined by AnnualTimeZoneRule and/or TimeArrayTimeZoneRule
objects. Below is a coding example of RuleBasedTimeZone representing
US Eastern time since 1967.</font>
<br>
<br><font face="Courier" size="2">int HOUR = 60*60*1000;</font>
<br>
<br><font face="Courier" size="2">RuleBasedTimeZone rbtz = new RuleBasedTimeZone("US_Eastern",
"EST", -5*HOUR, 0);</font>
<br>
<br><font face="Courier" size="2">AnnualDateTimeRule dtr;</font>
<br><font face="Courier" size="2">AnnualTimeZoneRule tzr;</font>
<br>
<br><font face="Courier" size="2">// Standard time</font>
<br><font face="Courier" size="2">dtr = new AnnualDateTimeRule(Calendar.OCTOBER,
-1, Calendar.SUNDAY, 2*HOUR, AnnualDateTimeRule.WALL_TIME);</font>
<br><font face="Courier" size="2">tzr = new AnnualTimeZoneRule("EST",
-5*HOUR, 0, dtr, 1967, 2006);</font>
<br><font face="Courier" size="2">rbtz.addRule(tzr);</font>
<br>
<br><font face="Courier" size="2">dtr = new AnnualDateTimeRule(Calendar.NOVEMBER,
1, Calendar.SUNDAY, true, 2*HOUR, AnnualDateTimeRule.WALL_TIME);</font>
<br><font face="Courier" size="2">tzr = new AnnualTimeZoneRule("EST",
-5*HOUR, 0, dtr, 2007, AnnualTimeZoneRule.MAX_YEAR);</font>
<br><font face="Courier" size="2">rbtz.addRule(tzr);</font>
<br>
<br><font face="Courier" size="2">// Daylight saving time</font>
<br><font face="Courier" size="2">dtr = new AnnualDateTimeRule(Calendar.APRIL,
-1, Calendar.SUNDAY, 2*HOUR, AnnualDateTimeRule.WALL_TIME);</font>
<br><font face="Courier" size="2">tzr = new AnnualTimeZoneRule("EDT",
-5*HOUR, 1*HOUR, dtr, 1967, 1973);</font>
<br><font face="Courier" size="2">rbtz.addRule(tzr);</font>
<br>
<br><font face="Courier" size="2">dtr = new AnnualDateTimeRule(Calendar.JANUARY,
6, 2*HOUR, AnnualDateTimeRule.WALL_TIME);</font>
<br><font face="Courier" size="2">tzr = new AnnualTimeZoneRule("EDT",
-5*HOUR, 1*HOUR, dtr, 1974, 1974);</font>
<br><font face="Courier" size="2">rbtz.addRule(tzr);</font>
<br>
<br><font face="Courier" size="2">dtr = new AnnualDateTimeRule(Calendar.FEBRUARY,
23, 2*HOUR, AnnualDateTimeRule.WALL_TIME);</font>
<br><font face="Courier" size="2">tzr = new AnnualTimeZoneRule("EDT",
-5*HOUR, 1*HOUR, dtr, 1975, 1975);</font>
<br><font face="Courier" size="2">rbtz.addRule(tzr);</font>
<br>
<br><font face="Courier" size="2">dtr = new AnnualDateTimeRule(Calendar.APRIL,
-1, Calendar.SUNDAY, 2*HOUR, AnnualDateTimeRule.WALL_TIME);</font>
<br><font face="Courier" size="2">tzr = new AnnualTimeZoneRule("EDT",
-5*HOUR, 1*HOUR, dtr, 1976, 1986);</font>
<br><font face="Courier" size="2">rbtz.addRule(tzr);</font>
<br>
<br><font face="Courier" size="2">dtr = new AnnualDateTimeRule(Calendar.APRIL,
1, Calendar.SUNDAY, true, 2*HOUR, AnnualDateTimeRule.WALL_TIME);</font>
<br><font face="Courier" size="2">tzr = new AnnualTimeZoneRule("EDT",
-5*HOUR, 1*HOUR, dtr, 1987, 2006);</font>
<br><font face="Courier" size="2">rbtz.addRule(tzr);</font>
<br>
<br><font face="Courier" size="2">dtr = new AnnualDateTimeRule(Calendar.MARCH,
8, Calendar.SUNDAY, true, 2*HOUR, AnnualDateTimeRule.WALL_TIME);</font>
<br><font face="Courier" size="2">tzr = new AnnualTimeZoneRule("EDT",
-5*HOUR, 1*HOUR, dtr, 2007, AnnualTimeZoneRule.MAX_YEAR);</font>
<br><font face="Courier" size="2">rbtz.addRule(tzr);</font>
<br>
<br>
<br><font face="sans-serif" size="2">5) VTimeZone</font>
<br>
<br><font face="sans-serif" size="2">VTimeZone is a subclass of TimeZone
implementing RFC2445 iCalendar VTIMEZONE. There are two ways to create
an instance of VTimeZone - one from ICU/Olson time zone ID and another
from VTIMEZONE data stream. VTimeZone has a private member which
store store either OlsonTimeZone or RuleBasedTimeZone. When a VTimeZone
object is created from ID, OlsonTimeZone is created for the ID. When
it is created from RFC2445 VTIMEZONE data stream, an instance of RuleBasedTimeZone
is created and initialized by parsing rules in the RFC format. VTimeZone
provides two write methods in addition to TimeZone public APIs.</font>
<br>
<br><font face="sans-serif" size="2">public boolean write(Writer writer)</font>
<br><font face="sans-serif" size="2">public boolean write(Writer writer,
long start, long end)</font>
<br>
<br><font face="sans-serif" size="2">In general, all of historical transitions
used by an ICU OlsonTimeZone is not necessary in iCalendar applications.
When you create an iCalendar message, you may only need time zone
rules including the event times. The second write method allow you
to filter the rules and only pick rules applicable to the specified time
range. By doing so, you can reduce the size of VTIMEZONE data block
in the iCalendar message.</font>
<br>
<br>
<br><font face="sans-serif" size="2"><b>Development note - design consideration,
question, limitation and etc.</b></font>
<br>
<br><font face="sans-serif" size="2">1) In last year, I proposed APIs supporting
RuleBasedTimeZone and VTimeZone. At that time, I designed APIs under
strong ifluence of RFC2445 VTIMEZONE. However, I realized the initial
implementation was not ideal for supporting zic (Olson tzdata) source files.
Although implementing zic compiler was not an important goal, I wanted
to reconsider the design to be able to support zic source files with less
efforts. The big difference between VTIMEZONE and zic syntax is -
a time zone in VTIMEZONE has an attribute "TZOFFSETFROM". Although
the time of zone transition is specified by local wall time, you can get
the exact UTC time when the rule starts without looking into other rules.
On the other hand, a single zic rule may only tell you the starts
in local wall time without previous offset. That means, to process
rule/zone definitions in zic source format, you have to walk through the
historical transitions from the begining. Actually, VTIMEZONE syntax
is somewhat error prone, because "to offset" may not match the
next time's "from offset". In the new proposal, I removed
"from offset" in AnnualTimeZoneRule. It allows you to transform
zic source into the rule without looking into other past rules.</font>
<br>
<br><font face="sans-serif" size="2">2) Although it is possible to use these
APIs to implement a parser to create a TimeZone from zic source format,
it is still not a trivial work. With the zic syntax, standard offset
transitions are separated from daylight saving transitions (Zone line vs.
Rule line). On the other hand, TimeZoneRule represent both standard
offset and start times in a single object. Thus, to implement zic
parser, you need to go through both Zone lines and Rule lines to detect
any changes including standard offset. For example, the next zic
source data -</font>
<br>
<br><font face="Courier" size="2"># Rule NAME
FROM TO
TYPE IN
ON AT
SAVE LETTER</font>
<br><font face="Courier" size="2">Rule FOO
1950 2000 - Apr 1 1:00 1:00
D</font>
<br><font face="Courier" size="2">Rule FOO
1950 max - Oct 31 1:00 0:00
S</font>
<br><font face="Courier" size="2">Rule FOO
2001 max - Mar 1 1:00 1:00
D</font>
<br>
<br><font face="Courier" size="2"># Rule NAME
FROM TO
TYPE IN
ON AT
SAVE LETTER</font>
<br><font face="Courier" size="2">Rule BAR
1950 max - Apr 2 2:00 1:00
D</font>
<br><font face="Courier" size="2">Rule BAR
1950 max - Oct 30 2:00 0:00
S</font>
<br>
<br><font face="Courier" size="2"># Zone NAME
GMTOFF
RULES FORMAT
[UNTIL]</font>
<br><font face="Courier" size="2">Zone Custom1
2:34:56 - LMT
1960</font>
<br><font face="Courier" size="2">
2:30 BAR
B%sT 1990</font>
<br><font face="Courier" size="2">
2:00 FOO
F%sT</font>
<br>
<br><font face="sans-serif" size="2">will be parsed into</font>
<br>
<br><font face="sans-serif" size="2">- RuleBasedTimeZone constructed with
initial name "LMT" with standard offset 1:23:45</font>
<br><font face="sans-serif" size="2">- AnnualTimeZoneRule for daylight saving
time (std 2:30/sav 1:00) starting on Apr 2 at 2am from 1961 to 1990 with
name "BDT"</font>
<br><font face="sans-serif" size="2">- AnnualTimeZoneRule for standard time
(std 2:30/sav 0:00) starting on Oct 30 at 2am from 1961 to 1990 with name
"BST"</font>
<br><font face="sans-serif" size="2">- AnnualTimeZoneRule for daylight saving
time (std 2:00/sav 1:00) on Apr 1 at 1am from 1991 to 2000 with name "FDT"</font>
<br><font face="sans-serif" size="2">- AnnualTimeZoneRule for standard time
(std 2:00/sav 0:00) on Oct 31 at 1am from 1991 to max with name "FST"</font>
<br><font face="sans-serif" size="2">- AnnualTimeZoneRule for daylight saving
time (std 2:00/sav 1:00) on Mar 1 at 1am from 2001 to max with name "FDT"</font>
<br>
<br><font face="sans-serif" size="2">Does anyone want to have the zic parser
implemented in ICU?</font>
<br>
<br><font face="sans-serif" size="2">3) When you create VTimeZone instance
from zone ID such as "America/New_York" and write out the rule
into RFC2445 format, you will see historical transitions are represented
by a list of date time, instead of the original rule such as 1st Sunday
in April. When ICU imports Olson tzdata into timezone.res, the tool
already resolves historical transition times in UTC and they are no longer
in mont/day rule format. Only the latest rules might be represented
in the format originally from tzdata.</font>
<br>
<br><font face="sans-serif" size="2">4) RuleBasedTimeZone is a subclass of
TimeZone, thus, it has getRawOffset(), setRawOffset(int), getDaylightSaving()
and useDaylightTime(). These APIs do not make sense much in TimeZone
implementation which supports historical transitions. The implementation
may try to return a result based on the currently active - except setRawOffset,
which may do nothing.</font>
<br>
<br>
<br>-------------------------------------------------------------------------<br>This SF.net email is sponsored by DB2 Express<br>Download DB2 Express C - the FREE version of DB2 express and take<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_blank" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>_______________________________________________<br>icu-design mailing list
<br><a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10616107&i=2" target="_top" rel="nofollow">icu-design@...</a><br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-design" target="_blank" rel="nofollow">
https://lists.sourceforge.net/lists/listinfo/icu-design</a><br></blockquote></div><br><br clear="all"><br>-- <br>Mark
<br />-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br />_______________________________________________
<br>icu-design mailing list
<br><a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10616107&i=3" target="_top" rel="nofollow">icu-design@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-design" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-design</a><p>From forum: <a href="http://old.nabble.com/ICU---Design-f14222.html" embed="fixTarget[14222]" target="_top" >ICU - Design</a></p>tag:old.nabble.com,2006:post-10616001What is the difference between two Big5-HKSCS conversion table?2007-05-14T21:20:26Z2007-05-14T21:20:26Zyandong.yaoHi guys,
<br><br>>From icu/source/data/mappings/convrtrs.txt, I found below two conversion
<br>tables for Big5-HKSCS, and I have not found the explanation for ibm-5471
<br>from
<br><a href="http://www-306.ibm.com/software/globalization/ccsid/ccsid_registered.jsp" target="_top" rel="nofollow">http://www-306.ibm.com/software/globalization/ccsid/ccsid_registered.jsp</a>.
<br>Could you help to clarify that what is the difference between them and
<br>which one should be used at what context?
<br><br>Thank you very much!
<br><br>---------------------------------------------
<br>ibm-5471_P100-2007 { UTR22* } # This uses supplementary characters.
<br>ibm-5471 { IBM* }
<br>Big5-HKSCS { IANA* JAVA* }
<br>big5hk { JAVA }
<br>HKSCS-BIG5 # From <a href="http://www.openi18n.org/localenameguide/" target="_top" rel="nofollow">http://www.openi18n.org/localenameguide/</a><br>ibm-1375_P100-2006 { UTR22* } # IBM's interpretation of Windows' Taiwan
<br>Big-5 w/ HKSCS extensions
<br>ibm-1375 { IBM* }
<br>Big5-HKSCS
<br>MS950_HKSCS { JAVA* }
<br>hkbig5 # from HP-UX 11i, which can't handle supplementary characters.
<br>big5-hkscs:unicode3.0
<br># windows-950 # Windows-950 can be w/ or w/o HKSCS extensions. By
<br>default it's not.
<br># windows-950_hkscs
<br>------------------------------------------------
<br><br>Regards,
<br>Yandong
<br><br><br />-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br />_______________________________________________
<br>icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10616001&i=0" target="_top" rel="nofollow">icu-support@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br><p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-10615988Re: ICU 3.6 stub static libsicudata.a library2007-05-14T21:18:57Z2007-05-14T21:18:57ZGlenn-22<div class='shrinkable-quote'>> Is it possible to build and install a stub version of the static ICU
<br>> data library (libsicudata.a) and have ICU use the memory mapped
<br>> package file icudt36b.dat using ICU_DATA environment variable instead
<br>> of statically linking in 10MB of data in every program on a Unix system?
<br>>
<br>> I tried building with
<br>>
<br>> --enable-static=yes
<br>> --with-data-packaging=files
<br>>
<br>> but the installed libsicudata.a apparently still contained 10MB of
<br>> data which was statically linked into every program. Is there some
<br>> option I'm missing or not specifying correctly to build and install a
<br>> stub libsicudata.a file?
</div><br>I faced a similar problem, in that my usage of ICU is restricted to only
<br>certain time-formatting issues, so all I needed was the U.S. locale and
<br>the set of world timezones. I didn't want to link in 10 MB of stuff I
<br>don't need. I was starting with the source code distribution which
<br>did not include an easy mechanism to regenerate the data library, so I
<br>figured out how to cut down the existing library. What was required
<br>was a patch (already applied to the code, post-3.6) to icupkg, and a
<br>change to a Makefile.in file so the built library only contains the
<br>particular components I'm interested in. Sure, this is a hack, but
<br>perhaps it will lead someone to think about how to generalize this
<br>capability into something officially supported. The two patches are
<br>supplied below, modulo some potential line-wrap damage from the email
<br>client and some probable conversion of tabs to spaces as I copy the
<br>patches here.
<br><br>% cat icu4c-3_6.patch0
<br>*** icu4c-3_6/source/tools/icupkg/icupkg.cpp.orig 2006-07-21
<br>14:17:52.000000000 -0700
<br>--- icu4c-3_6/source/tools/icupkg/icupkg.cpp 2007-04-28 20:36:31.000000000
<br>-0700
<br>***************
<br>*** 504,510 ****
<br> listPkg=readList(sourcePath, options[OPT_ADD_LIST].value, TRUE);
<br> if(listPkg!=NULL) {
<br> pkg->addItems(*listPkg);
<br>- delete listPkg;
<br> isModified=TRUE;
<br> } else {
<br> printUsage(pname, FALSE);
<br>--- 504,509 ----
<br><br>% cat icu4c-3_6.patch1
<br>*** icu4c-3_6/source/data/Makefile.in.orig 2006-08-11 15:22:24.000000000
<br>-0700
<br>--- icu4c-3_6/source/data/Makefile.in 2007-04-28 21:57:36.000000000 -0700
<br>***************
<br>*** 344,350 ****
<br> ifneq ($(ICUDATA_SOURCE_IS_NATIVE_TARGET),YES)
<br> @echo "Unpacking $(ICUDATA_SOURCE_ARCHIVE) and generating $@ (list of
<br>data files)"
<br> @-$(RMV) $@
<br>! $(INVOKE) $(BINDIR)/icupkg -d $(BUILDDIR) --list -x \*
<br>$(ICUDATA_SOURCE_ARCHIVE) > $@
<br> else
<br> @echo "$@" > $@
<br> endif
<br>--- 344,355 ----
<br> ifneq ($(ICUDATA_SOURCE_IS_NATIVE_TARGET),YES)
<br> @echo "Unpacking $(ICUDATA_SOURCE_ARCHIVE) and generating $@ (list of
<br>data files)"
<br> @-$(RMV) $@
<br>! # Just choose the resource components we actually need for our
<br>application.
<br>! echo res_index.res > $@
<br>! echo root.res >> $@
<br>! echo en_US.res >> $@
<br>! echo zoneinfo.res >> $@
<br>! $(INVOKE) $(BINDIR)/icupkg -d $(BUILDDIR) -x $@
<br>$(ICUDATA_SOURCE_ARCHIVE)
<br> else
<br> @echo "$@" > $@
<br> endif
<br><br>After applying the patches and rebuilding, I have:
<br><br>-rw-r--r-- 1 user group 165830 Apr 28 22:16 ./source/lib/libsicudata.a
<br><br>which is a reasonable size.
<br><br>The trick in this sort of thing is to understand exactly which library
<br>components you really need. What I selected is a guess that seems to
<br>work for my needs; YMMV.
<br><br><br>
<br>____________________________________________________________________________________Ready for the edge of your seat?
<br>Check out tonight's top picks on Yahoo! TV.
<br><a href="http://tv.yahoo.com/" target="_top" rel="nofollow">http://tv.yahoo.com/</a><br><br>-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>_______________________________________________
<br>icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10615988&i=0" target="_top" rel="nofollow">icu-support@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br><p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-10613934Re: ASCII/EBCDIC based codepages2007-05-14T17:07:25Z2007-05-14T17:07:25ZGeorge RhotenGenerally, determining which codepages are EBCDIC or ASCII based is easy.
<br><br>If \u0020 roundtrip converts to \x20, then it's ASCII (or one of its
<br>variants)
<br>If \u0020 roundtrip converts to \x40, then it's EBCDIC (or one of its
<br>variants)
<br>\u0020 can convert to other values, or it may not convert at all. So you
<br>should be aware of those conditions.
<br><br>I use a similar method when displaying the ASCIIness or EBCDICness of each
<br>codepage in Converter Explorer <a href="http://demo.icu-project.org/icu-bin/convexp" target="_top" rel="nofollow">http://demo.icu-project.org/icu-bin/convexp</a>
<br> If you're looking at ICU's Converter Explorer, you will want to look at
<br>the "Is ASCII [\x20-\x7E] compatible?" value when you zoom in on a
<br>specific converter in ICU.
<br><br>George Rhoten
<br>IBM Globalization Center of Competency/ICU San José, CA, USA
<br><a href="http://www.icu-project.org/" target="_top" rel="nofollow">http://www.icu-project.org/</a><br><br><br><br>John B Young/Irvine/IBM@IBMUS
<br>Sent by: <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10613934&i=0" target="_top" rel="nofollow">icu-support-bounces@...</a>
<br>05/14/2007 03:16 PM
<br>Please respond to
<br>ICU support mailing list <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10613934&i=1" target="_top" rel="nofollow">icu-support@...</a>>
<br><br><br>To
<br>ICU support mailing list <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10613934&i=2" target="_top" rel="nofollow">icu-support@...</a>>
<br>cc
<br><br>Subject
<br>Re: [icu-support] ASCII/EBCDIC based codepages
<br><br><br><br><br><br><br>Amit,
<br><br>My experience regarding ASCII/EBCDIC has been on the z/OS platform, with
<br>ICU deployed in the Unix System Services (USS) environment.
<br><br>I agree, trying to find those code pages that are EBCDIC based is not very
<br><br>straightforward.
<br><br>I have worked the problem from a reverse approach on z/OS. I've used some
<br><br>documentation related to the z/OS C/C++ compiler. Here's a link. I've
<br>found this most helpful.
<br><br><a href="http://publibz.boulder.ibm.com/cgi-bin/bookmgr_OS390/BOOKS/CBCPG170/APPENDIX1.4.1?SHELF=CBCBS171&DT=20060501163751" target="_top" rel="nofollow">http://publibz.boulder.ibm.com/cgi-bin/bookmgr_OS390/BOOKS/CBCPG170/APPENDIX1.4.1?SHELF=CBCBS171&DT=20060501163751</a><br><br><br>John B. Young
<br>IBM Tivoli Identity Manager
<br>Tivoli Software, IBM Software Group
<br>Notes: John B Young/Irvine/IBM@IBMUS
<br>Internet: <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10613934&i=3" target="_top" rel="nofollow">jbyoung@...</a>
<br>Office Phone: 714-438-5218, T/L: 925-5218
<br>"In theory, theory and practice are the same. In practice, theory and
<br>practice are different." - unknown
<br><br><br><br>"Tibarewal, Amit" <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10613934&i=4" target="_top" rel="nofollow">atibarewal@...</a>>
<br>Sent by: <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10613934&i=5" target="_top" rel="nofollow">icu-support-bounces@...</a>
<br>05/14/2007 03:35 AM
<br>Please respond to
<br>ICU support mailing list <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10613934&i=6" target="_top" rel="nofollow">icu-support@...</a>>
<br><br><br>To
<br><<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10613934&i=7" target="_top" rel="nofollow">icu-support@...</a>>
<br>cc
<br><br>Subject
<br>[icu-support] ASCII/EBCDIC based codepages
<br><br><br><br><br><br><br>Hi,
<br><br>I am looking for an API/function which can list all the ASCII/EBCDIC
<br>based codepages.
<br><br>One way I can think of doing it is by converting some ASCII/EBCDIC
<br>characters from each codepage to Unicode and back. Then see if the
<br>characters are still ASCII/EBCDIC. Not sure if this will work always.
<br><br>Is there any other way of doing it? Thanks in advance!
<br><br>Regards,
<br>Amit
<br><br><br><br><br>-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>_______________________________________________
<br>icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10613934&i=8" target="_top" rel="nofollow">icu-support@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br><p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-10613306Re: ASCII/EBCDIC based codepages2007-05-14T16:16:31Z2007-05-14T16:16:31ZJohn B YoungAmit,
<br><br>My experience regarding ASCII/EBCDIC has been on the z/OS platform, with
<br>ICU deployed in the Unix System Services (USS) environment.
<br><br>I agree, trying to find those code pages that are EBCDIC based is not very
<br>straightforward.
<br><br>I have worked the problem from a reverse approach on z/OS. I've used some
<br>documentation related to the z/OS C/C++ compiler. Here's a link. I've
<br>found this most helpful.
<br><br><a href="http://publibz.boulder.ibm.com/cgi-bin/bookmgr_OS390/BOOKS/CBCPG170/APPENDIX1.4.1?SHELF=CBCBS171&DT=20060501163751" target="_top" rel="nofollow">http://publibz.boulder.ibm.com/cgi-bin/bookmgr_OS390/BOOKS/CBCPG170/APPENDIX1.4.1?SHELF=CBCBS171&DT=20060501163751</a><br><br>John B. Young
<br>IBM Tivoli Identity Manager
<br>Tivoli Software, IBM Software Group
<br>Notes: John B Young/Irvine/IBM@IBMUS
<br>Internet: <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10613306&i=0" target="_top" rel="nofollow">jbyoung@...</a>
<br>Office Phone: 714-438-5218, T/L: 925-5218
<br>"In theory, theory and practice are the same. In practice, theory and
<br>practice are different." - unknown
<br><br><br><br>"Tibarewal, Amit" <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10613306&i=1" target="_top" rel="nofollow">atibarewal@...</a>>
<br>Sent by: <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10613306&i=2" target="_top" rel="nofollow">icu-support-bounces@...</a>
<br>05/14/2007 03:35 AM
<br>Please respond to
<br>ICU support mailing list <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10613306&i=3" target="_top" rel="nofollow">icu-support@...</a>>
<br><br><br>To
<br><<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10613306&i=4" target="_top" rel="nofollow">icu-support@...</a>>
<br>cc
<br><br>Subject
<br>[icu-support] ASCII/EBCDIC based codepages
<br><br><br><br><br><br><br>Hi,
<br><br>I am looking for an API/function which can list all the ASCII/EBCDIC
<br>based codepages.
<br><br>One way I can think of doing it is by converting some ASCII/EBCDIC
<br>characters from each codepage to Unicode and back. Then see if the
<br>characters are still ASCII/EBCDIC. Not sure if this will work always.
<br><br>Is there any other way of doing it? Thanks in advance!
<br><br>Regards,
<br>Amit
<br><br><br>-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>_______________________________________________
<br>icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10613306&i=5" target="_top" rel="nofollow">icu-support@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br><br><br><br>-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>_______________________________________________
<br>icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10613306&i=6" target="_top" rel="nofollow">icu-support@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br><p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-10613020Proposal for rule based time zone (ticket#5454)2007-05-14T15:56:00Z2007-05-14T15:56:00Zyoshito_umaoka
<br><font size=2 face="sans-serif">This is a design proposal for "Rule
based time zone" -> http://bugs.icu-project.org/trac/ticket/5454</font>
<br><font size=2 face="sans-serif">Please review this design proposal and
provide your feedback.</font>
<br>
<br><font size=2 face="sans-serif">Thanks</font>
<br><font size=2 face="sans-serif">Yoshito</font>
<br><font size=2 face="sans-serif">-----------------------------------------------------</font>
<br>
<br><font size=2 face="sans-serif"><b>Scope of the RFE</b></font>
<br>
<br><font size=2 face="sans-serif">1) ICU uses timezone.res which is generated
from Olson tzdata. Although you can get UTC offset of local time,
you cannot get when the offset is changed. For example, some ICU
clients may want to get next daylight saving time start/end date for some
reasons. For now, what ICU clients can do is to probe UTC offset
at a certain date, then find the point of time when the offset is changed
by binary search. The ICU internal time zone data actually contains
the time of transitions or rule used for getting the transitions. But
there are no APIs to access the transitions at this moment.</font>
<br>
<br><font size=2 face="sans-serif">2) ICU clients may want to define their
own time zones. For now, SimpleTimeZone is only the class which you
can use to create a custom time zone. SimpleTimeZone does not support
historical rule changes. If you really want to define a time zone
with historical rule changes, you will need to subclass TimeZone and write
your own TimeZone class.</font>
<br>
<br><font size=2 face="sans-serif">3) iCalendar is a standard calendar
protocol and has its own way to represent time zones. When you develop
a calendar application, you may need to extract offset transition rules
for a time zone when composing an iCalendar message. Also, when parsing
an iCalendar message, you will need to parse the time zone definitions
in RFC2445 format and create a TimeZone object to be used in your code.
Technically, if above 2 items are supported (extracting transition
rules/generating a time zone object by historical rules), you can write
your own RFC2445 VTIMEZONE formatter/parser. But implementing the
formatter/parser is not a trivial work, so ICU clients may want to have
the implementation in ICU itself.</font>
<br>
<br>
<br><font size=2 face="sans-serif"><b>Overview of proposed APIs</b></font>
<br>
<br><font size=2 face="sans-serif">The proposed API documentation is found
here -> http://source.icu-project.org/repos/icu/icuhtml/trunk/design/rbtz/ICU4J_JavaDoc/index.html</font>
<br><font size=2 face="sans-serif">ICU4C APIs will be added soon.</font>
<br>
<br><font size=2 face="sans-serif">1) TimeZoneRule/AnnualTimeZoneRule/TimeArrayTimeZoneRule</font>
<br>
<br><font size=2 face="sans-serif">TimeZoneRule is a class representing
a rule for a time zone. TimeZoneRule has next 3 fields - name, standard
offset and daylight saving. For example, US Eastern Daylight Saving
Time may be represented by name = "EDT" / standard offset = -18000000
(milliseconds) / daylight saving = 3600000. There are two subclasses
of TimeZoneRule - AnnualTimeZoneRule and TimeArrayTimeZoneRule.</font>
<br>
<br><font size=2 face="sans-serif">AnnualTimeZoneRule defines start
times by an instance of AnnualDateTimeRule. AnnualDateTimeRule is
a class representing a rule date/time. The rule date can be specified
by 4 different ways (day of month, Nth weekday in month, first weekday
after day of month, last weekday before day of month). The time rule
can be specified 3 different type - WALL_TIME, STANDARD_TIME and UNIVERSAL_TIME.
They are equivalent to rules which are currently used in SimpleTimeZone
internally. AnnualTimeZoneRule also defines applicable year range.</font>
<br>
<br><font size=2 face="sans-serif">For example, US Eastern Daylight Saving
time since 1987 is represented by next two AnnualTimeZoneRule instances.</font>
<br>
<br><font size=2 face="Courier">// First Sunday on or after April 1st,
2AM at local wall time</font>
<br><font size=2 face="Courier">AnnualDateTimeRule dtRule1 = new AnnualDateTimeRule(Calendar.APRIL,
1, Calendar.SUNDAY, true,</font>
<br><font size=2 face="Courier">
2*60*60*1000,
AnnualDateTimeRule.WALL_TIME);</font>
<br><font size=2 face="Courier">// First Sunday on or after March 8th,
2AM at local wall time</font>
<br><font size=2 face="Courier">AnnualDateTimeRule dtRule2 = new AnnualDateTimeRule(Calendar.MARCH,
8, Calendar.SUNDAY, true,</font>
<br><font size=2 face="Courier">
2*60*60*1000,
AnnualDateTimeRule.WALL_TIME);</font>
<br>
<br><font size=2 face="Courier">// Rule for 1987 - 2006</font>
<br><font size=2 face="Courier">AnnualTimeZoneRule tzRule1 = new AnnualTimeZoneRule("EDT",
// name of time zone</font>
<br><font size=2 face="Courier">
-5*60*60*1000,
// standard UTC offset -5 hours</font>
<br><font size=2 face="Courier">
1*60*60*1000,
// daylight saving</font>
<br><font size=2 face="Courier">
dtRule1,
// annual date time rule</font>
<br><font size=2 face="Courier">
1987, //
start year</font>
<br><font size=2 face="Courier">
2006); //
end year</font>
<br><font size=2 face="Courier">// Rule for 2007 - </font>
<br><font size=2 face="Courier">AnnualTimeZoneRule tzRule1 = new AnnualTimeZoneRule("EDT",
// name of time zone</font>
<br><font size=2 face="Courier">
-5*60*60*1000,
// standard UTC offset -5 hours</font>
<br><font size=2 face="Courier">
1*60*60*1000,
// daylight saving</font>
<br><font size=2 face="Courier">
dtRule2,
// annual date time rule</font>
<br><font size=2 face="Courier">
2007, //
start year</font>
<br><font size=2 face="Courier">
AnnualTimeZoneRule.MAX_YEAR);
// end year - forever</font>
<br>
<br>
<br><font size=2 face="sans-serif">TimeArrayTimeZoneRule defines start
times by an array of milliseconds since UTC epoch time (Jan 1, 1970
00:00:00).</font>
<br>
<br>
<br><font size=2 face="sans-serif">2) TimeZoneTransition</font>
<br>
<br><font size=2 face="sans-serif">TimeZoneTransition is a class repesenting
a single time transition. A TimeZoneTransition has 3 fields - time,
time zone rule before/after the time. TimeZoneTransition objects
are used as return type in new APIs.</font>
<br>
<br>
<br><font size=2 face="sans-serif">3) HasTimeZoneTransitions</font>
<br>
<br><font size=2 face="sans-serif">HasTimeZoneTransitions is an interface
which defines two methods -</font>
<br>
<br><font size=2 face="Courier">public TimeZoneTransition getNextTransition(long
base);</font>
<br><font size=2 face="Courier">public TimeZoneTransition getPreviousTransition(long
base);</font>
<br>
<br><font size=2 face="sans-serif">TimeZone Implementation classes - SimpleTimeZone
and OlsonTimeZone - will implement the interface to allow ICU clients to
get exact time when time is changed. For example, next Java code
snipet will return the next time transition in time zone "America/New_York".</font>
<br>
<br><font size=2 face="Courier">SimpleDateFormat sdf = new SimpleDateFormat("yyyy-MM-dd'T'HH:mm:ssZ",
ULocale.ROOT);</font>
<br><font size=2 face="Courier">sdf.setTimeZone(TimeZone.getTimeZone("UTC"));</font>
<br>
<br><font size=2 face="Courier">TimeZoneTransition nextTT = TimeZone.getTimeZone("America/New_York").getNextTransition(System.currentTimeMillis());</font>
<br>
<br><font size=2 face="Courier">System.out.println("Next transition
time: " + sdf.format(new Date(nextTT.getTime())));</font>
<br><font size=2 face="Courier">System.out.println("From: " +
nextTT.getFrom().getStdOffset() + "/" + nextTT.getFrom().getDstSaving());</font>
<br><font size=2 face="Courier">System.out.println("To: "
+ nextTT.getTo().getStdOffset() + "/" + nextTT.getTo().getDstSaving());</font>
<br>
<br><font size=2 face="sans-serif">Above code snipet will print out the
results below (as of now) -</font>
<br>
<br><font size=2 face="Courier New">Next transition time: 2007-11-04T06:00:00Z</font>
<br><font size=2 face="Courier New">From: -18000000/3600000</font>
<br><font size=2 face="Courier New">To: -18000000/0</font>
<br>
<br>
<br><font size=2 face="sans-serif">4) RuleBasedTimeZone</font>
<br>
<br><font size=2 face="sans-serif">RuleBasedTimeZone is a subclass of TimeZone
for creating a custom time zone by rules. The constructor takes 4
arguments - time zone ID, initial time name/standard offset/daylight saving.
When the instance is created, it has fixed UTC offset. Then
you can add your own rules defined by AnnualTimeZoneRule and/or TimeArrayTimeZoneRule
objects. Below is a coding example of RuleBasedTimeZone representing
US Eastern time since 1967.</font>
<br>
<br><font size=2 face="Courier">int HOUR = 60*60*1000;</font>
<br>
<br><font size=2 face="Courier">RuleBasedTimeZone rbtz = new RuleBasedTimeZone("US_Eastern",
"EST", -5*HOUR, 0);</font>
<br>
<br><font size=2 face="Courier">AnnualDateTimeRule dtr;</font>
<br><font size=2 face="Courier">AnnualTimeZoneRule tzr;</font>
<br>
<br><font size=2 face="Courier">// Standard time</font>
<br><font size=2 face="Courier">dtr = new AnnualDateTimeRule(Calendar.OCTOBER,
-1, Calendar.SUNDAY, 2*HOUR, AnnualDateTimeRule.WALL_TIME);</font>
<br><font size=2 face="Courier">tzr = new AnnualTimeZoneRule("EST",
-5*HOUR, 0, dtr, 1967, 2006);</font>
<br><font size=2 face="Courier">rbtz.addRule(tzr);</font>
<br>
<br><font size=2 face="Courier">dtr = new AnnualDateTimeRule(Calendar.NOVEMBER,
1, Calendar.SUNDAY, true, 2*HOUR, AnnualDateTimeRule.WALL_TIME);</font>
<br><font size=2 face="Courier">tzr = new AnnualTimeZoneRule("EST",
-5*HOUR, 0, dtr, 2007, AnnualTimeZoneRule.MAX_YEAR);</font>
<br><font size=2 face="Courier">rbtz.addRule(tzr);</font>
<br>
<br><font size=2 face="Courier">// Daylight saving time</font>
<br><font size=2 face="Courier">dtr = new AnnualDateTimeRule(Calendar.APRIL,
-1, Calendar.SUNDAY, 2*HOUR, AnnualDateTimeRule.WALL_TIME);</font>
<br><font size=2 face="Courier">tzr = new AnnualTimeZoneRule("EDT",
-5*HOUR, 1*HOUR, dtr, 1967, 1973);</font>
<br><font size=2 face="Courier">rbtz.addRule(tzr);</font>
<br>
<br><font size=2 face="Courier">dtr = new AnnualDateTimeRule(Calendar.JANUARY,
6, 2*HOUR, AnnualDateTimeRule.WALL_TIME);</font>
<br><font size=2 face="Courier">tzr = new AnnualTimeZoneRule("EDT",
-5*HOUR, 1*HOUR, dtr, 1974, 1974);</font>
<br><font size=2 face="Courier">rbtz.addRule(tzr);</font>
<br>
<br><font size=2 face="Courier">dtr = new AnnualDateTimeRule(Calendar.FEBRUARY,
23, 2*HOUR, AnnualDateTimeRule.WALL_TIME);</font>
<br><font size=2 face="Courier">tzr = new AnnualTimeZoneRule("EDT",
-5*HOUR, 1*HOUR, dtr, 1975, 1975);</font>
<br><font size=2 face="Courier">rbtz.addRule(tzr);</font>
<br>
<br><font size=2 face="Courier">dtr = new AnnualDateTimeRule(Calendar.APRIL,
-1, Calendar.SUNDAY, 2*HOUR, AnnualDateTimeRule.WALL_TIME);</font>
<br><font size=2 face="Courier">tzr = new AnnualTimeZoneRule("EDT",
-5*HOUR, 1*HOUR, dtr, 1976, 1986);</font>
<br><font size=2 face="Courier">rbtz.addRule(tzr);</font>
<br>
<br><font size=2 face="Courier">dtr = new AnnualDateTimeRule(Calendar.APRIL,
1, Calendar.SUNDAY, true, 2*HOUR, AnnualDateTimeRule.WALL_TIME);</font>
<br><font size=2 face="Courier">tzr = new AnnualTimeZoneRule("EDT",
-5*HOUR, 1*HOUR, dtr, 1987, 2006);</font>
<br><font size=2 face="Courier">rbtz.addRule(tzr);</font>
<br>
<br><font size=2 face="Courier">dtr = new AnnualDateTimeRule(Calendar.MARCH,
8, Calendar.SUNDAY, true, 2*HOUR, AnnualDateTimeRule.WALL_TIME);</font>
<br><font size=2 face="Courier">tzr = new AnnualTimeZoneRule("EDT",
-5*HOUR, 1*HOUR, dtr, 2007, AnnualTimeZoneRule.MAX_YEAR);</font>
<br><font size=2 face="Courier">rbtz.addRule(tzr);</font>
<br>
<br>
<br><font size=2 face="sans-serif">5) VTimeZone</font>
<br>
<br><font size=2 face="sans-serif">VTimeZone is a subclass of TimeZone
implementing RFC2445 iCalendar VTIMEZONE. There are two ways to create
an instance of VTimeZone - one from ICU/Olson time zone ID and another
from VTIMEZONE data stream. VTimeZone has a private member which
store store either OlsonTimeZone or RuleBasedTimeZone. When a VTimeZone
object is created from ID, OlsonTimeZone is created for the ID. When
it is created from RFC2445 VTIMEZONE data stream, an instance of RuleBasedTimeZone
is created and initialized by parsing rules in the RFC format. VTimeZone
provides two write methods in addition to TimeZone public APIs.</font>
<br>
<br><font size=2 face="sans-serif">public boolean write(Writer writer)</font>
<br><font size=2 face="sans-serif">public boolean write(Writer writer,
long start, long end)</font>
<br>
<br><font size=2 face="sans-serif">In general, all of historical transitions
used by an ICU OlsonTimeZone is not necessary in iCalendar applications.
When you create an iCalendar message, you may only need time zone
rules including the event times. The second write method allow you
to filter the rules and only pick rules applicable to the specified time
range. By doing so, you can reduce the size of VTIMEZONE data block
in the iCalendar message.</font>
<br>
<br>
<br><font size=2 face="sans-serif"><b>Development note - design consideration,
question, limitation and etc.</b></font>
<br>
<br><font size=2 face="sans-serif">1) In last year, I proposed APIs supporting
RuleBasedTimeZone and VTimeZone. At that time, I designed APIs under
strong ifluence of RFC2445 VTIMEZONE. However, I realized the initial
implementation was not ideal for supporting zic (Olson tzdata) source files.
Although implementing zic compiler was not an important goal, I wanted
to reconsider the design to be able to support zic source files with less
efforts. The big difference between VTIMEZONE and zic syntax is -
a time zone in VTIMEZONE has an attribute "TZOFFSETFROM". Although
the time of zone transition is specified by local wall time, you can get
the exact UTC time when the rule starts without looking into other rules.
On the other hand, a single zic rule may only tell you the starts
in local wall time without previous offset. That means, to process
rule/zone definitions in zic source format, you have to walk through the
historical transitions from the begining. Actually, VTIMEZONE syntax
is somewhat error prone, because "to offset" may not match the
next time's "from offset". In the new proposal, I removed
"from offset" in AnnualTimeZoneRule. It allows you to transform
zic source into the rule without looking into other past rules.</font>
<br>
<br><font size=2 face="sans-serif">2) Although it is possible to use these
APIs to implement a parser to create a TimeZone from zic source format,
it is still not a trivial work. With the zic syntax, standard offset
transitions are separated from daylight saving transitions (Zone line vs.
Rule line). On the other hand, TimeZoneRule represent both standard
offset and start times in a single object. Thus, to implement zic
parser, you need to go through both Zone lines and Rule lines to detect
any changes including standard offset. For example, the next zic
source data -</font>
<br>
<br><font size=2 face="Courier"># Rule NAME
FROM TO
TYPE IN
ON AT
SAVE LETTER</font>
<br><font size=2 face="Courier">Rule FOO
1950 2000 - Apr 1 1:00 1:00
D</font>
<br><font size=2 face="Courier">Rule FOO
1950 max - Oct 31 1:00 0:00
S</font>
<br><font size=2 face="Courier">Rule FOO
2001 max - Mar 1 1:00 1:00
D</font>
<br>
<br><font size=2 face="Courier"># Rule NAME
FROM TO
TYPE IN
ON AT
SAVE LETTER</font>
<br><font size=2 face="Courier">Rule BAR
1950 max - Apr 2 2:00 1:00
D</font>
<br><font size=2 face="Courier">Rule BAR
1950 max - Oct 30 2:00 0:00
S</font>
<br>
<br><font size=2 face="Courier"># Zone NAME
GMTOFF
RULES FORMAT
[UNTIL]</font>
<br><font size=2 face="Courier">Zone Custom1
2:34:56 - LMT
1960</font>
<br><font size=2 face="Courier">
2:30 BAR
B%sT 1990</font>
<br><font size=2 face="Courier">
2:00 FOO
F%sT</font>
<br>
<br><font size=2 face="sans-serif">will be parsed into</font>
<br>
<br><font size=2 face="sans-serif">- RuleBasedTimeZone constructed with
initial name "LMT" with standard offset 1:23:45</font>
<br><font size=2 face="sans-serif">- AnnualTimeZoneRule for daylight saving
time (std 2:30/sav 1:00) starting on Apr 2 at 2am from 1961 to 1990 with
name "BDT"</font>
<br><font size=2 face="sans-serif">- AnnualTimeZoneRule for standard time
(std 2:30/sav 0:00) starting on Oct 30 at 2am from 1961 to 1990 with name
"BST"</font>
<br><font size=2 face="sans-serif">- AnnualTimeZoneRule for daylight saving
time (std 2:00/sav 1:00) on Apr 1 at 1am from 1991 to 2000 with name "FDT"</font>
<br><font size=2 face="sans-serif">- AnnualTimeZoneRule for standard time
(std 2:00/sav 0:00) on Oct 31 at 1am from 1991 to max with name "FST"</font>
<br><font size=2 face="sans-serif">- AnnualTimeZoneRule for daylight saving
time (std 2:00/sav 1:00) on Mar 1 at 1am from 2001 to max with name "FDT"</font>
<br>
<br><font size=2 face="sans-serif">Does anyone want to have the zic parser
implemented in ICU?</font>
<br>
<br><font size=2 face="sans-serif">3) When you create VTimeZone instance
from zone ID such as "America/New_York" and write out the rule
into RFC2445 format, you will see historical transitions are represented
by a list of date time, instead of the original rule such as 1st Sunday
in April. When ICU imports Olson tzdata into timezone.res, the tool
already resolves historical transition times in UTC and they are no longer
in mont/day rule format. Only the latest rules might be represented
in the format originally from tzdata.</font>
<br>
<br><font size=2 face="sans-serif">4) RuleBasedTimeZone is a subclass of
TimeZone, thus, it has getRawOffset(), setRawOffset(int), getDaylightSaving()
and useDaylightTime(). These APIs do not make sense much in TimeZone
implementation which supports historical transitions. The implementation
may try to return a result based on the currently active - except setRawOffset,
which may do nothing.</font>
<br>
<br>
<br />-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br />_______________________________________________
<br>icu-design mailing list
<br><a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10613020&i=0" target="_top" rel="nofollow">icu-design@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-design" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-design</a><p>From forum: <a href="http://old.nabble.com/ICU---Design-f14222.html" embed="fixTarget[14222]" target="_top" >ICU - Design</a></p>tag:old.nabble.com,2006:post-10609686Re: ICU 3.6 stub static libsicudata.a library2007-05-14T12:30:24Z2007-05-14T12:30:24ZGeorge RhotenThe problem is due to the following lines in icu/source/data/Makefile.in,
<br>which always builds all the data into a static library. It should
<br>actually build the static data library when ENABLE_STATIC is YES, and
<br>PKGDATA_MODE is dll. You can submit a bug at
<br><a href="http://icu-project.org/bugs.html" target="_top" rel="nofollow">http://icu-project.org/bugs.html</a> to request a fix. General purpose
<br>patches are welcome :-)
<br><br>packagedata: icupkg.inc $(PKGDATA_LIST) build-local
<br>ifneq ($(ENABLE_STATIC),)
<br> $(PKGDATA_INVOKE) $(PKGDATA) -e $(ICUDATA_ENTRY_POINT) -T
<br>$(OUTTMPDIR) -p $(ICUDATA_NAME) $(PKGDATA_LIBSTATICNAME) -m static
<br>$(PKGDATA_LIST)
<br>endif
<br>ifneq ($(ICUDATA_SOURCE_IS_NATIVE_TARGET),YES)
<br> $(PKGDATA_INVOKE) $(PKGDATA) -e $(ICUDATA_ENTRY_POINT) -T
<br>$(OUTTMPDIR) -p $(ICUDATA_NAME) -m $(PKGDATA_MODE) $(PKGDATA_VERSIONING)
<br>$(PKGDATA_LIBNAME) $(PKGDATA_LIST)
<br>else
<br> $(INSTALL_DATA) $(ICUDATA_SOURCE_ARCHIVE) $(OUTDIR)
<br>endif
<br><br>## Install ICU data.
<br>install-local: $(PKGDATA_LIST) ./icupkg.inc packagedata $(OS390INSTALL)
<br> $(MKINSTALLDIRS) $(TMPDATADIR) $(DESTDIR)$(ICUPKGDATA_DIR)
<br>ifneq ($(ENABLE_STATIC),)
<br> $(PKGDATA_INVOKE) $(PKGDATA) -m static -e $(ICUDATA_ENTRY_POINT)
<br>-T $(OUTTMPDIR) -s $(BUILDDIR) -p $(ICUDATA_NAME) $(PKGDATA_LIBSTATICNAME)
<br>$(PKGDATA_LIST) -I $(ICUPKGDATA_INSTALL_LIBDIR)
<br>endif
<br>ifneq ($(ICUDATA_SOURCE_IS_NATIVE_TARGET),YES)
<br> $(PKGDATA_INVOKE) $(PKGDATA) -m $(PKGDATA_MODE)
<br>$(PKGDATA_VERSIONING) -e $(ICUDATA_ENTRY_POINT) -T $(OUTTMPDIR) -s
<br>$(BUILDDIR) -p $(ICUDATA_NAME) $(PKGDATA_LIBNAME) $(PKGDATA_LIST) -I
<br>$(ICUPKGDATA_INSTALL_DIR)
<br>else
<br> $(INSTALL_DATA) $(ICUDATA_SOURCE_ARCHIVE)
<br>$(DESTDIR)$(ICUPKGDATA_DIR)
<br>endif
<br><br>George Rhoten
<br>IBM Globalization Center of Competency/ICU San José, CA, USA
<br><a href="http://www.icu-project.org/" target="_top" rel="nofollow">http://www.icu-project.org/</a><br><br><br><br>Rand Childs <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10609686&i=0" target="_top" rel="nofollow">randchilds@...</a>>
<br>Sent by: <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10609686&i=1" target="_top" rel="nofollow">icu-support-bounces@...</a>
<br>05/12/2007 05:14 AM
<br>Please respond to
<br>ICU support mailing list <<a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10609686&i=2" target="_top" rel="nofollow">icu-support@...</a>>
<br><br><br>To
<br><a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10609686&i=3" target="_top" rel="nofollow">icu-support@...</a>
<br>cc
<br><br>Subject
<br>[icu-support] ICU 3.6 stub static libsicudata.a library
<br><br><br><br><br><br><br>Is it possible to build and install a stub version of the static ICU
<br>data library (libsicudata.a) and have ICU use the memory mapped
<br>package file icudt36b.dat using ICU_DATA environment variable instead
<br>of statically linking in 10MB of data in every program on a Unix system?
<br><br>I tried building with
<br><br>--enable-static=yes
<br>--with-data-packaging=files
<br><br>but the installed libsicudata.a apparently still contained 10MB of
<br>data which was statically linked into every program. Is there some
<br>option I'm missing or not specifying correctly to build and install a
<br>stub libsicudata.a file?
<br><br>Thanks
<br><br>Rand
<br><br><br>-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>_______________________________________________
<br>icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10609686&i=4" target="_top" rel="nofollow">icu-support@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br><br><br><br>-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>_______________________________________________
<br>icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10609686&i=5" target="_top" rel="nofollow">icu-support@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br><p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-10606767Utf-16- BOM ?2007-05-14T09:59:07Z2007-05-14T09:59:07ZKambam, Siva (Midwest Success LLC)<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=us-ascii">
<META NAME="Generator" CONTENT="MS Exchange Server version 6.5.7652.14">
<TITLE>Utf-16- BOM ?</TITLE>
</HEAD>
<BODY>
<!-- Converted from text/rtf format -->
<P><FONT SIZE=2 FACE="Arial">All,</FONT>
</P>
<P><FONT SIZE=2 FACE="Arial">I want to convert a "character String " to utf 16 and want to use the BE (BigEndian) BOE (Byte OrderMark )</FONT>
</P>
<P><FONT SIZE=2 FACE="Arial">Could any one let me know what will the default when I conver the character string to UTF16. </FONT>
</P>
<P><FONT SIZE=2 FACE="Arial">If it uses the SmallEndian how do I conver that to BigEndian format ?</FONT>
</P>
<BR>
<BR>
<P><FONT SIZE=2 FACE="Arial">_Siva</FONT>
<BR><FONT SIZE=2 FACE="Arial"> </FONT>
</P>
</BODY>
</HTML><br />-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br />_______________________________________________
<br>icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10606767&i=0" target="_top" rel="nofollow">icu-support@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br><p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>tag:old.nabble.com,2006:post-10601383ASCII/EBCDIC based codepages2007-05-14T04:35:20Z2007-05-14T04:35:20ZTibarewal, AmitHi,
<br><br>I am looking for an API/function which can list all the ASCII/EBCDIC
<br>based codepages.
<br><br>One way I can think of doing it is by converting some ASCII/EBCDIC
<br>characters from each codepage to Unicode and back. Then see if the
<br>characters are still ASCII/EBCDIC. Not sure if this will work always.
<br><br>Is there any other way of doing it? Thanks in advance!
<br><br>Regards,
<br>Amit
<br><br><br>-------------------------------------------------------------------------
<br>This SF.net email is sponsored by DB2 Express
<br>Download DB2 Express C - the FREE version of DB2 express and take
<br>control of your XML. No limits. Just data. Click to get it now.
<br><a href="http://sourceforge.net/powerbar/db2/" target="_top" rel="nofollow">http://sourceforge.net/powerbar/db2/</a><br>_______________________________________________
<br>icu-support mailing list - <a href="http://old.nabble.com/user/SendEmail.jtp?type=post&post=10601383&i=0" target="_top" rel="nofollow">icu-support@...</a>
<br>To Un/Subscribe: <a href="https://lists.sourceforge.net/lists/listinfo/icu-support" target="_top" rel="nofollow">https://lists.sourceforge.net/lists/listinfo/icu-support</a><br><p>From forum: <a href="http://old.nabble.com/ICU---Support-f14220.html" embed="fixTarget[14220]" target="_top" >ICU - Support</a></p>