xom-interest AT lists.ibiblio.org
Subject: XOM API for Processing XML with Java
List archive
[XOM-interest] Re: Unicode forms for internal storage
- From: Elliotte Rusty Harold <elharo AT metalab.unc.edu>
- To: Markus Scherer <markus.scherer AT jtcsv.com>
- Cc: xom-interest AT lists.ibiblio.org, unicode AT unicode.org
- Subject: [XOM-interest] Re: Unicode forms for internal storage
- Date: Tue, 20 Jan 2004 14:45:12 -0500
At 9:52 AM -0800 1/20/04, Markus Scherer wrote:
You need not invent something new: Just use a simplified SCSU encoder, and either a regular SCSU decoder or one that only supports the features which your custom encoder uses.
Thanks. It looks like exactly what I need.
For a tiny SCSU encoder (main function 75 lines of commented C) that also compresses a little better than what you describe see http://www.mindspring.com/~markus.scherer/unicode/tr6/
You could scale that encoder up or down to your liking.
For a full SCSU converter you could use ICU, for example. http://oss.software.ibm.com/icu/
Hmm, I'm already carrying around part of ICU4J to perform normalization. I'll have to check and see if I've got the SCSU support compiled into my version of the ICU jar.
You could also use BOCU-1.
Reading the BOCU tech note, it looks like SCSU performs better, The main benefit of BOCU is if you're transmitting this encoding on the wire, which I am definitely not doing. But SCSU looks like a really nice option. Thanks.
--
Elliotte Rusty Harold
elharo AT metalab.unc.edu
Effective XML (Addison-Wesley, 2003)
http://www.cafeconleche.org/books/effectivexml
http://www.amazon.com/exec/obidos/ISBN%3D0321150406/ref%3Dnosim/cafeaulaitA
-
[XOM-interest] Unicode forms for internal storage,
Elliotte Rusty Harold, 01/20/2004
-
[XOM-interest] Re: Unicode forms for internal storage,
Markus Scherer, 01/20/2004
- [XOM-interest] Re: Unicode forms for internal storage, Elliotte Rusty Harold, 01/20/2004
-
[XOM-interest] Re: Unicode forms for internal storage,
Jon Hanna, 01/21/2004
- [XOM-interest] Re: Unicode forms for internal storage, Elliotte Rusty Harold, 01/21/2004
-
[XOM-interest] Re: Unicode forms for internal storage,
Markus Scherer, 01/20/2004
Archive powered by MHonArc 2.6.24.