XOM API for Processing XML with Java

[Elliotte Harold <elharo AT metalab.unc.edu>]

Wolfgang Hoschek wrote:

> Hi,
>
> Some characters such as "񐀀" and "'[[[񐀀]]]'" seem to get 
> turned by XOM to "?" characters.
> I've seen similar things before when using byte to char conversions, 
> both with the nio converters and the java.lang.String converters. Any 
> ideas on what could be done about it, or what I'm doing wrong here?

I've walked through this with a debugger and I'm pretty sure that what's 
going on here is that you're doing System.out.println or some equivalent 
and that is turning the surrogate pairs into question marks. Neither XOM 
nor the XML parser is doing this. I've only tested the toXML case but I 
assume the serializer is the same until proven otherwise.

If you're using an OutputStreamWriter anywhere that might be doing it. 
According to the JavaDoc for OutputStreamWriter, "If the character 
represented by a surrogate pair cannot be encoded by a given charset 
then a charset-dependent substitution sequence is written to the output 
stream." Normally this substitution char is a question mark.


--
Elliotte Rusty Harold  elharo AT metalab.unc.edu
XML in a Nutshell 3rd Edition Just Published!
http://www.cafeconleche.org/books/xian3/
http://www.amazon.com/exec/obidos/ISBN=0596007647/cafeaulaitA/ref=nosim