XOM API for Processing XML with Java

[Wolfgang Hoschek <wolfgang.hoschek AT mac.com>]

Galip,

The prototype source code is at

http://dsd.lbl.gov/nux-download/snapshots/bnuxwriter-0.1.tar.gz

The main class is BinaryXMLStreamWriter, instantiated via

XMLStreamWriter writer = BinaryXMLCodec.createXMLStreamWriter(...)

To compile the files into a nux.jar file, copy the unpacked files  
into nux/src/nux/xom/binary/

and run

cd nux; ant jar

(Quite a few Stax features aren't implemented, but those aren't  
required for copying via XMLStreamCopier from an XMLStreamReader to  
an XMLStreamWriter. Of course, turning this class into production  
quality code would take a bit more effort.)

Enjoy,
Wolfgang.

On Jul 23, 2006, at 12:59 PM, Galip Aydin wrote:

> Wolfgang,
> First, thank you for taking your time this weekend to do the  
> profiling.
>
> [Let me know if you'd like to experiment with the prototype.]
>
> Yes I would like that, please let me know how.
>
> [As an aside, some of the larger documents appear to consist of N
> concatenations of a base document. If that's indeed the case, if
> would be better to use real data throughout, if available. The reason
> is that binary tokenization schemes can take advantage of such
> artificial redundancy in manners that are not representative of real
> world usage.]
>
>
> That is indeed the case, I just wanted to have certain number of  
> features per doc, so simply did copy/paste. But I will generate a  
> new test set from real data.
>
> Galip.