Skip to Content.
Sympa Menu

xom-interest - Re: [XOM-interest] XOM and Large Files

xom-interest AT lists.ibiblio.org

Subject: XOM API for Processing XML with Java

List archive

Chronological Thread  
  • From: "Michael Kay" <mike AT saxonica.com>
  • To: "'Mike Colbert'" <mbcolbert AT yahoo.com>, "'Elliotte Harold'" <elharo AT metalab.unc.edu>
  • Cc: 'John Cowan' <cowan AT ccil.org>, xom-interest AT lists.ibiblio.org
  • Subject: Re: [XOM-interest] XOM and Large Files
  • Date: Wed, 26 Jul 2006 17:42:04 +0100

As a matter of interest, how long is it taking to process 1Gb, and how much
memory does it use?

Michael Kay
http://www.saxonica.com/

> -----Original Message-----
> From: xom-interest-bounces AT lists.ibiblio.org
> [mailto:xom-interest-bounces AT lists.ibiblio.org] On Behalf Of
> Mike Colbert
> Sent: 26 July 2006 17:35
> To: Elliotte Harold
> Cc: John Cowan; xom-interest AT lists.ibiblio.org
> Subject: Re: [XOM-interest] XOM and Large Files
>
> --- Elliotte Harold <elharo AT metalab.unc.edu> wrote:
>
> > In that case use a SequenceInputStream to add the root
> element start
> > and end-tags before you read in the data. You really don't want to
> > read everything into a String first.
> >
>
> Excellent advice!
>
> So, it turns out I had neglected to wrap my Readers in
> BufferedReaders, as John advised. They were in there before,
> but I changed things around and they fell out somewhere along
> the way. So many, many thanks to John for reminding me.
> This alone made an order of magnitude speed improvement.
>
> I also dropped the String, and used the SequenceInputStream
> to write in the root element, and this is of course a
> superior approach. Although, the time savings aren't as
> noticeable; I would have to do a micro-benchmark and we all
> know how that goes, so I won't even bother.
>
> In any case, it's flying now. Many thanks to all!
>
> Mike
>
>
> _______________________________________________
> XOM-interest mailing list
> XOM-interest AT lists.ibiblio.org
> http://lists.ibiblio.org/mailman/listinfo/xom-interest





Archive powered by MHonArc 2.6.24.

Top of Page