xom-interest AT lists.ibiblio.org
Subject: XOM API for Processing XML with Java
List archive
- From: "Michael Kay" <mike AT saxonica.com>
- To: "'Mike Colbert'" <mbcolbert AT yahoo.com>, "'Elliotte Harold'" <elharo AT metalab.unc.edu>
- Cc: 'John Cowan' <cowan AT ccil.org>, xom-interest AT lists.ibiblio.org
- Subject: Re: [XOM-interest] XOM and Large Files
- Date: Wed, 26 Jul 2006 17:42:04 +0100
As a matter of interest, how long is it taking to process 1Gb, and how much
memory does it use?
Michael Kay
http://www.saxonica.com/
> -----Original Message-----
> From: xom-interest-bounces AT lists.ibiblio.org
> [mailto:xom-interest-bounces AT lists.ibiblio.org] On Behalf Of
> Mike Colbert
> Sent: 26 July 2006 17:35
> To: Elliotte Harold
> Cc: John Cowan; xom-interest AT lists.ibiblio.org
> Subject: Re: [XOM-interest] XOM and Large Files
>
> --- Elliotte Harold <elharo AT metalab.unc.edu> wrote:
>
> > In that case use a SequenceInputStream to add the root
> element start
> > and end-tags before you read in the data. You really don't want to
> > read everything into a String first.
> >
>
> Excellent advice!
>
> So, it turns out I had neglected to wrap my Readers in
> BufferedReaders, as John advised. They were in there before,
> but I changed things around and they fell out somewhere along
> the way. So many, many thanks to John for reminding me.
> This alone made an order of magnitude speed improvement.
>
> I also dropped the String, and used the SequenceInputStream
> to write in the root element, and this is of course a
> superior approach. Although, the time savings aren't as
> noticeable; I would have to do a micro-benchmark and we all
> know how that goes, so I won't even bother.
>
> In any case, it's flying now. Many thanks to all!
>
> Mike
>
>
> _______________________________________________
> XOM-interest mailing list
> XOM-interest AT lists.ibiblio.org
> http://lists.ibiblio.org/mailman/listinfo/xom-interest
-
[XOM-interest] XOM and Large Files,
Mike Colbert, 07/26/2006
-
Re: [XOM-interest] XOM and Large Files,
Wolfgang Hoschek, 07/26/2006
-
Re: [XOM-interest] XOM and Large Files,
Mike Colbert, 07/26/2006
- Re: [XOM-interest] XOM and Large Files, Wolfgang Hoschek, 07/26/2006
-
Re: [XOM-interest] XOM and Large Files,
Mike Colbert, 07/26/2006
-
Re: [XOM-interest] XOM and Large Files,
John Cowan, 07/26/2006
-
Re: [XOM-interest] XOM and Large Files,
Mike Colbert, 07/26/2006
-
Re: [XOM-interest] XOM and Large Files,
Elliotte Harold, 07/26/2006
-
Re: [XOM-interest] XOM and Large Files,
Mike Colbert, 07/26/2006
-
Re: [XOM-interest] XOM and Large Files,
Michael Kay, 07/26/2006
- Re: [XOM-interest] XOM and Large Files, Mike Colbert, 07/26/2006
-
Re: [XOM-interest] XOM and Large Files,
Mike Colbert, 07/26/2006
-
Re: [XOM-interest] XOM and Large Files,
Mike Colbert, 07/26/2006
- Re: [XOM-interest] XOM and Large Files, Elliotte Harold, 07/26/2006
-
Re: [XOM-interest] XOM and Large Files,
Mike Colbert, 07/26/2006
-
Re: [XOM-interest] XOM and Large Files,
Tatu Saloranta, 07/26/2006
-
Re: [XOM-interest] XOM and Large Files,
John Cowan, 07/26/2006
- Re: [XOM-interest] XOM and Large Files, Elliotte Harold, 07/26/2006
- Re: [XOM-interest] XOM and Large Files, John Cowan, 07/26/2006
- Re: [XOM-interest] XOM and Large Files, John Cowan, 07/26/2006
- Re: [XOM-interest] XOM and Large Files, Mike Colbert, 07/26/2006
-
Re: [XOM-interest] XOM and Large Files,
John Cowan, 07/26/2006
-
Re: [XOM-interest] XOM and Large Files,
Michael Kay, 07/26/2006
-
Re: [XOM-interest] XOM and Large Files,
Mike Colbert, 07/26/2006
-
Re: [XOM-interest] XOM and Large Files,
Elliotte Harold, 07/26/2006
-
Re: [XOM-interest] XOM and Large Files,
Mike Colbert, 07/26/2006
-
Re: [XOM-interest] XOM and Large Files,
Wolfgang Hoschek, 07/26/2006
Archive powered by MHonArc 2.6.24.