Skip to Content.
Sympa Menu

xom-interest - Re: [XOM-interest] NUX, StreamingPathFilter and OutOfMemoryError

xom-interest AT lists.ibiblio.org

Subject: XOM API for Processing XML with Java

List archive

Chronological Thread  
  • From: Wolfgang Hoschek <wolfgang.hoschek AT mac.com>
  • To: Cedric Coulon <coulon AT comp.nus.edu.sg>
  • Cc: xom-interest AT lists.ibiblio.org
  • Subject: Re: [XOM-interest] NUX, StreamingPathFilter and OutOfMemoryError
  • Date: Mon, 19 Nov 2007 17:35:13 -0800

This example works fine here with a 10 MB heap (java -Xmx10m) and the nux-1.6 release. I just downloaded the DBLP data (400 MB) again and ran your snippet with sun java-1.5. BTW, since the DBLP data includes a lot of external entities you need to bump up the entity expansion limit according to http://java.sun.com/webservices/docs/1.5/jaxp/ ReleaseNotes.html via

System.setProperty("entityExpansionLimit", String.valueOf (Integer.MAX_VALUE));

More detailed config and version info for your environment might help to pinpoint the problem.

Wolfgang.

On Nov 19, 2007, at 2:39 AM, Cedric Coulon wrote:

Hi,

I want to parse a large xml file and extract the element book. The xml
source file is dblp database (dblp.xml - 411M -
http://dblp.uni-trier.de/xml/).
So I use NUX and the StreamingPathFilter class. However I have an
OutOfMemoryError... I don't know what I'm doing wrong.

Thanks you for your help.

Bye,
Cedric.

Here is the source of my java program:

public static void main(String[] args) {
try {
StreamingTransform myTransform = new StreamingTransform () {
public Nodes transform(Element e) {
System.out.println(XOMUtil.toPrettyXML(e));
return new Nodes();
}
};

Builder builder = new Builder(new
StreamingPathFilter("/dblp/book", null).createNodeFactory(null,
myTransform));
builder.build(new File("dblp.xml")); //
http://dblp.uni-trier.de/xml/
} catch (Exception e) {
e.printStackTrace();
}
}

_______________________________________________
XOM-interest mailing list
XOM-interest AT lists.ibiblio.org
http://lists.ibiblio.org/mailman/listinfo/xom-interest





Archive powered by MHonArc 2.6.24.

Top of Page