Ticket #18397 (closed: invalid)
OutOfMemory Exception while processing an XML-sourcefile with 1.000.000 records using a sx:subtreeRecordReader
|Reported by:||kkk88||Owned by:|
|Keywords:||sx:subtreeRecordReader too many records in xml-source-file||Cc:|
I am having trouble with a huge xml-file (about 650 MB) including
round about 1.000.000 million records which i want to convert into
servingXML aborts with an OutOfMemory-Exception because running out of java heap space...but i thought, servingXML uses a streaming architecture, that doesn't allocate java heap space for a whole file but only for the currently processed record...
My servingXML-resource works fine if try it with an XML-file of only 100.000 records...
What can i change in my resources-file to solve this problem?
Is there any suggestion for processing those large xml-files?
(for Details: see attachements)
Thank you very much in advance.