Re: [Exist-open] Having problem indexing/uploading large xml document (450MB)

[Wolfgang M. <wol...@ex...>]

> Hi, I'm working with de DBLP xml dataset, which is about 450MB, I went to
> the admin section of eXist, then to the Browse Selection and tried to upload
> the document. It takes a few seconds, and then a blank page shows up with
> just the menu on the left side. The document was not uploaded and of course
> I can't query it.
> What's wrong?

450MB are a bit too much for uploading via web forms. I guess the web
server times out the request or runs out of memory.

Please use the Java admin client for jobs like this. For maximum
performance, you can launch the client in embedded mode, which saves
you the time for uploading the data.

To parse the DBLP fast enough, you should also increase cacheSize in
conf.xml, as well as provide a little more memory to Java. Please read
the following notes though:

http://atomic.exist-db.org/blogs/eXist/WarningBadMemory

Wolfgang