From: Dmitriy S. <sha...@gm...> - 2012-08-21 06:13:54
|
You should change <binary-manager> at conf.xml to FileFilterInputStreamCache. The control of this should be on the level of xquery script as pragma, IMHO. Dmitriy On Aug 21, 2012 9:38 AM, "Casey Jordan" <cas...@jo...> wrote: > I should probably add that the zip file is 2GB, and that eXist has about > 2GB of heap memory. > > I was under the impression that we could work with fairly large files > though without having to increase the memory. > > On Tue, Aug 21, 2012 at 12:05 AM, Casey Jordan cas...@jo...>wrote: > >> I hit this error today when trying to work with a big zip file in eXist >> (Trunk/HEAD): >> >> (This is the source of the error, see below for full stack) >> ... >> Caused by: java.io.IOException: Map failed >> at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:803) >> at >> org.exist.xquery.value.BinaryValueFromFile.<init>(BinaryValueFromFile.java:33) >> ... 56 more >> Caused by: java.lang.OutOfMemoryError: Map failed >> at sun.nio.ch.FileChannelImpl.map0(Native Method) >> at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:800) >> ... 57 more >> >> Here is the full error: >> >> ERROR Error. [source: process_upload.xql] >> at >> org.exist.xquery.value.BinaryValueFromFile.<init>(BinaryValueFromFile.java:35) >> at >> org.exist.xquery.value.BinaryValueFromFile.getInstance(BinaryValueFromFile.java:40) >> at >> org.exist.xquery.functions.request.GetUploadedFile.eval(GetUploadedFile.java:142) >> at org.exist.xquery.BasicFunction.eval(BasicFunction.java:68) >> at >> org.exist.xquery.InternalFunctionCall.eval(InternalFunctionCall.java:55) >> at org.exist.xquery.LetExpr.eval(LetExpr.java:153) >> at org.exist.xquery.LetExpr.eval(LetExpr.java:198) >> at org.exist.xquery.BindingExpression.eval(BindingExpression.java:156) >> at >> org.exist.xquery.AbstractExpression.eval(AbstractExpression.java:71) >> at org.exist.xquery.PathExpr.eval(PathExpr.java:268) >> at >> org.exist.xquery.AbstractExpression.eval(AbstractExpression.java:71) >> at org.exist.xquery.XQuery.execute(XQuery.java:246) >> at org.exist.xquery.XQuery.execute(XQuery.java:201) >> at >> org.exist.http.servlets.XQueryServlet.process(XQueryServlet.java:488) >> at >> org.exist.http.servlets.XQueryServlet.doPost(XQueryServlet.java:194) >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:755) >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) >> at >> org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:598) >> at >> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:486) >> at >> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119) >> at >> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:542) >> at >> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233) >> at >> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065) >> at >> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413) >> at >> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192) >> at >> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999) >> at >> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117) >> at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:224) >> at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:98) >> at org.exist.http.urlrewrite.Forward.doRewrite(Forward.java:47) >> at >> org.exist.http.urlrewrite.XQueryURLRewrite.doRewrite(XQueryURLRewrite.java:552) >> at >> org.exist.http.urlrewrite.XQueryURLRewrite.service(XQueryURLRewrite.java:336) >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) >> at >> org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:598) >> at >> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:486) >> at >> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119) >> at >> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:499) >> at >> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233) >> at >> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065) >> at >> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413) >> at >> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192) >> at >> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999) >> at >> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117) >> at >> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:149) >> at >> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111) >> at org.eclipse.jetty.server.Server.handle(Server.java:350) >> at >> org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454) >> at >> org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:900) >> at >> org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:954) >> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:851) >> at >> org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235) >> at >> org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:77) >> at >> org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:606) >> at >> org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:46) >> at >> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:603) >> at >> org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:538) >> at java.lang.Thread.run(Thread.java:636) >> Caused by: java.io.IOException: Map failed >> at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:803) >> at >> org.exist.xquery.value.BinaryValueFromFile.<init>(BinaryValueFromFile.java:33) >> ... 56 more >> Caused by: java.lang.OutOfMemoryError: Map failed >> at sun.nio.ch.FileChannelImpl.map0(Native Method) >> at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:800) >> ... 57 more >> >> >> Anyone understand why this is happening? Or how to fix it? >> >> Thanks, >> >> Casey >> >> -- >> -- >> Casey Jordan >> easyDITA a product of Jorsek LLC >> "CaseyDJordan" on LinkedIn, Twitter & Facebook >> (585) 348 7399 >> easydita.com >> >> >> This message is intended only for the use of the Addressee(s) and may >> contain information that is privileged, confidential, and/or exempt from >> disclosure under applicable law. If you are not the intended recipient, >> please be advised that any disclosure copying, distribution, or use of >> the information contained herein is prohibited. If you have received >> this communication in error, please destroy all copies of the message, >> whether in electronic or hard copy format, as well as attachments, and >> immediately contact the sender by replying to this e-mail or by phone. >> Thank you. >> >> > > > -- > -- > Casey Jordan > easyDITA a product of Jorsek LLC > "CaseyDJordan" on LinkedIn, Twitter & Facebook > (585) 348 7399 > easydita.com > > > This message is intended only for the use of the Addressee(s) and may > contain information that is privileged, confidential, and/or exempt from > disclosure under applicable law. If you are not the intended recipient, > please be advised that any disclosure copying, distribution, or use of > the information contained herein is prohibited. If you have received > this communication in error, please destroy all copies of the message, > whether in electronic or hard copy format, as well as attachments, and > immediately contact the sender by replying to this e-mail or by phone. > Thank you. > > > > ------------------------------------------------------------------------------ > Live Security Virtual Conference > Exclusive live event will cover all the ways today's security and > threat landscape has changed and how IT managers can respond. Discussions > will include endpoint security, mobile security and the latest in malware > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ > _______________________________________________ > Exist-open mailing list > Exi...@li... > https://lists.sourceforge.net/lists/listinfo/exist-open > > |