From: Bryan T. <br...@sy...> - 2015-09-11 16:58:21
|
Ok. We do have a workaround for this. The problem is a deferred free that is not being properly released. This is identified by java.lang.RuntimeException: Problem with entry at -1982077125921865306* com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:4909) * This issue was first reported by the wiki data service and we developed a work around for them. The utility is available here: https://jira.blazegraph.com/browse/BLZG-1236?focusedCommentId=19105&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-19105 Please let us know if this resolves the issue. Thanks, Bryan ---- Bryan Thompson Chief Scientist & Founder SYSTAP, LLC 4501 Tower Road Greensboro, NC 27410 br...@sy... http://blazegraph.com http://blog.bigdata.com <http://bigdata.com> http://mapgraph.io Blazegraph™ <http://www.blazegraph.com/> is our ultra high-performance graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs. Blazegraph is now available with GPU acceleration using our disruptive technology to accelerate data-parallel graph analytics and graph query. CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. On Fri, Sep 11, 2015 at 12:43 PM, Joakim Soderberg < joa...@bl...> wrote: > It seems to be a problem with the same entry: > > *type* Exception report > > *message* *Problem with entry at -1982077125921865306: > lastRootBlock=rootBlock{ rootBlock=1, challisField=53, version=3, > nextOffset=18367917264487524, localTime=1441926674289 [Thursday, September > 10, 2015 11:11:14 PM UTC], firstCommitTime=1441073445445 [Tuesday, > September 1, 2015 2:10:45 AM UTC], lastCommitTime=1441926670929 [Thursday, > September 10, 2015 11:11:10 PM UTC], commitCounter=53, > commitRecordAddr={off=NATIVE:-451550099,len=422}, > commitRecordIndexAddr={off=NATIVE:-468869758,len=220}, > blockSequence=106022, quorumToken=-1, metaBitsAddr=13435602594695444, > metaStartAddr=4614957, storeType=RW, > uuid=d64bf2e9-599b-4f41-8bfe-f3b000f73138, offsetBits=42, > checksum=371010502, createTime=1441073445016 [Tuesday, September 1, 2015 > 2:10:45 AM UTC], closeTime=0}* > > *description* *The server encountered an internal error that prevented it > from fulfilling this request.* > > *exception* > > java.lang.RuntimeException: Problem with entry at -1982077125921865306: lastRootBlock=rootBlock{ rootBlock=1, challisField=53, version=3, nextOffset=18367917264487524, localTime=1441926674289 [Thursday, September 10, 2015 11:11:14 PM UTC], firstCommitTime=1441073445445 [Tuesday, September 1, 2015 2:10:45 AM UTC], lastCommitTime=1441926670929 [Thursday, September 10, 2015 11:11:10 PM UTC], commitCounter=53, commitRecordAddr={off=NATIVE:-451550099,len=422}, commitRecordIndexAddr={off=NATIVE:-468869758,len=220}, blockSequence=106022, quorumToken=-1, metaBitsAddr=13435602594695444, metaStartAddr=4614957, storeType=RW, uuid=d64bf2e9-599b-4f41-8bfe-f3b000f73138, offsetBits=42, checksum=371010502, createTime=1441073445016 [Tuesday, September 1, 2015 2:10:45 AM UTC], closeTime=0} > com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3126) > com.bigdata.rdf.store.LocalTripleStore.commit(LocalTripleStore.java:98) > com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.commit2(BigdataSail.java:3394) > com.bigdata.rdf.sail.BigdataSailRepositoryConnection.commit2(BigdataSailRepositoryConnection.java:330) > com.bigdata.rdf.sail.BigdataSailRepositoryConnection.commit(BigdataSailRepositoryConnection.java:349) > com.blippar.blazegraph.BlazegraphUtils.loadData(BlazegraphUtils.java:446) > com.blippar.action.AddAction.execute(AddAction.java:81) > com.blippar.servlet.MinervaServlet.doPost(MinervaServlet.java:93) > com.blippar.servlet.MinervaServlet.doGet(MinervaServlet.java:60) > javax.servlet.http.HttpServlet.service(HttpServlet.java:622) > javax.servlet.http.HttpServlet.service(HttpServlet.java:729) > org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) > > *root cause* > > java.lang.RuntimeException: Problem with entry at -1982077125921865306 > com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:4909) > com.bigdata.rwstore.RWStore.checkDeferredFrees(RWStore.java:3563) > com.bigdata.journal.RWStrategy.checkDeferredFrees(RWStrategy.java:781) > com.bigdata.journal.AbstractJournal$CommitState.writeCommitRecord(AbstractJournal.java:3489) > com.bigdata.journal.AbstractJournal$CommitState.access$2800(AbstractJournal.java:3291) > com.bigdata.journal.AbstractJournal.commitNow(AbstractJournal.java:4101) > com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3124) > com.bigdata.rdf.store.LocalTripleStore.commit(LocalTripleStore.java:98) > com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.commit2(BigdataSail.java:3394) > com.bigdata.rdf.sail.BigdataSailRepositoryConnection.commit2(BigdataSailRepositoryConnection.java:330) > com.bigdata.rdf.sail.BigdataSailRepositoryConnection.commit(BigdataSailRepositoryConnection.java:349) > com.blippar.blazegraph.BlazegraphUtils.loadData(BlazegraphUtils.java:446) > com.blippar.action.AddAction.execute(AddAction.java:81) > com.blippar.servlet.MinervaServlet.doPost(MinervaServlet.java:93) > com.blippar.servlet.MinervaServlet.doGet(MinervaServlet.java:60) > javax.servlet.http.HttpServlet.service(HttpServlet.java:622) > javax.servlet.http.HttpServlet.service(HttpServlet.java:729) > org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) > > *root cause* > > java.lang.RuntimeException: addr=-472185800 : cause=java.lang.IllegalStateException: Bad Address: length requested greater than allocated slot > com.bigdata.rwstore.RWStore.getData(RWStore.java:2191) > com.bigdata.rwstore.RWStore.getData(RWStore.java:1990) > com.bigdata.rwstore.RWStore.getData(RWStore.java:2034) > com.bigdata.rwstore.RWStore.getData(RWStore.java:1990) > com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:4799) > com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:4895) > com.bigdata.rwstore.RWStore.checkDeferredFrees(RWStore.java:3563) > com.bigdata.journal.RWStrategy.checkDeferredFrees(RWStrategy.java:781) > com.bigdata.journal.AbstractJournal$CommitState.writeCommitRecord(AbstractJournal.java:3489) > com.bigdata.journal.AbstractJournal$CommitState.access$2800(AbstractJournal.java:3291) > com.bigdata.journal.AbstractJournal.commitNow(AbstractJournal.java:4101) > com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3124) > com.bigdata.rdf.store.LocalTripleStore.commit(LocalTripleStore.java:98) > com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.commit2(BigdataSail.java:3394) > com.bigdata.rdf.sail.BigdataSailRepositoryConnection.commit2(BigdataSailRepositoryConnection.java:330) > com.bigdata.rdf.sail.BigdataSailRepositoryConnection.commit(BigdataSailRepositoryConnection.java:349) > com.blippar.blazegraph.BlazegraphUtils.loadData(BlazegraphUtils.java:446) > com.blippar.action.AddAction.execute(AddAction.java:81) > com.blippar.servlet.MinervaServlet.doPost(MinervaServlet.java:93) > com.blippar.servlet.MinervaServlet.doGet(MinervaServlet.java:60) > javax.servlet.http.HttpServlet.service(HttpServlet.java:622) > javax.servlet.http.HttpServlet.service(HttpServlet.java:729) > org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) > > *root cause* > > java.lang.IllegalStateException: Bad Address: length requested greater than allocated slot > com.bigdata.rwstore.RWStore.getData(RWStore.java:2083) > com.bigdata.rwstore.RWStore.getData(RWStore.java:1990) > com.bigdata.rwstore.RWStore.getData(RWStore.java:2034) > com.bigdata.rwstore.RWStore.getData(RWStore.java:1990) > com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:4799) > com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:4895) > com.bigdata.rwstore.RWStore.checkDeferredFrees(RWStore.java:3563) > com.bigdata.journal.RWStrategy.checkDeferredFrees(RWStrategy.java:781) > com.bigdata.journal.AbstractJournal$CommitState.writeCommitRecord(AbstractJournal.java:3489) > com.bigdata.journal.AbstractJournal$CommitState.access$2800(AbstractJournal.java:3291) > com.bigdata.journal.AbstractJournal.commitNow(AbstractJournal.java:4101) > com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3124) > com.bigdata.rdf.store.LocalTripleStore.commit(LocalTripleStore.java:98) > com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.commit2(BigdataSail.java:3394) > com.bigdata.rdf.sail.BigdataSailRepositoryConnection.commit2(BigdataSailRepositoryConnection.java:330) > com.bigdata.rdf.sail.BigdataSailRepositoryConnection.commit(BigdataSailRepositoryConnection.java:349) > com.blippar.blazegraph.BlazegraphUtils.loadData(BlazegraphUtils.java:446) > com.blippar.action.AddAction.execute(AddAction.java:81) > com.blippar.servlet.MinervaServlet.doPost(MinervaServlet.java:93) > com.blippar.servlet.MinervaServlet.doGet(MinervaServlet.java:60) > javax.servlet.http.HttpServlet.service(HttpServlet.java:622) > javax.servlet.http.HttpServlet.service(HttpServlet.java:729) > org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) > > > > > On Sep 11, 2015, at 9:15 AM, Brad Bebee <be...@sy...> wrote: > > Joakim, > > Thank you. If you are able to reproduce it, please send as much of the > stack trace as you can. > > Thanks, --Brad > > On Fri, Sep 11, 2015 at 12:09 PM, Joakim Soderberg < > joa...@bl...> wrote: > >> Unfortunately not. I will try to reproduce the error. >> >> >> On Sep 11, 2015, at 5:23 AM, Brad Bebee <be...@sy...> wrote: >> >> Joakim, >> >> Can you send us the full stack trace to diagnose this? >> >> Thanks, --Brad >> >> On Thu, Sep 10, 2015 at 8:04 PM, Joakim Soderberg < >> joa...@bl...> wrote: >> >>> Hi >>> I am running Blazegraph in embedded mode on a CentOS 4-core with 60GB >>> RAM. The jul-file is 280GB hosting 1.3 B triples. While adding triples by >>> adding to a RepositoryConnection >>> I get the following error: >>> >>> HTTP Status 500 - Problem with entry at -1982077125921865306: >>> lastRootBlock=rootBlock{ rootBlock=1, challisField=53, version=3, >>> nextOffset=18367917264487524, localTime=1441926674289 [Thursday, September >>> 10, 2015 11:11:14 PM UTC], firstCommitTime=1441073445445 [Tuesday, >>> September 1, 2015 2:10:45 AM UTC], lastCommitTime=1441926670929 [Thursday, >>> September 10, 2015 11:11:10 PM UTC], commitCounter=53, >>> commitRecordAddr={off=NATIVE:-451550099,len=422}, commitRecordIndexAddr={off=NATIVE:-468869758,len=220}, >>> blockSequence=106022, quorumToken=-1, metaBitsAddr=13435602594695444, >>> metaStartAddr=4614957, storeType=RW, >>> uuid=d64bf2e9-599b-4f41-8bfe-f3b000f73138, >>> offsetBits=42, checksum=371010502, createTime=1441073445016 [Tuesday, >>> September 1, 2015 2:10:45 AM UTC], closeTime=0} >>> >>> After this I can’t add triples again, could the jnl-file be corrupt now? >>> Can it be repaired? >>> >>> /Joakim >>> >>> >>> ------------------------------------------------------------------------------ >>> >>> _______________________________________________ >>> Bigdata-developers mailing list >>> Big...@li... >>> https://lists.sourceforge.net/lists/listinfo/bigdata-developers >>> >>> >> >> >> -- >> _______________ >> Brad Bebee >> CEO, Managing Partner >> SYSTAP, LLC >> e: be...@sy... >> m: 202.642.7961 >> f: 571.367.5000 >> w: www.blazegraph.com >> >> Blazegraph™ <http://www.blazegraph.com/> is our ultra high-performance >> graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs. >> Mapgraph™ <http://www.systap.com/mapgraph> is our disruptive new >> technology to use GPUs to accelerate data-parallel graph analytics. >> >> CONFIDENTIALITY NOTICE: This email and its contents and attachments are >> for the sole use of the intended recipient(s) and are confidential or >> proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, >> dissemination or copying of this email or its contents or attachments is >> prohibited. If you have received this communication in error, please notify >> the sender by reply email and permanently delete all copies of the email >> and its contents and attachments. >> >> >> > > > -- > _______________ > Brad Bebee > CEO, Managing Partner > SYSTAP, LLC > e: be...@sy... > m: 202.642.7961 > f: 571.367.5000 > w: www.blazegraph.com > > Blazegraph™ <http://www.blazegraph.com/> is our ultra high-performance > graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs. > Mapgraph™ <http://www.systap.com/mapgraph> is our disruptive new > technology to use GPUs to accelerate data-parallel graph analytics. > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are > for the sole use of the intended recipient(s) and are confidential or > proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, > dissemination or copying of this email or its contents or attachments is > prohibited. If you have received this communication in error, please notify > the sender by reply email and permanently delete all copies of the email > and its contents and attachments. > > > > > ------------------------------------------------------------------------------ > > _______________________________________________ > Bigdata-developers mailing list > Big...@li... > https://lists.sourceforge.net/lists/listinfo/bigdata-developers > > |