From: Joakim S. <joa...@bl...> - 2015-09-11 21:28:24
|
Hi, I can confirm that the workaround did indeed fix the problem. Thanks Joakim Soderberg Sr Scientist, PhD, Head Content Platform Blippar US, 444 Castro St # 302, Mountain View, CA 94041 LONDON • NEW YORK • SAN FRANCISCO • LA • CHICAGO • AMSTERDAM • ISTANBUL • DELHI • TOKYO • TORONTO This e-mail is confidential. It may also be legally privileged. If you are not the addressee you may not copy, forward, disclose or use any part of it. If you have received this message in error, please delete it and all copies from your system and notify the sender immediately by return e-mail. Internet communications cannot be guaranteed to be timely, secure, error or virus-free. The sender does not accept liability for any errors or omissions. > On Sep 11, 2015, at 9:58 AM, Bryan Thompson <br...@sy...> wrote: > > Ok. We do have a workaround for this. The problem is a deferred free that is not being properly released. This is identified by > > java.lang.RuntimeException: Problem with entry at -1982077125921865306 > com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:4909) > This issue was first reported by the wiki data service and we developed a work around for them. The utility is available here: > > https://jira.blazegraph.com/browse/BLZG-1236?focusedCommentId=19105&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-19105 <https://jira.blazegraph.com/browse/BLZG-1236?focusedCommentId=19105&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-19105> > > Please let us know if this resolves the issue. > > Thanks, > Bryan > > ---- > Bryan Thompson > Chief Scientist & Founder > SYSTAP, LLC > 4501 Tower Road > Greensboro, NC 27410 > br...@sy... <mailto:br...@sy...> > http://blazegraph.com <http://blazegraph.com/> > http://blog.bigdata.com <http://bigdata.com/> > http://mapgraph.io <http://mapgraph.io/> > Blazegraph™ <http://www.blazegraph.com/> is our ultra high-performance graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs. Blazegraph is now available with GPU acceleration using our disruptive technology to accelerate data-parallel graph analytics and graph query. > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. > > > > On Fri, Sep 11, 2015 at 12:43 PM, Joakim Soderberg <joa...@bl... <mailto:joa...@bl...>> wrote: > It seems to be a problem with the same entry: > > type Exception report > > message Problem with entry at -1982077125921865306: lastRootBlock=rootBlock{ rootBlock=1, challisField=53, version=3, nextOffset=18367917264487524, localTime=1441926674289 [Thursday, September 10, 2015 11:11:14 PM UTC], firstCommitTime=1441073445445 [Tuesday, September 1, 2015 2:10:45 AM UTC], lastCommitTime=1441926670929 [Thursday, September 10, 2015 11:11:10 PM UTC], commitCounter=53, commitRecordAddr={off=NATIVE:-451550099,len=422}, commitRecordIndexAddr={off=NATIVE:-468869758,len=220}, blockSequence=106022, quorumToken=-1, metaBitsAddr=13435602594695444, metaStartAddr=4614957, storeType=RW, uuid=d64bf2e9-599b-4f41-8bfe-f3b000f73138, offsetBits=42, checksum=371010502, createTime=1441073445016 [Tuesday, September 1, 2015 2:10:45 AM UTC], closeTime=0} > > description The server encountered an internal error that prevented it from fulfilling this request. > > exception > > java.lang.RuntimeException: Problem with entry at -1982077125921865306: lastRootBlock=rootBlock{ rootBlock=1, challisField=53, version=3, nextOffset=18367917264487524, localTime=1441926674289 [Thursday, September 10, 2015 11:11:14 PM UTC], firstCommitTime=1441073445445 [Tuesday, September 1, 2015 2:10:45 AM UTC], lastCommitTime=1441926670929 [Thursday, September 10, 2015 11:11:10 PM UTC], commitCounter=53, commitRecordAddr={off=NATIVE:-451550099,len=422}, commitRecordIndexAddr={off=NATIVE:-468869758,len=220}, blockSequence=106022, quorumToken=-1, metaBitsAddr=13435602594695444, metaStartAddr=4614957, storeType=RW, uuid=d64bf2e9-599b-4f41-8bfe-f3b000f73138, offsetBits=42, checksum=371010502, createTime=1441073445016 [Tuesday, September 1, 2015 2:10:45 AM UTC], closeTime=0} > com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3126) > com.bigdata.rdf.store.LocalTripleStore.commit(LocalTripleStore.java:98) > com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.commit2(BigdataSail.java:3394) > com.bigdata.rdf.sail.BigdataSailRepositoryConnection.commit2(BigdataSailRepositoryConnection.java:330) > com.bigdata.rdf.sail.BigdataSailRepositoryConnection.commit(BigdataSailRepositoryConnection.java:349) > com.blippar.blazegraph.BlazegraphUtils.loadData(BlazegraphUtils.java:446) > com.blippar.action.AddAction.execute(AddAction.java:81) > com.blippar.servlet.MinervaServlet.doPost(MinervaServlet.java:93) > com.blippar.servlet.MinervaServlet.doGet(MinervaServlet.java:60) > javax.servlet.http.HttpServlet.service(HttpServlet.java:622) > javax.servlet.http.HttpServlet.service(HttpServlet.java:729) > org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) > root cause > > java.lang.RuntimeException: Problem with entry at -1982077125921865306 > com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:4909) > com.bigdata.rwstore.RWStore.checkDeferredFrees(RWStore.java:3563) > com.bigdata.journal.RWStrategy.checkDeferredFrees(RWStrategy.java:781) > com.bigdata.journal.AbstractJournal$CommitState.writeCommitRecord(AbstractJournal.java:3489) > com.bigdata.journal.AbstractJournal$CommitState.access$2800(AbstractJournal.java:3291) > com.bigdata.journal.AbstractJournal.commitNow(AbstractJournal.java:4101) > com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3124) > com.bigdata.rdf.store.LocalTripleStore.commit(LocalTripleStore.java:98) > com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.commit2(BigdataSail.java:3394) > com.bigdata.rdf.sail.BigdataSailRepositoryConnection.commit2(BigdataSailRepositoryConnection.java:330) > com.bigdata.rdf.sail.BigdataSailRepositoryConnection.commit(BigdataSailRepositoryConnection.java:349) > com.blippar.blazegraph.BlazegraphUtils.loadData(BlazegraphUtils.java:446) > com.blippar.action.AddAction.execute(AddAction.java:81) > com.blippar.servlet.MinervaServlet.doPost(MinervaServlet.java:93) > com.blippar.servlet.MinervaServlet.doGet(MinervaServlet.java:60) > javax.servlet.http.HttpServlet.service(HttpServlet.java:622) > javax.servlet.http.HttpServlet.service(HttpServlet.java:729) > org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) > root cause > > java.lang.RuntimeException: addr=-472185800 : cause=java.lang.IllegalStateException: Bad Address: length requested greater than allocated slot > com.bigdata.rwstore.RWStore.getData(RWStore.java:2191) > com.bigdata.rwstore.RWStore.getData(RWStore.java:1990) > com.bigdata.rwstore.RWStore.getData(RWStore.java:2034) > com.bigdata.rwstore.RWStore.getData(RWStore.java:1990) > com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:4799) > com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:4895) > com.bigdata.rwstore.RWStore.checkDeferredFrees(RWStore.java:3563) > com.bigdata.journal.RWStrategy.checkDeferredFrees(RWStrategy.java:781) > com.bigdata.journal.AbstractJournal$CommitState.writeCommitRecord(AbstractJournal.java:3489) > com.bigdata.journal.AbstractJournal$CommitState.access$2800(AbstractJournal.java:3291) > com.bigdata.journal.AbstractJournal.commitNow(AbstractJournal.java:4101) > com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3124) > com.bigdata.rdf.store.LocalTripleStore.commit(LocalTripleStore.java:98) > com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.commit2(BigdataSail.java:3394) > com.bigdata.rdf.sail.BigdataSailRepositoryConnection.commit2(BigdataSailRepositoryConnection.java:330) > com.bigdata.rdf.sail.BigdataSailRepositoryConnection.commit(BigdataSailRepositoryConnection.java:349) > com.blippar.blazegraph.BlazegraphUtils.loadData(BlazegraphUtils.java:446) > com.blippar.action.AddAction.execute(AddAction.java:81) > com.blippar.servlet.MinervaServlet.doPost(MinervaServlet.java:93) > com.blippar.servlet.MinervaServlet.doGet(MinervaServlet.java:60) > javax.servlet.http.HttpServlet.service(HttpServlet.java:622) > javax.servlet.http.HttpServlet.service(HttpServlet.java:729) > org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) > root cause > > java.lang.IllegalStateException: Bad Address: length requested greater than allocated slot > com.bigdata.rwstore.RWStore.getData(RWStore.java:2083) > com.bigdata.rwstore.RWStore.getData(RWStore.java:1990) > com.bigdata.rwstore.RWStore.getData(RWStore.java:2034) > com.bigdata.rwstore.RWStore.getData(RWStore.java:1990) > com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:4799) > com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:4895) > com.bigdata.rwstore.RWStore.checkDeferredFrees(RWStore.java:3563) > com.bigdata.journal.RWStrategy.checkDeferredFrees(RWStrategy.java:781) > com.bigdata.journal.AbstractJournal$CommitState.writeCommitRecord(AbstractJournal.java:3489) > com.bigdata.journal.AbstractJournal$CommitState.access$2800(AbstractJournal.java:3291) > com.bigdata.journal.AbstractJournal.commitNow(AbstractJournal.java:4101) > com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3124) > com.bigdata.rdf.store.LocalTripleStore.commit(LocalTripleStore.java:98) > com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.commit2(BigdataSail.java:3394) > com.bigdata.rdf.sail.BigdataSailRepositoryConnection.commit2(BigdataSailRepositoryConnection.java:330) > com.bigdata.rdf.sail.BigdataSailRepositoryConnection.commit(BigdataSailRepositoryConnection.java:349) > com.blippar.blazegraph.BlazegraphUtils.loadData(BlazegraphUtils.java:446) > com.blippar.action.AddAction.execute(AddAction.java:81) > com.blippar.servlet.MinervaServlet.doPost(MinervaServlet.java:93) > com.blippar.servlet.MinervaServlet.doGet(MinervaServlet.java:60) > javax.servlet.http.HttpServlet.service(HttpServlet.java:622) > javax.servlet.http.HttpServlet.service(HttpServlet.java:729) > org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) > > > >> On Sep 11, 2015, at 9:15 AM, Brad Bebee <be...@sy... <mailto:be...@sy...>> wrote: >> >> Joakim, >> >> Thank you. If you are able to reproduce it, please send as much of the stack trace as you can. >> >> Thanks, --Brad >> >> On Fri, Sep 11, 2015 at 12:09 PM, Joakim Soderberg <joa...@bl... <mailto:joa...@bl...>> wrote: >> Unfortunately not. I will try to reproduce the error. >> >> >> >>> On Sep 11, 2015, at 5:23 AM, Brad Bebee <be...@sy... <mailto:be...@sy...>> wrote: >>> >>> Joakim, >>> >>> Can you send us the full stack trace to diagnose this? >>> >>> Thanks, --Brad >>> >>> On Thu, Sep 10, 2015 at 8:04 PM, Joakim Soderberg <joa...@bl... <mailto:joa...@bl...>> wrote: >>> Hi >>> I am running Blazegraph in embedded mode on a CentOS 4-core with 60GB RAM. The jul-file is 280GB hosting 1.3 B triples. While adding triples by adding to a RepositoryConnection >>> I get the following error: >>> >>> HTTP Status 500 - Problem with entry at -1982077125921865306: lastRootBlock=rootBlock{ rootBlock=1, challisField=53, version=3, nextOffset=18367917264487524, localTime=1441926674289 [Thursday, September 10, 2015 11:11:14 PM UTC], firstCommitTime=1441073445445 [Tuesday, September 1, 2015 2:10:45 AM UTC], lastCommitTime=1441926670929 [Thursday, September 10, 2015 11:11:10 PM UTC], commitCounter=53, commitRecordAddr={off=NATIVE:-451550099,len=422}, commitRecordIndexAddr={off=NATIVE:-468869758,len=220}, blockSequence=106022, quorumToken=-1, metaBitsAddr=13435602594695444, metaStartAddr=4614957, storeType=RW, uuid=d64bf2e9-599b-4f41-8bfe-f3b000f73138, offsetBits=42, checksum=371010502, createTime=1441073445016 [Tuesday, September 1, 2015 2:10:45 AM UTC], closeTime=0} >>> >>> After this I can’t add triples again, could the jnl-file be corrupt now? Can it be repaired? >>> >>> /Joakim >>> >>> ------------------------------------------------------------------------------ >>> >>> _______________________________________________ >>> Bigdata-developers mailing list >>> Big...@li... <mailto:Big...@li...> >>> https://lists.sourceforge.net/lists/listinfo/bigdata-developers <https://lists.sourceforge.net/lists/listinfo/bigdata-developers> >>> >>> >>> >>> >>> -- >>> _______________ >>> Brad Bebee >>> CEO, Managing Partner >>> SYSTAP, LLC >>> e: be...@sy... <mailto:be...@sy...> >>> m: 202.642.7961 <tel:202.642.7961> >>> f: 571.367.5000 <tel:571.367.5000> >>> w: www.blazegraph.com <http://www.blazegraph.com/> >>> >>> Blazegraph™ <http://www.blazegraph.com/> is our ultra high-performance graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs. Mapgraph™ <http://www.systap.com/mapgraph> is our disruptive new technology to use GPUs to accelerate data-parallel graph analytics. >>> >>> CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. >>> >>> >> >> >> >> >> -- >> _______________ >> Brad Bebee >> CEO, Managing Partner >> SYSTAP, LLC >> e: be...@sy... <mailto:be...@sy...> >> m: 202.642.7961 <tel:202.642.7961> >> f: 571.367.5000 <tel:571.367.5000> >> w: www.blazegraph.com <http://www.blazegraph.com/> >> >> Blazegraph™ <http://www.blazegraph.com/> is our ultra high-performance graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs. Mapgraph™ <http://www.systap.com/mapgraph> is our disruptive new technology to use GPUs to accelerate data-parallel graph analytics. >> >> CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. >> >> > > > ------------------------------------------------------------------------------ > > _______________________________________________ > Bigdata-developers mailing list > Big...@li... <mailto:Big...@li...> > https://lists.sourceforge.net/lists/listinfo/bigdata-developers <https://lists.sourceforge.net/lists/listinfo/bigdata-developers> > > |