From: Bryan T. <br...@sy...> - 2015-09-11 21:36:24
|
Excellent. On Sep 11, 2015 5:28 PM, "Joakim Soderberg" <joa...@bl...> wrote: > Hi, > I can confirm that the workaround did indeed fix the problem. > > Thanks > > *Joakim Soderberg* > > *Sr Scientist, PhD, **Head Content Platform * > > Blippar US, 444 Castro St # 302, Mountain View, CA 94041 > > > LONDON • NEW YORK • SAN FRANCISCO • LA • CHICAGO • AMSTERDAM • ISTANBUL • > DELHI • TOKYO • TORONTO > > *This e-mail is confidential. It may also be legally privileged. If you > are not the addressee you may not copy, forward, disclose or use any part > of it. If you have received this message in error, please delete it and all > copies from your system and notify the sender immediately by return e-mail. > Internet communications cannot be guaranteed to be timely, secure, error or > virus-free. The sender does not accept liability for any errors or > omissions.* > > On Sep 11, 2015, at 9:58 AM, Bryan Thompson <br...@sy...> wrote: > > Ok. We do have a workaround for this. The problem is a deferred free that > is not being properly released. This is identified by > > java.lang.RuntimeException: Problem with entry at -1982077125921865306* com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:4909) > * > > This issue was first reported by the wiki data service and we developed a > work around for them. The utility is available here: > > > https://jira.blazegraph.com/browse/BLZG-1236?focusedCommentId=19105&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-19105 > > Please let us know if this resolves the issue. > > Thanks, > Bryan > > ---- > Bryan Thompson > Chief Scientist & Founder > SYSTAP, LLC > 4501 Tower Road > Greensboro, NC 27410 > br...@sy... > http://blazegraph.com > http://blog.bigdata.com <http://bigdata.com/> > http://mapgraph.io > > Blazegraph™ <http://www.blazegraph.com/> is our ultra high-performance > graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints > APIs. Blazegraph is now available with GPU acceleration using our disruptive > technology to accelerate data-parallel graph analytics and graph query. > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are > for the sole use of the intended recipient(s) and are confidential or > proprietary to SYSTAP. Any unauthorized review, use, disclosure, > dissemination or copying of this email or its contents or attachments is > prohibited. If you have received this communication in error, please notify > the sender by reply email and permanently delete all copies of the email > and its contents and attachments. > > On Fri, Sep 11, 2015 at 12:43 PM, Joakim Soderberg < > joa...@bl...> wrote: > >> It seems to be a problem with the same entry: >> >> *type* Exception report >> >> *message* *Problem with entry at -1982077125921865306: >> lastRootBlock=rootBlock{ rootBlock=1, challisField=53, version=3, >> nextOffset=18367917264487524, localTime=1441926674289 [Thursday, September >> 10, 2015 11:11:14 PM UTC], firstCommitTime=1441073445445 [Tuesday, >> September 1, 2015 2:10:45 AM UTC], lastCommitTime=1441926670929 [Thursday, >> September 10, 2015 11:11:10 PM UTC], commitCounter=53, >> commitRecordAddr={off=NATIVE:-451550099,len=422}, >> commitRecordIndexAddr={off=NATIVE:-468869758,len=220}, >> blockSequence=106022, quorumToken=-1, metaBitsAddr=13435602594695444, >> metaStartAddr=4614957, storeType=RW, >> uuid=d64bf2e9-599b-4f41-8bfe-f3b000f73138, offsetBits=42, >> checksum=371010502, createTime=1441073445016 [Tuesday, September 1, 2015 >> 2:10:45 AM UTC], closeTime=0}* >> >> *description* *The server encountered an internal error that prevented >> it from fulfilling this request.* >> >> *exception* >> >> java.lang.RuntimeException: Problem with entry at -1982077125921865306: lastRootBlock=rootBlock{ rootBlock=1, challisField=53, version=3, nextOffset=18367917264487524, localTime=1441926674289 [Thursday, September 10, 2015 11:11:14 PM UTC], firstCommitTime=1441073445445 [Tuesday, September 1, 2015 2:10:45 AM UTC], lastCommitTime=1441926670929 [Thursday, September 10, 2015 11:11:10 PM UTC], commitCounter=53, commitRecordAddr={off=NATIVE:-451550099,len=422}, commitRecordIndexAddr={off=NATIVE:-468869758,len=220}, blockSequence=106022, quorumToken=-1, metaBitsAddr=13435602594695444, metaStartAddr=4614957, storeType=RW, uuid=d64bf2e9-599b-4f41-8bfe-f3b000f73138, offsetBits=42, checksum=371010502, createTime=1441073445016 [Tuesday, September 1, 2015 2:10:45 AM UTC], closeTime=0} >> com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3126) >> com.bigdata.rdf.store.LocalTripleStore.commit(LocalTripleStore.java:98) >> com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.commit2(BigdataSail.java:3394) >> com.bigdata.rdf.sail.BigdataSailRepositoryConnection.commit2(BigdataSailRepositoryConnection.java:330) >> com.bigdata.rdf.sail.BigdataSailRepositoryConnection.commit(BigdataSailRepositoryConnection.java:349) >> com.blippar.blazegraph.BlazegraphUtils.loadData(BlazegraphUtils.java:446) >> com.blippar.action.AddAction.execute(AddAction.java:81) >> com.blippar.servlet.MinervaServlet.doPost(MinervaServlet.java:93) >> com.blippar.servlet.MinervaServlet.doGet(MinervaServlet.java:60) >> javax.servlet.http.HttpServlet.service(HttpServlet.java:622) >> javax.servlet.http.HttpServlet.service(HttpServlet.java:729) >> org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) >> >> *root cause* >> >> java.lang.RuntimeException: Problem with entry at -1982077125921865306 >> com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:4909) >> com.bigdata.rwstore.RWStore.checkDeferredFrees(RWStore.java:3563) >> com.bigdata.journal.RWStrategy.checkDeferredFrees(RWStrategy.java:781) >> com.bigdata.journal.AbstractJournal$CommitState.writeCommitRecord(AbstractJournal.java:3489) >> com.bigdata.journal.AbstractJournal$CommitState.access$2800(AbstractJournal.java:3291) >> com.bigdata.journal.AbstractJournal.commitNow(AbstractJournal.java:4101) >> com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3124) >> com.bigdata.rdf.store.LocalTripleStore.commit(LocalTripleStore.java:98) >> com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.commit2(BigdataSail.java:3394) >> com.bigdata.rdf.sail.BigdataSailRepositoryConnection.commit2(BigdataSailRepositoryConnection.java:330) >> com.bigdata.rdf.sail.BigdataSailRepositoryConnection.commit(BigdataSailRepositoryConnection.java:349) >> com.blippar.blazegraph.BlazegraphUtils.loadData(BlazegraphUtils.java:446) >> com.blippar.action.AddAction.execute(AddAction.java:81) >> com.blippar.servlet.MinervaServlet.doPost(MinervaServlet.java:93) >> com.blippar.servlet.MinervaServlet.doGet(MinervaServlet.java:60) >> javax.servlet.http.HttpServlet.service(HttpServlet.java:622) >> javax.servlet.http.HttpServlet.service(HttpServlet.java:729) >> org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) >> >> *root cause* >> >> java.lang.RuntimeException: addr=-472185800 : cause=java.lang.IllegalStateException: Bad Address: length requested greater than allocated slot >> com.bigdata.rwstore.RWStore.getData(RWStore.java:2191) >> com.bigdata.rwstore.RWStore.getData(RWStore.java:1990) >> com.bigdata.rwstore.RWStore.getData(RWStore.java:2034) >> com.bigdata.rwstore.RWStore.getData(RWStore.java:1990) >> com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:4799) >> com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:4895) >> com.bigdata.rwstore.RWStore.checkDeferredFrees(RWStore.java:3563) >> com.bigdata.journal.RWStrategy.checkDeferredFrees(RWStrategy.java:781) >> com.bigdata.journal.AbstractJournal$CommitState.writeCommitRecord(AbstractJournal.java:3489) >> com.bigdata.journal.AbstractJournal$CommitState.access$2800(AbstractJournal.java:3291) >> com.bigdata.journal.AbstractJournal.commitNow(AbstractJournal.java:4101) >> com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3124) >> com.bigdata.rdf.store.LocalTripleStore.commit(LocalTripleStore.java:98) >> com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.commit2(BigdataSail.java:3394) >> com.bigdata.rdf.sail.BigdataSailRepositoryConnection.commit2(BigdataSailRepositoryConnection.java:330) >> com.bigdata.rdf.sail.BigdataSailRepositoryConnection.commit(BigdataSailRepositoryConnection.java:349) >> com.blippar.blazegraph.BlazegraphUtils.loadData(BlazegraphUtils.java:446) >> com.blippar.action.AddAction.execute(AddAction.java:81) >> com.blippar.servlet.MinervaServlet.doPost(MinervaServlet.java:93) >> com.blippar.servlet.MinervaServlet.doGet(MinervaServlet.java:60) >> javax.servlet.http.HttpServlet.service(HttpServlet.java:622) >> javax.servlet.http.HttpServlet.service(HttpServlet.java:729) >> org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) >> >> *root cause* >> >> java.lang.IllegalStateException: Bad Address: length requested greater than allocated slot >> com.bigdata.rwstore.RWStore.getData(RWStore.java:2083) >> com.bigdata.rwstore.RWStore.getData(RWStore.java:1990) >> com.bigdata.rwstore.RWStore.getData(RWStore.java:2034) >> com.bigdata.rwstore.RWStore.getData(RWStore.java:1990) >> com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:4799) >> com.bigdata.rwstore.RWStore.freeDeferrals(RWStore.java:4895) >> com.bigdata.rwstore.RWStore.checkDeferredFrees(RWStore.java:3563) >> com.bigdata.journal.RWStrategy.checkDeferredFrees(RWStrategy.java:781) >> com.bigdata.journal.AbstractJournal$CommitState.writeCommitRecord(AbstractJournal.java:3489) >> com.bigdata.journal.AbstractJournal$CommitState.access$2800(AbstractJournal.java:3291) >> com.bigdata.journal.AbstractJournal.commitNow(AbstractJournal.java:4101) >> com.bigdata.journal.AbstractJournal.commit(AbstractJournal.java:3124) >> com.bigdata.rdf.store.LocalTripleStore.commit(LocalTripleStore.java:98) >> com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.commit2(BigdataSail.java:3394) >> com.bigdata.rdf.sail.BigdataSailRepositoryConnection.commit2(BigdataSailRepositoryConnection.java:330) >> com.bigdata.rdf.sail.BigdataSailRepositoryConnection.commit(BigdataSailRepositoryConnection.java:349) >> com.blippar.blazegraph.BlazegraphUtils.loadData(BlazegraphUtils.java:446) >> com.blippar.action.AddAction.execute(AddAction.java:81) >> com.blippar.servlet.MinervaServlet.doPost(MinervaServlet.java:93) >> com.blippar.servlet.MinervaServlet.doGet(MinervaServlet.java:60) >> javax.servlet.http.HttpServlet.service(HttpServlet.java:622) >> javax.servlet.http.HttpServlet.service(HttpServlet.java:729) >> org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) >> >> >> >> >> On Sep 11, 2015, at 9:15 AM, Brad Bebee <be...@sy...> wrote: >> >> Joakim, >> >> Thank you. If you are able to reproduce it, please send as much of the >> stack trace as you can. >> >> Thanks, --Brad >> >> On Fri, Sep 11, 2015 at 12:09 PM, Joakim Soderberg < >> joa...@bl...> wrote: >> >>> Unfortunately not. I will try to reproduce the error. >>> >>> >>> On Sep 11, 2015, at 5:23 AM, Brad Bebee <be...@sy...> wrote: >>> >>> Joakim, >>> >>> Can you send us the full stack trace to diagnose this? >>> >>> Thanks, --Brad >>> >>> On Thu, Sep 10, 2015 at 8:04 PM, Joakim Soderberg < >>> joa...@bl...> wrote: >>> >>>> Hi >>>> I am running Blazegraph in embedded mode on a CentOS 4-core with 60GB >>>> RAM. The jul-file is 280GB hosting 1.3 B triples. While adding triples by >>>> adding to a RepositoryConnection >>>> I get the following error: >>>> >>>> HTTP Status 500 - Problem with entry at -1982077125921865306: >>>> lastRootBlock=rootBlock{ rootBlock=1, challisField=53, version=3, >>>> nextOffset=18367917264487524, localTime=1441926674289 [Thursday, September >>>> 10, 2015 11:11:14 PM UTC], firstCommitTime=1441073445445 [Tuesday, >>>> September 1, 2015 2:10:45 AM UTC], lastCommitTime=1441926670929 [Thursday, >>>> September 10, 2015 11:11:10 PM UTC], commitCounter=53, >>>> commitRecordAddr={off=NATIVE:-451550099,len=422}, commitRecordIndexAddr={off=NATIVE:-468869758,len=220}, >>>> blockSequence=106022, quorumToken=-1, metaBitsAddr=13435602594695444, >>>> metaStartAddr=4614957, storeType=RW, >>>> uuid=d64bf2e9-599b-4f41-8bfe-f3b000f73138, >>>> offsetBits=42, checksum=371010502, createTime=1441073445016 [Tuesday, >>>> September 1, 2015 2:10:45 AM UTC], closeTime=0} >>>> >>>> After this I can’t add triples again, could the jnl-file be corrupt >>>> now? Can it be repaired? >>>> >>>> /Joakim >>>> >>>> >>>> ------------------------------------------------------------------------------ >>>> >>>> _______________________________________________ >>>> Bigdata-developers mailing list >>>> Big...@li... >>>> https://lists.sourceforge.net/lists/listinfo/bigdata-developers >>>> >>>> >>> >>> >>> -- >>> _______________ >>> Brad Bebee >>> CEO, Managing Partner >>> SYSTAP, LLC >>> e: be...@sy... >>> m: 202.642.7961 >>> f: 571.367.5000 >>> w: www.blazegraph.com >>> >>> Blazegraph™ <http://www.blazegraph.com/> is our ultra high-performance >>> graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs. >>> Mapgraph™ <http://www.systap.com/mapgraph> is our disruptive new >>> technology to use GPUs to accelerate data-parallel graph analytics. >>> >>> CONFIDENTIALITY NOTICE: This email and its contents and attachments >>> are for the sole use of the intended recipient(s) and are confidential or >>> proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, >>> dissemination or copying of this email or its contents or attachments is >>> prohibited. If you have received this communication in error, please notify >>> the sender by reply email and permanently delete all copies of the email >>> and its contents and attachments. >>> >>> >>> >> >> >> -- >> _______________ >> Brad Bebee >> CEO, Managing Partner >> SYSTAP, LLC >> e: be...@sy... >> m: 202.642.7961 >> f: 571.367.5000 >> w: www.blazegraph.com >> >> Blazegraph™ <http://www.blazegraph.com/> is our ultra high-performance >> graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs. >> Mapgraph™ <http://www.systap.com/mapgraph> is our disruptive new >> technology to use GPUs to accelerate data-parallel graph analytics. >> >> CONFIDENTIALITY NOTICE: This email and its contents and attachments are >> for the sole use of the intended recipient(s) and are confidential or >> proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, >> dissemination or copying of this email or its contents or attachments is >> prohibited. If you have received this communication in error, please notify >> the sender by reply email and permanently delete all copies of the email >> and its contents and attachments. >> >> >> >> >> ------------------------------------------------------------------------------ >> >> _______________________________________________ >> Bigdata-developers mailing list >> Big...@li... >> https://lists.sourceforge.net/lists/listinfo/bigdata-developers >> >> > > |