Menu
▾
▴
Re: [Bigdata-developers] Antw: Re: SPARQL Load runs into ArrayIndexOutOfBoundsException
|
From: Bryan T. <br...@sy...> - 2016-03-31 17:10:01
|
Yes, the rdf4j parsers are not graceful about invalid URIs. Bryan ---- Bryan Thompson Chief Scientist & Founder Blazegraph e: br...@bl... w: http://blazegraph.com Blazegraph products help to solve the Graph Cache Thrash to achieve large scale processing for graph and predictive analytics. Blazegraph is the creator of the industry’s first GPU-accelerated high-performance database for large graphs, has been named as one of the “10 Companies and Technologies to Watch in 2016” <http://insideanalysis.com/2016/01/20535/>. Blazegraph Database <https://www.blazegraph.com/> is our ultra-high performance graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs. Blazegraph GPU <https://www.blazegraph.com/product/gpu-accelerated/> andBlazegraph DAS <https://www.blazegraph.com/product/gpu-accelerated/>L are disruptive new technologies that use GPUs to enable extreme scaling that is thousands of times faster and 40 times more affordable than CPU-based solutions. CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP, LLC DBA Blazegraph. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. On Thu, Mar 31, 2016 at 1:07 PM, Andreas Kahl <ka...@bs...> wrote: > Bryan, > > I think the bug is fixed: at least I loaded successfully 98,500,000 > triples - until I hit an unencoded space in an URI. > Setting > com.bigdata.rdf.rio.RDFParserOptions.stopAtFirstError=false > com.bigdata.rdf.rio.RDFParserOptions.verifyData=false > did not help. I will try to contact the authors of the dataset. > But as far as your bug is concerned, I am quite sure it's fixed. > > Best Regards > Andreas > > Here's the snippet with the Error from the Log: > <br>totalElapsed=3061671ms, elapsed=3061543ms, parsed=98480000, tps=32166, > done=false</br > ><br>totalElapsed=3061763ms, elapsed=3061635ms, parsed=98490000, > tps=32169, done=false</br > ><br>totalElapsed=3061855ms, elapsed=3061727ms, parsed=98500000, > tps=32171, done=false</br > ><p>ABORT</p > ><pre>Load > > source=ConstantNode(TermId(0U)[file:///srv/feed-dateien/DNBLOD/GND.ttl.gz]) > </pre > ><pre>java.lang.RuntimeException: Could not load: > url=file:///srv/feed-dateien/DNBLOD/GND.ttl.gz, > cause=org.openrdf.rio.RDFParseException: IRI included an unencoded space: > '32' [line 119517521] > at > com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertLoadGraph(AST2BOpUpdate.java:1403) > at > com.bigdata.rdf.sparql.ast.eval.AST2BOpUpdate.convertUpdateSwitch(AST2BOpUpdate.java:439) > > >>> "Andreas Kahl" <ka...@bs...> 31.03.2016 14:36 >>> > Bryan, > > Thanks for the quick response. blazegraph-jar-2.1.0-20160330.023632-2.jar > from > https://oss.sonatype.org/content/repositories/snapshots/com/blazegraph/blazegraph-jar/2.1.0-SNAPSHOT/ seems > to be working well at first sight - at least it has run past the point > where 2.0.1 failed every time. I will send you a confirmation as soon as > the whole file has run through. > > Best Regards > Andreas > > > >>> Bryan Thompson <br...@sy...> 31.03.2016 14:24 >>> > The 2.1.0-SNAPSHOT release => You can download the WAR from > https://oss.sonatype.org/content/repositories/snapshots/com/blazegraph/bigdata-war/2.1.0-SNAPSHOT/ > . > > Please let us know if this corrects the issue. > > Thanks, > Bryan > > ---- > Bryan Thompson > Chief Scientist & Founder > Blazegraph > e: br...@bl... > w: http://blazegraph.com > > Blazegraph products help to solve the Graph Cache Thrash to achieve large > scale processing for graph and predictive analytics. Blazegraph is the > creator of the industry’s first GPU-accelerated high-performance database > for large graphs, has been named as one of the “10 Companies and > Technologies to Watch in 2016” <http://insideanalysis.com/2016/01/20535/>. > > > Blazegraph Database <https://www.blazegraph.com/> is our ultra-high > performance graph database that supports both RDF/SPARQL and > Tinkerpop/Blueprints APIs. Blazegraph GPU > <https://www.blazegraph.com/product/gpu-accelerated/> andBlazegraph DAS > <https://www.blazegraph.com/product/gpu-accelerated/>L are disruptive new > technologies that use GPUs to enable extreme scaling that is thousands of > times faster and 40 times more affordable than CPU-based solutions. > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are > for the sole use of the intended recipient(s) and are confidential or > proprietary to SYSTAP, LLC DBA Blazegraph. Any unauthorized review, use, > disclosure, dissemination or copying of this email or its contents or > attachments is prohibited. If you have received this communication in > error, please notify the sender by reply email and permanently delete all > copies of the email and its contents and attachments. > > On Thu, Mar 31, 2016 at 8:23 AM, Bryan Thompson <br...@sy...> wrote: > >> This should be fixed in 2.1.0, which is now in QA. Brad can provide you >> with a snapshot leading up to the release for testing. >> >> Our hypothesis is that the problem arose from failing to account for the >> accumulation of blank nodes in an internal buffer. The fix takes account of >> this and then evicts batches before the buffer would overflow. The overflow >> is the index out of bounds exception. >> >> Thanks, >> Bryan >> >> ---- >> Bryan Thompson >> Chief Scientist & Founder >> Blazegraph >> e: br...@bl... >> w: http://blazegraph.com >> >> Blazegraph products help to solve the Graph Cache Thrash to achieve large >> scale processing for graph and predictive analytics. Blazegraph is the >> creator of the industry’s first GPU-accelerated high-performance database >> for large graphs, has been named as one of the “10 Companies and >> Technologies to Watch in 2016” <http://insideanalysis.com/2016/01/20535/>. >> >> >> Blazegraph Database <https://www.blazegraph.com/> is our ultra-high >> performance graph database that supports both RDF/SPARQL and >> Tinkerpop/Blueprints APIs. Blazegraph GPU >> <https://www.blazegraph.com/product/gpu-accelerated/> andBlazegraph DAS >> <https://www.blazegraph.com/product/gpu-accelerated/>L are disruptive >> new technologies that use GPUs to enable extreme scaling that is thousands >> of times faster and 40 times more affordable than CPU-based solutions. >> >> CONFIDENTIALITY NOTICE: This email and its contents and attachments are >> for the sole use of the intended recipient(s) and are confidential or >> proprietary to SYSTAP, LLC DBA Blazegraph. Any unauthorized review, use, >> disclosure, dissemination or copying of this email or its contents or >> attachments is prohibited. If you have received this communication in >> error, please notify the sender by reply email and permanently delete all >> copies of the email and its contents and attachments. >> >> On Thu, Mar 31, 2016 at 8:00 AM, Andreas Kahl <ka...@bs...> >> wrote: >> >>> Hello everyone, >>> >>> I did some extensive testing on this error, but I cannot load this file >>> into Blazegraph 2.0.1 (I tried the .jar from Sourceforge and compiled the >>> latest master revision with Oracle JDK 1.8.0_74 myself). >>> Blazegraph runs into this: >>> java.lang.RuntimeException: Could not load: >>> url=file:///srv/feed-dateien/DNBLOD/GND.ttl.gz, >>> cause=java.lang.ArrayIndexOutOfBoundsException: 40005 >>> >>> Please find the complete Stacktrace in the Logs attached. >>> >>> The SPARQL LOAD Command: >>> curl -d"update=LOAD <file:///srv/feed-dateien/DNBLOD/GND.ttl.gz>" >>> -d"monitor=true" http://localhost:8080/blazegraph/sparql 2>&1 >>> >>/var/log/bigdata/loadGnd.log >>> >>> The data tested can be downloaded from >>> http://datendienst.dnb.de/cgi-bin/mabit.pl?cmd=fetch&userID=opendata&pass=opendata&mabheft=GND.ttl.gz >>> >>> Blazegraph was running with this call: >>> nohup java -server -Xmx6g -XX:+UseG1GC >>> -Djava.io.tmpdir=/mnt/triplestore/tomcat8/temp/ -cp >>> /mnt/triplestore/bigdata/blazegraph-jar-2.0.1.jar >>> com.bigdata.rdf.sail.webapp.NanoSparqlServer 8080 kb >>> /etc/bigdata/RWStore.properties >/var/log/bigdata/blazegraph.log & >>> >>> Java-Version on the server: >>> java -version >>> java version "1.8.0_65" >>> Java(TM) SE Runtime Environment (build 1.8.0_65-b17) >>> Java HotSpot(TM) 64-Bit Server VM (build 25.65-b01, mixed mode) >>> >>> RWStore.properties was practically the original one (I just switched to >>> Triples Mode and altered the Journal file's location. No custom >>> Vocabularies or namespaces were used. >>> >>> Is there any known Issue? Should I try some specific revision from >>> Github? >>> >>> Thanks for any hints. >>> >>> Andreas >>> >>> >>> ------------------------------------------------------------------------------ >>> Transform Data into Opportunity. >>> Accelerate data analysis in your applications with >>> Intel Data Analytics Acceleration Library. >>> Click to learn more. >>> http://pubads.g.doubleclick.net/gampad/clk?id=278785471&iu=/4140 >>> _______________________________________________ >>> Bigdata-developers mailing list >>> Big...@li... >>> https://lists.sourceforge.net/lists/listinfo/bigdata-developers >>> >>> >> > |
