Menu
▾
▴
Re: [Bigdata-developers] Benchmarking Blazegraph
|
From: Brad B. <be...@sy...> - 2015-11-16 14:31:12
|
Felix, Great -- yes, please do post your results to the mailing list. Regarding using the Vocabulary, yes, you must create a new Journal with the property for the vocabulary class as you have in your example. When you start Blazegraph, you must also make sure that the vocabulary class is in the classpath, i.e. something like java -cp /path/to/vocab -jar bigdata-1.5.2-bundled.jar. We would recommend that you update to the 1.5.3 bundled jar, if possible. The 2.0 release at the end of the year will have a number of loading enhancements as well. com.bigdata.rdf.store.AbstractTripleStore.vocabularyClass=MyCustomVocab Good luck and let us know how it goes. Thanks, --Brad On Mon, Nov 16, 2015 at 3:36 AM, Felix Conrads < mai...@st...> wrote: > Hey, > > First off thanks alot! It took a while to come back to it, as some other > work showed up which needs to be done first. > Nevertheless i have one more question: > > I took the fastload properties and generated a Vocabulary exactly as your > JIRA Ticket [2]. How do i say blazegraph it should use my vocab? Is it as > simple as to put in the properties following line: > com.bigdata.rdf.store.AbstractTripleStore.vocabularyClass=MyCustomVocab > (Generated File is MyCustomVocab.java in the directory with > bigdata-1.5.2-bundled.jar) > > > I'll test Blazegraph with a DBPedia Dataset and a SWDF Dataset with 250 > Queries (ASK, SELECT, CONSTRUCT, DESCRIBE) generated with FEASIBLE [1] and > at least DBPedia with Updates from DBpedia Live [2] (round about 250 > inserts and deletes). The test should show how the triplestores act when > they to not just only have 1 SPARQL User but several SPARQL Users and one > UPDATE user. For this we'll test blazegraph and other triplestores with > 1,2,4,8,16 SPARQL Users and 0 UPDATE Users, and 1,2,4,8,16 SPARQL Users and > 1 Update User. > The whole Benchmark will be tested with IGUANA [3]. > > If you're interest in the results. I can send them to you :) > > [1] http://aksw.org/Projects/FEASIBLE.html > [2] http://live.dbpedia.org/ > [3] https://github.com/AKSW/IGUANA > > Thanks alot > Felix > > > Am 13.10.2015 um 16:28 schrieb Brad Bebee: > > Felix, > > You will definitely want to adjust the properties a bit. Checkout [1] and > then generate a Vocabulary per the JIRA ticket [2]. That should improve > your performance substantially. I've also copied the blazegraph developers > list to see if anyone else has recommendations. > > Thanks, --Brad > > [1] > https://sourceforge.net/p/bigdata/git/ci/master/tree/bigdata-sails/src/samples/com/bigdata/samples/fastload.properties > > > [2] https://jira.blazegraph.com/browse/BLZG-1509 > > > > On Tue, Oct 13, 2015 at 10:19 AM, <mai...@st...> > wrote: > >> Hey >> >> thanks for the fast answer. >> The journal file looks like this: >> >> com.bigdata.journal.AbstractJournal.bufferMode=DiskRW >> com.bigdata.journal.AbstractJournal.file=bigdata.jnl >> >> Thanks >> Felix >> >> >> Zitat von Brad Bebee <be...@sy...>: >> >> Felix, >>> >>> Thank you. Can you send us some details of your journal configuration? >>> It may be beneficial to use a Vocabulary to inline the DBPedia values >>> for >>> improved load performance. >>> >>> Thanks, --Brad >>> >>> On Tue, Oct 13, 2015 at 10:10 AM, Blazegraph Web Site Contact < >>> bla...@bl...> wrote: >>> >>> From: Felix Conrads<mai...@st...> >>>> Subject: Benchmarking Blazegraph >>>> >>>> Message Body: >>>> >>>> Name : Felix Conrads >>>> Email : mai...@st... >>>> Message : Hello, >>>> >>>> I'm Felix Conrads from AKSW Research Group at University Leipzig. >>>> Currently i evaluate a Benchmark execution framework with several >>>> triplestores including Blazegrah. While blazegraph works fine it needs >>>> too >>>> much time to upload some of our datasets into it. >>>> These are the dbpedia datasets with ~217.000.000 triples and >>>> ~434.000.000 >>>> triples. >>>> I tried to upload the first one with the method described here: >>>> https://wiki.blazegraph.com/wiki/index.php/Bulk_Data_Load >>>> If you could tell me if there is any possiblity to upload them faster >>>> than >>>> >15 hours (i aborted it there) i would be very thankful . >>>> >>>> Thanks in advance and best regards >>>> Felix Conrads >>>> >>>> -- >>>> This e-mail was sent from a contact form on ( >>>> <http://www.blazegraph.com>http://www.blazegraph.com) >>>> >>>> -- >>>> You received this message because you are subscribed to the Google >>>> Groups >>>> "contact-us" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an >>>> email to con...@sy.... >>>> To post to this group, send email to <con...@sy...> >>>> con...@sy.... >>>> To view this discussion on the web visit >>>> >>>> https://groups.google.com/a/systap.com/d/msgid/contact-us/8ece997cd271234401ab075d427430ca%40www.blazegraph.com >>>> . >>>> >>>> >>> >>> >>> -- >>> _______________ >>> Brad Bebee >>> CEO, Managing Partner >>> SYSTAP, LLC >>> e: be...@sy... >>> m: 202.642.7961 >>> f: 571.367.5000 >>> w: www.blazegraph.com >>> >>> Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance >>> graph >>> database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs. >>> Mapgraph™ <http://www.systap.com/mapgraph> is our disruptive new >>> technology >>> to use GPUs to accelerate data-parallel graph analytics. >>> >>> CONFIDENTIALITY NOTICE: This email and its contents and attachments are >>> for the sole use of the intended recipient(s) and are confidential or >>> proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, >>> dissemination or copying of this email or its contents or attachments is >>> prohibited. If you have received this communication in error, please >>> notify >>> the sender by reply email and permanently delete all copies of the email >>> and its contents and attachments. >>> >> >> >> >> -- >> You received this message because you are subscribed to the Google Groups >> "blazegraph" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to bla...@sy.... >> To post to this group, send email to <bla...@sy...> >> bla...@sy.... >> To view this discussion on the web visit >> <https://groups.google.com/a/systap.com/d/msgid/blazegraph/20151013161930.Horde.W_LJNqOM0w-ESzbfcFB7bw2%40mail.uni-leipzig.de> >> https://groups.google.com/a/systap.com/d/msgid/blazegraph/20151013161930.Horde.W_LJNqOM0w-ESzbfcFB7bw2%40mail.uni-leipzig.de >> . >> > > > > -- > _______________ > Brad Bebee > CEO, Managing Partner > SYSTAP, LLC > e: be...@sy... > m: 202.642.7961 > f: 571.367.5000 > w: <http://www.blazegraph.com>www.blazegraph.com > > Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance > graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints > APIs. Mapgraph™ <http://www.systap.com/mapgraph> is our disruptive new > technology to use GPUs to accelerate data-parallel graph analytics. > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are > for the sole use of the intended recipient(s) and are confidential or > proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, > dissemination or copying of this email or its contents or attachments is > prohibited. If you have received this communication in error, please notify > the sender by reply email and permanently delete all copies of the email > and its contents and attachments. > > > > > ------------------------------ > [image: Avast logo] <https://www.avast.com/antivirus> > > Diese E-Mail wurde von Avast Antivirus-Software auf Viren geprüft. > www.avast.com <https://www.avast.com/antivirus> > > -- _______________ Brad Bebee CEO, Managing Partner SYSTAP, LLC e: be...@sy... m: 202.642.7961 f: 571.367.5000 w: www.blazegraph.com Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs. Mapgraph™ <http://www.systap.com/mapgraph> is our disruptive new technology to use GPUs to accelerate data-parallel graph analytics. CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. |
