Re: [Bigdata-developers] Benchmarking Blazegraph

[Felix C. <mai...@st...>]

Hey,

First off thanks alot! It took a while to come back to it, as some other
work showed up which needs to be done first.
Nevertheless i have one more question:

I took the fastload properties and generated a Vocabulary exactly as
your JIRA Ticket [2]. How do i say blazegraph it should use my vocab? Is
it as simple as to put in the properties following line:
com.bigdata.rdf.store.AbstractTripleStore.vocabularyClass=MyCustomVocab
(Generated File is MyCustomVocab.java in the directory with
bigdata-1.5.2-bundled.jar)


I'll test Blazegraph with a DBPedia Dataset and a SWDF Dataset with 250
Queries (ASK, SELECT, CONSTRUCT, DESCRIBE) generated with FEASIBLE [1]
and at least DBPedia with Updates from DBpedia Live [2] (round about 250
inserts and deletes). The test should show how the triplestores act when
they to not just only have 1 SPARQL User but several SPARQL Users and
one UPDATE user. For this we'll test blazegraph and other triplestores
with 1,2,4,8,16 SPARQL Users and 0 UPDATE Users, and 1,2,4,8,16 SPARQL
Users and 1 Update User.
The whole Benchmark will be tested with IGUANA [3].

If you're interest in the results. I can send them to you :)

[1] http://aksw.org/Projects/FEASIBLE.html
[2] http://live.dbpedia.org/
[3] https://github.com/AKSW/IGUANA

Thanks alot
Felix

Am 13.10.2015 um 16:28 schrieb Brad Bebee:
> Felix,
>
> You will definitely want to adjust the properties a bit.  Checkout [1]
> and then generate a Vocabulary per the JIRA ticket [2].  That should
> improve your performance substantially.  I've also copied the
> blazegraph developers list to see if anyone else has recommendations.
>
> Thanks, --Brad
>
> [1] https://sourceforge.net/p/bigdata/git/ci/master/tree/bigdata-sails/src/samples/com/bigdata/samples/fastload.properties 
>
> [2] https://jira.blazegraph.com/browse/BLZG-1509
>
>
>
> On Tue, Oct 13, 2015 at 10:19 AM, <mai...@st...
> <mailto:mai...@st...>> wrote:
>
>     Hey
>
>     thanks for the fast answer.
>     The journal file looks like this:
>
>     com.bigdata.journal.AbstractJournal.bufferMode=DiskRW
>     com.bigdata.journal.AbstractJournal.file=bigdata.jnl
>
>     Thanks
>     Felix
>
>
>     Zitat von Brad Bebee <be...@sy... <mailto:be...@sy...>>:
>
>         Felix,
>
>         Thank you.  Can you send us some details of your journal
>         configuration?
>          It may be beneficial to use a Vocabulary to inline the
>         DBPedia values for
>         improved load performance.
>
>         Thanks, --Brad
>
>         On Tue, Oct 13, 2015 at 10:10 AM, Blazegraph Web Site Contact <
>         bla...@bl... <mailto:bla...@bl...>>
>         wrote:
>
>             From: Felix Conrads<mai...@st...
>             <mailto:mai...@st...>>
>             Subject: Benchmarking Blazegraph
>
>             Message Body:
>
>             Name : Felix Conrads
>             Email : mai...@st...
>             <mailto:mai...@st...>
>             Message  : Hello,
>
>             I'm Felix Conrads from AKSW Research Group at University
>             Leipzig.
>             Currently i evaluate a Benchmark execution framework with
>             several
>             triplestores including Blazegrah. While blazegraph works
>             fine it needs too
>             much time to upload some of our datasets into it.
>             These are the dbpedia datasets with ~217.000.000 triples
>             and ~434.000.000
>             triples.
>             I tried to upload the first one with the method described
>             here:
>             https://wiki.blazegraph.com/wiki/index.php/Bulk_Data_Load
>             If you could tell me if there is any possiblity to upload
>             them faster than
>             >15 hours (i aborted it there) i would be very thankful .
>
>             Thanks in advance and best regards
>             Felix Conrads

>
>             --
>             This e-mail was sent from a contact form on 
>             (http://www.blazegraph.com)
>
>             --
>             You received this message because you are subscribed to
>             the Google Groups
>             "contact-us" group.
>             To unsubscribe from this group and stop receiving emails
>             from it, send an
>             email to con...@sy...
>             <mailto:contact-us%2Bu...@sy...>.
>             To post to this group, send email to con...@sy...
>             <mailto:con...@sy...>.
>             To view this discussion on the web visit
>             https://groups.google.com/a/systap.com/d/msgid/contact-us/8ece997cd271234401ab075d427430ca%40www.blazegraph.com
>             .
>
>
>
>
>         --
>         _______________
>         Brad Bebee
>         CEO, Managing Partner
>         SYSTAP, LLC
>         e:  be...@sy... <mailto:be...@sy...>
>         m: 202.642.7961 <tel:202.642.7961>
>         f:  571.367.5000 <tel:571.367.5000>
>         w:  www.blazegraph.com <http://www.blazegraph.com>
>
>         Blazegraph™ <http://www.blazegraph.com> is our ultra
>         high-performance graph
>         database that supports both RDF/SPARQL and
>         Tinkerpop/Blueprints APIs.
>         Mapgraph™ <http://www.systap.com/mapgraph> is our disruptive
>         new technology
>         to use GPUs to accelerate data-parallel graph analytics.
>
>         CONFIDENTIALITY NOTICE:  This email and its contents and
>         attachments are
>         for the sole use of the intended recipient(s) and are
>         confidential or
>         proprietary to SYSTAP, LLC.  Any unauthorized review, use,
>         disclosure,
>         dissemination or copying of this email or its contents or
>         attachments is
>         prohibited. If you have received this communication in error,
>         please notify
>         the sender by reply email and permanently delete all copies of
>         the email
>         and its contents and attachments.
>
>
>
>
>     -- 
>     You received this message because you are subscribed to the Google
>     Groups "blazegraph" group.
>     To unsubscribe from this group and stop receiving emails from it,
>     send an email to bla...@sy...
>     <mailto:blazegraph%2Bu...@sy...>.
>     To post to this group, send email to bla...@sy...
>     <mailto:bla...@sy...>.
>     To view this discussion on the web visit
>     https://groups.google.com/a/systap.com/d/msgid/blazegraph/20151013161930.Horde.W_LJNqOM0w-ESzbfcFB7bw2%40mail.uni-leipzig.de.
>
>
>
>
> -- 
> _______________
> Brad Bebee
> CEO, Managing Partner
> SYSTAP, LLC
> e:  be...@sy... <mailto:be...@sy...>
> m: 202.642.7961
> f:  571.367.5000
> w:  www.blazegraph.com <http://www.blazegraph.com>
>
> Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance
> graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints
> APIs.  Mapgraph™ <http://www.systap.com/mapgraph> is our disruptive
> new technology to use GPUs to accelerate data-parallel graph analytics.
>
> CONFIDENTIALITY NOTICE:  This email and its contents and attachments
> are for the sole use of the intended recipient(s) and are confidential
> or proprietary to SYSTAP, LLC.  Any unauthorized review, use,
> disclosure, dissemination or copying of this email or its contents or
> attachments is prohibited. If you have received this communication in
> error, please notify the sender by reply email and permanently delete
> all copies of the email and its contents and attachments.




---
Diese E-Mail wurde von Avast Antivirus-Software auf Viren geprüft.
https://www.avast.com/antivirus