Menu
▾
▴
bigdata-developers — List for bigdata developers
This list is closed, nobody may subscribe to it.
| 2010 |
Jan
|
Feb
(19) |
Mar
(8) |
Apr
(25) |
May
(16) |
Jun
(77) |
Jul
(131) |
Aug
(76) |
Sep
(30) |
Oct
(7) |
Nov
(3) |
Dec
|
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2011 |
Jan
|
Feb
|
Mar
|
Apr
|
May
(2) |
Jun
(2) |
Jul
(16) |
Aug
(3) |
Sep
(1) |
Oct
|
Nov
(7) |
Dec
(7) |
| 2012 |
Jan
(10) |
Feb
(1) |
Mar
(8) |
Apr
(6) |
May
(1) |
Jun
(3) |
Jul
(1) |
Aug
|
Sep
(1) |
Oct
|
Nov
(8) |
Dec
(2) |
| 2013 |
Jan
(5) |
Feb
(12) |
Mar
(2) |
Apr
(1) |
May
(1) |
Jun
(1) |
Jul
(22) |
Aug
(50) |
Sep
(31) |
Oct
(64) |
Nov
(83) |
Dec
(28) |
| 2014 |
Jan
(31) |
Feb
(18) |
Mar
(27) |
Apr
(39) |
May
(45) |
Jun
(15) |
Jul
(6) |
Aug
(27) |
Sep
(6) |
Oct
(67) |
Nov
(70) |
Dec
(1) |
| 2015 |
Jan
(3) |
Feb
(18) |
Mar
(22) |
Apr
(121) |
May
(42) |
Jun
(17) |
Jul
(8) |
Aug
(11) |
Sep
(26) |
Oct
(15) |
Nov
(66) |
Dec
(38) |
| 2016 |
Jan
(14) |
Feb
(59) |
Mar
(28) |
Apr
(44) |
May
(21) |
Jun
(12) |
Jul
(9) |
Aug
(11) |
Sep
(4) |
Oct
(2) |
Nov
(1) |
Dec
|
| 2017 |
Jan
(20) |
Feb
(7) |
Mar
(4) |
Apr
(18) |
May
(7) |
Jun
(3) |
Jul
(13) |
Aug
(2) |
Sep
(4) |
Oct
(9) |
Nov
(2) |
Dec
(5) |
| 2018 |
Jan
|
Feb
|
Mar
|
Apr
(2) |
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
| 2019 |
Jan
|
Feb
|
Mar
(1) |
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
|
From: Bryan T. <br...@sy...> - 2015-04-15 14:13:19
|
The RDR specific mime types are also defined here: http://wiki.blazegraph.com/wiki/index.php/Reification_Done_Right#RDF_Data_Interchange Thanks, Bryan ---- Bryan Thompson Chief Scientist & Founder SYSTAP, LLC 4501 Tower Road Greensboro, NC 27410 br...@sy... http://blazegraph.com http://blog.bigdata.com <http://bigdata.com> http://mapgraph.io Blazegraph™ <http://www.blazegraph.com/> is our ultra high-performance graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new technology to use GPUs to accelerate data-parallel graph analytics. CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. On Wed, Apr 15, 2015 at 10:03 AM, Bryan Thompson <br...@sy...> wrote: > Max, > > I've fixed the wiki. > > The problem is the Content-Type header. I have modified the servlet to > report back the Content-Type header in the error message. > > You are probably specifying Content-Type=application/x-turtle. When I use > this value I get the same error message. > > You need to specify *application/x-turtle-RDR* per > http://wiki.blazegraph.com/wiki/index.php/NanoSparqlServer#MIME_Types > > Thanks, > Bryan > ---- > Bryan Thompson > Chief Scientist & Founder > SYSTAP, LLC > 4501 Tower Road > Greensboro, NC 27410 > br...@sy... > http://blazegraph.com > http://blog.bigdata.com <http://bigdata.com> > http://mapgraph.io > > Blazegraph™ <http://www.blazegraph.com/> is our ultra high-performance > graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints > APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new > technology to use GPUs to accelerate data-parallel graph analytics. > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are > for the sole use of the intended recipient(s) and are confidential or > proprietary to SYSTAP. Any unauthorized review, use, disclosure, > dissemination or copying of this email or its contents or attachments is > prohibited. If you have received this communication in error, please notify > the sender by reply email and permanently delete all copies of the email > and its contents and attachments. > > On Tue, Apr 14, 2015 at 10:00 PM, Max Ott <ma...@ni...> wrote: > >> Hi, >> >> I have trying to get the RDR extension working as this is the feature I'm >> most interested in. So I copied a simple statement from the web site into a >> file called 'bob.tut' >> >> @prefix : <http://bigdata.com> . >> @prefix foaf: <http://xmlns.com/foaf/0.1/> . >> >> :bob foaf:name "Bob" . >> <<:bob foaf:age 23>> dct:creator <http://example.com/crawlers#c1> ; >> dct:source <http://example.net/homepage-listing.html> >> . >> >> (BTW, the trailing dot on line 2 and ‘;’ on line 5 is missing in the wiki >> writeup). >> >> I then created a namespace “test” with RDR selected which gave me the >> following service description: >> >> …. >> <endpoint xmlns="http://www.w3.org/ns/sparql-service-description#" >> rdf:resource="http://localhost:9999/bigdata/namespace/test/sparql”/> >> … >> <feature xmlns="http://www.w3.org/ns/sparql-service-description#" >> rdf:resource="http://www.bigdata.com/rdf#/features/KB/Mode/Sids"/> >> <feature xmlns="http://www.w3.org/ns/sparql-service-description#" >> rdf:resource="http://www.bigdata.com/rdf#/features/KB/TruthMaintenance"/> >> >> If I now try to upload ‘bob’, I get the following error: >> >> $ curl -D- -H 'Content-Type: text/turtle' --upload-file bob.tut -X POST ' >> http://localhost:9999/bigdata/namespace/test/sparql/test/sparql?context-uri=http://example.org/tbox' >> >> HTTP/1.1 100 Continue >> >> HTTP/1.1 500 Server Error >> Content-Type: text/plain >> Transfer-Encoding: chunked >> Server: Jetty(9.2.3.v20140905) >> >> INSERT-WITH-BODY: baseURI= >> http://192.168.59.3:9999/bigdata/namespace/test/sparql, context-uri=[ >> http://example.org/tbox] >> java.util.concurrent.ExecutionException: >> org.openrdf.rio.RDFParseException: IRI included an unencoded space: '32' >> [line 5] >> …. >> >> Looks like the RDF parser didn’t get the memo that I’m sending RDR data, >> but I have no idea what I’m doing wrong, nor apparently what I'm doing - >> period :) >> >> Any help would be greatly appreciated. >> >> Cheers, >> -max >> >> >> >> ------------------------------------------------------------------------------ >> BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT >> Develop your own process in accordance with the BPMN 2 standard >> Learn Process modeling best practices with Bonita BPM through live >> exercises >> http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- >> event?utm_ >> source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF >> _______________________________________________ >> Bigdata-developers mailing list >> Big...@li... >> https://lists.sourceforge.net/lists/listinfo/bigdata-developers >> >> > |
|
From: Brad B. <be...@sy...> - 2015-04-15 12:30:07
|
Alex, One aspect to consider here is the ultimate scalability of your application. Currently, the HA and scale-out features are only support through integration with the REST API [1]. If you think you will need those features, then you should definitely go with the REST API. There is a Java client for that [2] that could be used in Scala with relatively little effort. You can implement Stored Queries and other features on the server-side to achieve high performance [3]. The upcoming 1.5.2 release at the end of this month will have transaction support at the REST and SAIL layers [4]. Did you have features in particular you wanted to use outside of the SAIL API? Thanks, --Brad [1] http://wiki.blazegraph.com/wiki/index.php/NanoSparqlServer#REST_API [2] http://wiki.blazegraph.com/wiki/index.php/JettyHttpClient [3] http://wiki.blazegraph.com/wiki/index.php/StoredQuery [4] http://trac.bigdata.com/ticket/1156 On Tue, Apr 14, 2015 at 7:43 PM, Alex Jouravlev < al...@bu...> wrote: > Hi everyone, > > What would be the first steps to start using bigdata in the full mode, > embedded into a scala/Lift application? I don't want to use Sesame layer > as, if I understand correctly, that would strip out a lot of interesting > features. > > <http://au.linkedin.com/in/alexjouravlev/> > > Alx > > > ------------------------------------------------------------------------------ > BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT > Develop your own process in accordance with the BPMN 2 standard > Learn Process modeling best practices with Bonita BPM through live > exercises > http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- > event?utm_ > source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF > _______________________________________________ > Bigdata-developers mailing list > Big...@li... > https://lists.sourceforge.net/lists/listinfo/bigdata-developers > > -- _______________ Brad Bebee Managing Partner SYSTAP, LLC e: be...@sy... m: 202.642.7961 f: 571.367.5000 w: www.systap.com Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new technology to use GPUs to accelerate data-parallel graph analytics. CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. |
|
From: Bryan T. <br...@sy...> - 2015-04-15 11:25:41
|
That would be the MySQL backend... There are several deployment modes referenced on http://www.blazegraph.com/download Are you are using the embedded jar? Thanks, Bryan On Wednesday, April 15, 2015, Max Ott <ma...@ni...> wrote: > Bryan, > > No idea what deployment mode I'm using. Just following the getting started > guide on the web site. Also can't access the ticket: > > OperationalError: (1030, 'Got error 28 from storage engine') > > > Cheers, > > -max > > > On Wed, Apr 15, 2015 at 8:56 PM Bryan Thompson <br...@sy... > <javascript:_e(%7B%7D,'cvml','br...@sy...');>> wrote: > >> Max, >> >> What deployment mode are you using? Do you have the log from startup >> where it lists out the registered RDF parser factories? Openrdf needs to be >> before The Blazegraph jar on the class path or the RDR parsers will get >> unregistered by openrdf. See http://trac.bigdata.com/ticket/1060. We >> hope to address this issue in 1.5.2. >> >> Thanks, >> Bryan >> >> >> On Tuesday, April 14, 2015, Max Ott <ma...@ni... >> <javascript:_e(%7B%7D,'cvml','ma...@ni...');>> wrote: >> >>> Hi, >>> >>> I have trying to get the RDR extension working as this is the feature >>> I'm most interested in. So I copied a simple statement from the web site >>> into a file called 'bob.tut' >>> >>> @prefix : <http://bigdata.com> . >>> @prefix foaf: <http://xmlns.com/foaf/0.1/> . >>> >>> :bob foaf:name "Bob" . >>> <<:bob foaf:age 23>> dct:creator <http://example.com/crawlers#c1> ; >>> dct:source < >>> http://example.net/homepage-listing.html> . >>> >>> (BTW, the trailing dot on line 2 and ‘;’ on line 5 is missing in the >>> wiki writeup). >>> >>> I then created a namespace “test” with RDR selected which gave me the >>> following service description: >>> >>> …. >>> <endpoint xmlns="http://www.w3.org/ns/sparql-service-description#" >>> rdf:resource="http://localhost:9999/bigdata/namespace/test/sparql”/> >>> … >>> <feature xmlns="http://www.w3.org/ns/sparql-service-description#" >>> rdf:resource="http://www.bigdata.com/rdf#/features/KB/Mode/Sids"/> >>> <feature xmlns="http://www.w3.org/ns/sparql-service-description#" >>> rdf:resource="http://www.bigdata.com/rdf#/features/KB/TruthMaintenance >>> "/> >>> >>> If I now try to upload ‘bob’, I get the following error: >>> >>> $ curl -D- -H 'Content-Type: text/turtle' --upload-file bob.tut -X POST ' >>> http://localhost:9999/bigdata/namespace/test/sparql/test/sparql?context-uri=http://example.org/tbox' >>> >>> HTTP/1.1 100 Continue >>> >>> HTTP/1.1 500 Server Error >>> Content-Type: text/plain >>> Transfer-Encoding: chunked >>> Server: Jetty(9.2.3.v20140905) >>> >>> INSERT-WITH-BODY: baseURI= >>> http://192.168.59.3:9999/bigdata/namespace/test/sparql, context-uri=[ >>> http://example.org/tbox] >>> java.util.concurrent.ExecutionException: >>> org.openrdf.rio.RDFParseException: IRI included an unencoded space: '32' >>> [line 5] >>> …. >>> >>> Looks like the RDF parser didn’t get the memo that I’m sending RDR data, >>> but I have no idea what I’m doing wrong, nor apparently what I'm doing - >>> period :) >>> >>> Any help would be greatly appreciated. >>> >>> Cheers, >>> -max >>> >>> >> >> -- >> ---- >> Bryan Thompson >> Chief Scientist & Founder >> SYSTAP, LLC >> 4501 Tower Road >> Greensboro, NC 27410 >> br...@sy... <javascript:_e(%7B%7D,'cvml','br...@sy...');> >> http://blazegraph.com >> http://blog.bigdata.com <http://bigdata.com> >> http://mapgraph.io >> >> Blazegraph™ <http://www.blazegraph.com/> is our ultra high-performance >> graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints >> APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new >> technology to use GPUs to accelerate data-parallel graph analytics. >> >> CONFIDENTIALITY NOTICE: This email and its contents and attachments are >> for the sole use of the intended recipient(s) and are confidential or >> proprietary to SYSTAP. Any unauthorized review, use, disclosure, >> dissemination or copying of this email or its contents or attachments is >> prohibited. If you have received this communication in error, please notify >> the sender by reply email and permanently delete all copies of the email >> and its contents and attachments. >> >> -- ---- Bryan Thompson Chief Scientist & Founder SYSTAP, LLC 4501 Tower Road Greensboro, NC 27410 br...@sy... http://blazegraph.com http://blog.bigdata.com <http://bigdata.com> http://mapgraph.io Blazegraph™ <http://www.blazegraph.com/> is our ultra high-performance graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new technology to use GPUs to accelerate data-parallel graph analytics. CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. |
|
From: Bryan T. <br...@sy...> - 2015-04-15 11:19:46
|
Max, What deployment mode are you using? Do you have the log from startup where it lists out the registered RDF parser factories? Openrdf needs to be before The Blazegraph jar on the class path or the RDR parsers will get unregistered by openrdf. See http://trac.bigdata.com/ticket/1060. We hope to address this issue in 1.5.2. Thanks, Bryan On Tuesday, April 14, 2015, Max Ott <ma...@ni...> wrote: > Hi, > > I have trying to get the RDR extension working as this is the feature I'm > most interested in. So I copied a simple statement from the web site into a > file called 'bob.tut' > > @prefix : <http://bigdata.com> . > @prefix foaf: <http://xmlns.com/foaf/0.1/> . > > :bob foaf:name "Bob" . > <<:bob foaf:age 23>> dct:creator <http://example.com/crawlers#c1> ; > dct:source <http://example.net/homepage-listing.html> > . > > (BTW, the trailing dot on line 2 and ‘;’ on line 5 is missing in the wiki > writeup). > > I then created a namespace “test” with RDR selected which gave me the > following service description: > > …. > <endpoint xmlns="http://www.w3.org/ns/sparql-service-description#" > rdf:resource="http://localhost:9999/bigdata/namespace/test/sparql”/> > … > <feature xmlns="http://www.w3.org/ns/sparql-service-description#" > rdf:resource="http://www.bigdata.com/rdf#/features/KB/Mode/Sids"/> > <feature xmlns="http://www.w3.org/ns/sparql-service-description#" > rdf:resource="http://www.bigdata.com/rdf#/features/KB/TruthMaintenance"/> > > If I now try to upload ‘bob’, I get the following error: > > $ curl -D- -H 'Content-Type: text/turtle' --upload-file bob.tut -X POST ' > http://localhost:9999/bigdata/namespace/test/sparql/test/sparql?context-uri=http://example.org/tbox' > > HTTP/1.1 100 Continue > > HTTP/1.1 500 Server Error > Content-Type: text/plain > Transfer-Encoding: chunked > Server: Jetty(9.2.3.v20140905) > > INSERT-WITH-BODY: baseURI= > http://192.168.59.3:9999/bigdata/namespace/test/sparql, context-uri=[ > http://example.org/tbox] > java.util.concurrent.ExecutionException: > org.openrdf.rio.RDFParseException: IRI included an unencoded space: '32' > [line 5] > …. > > Looks like the RDF parser didn’t get the memo that I’m sending RDR data, > but I have no idea what I’m doing wrong, nor apparently what I'm doing - > period :) > > Any help would be greatly appreciated. > > Cheers, > -max > > -- ---- Bryan Thompson Chief Scientist & Founder SYSTAP, LLC 4501 Tower Road Greensboro, NC 27410 br...@sy... http://blazegraph.com http://blog.bigdata.com <http://bigdata.com> http://mapgraph.io Blazegraph™ <http://www.blazegraph.com/> is our ultra high-performance graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new technology to use GPUs to accelerate data-parallel graph analytics. CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. |
|
From: Max O. <ma...@ni...> - 2015-04-15 11:02:12
|
Bryan, No idea what deployment mode I'm using. Just following the getting started guide on the web site. Also can't access the ticket: OperationalError: (1030, 'Got error 28 from storage engine') Cheers, -max On Wed, Apr 15, 2015 at 8:56 PM Bryan Thompson <br...@sy...> wrote: > Max, > > What deployment mode are you using? Do you have the log from startup where > it lists out the registered RDF parser factories? Openrdf needs to be > before The Blazegraph jar on the class path or the RDR parsers will get > unregistered by openrdf. See http://trac.bigdata.com/ticket/1060. We > hope to address this issue in 1.5.2. > > Thanks, > Bryan > > > On Tuesday, April 14, 2015, Max Ott <ma...@ni...> wrote: > >> Hi, >> >> I have trying to get the RDR extension working as this is the feature I'm >> most interested in. So I copied a simple statement from the web site into a >> file called 'bob.tut' >> >> @prefix : <http://bigdata.com> . >> @prefix foaf: <http://xmlns.com/foaf/0.1/> . >> >> :bob foaf:name "Bob" . >> <<:bob foaf:age 23>> dct:creator <http://example.com/crawlers#c1> ; >> dct:source <http://example.net/homepage-listing.html> >> . >> >> (BTW, the trailing dot on line 2 and ‘;’ on line 5 is missing in the wiki >> writeup). >> >> I then created a namespace “test” with RDR selected which gave me the >> following service description: >> >> …. >> <endpoint xmlns="http://www.w3.org/ns/sparql-service-description#" >> rdf:resource="http://localhost:9999/bigdata/namespace/test/sparql”/> >> … >> <feature xmlns="http://www.w3.org/ns/sparql-service-description#" >> rdf:resource="http://www.bigdata.com/rdf#/features/KB/Mode/Sids"/> >> <feature xmlns="http://www.w3.org/ns/sparql-service-description#" >> rdf:resource="http://www.bigdata.com/rdf#/features/KB/TruthMaintenance"/> >> >> If I now try to upload ‘bob’, I get the following error: >> >> $ curl -D- -H 'Content-Type: text/turtle' --upload-file bob.tut -X POST ' >> http://localhost:9999/bigdata/namespace/test/sparql/test/sparql?context-uri=http://example.org/tbox' >> >> HTTP/1.1 100 Continue >> >> HTTP/1.1 500 Server Error >> Content-Type: text/plain >> Transfer-Encoding: chunked >> Server: Jetty(9.2.3.v20140905) >> >> INSERT-WITH-BODY: baseURI= >> http://192.168.59.3:9999/bigdata/namespace/test/sparql, context-uri=[ >> http://example.org/tbox] >> java.util.concurrent.ExecutionException: >> org.openrdf.rio.RDFParseException: IRI included an unencoded space: '32' >> [line 5] >> …. >> >> Looks like the RDF parser didn’t get the memo that I’m sending RDR data, >> but I have no idea what I’m doing wrong, nor apparently what I'm doing - >> period :) >> >> Any help would be greatly appreciated. >> >> Cheers, >> -max >> >> > > -- > ---- > Bryan Thompson > Chief Scientist & Founder > SYSTAP, LLC > 4501 Tower Road > Greensboro, NC 27410 > br...@sy... > http://blazegraph.com > http://blog.bigdata.com <http://bigdata.com> > http://mapgraph.io > > Blazegraph™ <http://www.blazegraph.com/> is our ultra high-performance > graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints > APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new > technology to use GPUs to accelerate data-parallel graph analytics. > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are > for the sole use of the intended recipient(s) and are confidential or > proprietary to SYSTAP. Any unauthorized review, use, disclosure, > dissemination or copying of this email or its contents or attachments is > prohibited. If you have received this communication in error, please notify > the sender by reply email and permanently delete all copies of the email > and its contents and attachments. > > |
|
From: Max O. <ma...@ni...> - 2015-04-15 02:00:29
|
Hi, I have trying to get the RDR extension working as this is the feature I'm most interested in. So I copied a simple statement from the web site into a file called 'bob.tut' @prefix : <http://bigdata.com> . @prefix foaf: <http://xmlns.com/foaf/0.1/> . :bob foaf:name "Bob" . <<:bob foaf:age 23>> dct:creator <http://example.com/crawlers#c1> ; dct:source <http://example.net/homepage-listing.html> . (BTW, the trailing dot on line 2 and ‘;’ on line 5 is missing in the wiki writeup). I then created a namespace “test” with RDR selected which gave me the following service description: …. <endpoint xmlns="http://www.w3.org/ns/sparql-service-description#" rdf:resource="http://localhost:9999/bigdata/namespace/test/sparql”/> … <feature xmlns="http://www.w3.org/ns/sparql-service-description#" rdf:resource="http://www.bigdata.com/rdf#/features/KB/Mode/Sids"/> <feature xmlns="http://www.w3.org/ns/sparql-service-description#" rdf:resource="http://www.bigdata.com/rdf#/features/KB/TruthMaintenance"/> If I now try to upload ‘bob’, I get the following error: $ curl -D- -H 'Content-Type: text/turtle' --upload-file bob.tut -X POST ' http://localhost:9999/bigdata/namespace/test/sparql/test/sparql?context-uri=http://example.org/tbox' HTTP/1.1 100 Continue HTTP/1.1 500 Server Error Content-Type: text/plain Transfer-Encoding: chunked Server: Jetty(9.2.3.v20140905) INSERT-WITH-BODY: baseURI= http://192.168.59.3:9999/bigdata/namespace/test/sparql, context-uri=[ http://example.org/tbox] java.util.concurrent.ExecutionException: org.openrdf.rio.RDFParseException: IRI included an unencoded space: '32' [line 5] …. Looks like the RDF parser didn’t get the memo that I’m sending RDR data, but I have no idea what I’m doing wrong, nor apparently what I'm doing - period :) Any help would be greatly appreciated. Cheers, -max |
|
From: Max O. <ma...@ni...> - 2015-04-15 01:35:04
|
Great that works now. Thanks. More questions coming up in different thread.
Cheers,
-max
On Wed, Apr 15, 2015 at 4:19 AM Brad Bebee <be...@sy...> wrote:
> Max,
>
> Great to hear you're giving it a try. Please try connecting to the remote
> Blazegraph instance with this command:
>
> g = new BigdataGraphClient("http://localhost:9999/bigdata")
>
> The site's been updated as well: http://www.systap.com/blueprints. Keep
> us up-to-date with your progress.
>
> Thanks, --Brad
>
> On Mon, Apr 13, 2015 at 11:05 PM, Max Ott <ma...@ni...> wrote:
>
>> Folks,
>>
>> I have been finally getting some time to evaluate Blazegraph for a
>> project but seem to have a problem getting started. I followed the getting
>> started instructions and with both, Gremlin and Rexter I seem to run into
>> the same problem that the URL created by those two to access the server
>> (started with ant start-blazegraph).
>>
>> I'm lost to even know where to start.
>>
>> gremlin> g.loadGraphML("graph-example-1.xml")
>>
>> 18:56:20.504 [main] DEBUG org.eclipse.jetty.client.HttpClient - Created
>> HttpDestination[http://localhost:9999
>> ],queue=0,pool=ConnectionPool[c=0/64,a=0,i=0]
>>
>> 18:56:20.507 [main] DEBUG o.e.jetty.client.HttpDestination - Queued
>> HttpRequest[POST /bigdata/LBS/read/sparql/sparql HTTP/1.1]@676783d3 for
>> HttpDestination[http://localhost:9999
>> ],queue=1,pool=ConnectionPool[c=0/64,a=0,i=0]
>>
>>
>> Any suggestions on how I can debug this further?
>>
>> Session log attached.
>>
>> Cheers,
>>
>> -max
>>
>>
>>
>>
>> ------------------------------------------------------------------------------
>> BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
>> Develop your own process in accordance with the BPMN 2 standard
>> Learn Process modeling best practices with Bonita BPM through live
>> exercises
>> http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual-
>> event?utm_
>> source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF
>> _______________________________________________
>> Bigdata-developers mailing list
>> Big...@li...
>> https://lists.sourceforge.net/lists/listinfo/bigdata-developers
>>
>>
>
>
> --
> _______________
> Brad Bebee
> Managing Partner
> SYSTAP, LLC
> e: be...@sy...
> m: 202.642.7961
> f: 571.367.5000
> w: www.systap.com
>
> Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance
> graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints
> APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new
> technology to use GPUs to accelerate data-parallel graph analytics.
>
> CONFIDENTIALITY NOTICE: This email and its contents and attachments are
> for the sole use of the intended recipient(s) and are confidential or
> proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure,
> dissemination or copying of this email or its contents or attachments is
> prohibited. If you have received this communication in error, please notify
> the sender by reply email and permanently delete all copies of the email
> and its contents and attachments.
>
|
|
From: Alex J. <al...@bu...> - 2015-04-14 23:43:18
|
Hi everyone, What would be the first steps to start using bigdata in the full mode, embedded into a scala/Lift application? I don't want to use Sesame layer as, if I understand correctly, that would strip out a lot of interesting features. <http://au.linkedin.com/in/alexjouravlev/> Alx |
|
From: Brad B. <be...@sy...> - 2015-04-14 21:31:07
|
Jack, Yes, that's it! Give it a try and let us know how it turns out. Thanks, --Brad On Tue, Apr 14, 2015 at 5:27 PM, Jack Park <jac...@gm...> wrote: > That does run. > Given sparse manual prose, are you saying that by booting the jar, I can > talk to it with a remote client in the context of blueprints? > That would be pretty easy! > > On Tue, Apr 14, 2015 at 1:42 PM, Brad Bebee <be...@sy...> wrote: > >> Jack: OK -- have you tried the executable JAR [1] or is that not an >> option for you? Thanks, --Brad >> >> [1] >> http://wiki.blazegraph.com/wiki/index.php/NanoSparqlServer#Downloading_the_Executable_Jar >> >> On Tue, Apr 14, 2015 at 4:40 PM, Jack Park <jac...@gm...> wrote: >> >>> Thanks! >>> For now, the issue is getting the system to boot as a Jetty instance. >>> >>> On Tue, Apr 14, 2015 at 1:33 PM, Brad Bebee <be...@sy...> wrote: >>> >>>> Jack, >>>> >>>> Good news! Check out the Remote guide as well: >>>> http://wiki.blazegraph.com/wiki/index.php/UsingBlueprints#Using_a_Remote_Instance >>>> . >>>> >>>> Thanks, --Brad >>>> >>>> On Tue, Apr 14, 2015 at 4:20 PM, Jack Park <jac...@gm...> wrote: >>>> >>>>> My graph test now runs correctly. >>>>> New issue is making remote boot. That's another question for a >>>>> different thread. >>>>> >>>>> Many thanks! I can now start testing my algorithms against it. >>>>> >>>>> Jack >>>>> >>>>> On Tue, Apr 14, 2015 at 12:51 PM, Brad Bebee <be...@sy...> wrote: >>>>> >>>>>> Jack, >>>>>> >>>>>> Please check out >>>>>> http://wiki.blazegraph.com/wiki/index.php/UsingBlueprints#Using_Embedded_Instance. >>>>>> There is a ticket against the Factory create methods you identified [1]. >>>>>> The workaround is documented in the ticket and on the Wiki page for >>>>>> Blueprints. You should create a BigdataSail instance and then create a >>>>>> BigdataGraphEmbedded object. This is scheduled to be fixed in the 1.5.2 >>>>>> release at the end of the month. >>>>>> >>>>>> In the meantime, please let us know if this works for you. The >>>>>> 1.5.2 release will also have our first user's manual, so look out for >>>>>> improvements in that area coming soon. >>>>>> >>>>>> [1] http://trac.bigdata.com/ticket/1185 >>>>>> >>>>>> >>>>>> Thanks, --Brad >>>>>> >>>>>> On Mon, Apr 13, 2015 at 9:37 PM, Brad Bebee <be...@sy...> wrote: >>>>>> >>>>>>> Jack, >>>>>>> >>>>>>> OK -- I have replicated your error locally and am looking at a >>>>>>> work-around. >>>>>>> >>>>>>> Thanks, --Brad >>>>>>> >>>>>>> On Mon, Apr 13, 2015 at 5:50 PM, Jack Park <jac...@gm...> >>>>>>> wrote: >>>>>>> >>>>>>>> Quick review: >>>>>>>> >>>>>>>> Create an embedded repo with the code found in the blueprints test >>>>>>>> case. Essentially, copy that code directly. >>>>>>>> >>>>>>>> If there is no journal in the assigned directory, the javadoc tells >>>>>>>> me it will create one. >>>>>>>> >>>>>>>> The test case reads an XML blueprints GML file and paints the >>>>>>>> vertices and edges properly. >>>>>>>> >>>>>>>> But... >>>>>>>> It does not create the persistent repo. No journal file exists >>>>>>>> after closing. >>>>>>>> Next... >>>>>>>> hand create a journal and drop it in the assigned directory. Now, >>>>>>>> the system blows somewhere in importing the GML file. But, it did put 10 MB >>>>>>>> of stuff in the journal. >>>>>>>> >>>>>>>> It was suggested that there is a missing "properties" of some kind, >>>>>>>> specifically telling the system that the Sail must be a file type, not in >>>>>>>> memory. >>>>>>>> >>>>>>>> What follows is a naive attempt to create a system property (which, >>>>>>>> it turns out, is never read), but in any case, the result is the same. Here >>>>>>>> is that code, and narrative. >>>>>>>> >>>>>>>> File f = new File(DBPATH); >>>>>>>> System.out.println(f.getAbsolutePath()); >>>>>>>> System.setProperty(BigdataSail.Options.FILE, f.getAbsolutePath()); >>>>>>>> final BigdataGraph graph = BigdataGraphFactory.open(DBPATH, true); >>>>>>>> System.out.println("GRAPH "+graph); >>>>>>>> GraphMLReader.inputGraph(graph, example); >>>>>>>> for (Vertex v : graph.getVertices()) { >>>>>>>> System.err.println(v); >>>>>>>> } >>>>>>>> for (Edge e : graph.getEdges()) { >>>>>>>> System.err.println(e); >>>>>>>> } >>>>>>>> graph.shutdown(); >>>>>>>> >>>>>>>> I actually create an empty file at DBPATH mygraphjournal.jnl >>>>>>>> I have to believe that Sail knows about it because it explodes to >>>>>>>> 10,485,760 bytes >>>>>>>> >>>>>>>> But, it was doing that all along. >>>>>>>> Following the code, we land at >>>>>>>> BigdataSail openSail(final String file, final boolean create) >>>>>>>> >>>>>>>> which, if the file doesn't exist, and create == true, then it >>>>>>>> creates the same property internally; it's not assuming anything. That >>>>>>>> starts at BigdataSailFactory line 216 >>>>>>>> >>>>>>>> Now, below that starting at line 291: >>>>>>>> >>>>>>>> /** >>>>>>>> * Create a new bigdata instance using the specified options. >>>>>>>> Since no >>>>>>>> * journal file is specified this must be an in-memory instance. >>>>>>>> */ >>>>>>>> public static BigdataSail createSail(final String file, >>>>>>>> final Option... args) { >>>>>>>> >>>>>>>> But, that code was called from line 223 which is where the file >>>>>>>> does not exist, and create == true >>>>>>>> >>>>>>>> So, let us look at that code through my possibly distorted lens: >>>>>>>> >>>>>>>> I call BigdataSail openSail(final String file, final boolean >>>>>>>> create) { >>>>>>>> >>>>>>>> with a file path, for a file which does not yet exist. >>>>>>>> >>>>>>>> That code first asks: does the file exist? >>>>>>>> If not, then it asks is create == false; if so, toss a bitch. >>>>>>>> Otherwise, call createSail with my file path, But, that code's >>>>>>>> javadoc says "what the hell, since no journal file, let's make it >>>>>>>> in-memory". Really? Read the code, it calls >>>>>>>> createSail(final Properties props, >>>>>>>> final String file, final Option... args) >>>>>>>> with empty properties, and ignores the sent in file. >>>>>>>> >>>>>>>> How can that work? >>>>>>>> >>>>>>>> In any case, back to my situation. >>>>>>>> >>>>>>>> My read of the code calls this: >>>>>>>> BigdataSail openSail(final String file, final boolean create) >>>>>>>> >>>>>>>> arrives with a file that does exist, and create == true. >>>>>>>> So, it takes the else branch, where it creates the necessary >>>>>>>> property, just as I did, which, really, means it never actually consulted >>>>>>>> system environment properties after all, and builds a sail. >>>>>>>> >>>>>>>> Which means the event I am experiencing lies somewhere else in the >>>>>>>> flow of things., >>>>>>>> After all, it did create a sail and it wrote 10 MB of stuff in >>>>>>>> there. So, it knows what's going on, filewise. >>>>>>>> >>>>>>>> That tells me that something else is going on, having much more to >>>>>>>> do with file loading. >>>>>>>> >>>>>>>> So, now, I am hand stepping through in debug mode. I put >>>>>>>> breakpoints anywhere the code calls the graph (said code being inside the >>>>>>>> Blueprints graph reader). >>>>>>>> >>>>>>>> Always, it ends up in AbstractTripleStore.copyStatements line 3783, >>>>>>>> where it jumps into TempTripleStore to get a temporary store which it made >>>>>>>> down in my user data space, followed by jumping into a ThreadPool, and >>>>>>>> returning a future which, internally, says NotMaterializedException >>>>>>>> >>>>>>>> No present clue what's going on. >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> ------------------------------------------------------------------------------ >>>>>>>> BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT >>>>>>>> Develop your own process in accordance with the BPMN 2 standard >>>>>>>> Learn Process modeling best practices with Bonita BPM through live >>>>>>>> exercises >>>>>>>> http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- >>>>>>>> event?utm_ >>>>>>>> >>>>>>>> source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF >>>>>>>> _______________________________________________ >>>>>>>> Bigdata-developers mailing list >>>>>>>> Big...@li... >>>>>>>> https://lists.sourceforge.net/lists/listinfo/bigdata-developers >>>>>>>> >>>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> _______________ >>>>>>> Brad Bebee >>>>>>> Managing Partner >>>>>>> SYSTAP, LLC >>>>>>> e: be...@sy... >>>>>>> m: 202.642.7961 >>>>>>> f: 571.367.5000 >>>>>>> w: www.systap.com >>>>>>> >>>>>>> Blazegraph™ <http://www.blazegraph.com> is our ultra >>>>>>> high-performance graph database that supports both RDF/SPARQL and >>>>>>> Tinkerpop/Blueprints APIs. MapGraph™ >>>>>>> <http://www.systap.com/mapgraph> is our disruptive new technology >>>>>>> to use GPUs to accelerate data-parallel graph analytics. >>>>>>> >>>>>>> CONFIDENTIALITY NOTICE: This email and its contents and >>>>>>> attachments are for the sole use of the intended recipient(s) and are >>>>>>> confidential or proprietary to SYSTAP, LLC. Any unauthorized review, use, >>>>>>> disclosure, dissemination or copying of this email or its contents or >>>>>>> attachments is prohibited. If you have received this communication in >>>>>>> error, please notify the sender by reply email and permanently delete all >>>>>>> copies of the email and its contents and attachments. >>>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> _______________ >>>>>> Brad Bebee >>>>>> Managing Partner >>>>>> SYSTAP, LLC >>>>>> e: be...@sy... >>>>>> m: 202.642.7961 >>>>>> f: 571.367.5000 >>>>>> w: www.systap.com >>>>>> >>>>>> Blazegraph™ <http://www.blazegraph.com> is our ultra >>>>>> high-performance graph database that supports both RDF/SPARQL and >>>>>> Tinkerpop/Blueprints APIs. MapGraph™ >>>>>> <http://www.systap.com/mapgraph> is our disruptive new technology to >>>>>> use GPUs to accelerate data-parallel graph analytics. >>>>>> >>>>>> CONFIDENTIALITY NOTICE: This email and its contents and attachments >>>>>> are for the sole use of the intended recipient(s) and are confidential or >>>>>> proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, >>>>>> dissemination or copying of this email or its contents or attachments is >>>>>> prohibited. If you have received this communication in error, please notify >>>>>> the sender by reply email and permanently delete all copies of the email >>>>>> and its contents and attachments. >>>>>> >>>>> >>>>> >>>> >>>> >>>> -- >>>> _______________ >>>> Brad Bebee >>>> Managing Partner >>>> SYSTAP, LLC >>>> e: be...@sy... >>>> m: 202.642.7961 >>>> f: 571.367.5000 >>>> w: www.systap.com >>>> >>>> Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance >>>> graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints >>>> APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive >>>> new technology to use GPUs to accelerate data-parallel graph analytics. >>>> >>>> CONFIDENTIALITY NOTICE: This email and its contents and attachments >>>> are for the sole use of the intended recipient(s) and are confidential or >>>> proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, >>>> dissemination or copying of this email or its contents or attachments is >>>> prohibited. If you have received this communication in error, please notify >>>> the sender by reply email and permanently delete all copies of the email >>>> and its contents and attachments. >>>> >>> >>> >> >> >> -- >> _______________ >> Brad Bebee >> Managing Partner >> SYSTAP, LLC >> e: be...@sy... >> m: 202.642.7961 >> f: 571.367.5000 >> w: www.systap.com >> >> Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance >> graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints >> APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new >> technology to use GPUs to accelerate data-parallel graph analytics. >> >> CONFIDENTIALITY NOTICE: This email and its contents and attachments are >> for the sole use of the intended recipient(s) and are confidential or >> proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, >> dissemination or copying of this email or its contents or attachments is >> prohibited. If you have received this communication in error, please notify >> the sender by reply email and permanently delete all copies of the email >> and its contents and attachments. >> > > -- _______________ Brad Bebee Managing Partner SYSTAP, LLC e: be...@sy... m: 202.642.7961 f: 571.367.5000 w: www.systap.com Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new technology to use GPUs to accelerate data-parallel graph analytics. CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. |
|
From: Jack P. <jac...@gm...> - 2015-04-14 20:40:10
|
Thanks! For now, the issue is getting the system to boot as a Jetty instance. On Tue, Apr 14, 2015 at 1:33 PM, Brad Bebee <be...@sy...> wrote: > Jack, > > Good news! Check out the Remote guide as well: > http://wiki.blazegraph.com/wiki/index.php/UsingBlueprints#Using_a_Remote_Instance > . > > Thanks, --Brad > > On Tue, Apr 14, 2015 at 4:20 PM, Jack Park <jac...@gm...> wrote: > >> My graph test now runs correctly. >> New issue is making remote boot. That's another question for a different >> thread. >> >> Many thanks! I can now start testing my algorithms against it. >> >> Jack >> >> On Tue, Apr 14, 2015 at 12:51 PM, Brad Bebee <be...@sy...> wrote: >> >>> Jack, >>> >>> Please check out >>> http://wiki.blazegraph.com/wiki/index.php/UsingBlueprints#Using_Embedded_Instance. >>> There is a ticket against the Factory create methods you identified [1]. >>> The workaround is documented in the ticket and on the Wiki page for >>> Blueprints. You should create a BigdataSail instance and then create a >>> BigdataGraphEmbedded object. This is scheduled to be fixed in the 1.5.2 >>> release at the end of the month. >>> >>> In the meantime, please let us know if this works for you. The 1.5.2 >>> release will also have our first user's manual, so look out for >>> improvements in that area coming soon. >>> >>> [1] http://trac.bigdata.com/ticket/1185 >>> >>> >>> Thanks, --Brad >>> >>> On Mon, Apr 13, 2015 at 9:37 PM, Brad Bebee <be...@sy...> wrote: >>> >>>> Jack, >>>> >>>> OK -- I have replicated your error locally and am looking at a >>>> work-around. >>>> >>>> Thanks, --Brad >>>> >>>> On Mon, Apr 13, 2015 at 5:50 PM, Jack Park <jac...@gm...> wrote: >>>> >>>>> Quick review: >>>>> >>>>> Create an embedded repo with the code found in the blueprints test >>>>> case. Essentially, copy that code directly. >>>>> >>>>> If there is no journal in the assigned directory, the javadoc tells me >>>>> it will create one. >>>>> >>>>> The test case reads an XML blueprints GML file and paints the vertices >>>>> and edges properly. >>>>> >>>>> But... >>>>> It does not create the persistent repo. No journal file exists after >>>>> closing. >>>>> Next... >>>>> hand create a journal and drop it in the assigned directory. Now, the >>>>> system blows somewhere in importing the GML file. But, it did put 10 MB of >>>>> stuff in the journal. >>>>> >>>>> It was suggested that there is a missing "properties" of some kind, >>>>> specifically telling the system that the Sail must be a file type, not in >>>>> memory. >>>>> >>>>> What follows is a naive attempt to create a system property (which, it >>>>> turns out, is never read), but in any case, the result is the same. Here is >>>>> that code, and narrative. >>>>> >>>>> File f = new File(DBPATH); >>>>> System.out.println(f.getAbsolutePath()); >>>>> System.setProperty(BigdataSail.Options.FILE, f.getAbsolutePath()); >>>>> final BigdataGraph graph = BigdataGraphFactory.open(DBPATH, true); >>>>> System.out.println("GRAPH "+graph); >>>>> GraphMLReader.inputGraph(graph, example); >>>>> for (Vertex v : graph.getVertices()) { >>>>> System.err.println(v); >>>>> } >>>>> for (Edge e : graph.getEdges()) { >>>>> System.err.println(e); >>>>> } >>>>> graph.shutdown(); >>>>> >>>>> I actually create an empty file at DBPATH mygraphjournal.jnl >>>>> I have to believe that Sail knows about it because it explodes to >>>>> 10,485,760 bytes >>>>> >>>>> But, it was doing that all along. >>>>> Following the code, we land at >>>>> BigdataSail openSail(final String file, final boolean create) >>>>> >>>>> which, if the file doesn't exist, and create == true, then it creates >>>>> the same property internally; it's not assuming anything. That starts at >>>>> BigdataSailFactory line 216 >>>>> >>>>> Now, below that starting at line 291: >>>>> >>>>> /** >>>>> * Create a new bigdata instance using the specified options. >>>>> Since no >>>>> * journal file is specified this must be an in-memory instance. >>>>> */ >>>>> public static BigdataSail createSail(final String file, >>>>> final Option... args) { >>>>> >>>>> But, that code was called from line 223 which is where the file does >>>>> not exist, and create == true >>>>> >>>>> So, let us look at that code through my possibly distorted lens: >>>>> >>>>> I call BigdataSail openSail(final String file, final boolean create) { >>>>> >>>>> with a file path, for a file which does not yet exist. >>>>> >>>>> That code first asks: does the file exist? >>>>> If not, then it asks is create == false; if so, toss a bitch. >>>>> Otherwise, call createSail with my file path, But, that code's javadoc >>>>> says "what the hell, since no journal file, let's make it in-memory". >>>>> Really? Read the code, it calls >>>>> createSail(final Properties props, >>>>> final String file, final Option... args) >>>>> with empty properties, and ignores the sent in file. >>>>> >>>>> How can that work? >>>>> >>>>> In any case, back to my situation. >>>>> >>>>> My read of the code calls this: >>>>> BigdataSail openSail(final String file, final boolean create) >>>>> >>>>> arrives with a file that does exist, and create == true. >>>>> So, it takes the else branch, where it creates the necessary property, >>>>> just as I did, which, really, means it never actually consulted system >>>>> environment properties after all, and builds a sail. >>>>> >>>>> Which means the event I am experiencing lies somewhere else in the >>>>> flow of things., >>>>> After all, it did create a sail and it wrote 10 MB of stuff in there. >>>>> So, it knows what's going on, filewise. >>>>> >>>>> That tells me that something else is going on, having much more to do >>>>> with file loading. >>>>> >>>>> So, now, I am hand stepping through in debug mode. I put breakpoints >>>>> anywhere the code calls the graph (said code being inside the Blueprints >>>>> graph reader). >>>>> >>>>> Always, it ends up in AbstractTripleStore.copyStatements line 3783, >>>>> where it jumps into TempTripleStore to get a temporary store which it made >>>>> down in my user data space, followed by jumping into a ThreadPool, and >>>>> returning a future which, internally, says NotMaterializedException >>>>> >>>>> No present clue what's going on. >>>>> >>>>> >>>>> >>>>> ------------------------------------------------------------------------------ >>>>> BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT >>>>> Develop your own process in accordance with the BPMN 2 standard >>>>> Learn Process modeling best practices with Bonita BPM through live >>>>> exercises >>>>> http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- >>>>> event?utm_ >>>>> source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF >>>>> _______________________________________________ >>>>> Bigdata-developers mailing list >>>>> Big...@li... >>>>> https://lists.sourceforge.net/lists/listinfo/bigdata-developers >>>>> >>>>> >>>> >>>> >>>> -- >>>> _______________ >>>> Brad Bebee >>>> Managing Partner >>>> SYSTAP, LLC >>>> e: be...@sy... >>>> m: 202.642.7961 >>>> f: 571.367.5000 >>>> w: www.systap.com >>>> >>>> Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance >>>> graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints >>>> APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive >>>> new technology to use GPUs to accelerate data-parallel graph analytics. >>>> >>>> CONFIDENTIALITY NOTICE: This email and its contents and attachments >>>> are for the sole use of the intended recipient(s) and are confidential or >>>> proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, >>>> dissemination or copying of this email or its contents or attachments is >>>> prohibited. If you have received this communication in error, please notify >>>> the sender by reply email and permanently delete all copies of the email >>>> and its contents and attachments. >>>> >>> >>> >>> >>> -- >>> _______________ >>> Brad Bebee >>> Managing Partner >>> SYSTAP, LLC >>> e: be...@sy... >>> m: 202.642.7961 >>> f: 571.367.5000 >>> w: www.systap.com >>> >>> Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance >>> graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints >>> APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new >>> technology to use GPUs to accelerate data-parallel graph analytics. >>> >>> CONFIDENTIALITY NOTICE: This email and its contents and attachments >>> are for the sole use of the intended recipient(s) and are confidential or >>> proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, >>> dissemination or copying of this email or its contents or attachments is >>> prohibited. If you have received this communication in error, please notify >>> the sender by reply email and permanently delete all copies of the email >>> and its contents and attachments. >>> >> >> > > > -- > _______________ > Brad Bebee > Managing Partner > SYSTAP, LLC > e: be...@sy... > m: 202.642.7961 > f: 571.367.5000 > w: www.systap.com > > Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance > graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints > APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new > technology to use GPUs to accelerate data-parallel graph analytics. > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are > for the sole use of the intended recipient(s) and are confidential or > proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, > dissemination or copying of this email or its contents or attachments is > prohibited. If you have received this communication in error, please notify > the sender by reply email and permanently delete all copies of the email > and its contents and attachments. > |
|
From: Brad B. <be...@sy...> - 2015-04-14 20:33:53
|
Jack, Good news! Check out the Remote guide as well: http://wiki.blazegraph.com/wiki/index.php/UsingBlueprints#Using_a_Remote_Instance . Thanks, --Brad On Tue, Apr 14, 2015 at 4:20 PM, Jack Park <jac...@gm...> wrote: > My graph test now runs correctly. > New issue is making remote boot. That's another question for a different > thread. > > Many thanks! I can now start testing my algorithms against it. > > Jack > > On Tue, Apr 14, 2015 at 12:51 PM, Brad Bebee <be...@sy...> wrote: > >> Jack, >> >> Please check out >> http://wiki.blazegraph.com/wiki/index.php/UsingBlueprints#Using_Embedded_Instance. >> There is a ticket against the Factory create methods you identified [1]. >> The workaround is documented in the ticket and on the Wiki page for >> Blueprints. You should create a BigdataSail instance and then create a >> BigdataGraphEmbedded object. This is scheduled to be fixed in the 1.5.2 >> release at the end of the month. >> >> In the meantime, please let us know if this works for you. The 1.5.2 >> release will also have our first user's manual, so look out for >> improvements in that area coming soon. >> >> [1] http://trac.bigdata.com/ticket/1185 >> >> >> Thanks, --Brad >> >> On Mon, Apr 13, 2015 at 9:37 PM, Brad Bebee <be...@sy...> wrote: >> >>> Jack, >>> >>> OK -- I have replicated your error locally and am looking at a >>> work-around. >>> >>> Thanks, --Brad >>> >>> On Mon, Apr 13, 2015 at 5:50 PM, Jack Park <jac...@gm...> wrote: >>> >>>> Quick review: >>>> >>>> Create an embedded repo with the code found in the blueprints test >>>> case. Essentially, copy that code directly. >>>> >>>> If there is no journal in the assigned directory, the javadoc tells me >>>> it will create one. >>>> >>>> The test case reads an XML blueprints GML file and paints the vertices >>>> and edges properly. >>>> >>>> But... >>>> It does not create the persistent repo. No journal file exists after >>>> closing. >>>> Next... >>>> hand create a journal and drop it in the assigned directory. Now, the >>>> system blows somewhere in importing the GML file. But, it did put 10 MB of >>>> stuff in the journal. >>>> >>>> It was suggested that there is a missing "properties" of some kind, >>>> specifically telling the system that the Sail must be a file type, not in >>>> memory. >>>> >>>> What follows is a naive attempt to create a system property (which, it >>>> turns out, is never read), but in any case, the result is the same. Here is >>>> that code, and narrative. >>>> >>>> File f = new File(DBPATH); >>>> System.out.println(f.getAbsolutePath()); >>>> System.setProperty(BigdataSail.Options.FILE, f.getAbsolutePath()); >>>> final BigdataGraph graph = BigdataGraphFactory.open(DBPATH, true); >>>> System.out.println("GRAPH "+graph); >>>> GraphMLReader.inputGraph(graph, example); >>>> for (Vertex v : graph.getVertices()) { >>>> System.err.println(v); >>>> } >>>> for (Edge e : graph.getEdges()) { >>>> System.err.println(e); >>>> } >>>> graph.shutdown(); >>>> >>>> I actually create an empty file at DBPATH mygraphjournal.jnl >>>> I have to believe that Sail knows about it because it explodes to >>>> 10,485,760 bytes >>>> >>>> But, it was doing that all along. >>>> Following the code, we land at >>>> BigdataSail openSail(final String file, final boolean create) >>>> >>>> which, if the file doesn't exist, and create == true, then it creates >>>> the same property internally; it's not assuming anything. That starts at >>>> BigdataSailFactory line 216 >>>> >>>> Now, below that starting at line 291: >>>> >>>> /** >>>> * Create a new bigdata instance using the specified options. >>>> Since no >>>> * journal file is specified this must be an in-memory instance. >>>> */ >>>> public static BigdataSail createSail(final String file, >>>> final Option... args) { >>>> >>>> But, that code was called from line 223 which is where the file does >>>> not exist, and create == true >>>> >>>> So, let us look at that code through my possibly distorted lens: >>>> >>>> I call BigdataSail openSail(final String file, final boolean create) { >>>> >>>> with a file path, for a file which does not yet exist. >>>> >>>> That code first asks: does the file exist? >>>> If not, then it asks is create == false; if so, toss a bitch. >>>> Otherwise, call createSail with my file path, But, that code's javadoc >>>> says "what the hell, since no journal file, let's make it in-memory". >>>> Really? Read the code, it calls >>>> createSail(final Properties props, >>>> final String file, final Option... args) >>>> with empty properties, and ignores the sent in file. >>>> >>>> How can that work? >>>> >>>> In any case, back to my situation. >>>> >>>> My read of the code calls this: >>>> BigdataSail openSail(final String file, final boolean create) >>>> >>>> arrives with a file that does exist, and create == true. >>>> So, it takes the else branch, where it creates the necessary property, >>>> just as I did, which, really, means it never actually consulted system >>>> environment properties after all, and builds a sail. >>>> >>>> Which means the event I am experiencing lies somewhere else in the flow >>>> of things., >>>> After all, it did create a sail and it wrote 10 MB of stuff in there. >>>> So, it knows what's going on, filewise. >>>> >>>> That tells me that something else is going on, having much more to do >>>> with file loading. >>>> >>>> So, now, I am hand stepping through in debug mode. I put breakpoints >>>> anywhere the code calls the graph (said code being inside the Blueprints >>>> graph reader). >>>> >>>> Always, it ends up in AbstractTripleStore.copyStatements line 3783, >>>> where it jumps into TempTripleStore to get a temporary store which it made >>>> down in my user data space, followed by jumping into a ThreadPool, and >>>> returning a future which, internally, says NotMaterializedException >>>> >>>> No present clue what's going on. >>>> >>>> >>>> >>>> ------------------------------------------------------------------------------ >>>> BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT >>>> Develop your own process in accordance with the BPMN 2 standard >>>> Learn Process modeling best practices with Bonita BPM through live >>>> exercises >>>> http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- >>>> event?utm_ >>>> source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF >>>> _______________________________________________ >>>> Bigdata-developers mailing list >>>> Big...@li... >>>> https://lists.sourceforge.net/lists/listinfo/bigdata-developers >>>> >>>> >>> >>> >>> -- >>> _______________ >>> Brad Bebee >>> Managing Partner >>> SYSTAP, LLC >>> e: be...@sy... >>> m: 202.642.7961 >>> f: 571.367.5000 >>> w: www.systap.com >>> >>> Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance >>> graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints >>> APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new >>> technology to use GPUs to accelerate data-parallel graph analytics. >>> >>> CONFIDENTIALITY NOTICE: This email and its contents and attachments >>> are for the sole use of the intended recipient(s) and are confidential or >>> proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, >>> dissemination or copying of this email or its contents or attachments is >>> prohibited. If you have received this communication in error, please notify >>> the sender by reply email and permanently delete all copies of the email >>> and its contents and attachments. >>> >> >> >> >> -- >> _______________ >> Brad Bebee >> Managing Partner >> SYSTAP, LLC >> e: be...@sy... >> m: 202.642.7961 >> f: 571.367.5000 >> w: www.systap.com >> >> Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance >> graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints >> APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new >> technology to use GPUs to accelerate data-parallel graph analytics. >> >> CONFIDENTIALITY NOTICE: This email and its contents and attachments are >> for the sole use of the intended recipient(s) and are confidential or >> proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, >> dissemination or copying of this email or its contents or attachments is >> prohibited. If you have received this communication in error, please notify >> the sender by reply email and permanently delete all copies of the email >> and its contents and attachments. >> > > -- _______________ Brad Bebee Managing Partner SYSTAP, LLC e: be...@sy... m: 202.642.7961 f: 571.367.5000 w: www.systap.com Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new technology to use GPUs to accelerate data-parallel graph analytics. CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. |
|
From: Jack P. <jac...@gm...> - 2015-04-14 20:20:40
|
My graph test now runs correctly. New issue is making remote boot. That's another question for a different thread. Many thanks! I can now start testing my algorithms against it. Jack On Tue, Apr 14, 2015 at 12:51 PM, Brad Bebee <be...@sy...> wrote: > Jack, > > Please check out > http://wiki.blazegraph.com/wiki/index.php/UsingBlueprints#Using_Embedded_Instance. > There is a ticket against the Factory create methods you identified [1]. > The workaround is documented in the ticket and on the Wiki page for > Blueprints. You should create a BigdataSail instance and then create a > BigdataGraphEmbedded object. This is scheduled to be fixed in the 1.5.2 > release at the end of the month. > > In the meantime, please let us know if this works for you. The 1.5.2 > release will also have our first user's manual, so look out for > improvements in that area coming soon. > > [1] http://trac.bigdata.com/ticket/1185 > > > Thanks, --Brad > > On Mon, Apr 13, 2015 at 9:37 PM, Brad Bebee <be...@sy...> wrote: > >> Jack, >> >> OK -- I have replicated your error locally and am looking at a >> work-around. >> >> Thanks, --Brad >> >> On Mon, Apr 13, 2015 at 5:50 PM, Jack Park <jac...@gm...> wrote: >> >>> Quick review: >>> >>> Create an embedded repo with the code found in the blueprints test case. >>> Essentially, copy that code directly. >>> >>> If there is no journal in the assigned directory, the javadoc tells me >>> it will create one. >>> >>> The test case reads an XML blueprints GML file and paints the vertices >>> and edges properly. >>> >>> But... >>> It does not create the persistent repo. No journal file exists after >>> closing. >>> Next... >>> hand create a journal and drop it in the assigned directory. Now, the >>> system blows somewhere in importing the GML file. But, it did put 10 MB of >>> stuff in the journal. >>> >>> It was suggested that there is a missing "properties" of some kind, >>> specifically telling the system that the Sail must be a file type, not in >>> memory. >>> >>> What follows is a naive attempt to create a system property (which, it >>> turns out, is never read), but in any case, the result is the same. Here is >>> that code, and narrative. >>> >>> File f = new File(DBPATH); >>> System.out.println(f.getAbsolutePath()); >>> System.setProperty(BigdataSail.Options.FILE, f.getAbsolutePath()); >>> final BigdataGraph graph = BigdataGraphFactory.open(DBPATH, true); >>> System.out.println("GRAPH "+graph); >>> GraphMLReader.inputGraph(graph, example); >>> for (Vertex v : graph.getVertices()) { >>> System.err.println(v); >>> } >>> for (Edge e : graph.getEdges()) { >>> System.err.println(e); >>> } >>> graph.shutdown(); >>> >>> I actually create an empty file at DBPATH mygraphjournal.jnl >>> I have to believe that Sail knows about it because it explodes to >>> 10,485,760 bytes >>> >>> But, it was doing that all along. >>> Following the code, we land at >>> BigdataSail openSail(final String file, final boolean create) >>> >>> which, if the file doesn't exist, and create == true, then it creates >>> the same property internally; it's not assuming anything. That starts at >>> BigdataSailFactory line 216 >>> >>> Now, below that starting at line 291: >>> >>> /** >>> * Create a new bigdata instance using the specified options. Since >>> no >>> * journal file is specified this must be an in-memory instance. >>> */ >>> public static BigdataSail createSail(final String file, >>> final Option... args) { >>> >>> But, that code was called from line 223 which is where the file does not >>> exist, and create == true >>> >>> So, let us look at that code through my possibly distorted lens: >>> >>> I call BigdataSail openSail(final String file, final boolean create) { >>> >>> with a file path, for a file which does not yet exist. >>> >>> That code first asks: does the file exist? >>> If not, then it asks is create == false; if so, toss a bitch. >>> Otherwise, call createSail with my file path, But, that code's javadoc >>> says "what the hell, since no journal file, let's make it in-memory". >>> Really? Read the code, it calls >>> createSail(final Properties props, >>> final String file, final Option... args) >>> with empty properties, and ignores the sent in file. >>> >>> How can that work? >>> >>> In any case, back to my situation. >>> >>> My read of the code calls this: >>> BigdataSail openSail(final String file, final boolean create) >>> >>> arrives with a file that does exist, and create == true. >>> So, it takes the else branch, where it creates the necessary property, >>> just as I did, which, really, means it never actually consulted system >>> environment properties after all, and builds a sail. >>> >>> Which means the event I am experiencing lies somewhere else in the flow >>> of things., >>> After all, it did create a sail and it wrote 10 MB of stuff in there. >>> So, it knows what's going on, filewise. >>> >>> That tells me that something else is going on, having much more to do >>> with file loading. >>> >>> So, now, I am hand stepping through in debug mode. I put breakpoints >>> anywhere the code calls the graph (said code being inside the Blueprints >>> graph reader). >>> >>> Always, it ends up in AbstractTripleStore.copyStatements line 3783, >>> where it jumps into TempTripleStore to get a temporary store which it made >>> down in my user data space, followed by jumping into a ThreadPool, and >>> returning a future which, internally, says NotMaterializedException >>> >>> No present clue what's going on. >>> >>> >>> >>> ------------------------------------------------------------------------------ >>> BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT >>> Develop your own process in accordance with the BPMN 2 standard >>> Learn Process modeling best practices with Bonita BPM through live >>> exercises >>> http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- >>> event?utm_ >>> source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF >>> _______________________________________________ >>> Bigdata-developers mailing list >>> Big...@li... >>> https://lists.sourceforge.net/lists/listinfo/bigdata-developers >>> >>> >> >> >> -- >> _______________ >> Brad Bebee >> Managing Partner >> SYSTAP, LLC >> e: be...@sy... >> m: 202.642.7961 >> f: 571.367.5000 >> w: www.systap.com >> >> Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance >> graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints >> APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new >> technology to use GPUs to accelerate data-parallel graph analytics. >> >> CONFIDENTIALITY NOTICE: This email and its contents and attachments are >> for the sole use of the intended recipient(s) and are confidential or >> proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, >> dissemination or copying of this email or its contents or attachments is >> prohibited. If you have received this communication in error, please notify >> the sender by reply email and permanently delete all copies of the email >> and its contents and attachments. >> > > > > -- > _______________ > Brad Bebee > Managing Partner > SYSTAP, LLC > e: be...@sy... > m: 202.642.7961 > f: 571.367.5000 > w: www.systap.com > > Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance > graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints > APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new > technology to use GPUs to accelerate data-parallel graph analytics. > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are > for the sole use of the intended recipient(s) and are confidential or > proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, > dissemination or copying of this email or its contents or attachments is > prohibited. If you have received this communication in error, please notify > the sender by reply email and permanently delete all copies of the email > and its contents and attachments. > |
|
From: Brad B. <be...@sy...> - 2015-04-14 19:51:32
|
Jack, Please check out http://wiki.blazegraph.com/wiki/index.php/UsingBlueprints#Using_Embedded_Instance. There is a ticket against the Factory create methods you identified [1]. The workaround is documented in the ticket and on the Wiki page for Blueprints. You should create a BigdataSail instance and then create a BigdataGraphEmbedded object. This is scheduled to be fixed in the 1.5.2 release at the end of the month. In the meantime, please let us know if this works for you. The 1.5.2 release will also have our first user's manual, so look out for improvements in that area coming soon. [1] http://trac.bigdata.com/ticket/1185 Thanks, --Brad On Mon, Apr 13, 2015 at 9:37 PM, Brad Bebee <be...@sy...> wrote: > Jack, > > OK -- I have replicated your error locally and am looking at a work-around. > > Thanks, --Brad > > On Mon, Apr 13, 2015 at 5:50 PM, Jack Park <jac...@gm...> wrote: > >> Quick review: >> >> Create an embedded repo with the code found in the blueprints test case. >> Essentially, copy that code directly. >> >> If there is no journal in the assigned directory, the javadoc tells me it >> will create one. >> >> The test case reads an XML blueprints GML file and paints the vertices >> and edges properly. >> >> But... >> It does not create the persistent repo. No journal file exists after >> closing. >> Next... >> hand create a journal and drop it in the assigned directory. Now, the >> system blows somewhere in importing the GML file. But, it did put 10 MB of >> stuff in the journal. >> >> It was suggested that there is a missing "properties" of some kind, >> specifically telling the system that the Sail must be a file type, not in >> memory. >> >> What follows is a naive attempt to create a system property (which, it >> turns out, is never read), but in any case, the result is the same. Here is >> that code, and narrative. >> >> File f = new File(DBPATH); >> System.out.println(f.getAbsolutePath()); >> System.setProperty(BigdataSail.Options.FILE, f.getAbsolutePath()); >> final BigdataGraph graph = BigdataGraphFactory.open(DBPATH, true); >> System.out.println("GRAPH "+graph); >> GraphMLReader.inputGraph(graph, example); >> for (Vertex v : graph.getVertices()) { >> System.err.println(v); >> } >> for (Edge e : graph.getEdges()) { >> System.err.println(e); >> } >> graph.shutdown(); >> >> I actually create an empty file at DBPATH mygraphjournal.jnl >> I have to believe that Sail knows about it because it explodes to >> 10,485,760 bytes >> >> But, it was doing that all along. >> Following the code, we land at >> BigdataSail openSail(final String file, final boolean create) >> >> which, if the file doesn't exist, and create == true, then it creates the >> same property internally; it's not assuming anything. That starts at >> BigdataSailFactory line 216 >> >> Now, below that starting at line 291: >> >> /** >> * Create a new bigdata instance using the specified options. Since >> no >> * journal file is specified this must be an in-memory instance. >> */ >> public static BigdataSail createSail(final String file, >> final Option... args) { >> >> But, that code was called from line 223 which is where the file does not >> exist, and create == true >> >> So, let us look at that code through my possibly distorted lens: >> >> I call BigdataSail openSail(final String file, final boolean create) { >> >> with a file path, for a file which does not yet exist. >> >> That code first asks: does the file exist? >> If not, then it asks is create == false; if so, toss a bitch. >> Otherwise, call createSail with my file path, But, that code's javadoc >> says "what the hell, since no journal file, let's make it in-memory". >> Really? Read the code, it calls >> createSail(final Properties props, >> final String file, final Option... args) >> with empty properties, and ignores the sent in file. >> >> How can that work? >> >> In any case, back to my situation. >> >> My read of the code calls this: >> BigdataSail openSail(final String file, final boolean create) >> >> arrives with a file that does exist, and create == true. >> So, it takes the else branch, where it creates the necessary property, >> just as I did, which, really, means it never actually consulted system >> environment properties after all, and builds a sail. >> >> Which means the event I am experiencing lies somewhere else in the flow >> of things., >> After all, it did create a sail and it wrote 10 MB of stuff in there. >> So, it knows what's going on, filewise. >> >> That tells me that something else is going on, having much more to do >> with file loading. >> >> So, now, I am hand stepping through in debug mode. I put breakpoints >> anywhere the code calls the graph (said code being inside the Blueprints >> graph reader). >> >> Always, it ends up in AbstractTripleStore.copyStatements line 3783, where >> it jumps into TempTripleStore to get a temporary store which it made down >> in my user data space, followed by jumping into a ThreadPool, and returning >> a future which, internally, says NotMaterializedException >> >> No present clue what's going on. >> >> >> >> ------------------------------------------------------------------------------ >> BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT >> Develop your own process in accordance with the BPMN 2 standard >> Learn Process modeling best practices with Bonita BPM through live >> exercises >> http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- >> event?utm_ >> source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF >> _______________________________________________ >> Bigdata-developers mailing list >> Big...@li... >> https://lists.sourceforge.net/lists/listinfo/bigdata-developers >> >> > > > -- > _______________ > Brad Bebee > Managing Partner > SYSTAP, LLC > e: be...@sy... > m: 202.642.7961 > f: 571.367.5000 > w: www.systap.com > > Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance > graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints > APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new > technology to use GPUs to accelerate data-parallel graph analytics. > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are > for the sole use of the intended recipient(s) and are confidential or > proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, > dissemination or copying of this email or its contents or attachments is > prohibited. If you have received this communication in error, please notify > the sender by reply email and permanently delete all copies of the email > and its contents and attachments. > -- _______________ Brad Bebee Managing Partner SYSTAP, LLC e: be...@sy... m: 202.642.7961 f: 571.367.5000 w: www.systap.com Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new technology to use GPUs to accelerate data-parallel graph analytics. CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. |
|
From: Brad B. <be...@sy...> - 2015-04-14 18:19:46
|
Max,
Great to hear you're giving it a try. Please try connecting to the remote
Blazegraph instance with this command:
g = new BigdataGraphClient("http://localhost:9999/bigdata")
The site's been updated as well: http://www.systap.com/blueprints. Keep
us up-to-date with your progress.
Thanks, --Brad
On Mon, Apr 13, 2015 at 11:05 PM, Max Ott <ma...@ni...> wrote:
> Folks,
>
> I have been finally getting some time to evaluate Blazegraph for a project
> but seem to have a problem getting started. I followed the getting started
> instructions and with both, Gremlin and Rexter I seem to run into the same
> problem that the URL created by those two to access the server (started
> with ant start-blazegraph).
>
> I'm lost to even know where to start.
>
> gremlin> g.loadGraphML("graph-example-1.xml")
>
> 18:56:20.504 [main] DEBUG org.eclipse.jetty.client.HttpClient - Created
> HttpDestination[http://localhost:9999
> ],queue=0,pool=ConnectionPool[c=0/64,a=0,i=0]
>
> 18:56:20.507 [main] DEBUG o.e.jetty.client.HttpDestination - Queued
> HttpRequest[POST /bigdata/LBS/read/sparql/sparql HTTP/1.1]@676783d3 for
> HttpDestination[http://localhost:9999
> ],queue=1,pool=ConnectionPool[c=0/64,a=0,i=0]
>
>
> Any suggestions on how I can debug this further?
>
> Session log attached.
>
> Cheers,
>
> -max
>
>
>
>
> ------------------------------------------------------------------------------
> BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
> Develop your own process in accordance with the BPMN 2 standard
> Learn Process modeling best practices with Bonita BPM through live
> exercises
> http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual-
> event?utm_
> source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF
> _______________________________________________
> Bigdata-developers mailing list
> Big...@li...
> https://lists.sourceforge.net/lists/listinfo/bigdata-developers
>
>
--
_______________
Brad Bebee
Managing Partner
SYSTAP, LLC
e: be...@sy...
m: 202.642.7961
f: 571.367.5000
w: www.systap.com
Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance graph
database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs.
MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new technology
to use GPUs to accelerate data-parallel graph analytics.
CONFIDENTIALITY NOTICE: This email and its contents and attachments are
for the sole use of the intended recipient(s) and are confidential or
proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure,
dissemination or copying of this email or its contents or attachments is
prohibited. If you have received this communication in error, please notify
the sender by reply email and permanently delete all copies of the email
and its contents and attachments.
|
|
From: Bryan T. <br...@sy...> - 2015-04-14 18:13:07
|
Jeremy,
Thank you for that question ;-).
First, I agree. We should improve the status information for UPDATE
queries.
SPARQL UPDATE is handled by AST2BOpUpdate. The DELETE / INSERT WHERE
pattern is handled at ~ line 570. I have inlined this bit of the code
below, but I also suggest reviewing it in place. As you can see from the
comment, this requires us to run the WHERE clause once.
See below for more thoughts on this.
/*
* DELETE + INSERT.
*
* Note: The semantics of DELETE + INSERT are that the WHERE
* clause is executed once. The solutions to that need to be fed
* once through the DELETE clause. After the DELETE clause has
* been processed for all solutions to the WHERE clause, the
* INSERT clause is then processed. So, we need to materialize
* the WHERE clause results when both the DELETE clause and the
* INSERT clause are present.
*
* FIXME For large intermediate results, we would be much better
* off putting the data onto an HTree (or, better yet, a chain
* of blocks) and processing the bindings as IVs rather than
* materializing them as RDF Values (and even for small data
* sets, we would be better off avoiding materialization of the
* RDF Values and using an ASTConstructIterator which builds
* ISPOs using IVs rather than Values).
*
* Note: Unlike operations against a graph, we do NOT perform
* truth maintenance for updates against solution sets,
* therefore we could get by nicely with operations on
* IBindingSet[]s without RDF Value materialization.
*
* @see https://sourceforge.net/apps/trac/bigdata/ticket/524
* (SPARQL Cache)
*/
There is also a REST API UPDATE request that is blazegraph specific [2]
that accepts a query identifying the statements to be removed and a request
entity indicating the statements to be added. This API method uses a
streaming approach. Unfortunately, this streaming approach is not
compatible with the group commit isolation semantics introduced in 1.5.1
So, if group commit is enabled for the end point, the query results are
fully materialized before we delete anything. If group commit is NOT
enabled, there there is still a scalable code path that incrementally
deletes statements as they are materialized by the query.
So, per the comment block above we could improve performance for
DELETE/INSERT WHERE (the general case where both the DELETE and the INSERT
are specified). It would be helpful to understand why the update process
slowed down for you. I suspect that the JVM heap may have gone into
overdrive if the materialized result set was large enough. In this case,
simply writing it onto a SolutionSetStream or HTree might be enough to
provide better scaling ergonomics.
The SPARQL UPDATE handling currently operates at the SailConnection level.
This means that we are materializing the RDF Values in the result set.
This is not strictly necessary and incurs additional overhead from both
dictionary lookups and the added help impact of RDF Values over IVs.
Originally I tried to write the code at a lower level, but got bitten
several times by the specific semantics of SPARQL UPDATE and the
SailConnection. The way it is currently organized makes it significantly
easier to be correct, but it is missing some opportunities for being more
efficient. The thing is, we need to watch out for the pre-conditions which
would allow those efficiencies. For example, whether truth maintenance is
enabled for the backing triple store instance, etc.
Thanks,
Bryan
[1]
http://wiki.blazegraph.com/wiki/index.php/NanoSparqlServer#UPDATE_.28DELETE_statements_selected_by_a_QUERY_plus_INSERT_statements_from_Request_Body_using_PUT.29
----
Bryan Thompson
Chief Scientist & Founder
SYSTAP, LLC
4501 Tower Road
Greensboro, NC 27410
br...@sy...
http://blazegraph.com
http://blog.bigdata.com <http://bigdata.com>
http://mapgraph.io
Blazegraph™ <http://www.blazegraph.com/> is our ultra high-performance
graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints
APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new
technology to use GPUs to accelerate data-parallel graph analytics.
CONFIDENTIALITY NOTICE: This email and its contents and attachments are
for the sole use of the intended recipient(s) and are confidential or
proprietary to SYSTAP. Any unauthorized review, use, disclosure,
dissemination or copying of this email or its contents or attachments is
prohibited. If you have received this communication in error, please notify
the sender by reply email and permanently delete all copies of the email
and its contents and attachments.
On Tue, Apr 14, 2015 at 12:58 PM, Jeremy J Carroll <jj...@sy...> wrote:
> I found a CONSTRUCT and LOAD much more performant than a DELETE/INSERT,
> and was wondering why, and whether there is anything new (to me) about the
> blazegraph architecture that I should understand.
>
> =====
>
>
> I had a graph for which I wished to rename almost all URIs.
> The graph had about 3M triples
> I was working in AWS on
>
> I constructed a temporary graph with a rename mapping
> and then tried the following update query:
>
> DELETE {
> GRAPH <%(abox)s> {
> ?oldS ?oldP ?oldO
> }
> }
> INSERT {
> GRAPH <%(abox)s> {
> ?newS ?newP ?newO
> }
> }
> WHERE {
> graph <%(abox)s> {
> ?oldS ?oldP ?oldO
> }
> GRAPH <x-eg:temporary-graph> {
> ?oldS <x-eg:replaced-by> ?newS
> }
> GRAPH <x-eg:temporary-graph> {
> ?oldP <x-eg:replaced-by> ?newP
> }
> {
> GRAPH <x-eg:temporary-graph> {
> ?oldO <x-eg:replaced-by> ?newO
> }
> } UNION {
> graph <%(abox)s> {
> ?oldS ?oldP ?oldO
> }
> FILTER ( isLiteral(?oldO) )
> BIND ( ?oldO as ?newO )
> }
> }
>
>
>
> where <%(abox)s> is a variable
>
>
> At the point where we perform this query we have exclusive access to the
> blaze graph process.
>
> It took over 4 hours, with approx. the first hour showing some change in
> the query execution stats, and then the last 3 hours showing no change in
> the stats (the status page in the NSS display is not very useful with these
> update queries).
> After 4 hours I got bored. Cancel did not work. So I killed blazegraph and
> restarted.
>
> I then rewrote the code as follows.
>
>
> I wrote a construct query:
>
> CONSTRUCT {
> ?newS ?newP ?newO
> }
> WHERE {
> graph <%(abox)s> {
> ?oldS ?oldP ?oldO
> }
> GRAPH <x-eg:temporary-graph> {
> ?oldS <x-eg:replaced-by> ?newS
> }
> GRAPH <x-eg:temporary-graph> {
> ?oldP <x-eg:replaced-by> ?newP
> }
> {
> GRAPH <x-eg:temporary-graph> {
> ?oldO <x-eg:replaced-by> ?newO
> }
> } UNION {
> graph <%(abox)s> {
> ?oldS ?oldP ?oldO
> }
> FILTER ( isLiteral(?oldO) )
> BIND ( ?oldO as ?newO )
> }
> }
>
> this created a temporary file.
>
> I replaced the DELETE part with
>
> DROP GRAPH <%(abox)s>
>
> and the INSERT with
>
> LOAD <file://%(tmpfile)s> INTO GRAPH <%(abox)s>
>
> ====
>
>
> The rewritten code took only a few minutes (less than 5 in total)
> I was expecting some improvement, but not as much as I saw.
>
> My understanding is that each of the three operations is atomic and
> isolated, but I lost the guarantee linking the three (which I did not need
> since I had exclusive lock at a higher level).
>
> Was it the atomicity that cost so much?
>
> Jeremy
>
>
>
>
>
>
>
>
>
>
> ------------------------------------------------------------------------------
> BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
> Develop your own process in accordance with the BPMN 2 standard
> Learn Process modeling best practices with Bonita BPM through live
> exercises
> http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual-
> event?utm_
> source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF
> _______________________________________________
> Bigdata-developers mailing list
> Big...@li...
> https://lists.sourceforge.net/lists/listinfo/bigdata-developers
>
|
|
From: Jeremy J C. <jj...@sy...> - 2015-04-14 17:22:44
|
I found a CONSTRUCT and LOAD much more performant than a DELETE/INSERT, and was wondering why, and whether there is anything new (to me) about the blazegraph architecture that I should understand.
=====
I had a graph for which I wished to rename almost all URIs.
The graph had about 3M triples
I was working in AWS on
I constructed a temporary graph with a rename mapping
and then tried the following update query:
DELETE {
GRAPH <%(abox)s> {
?oldS ?oldP ?oldO
}
}
INSERT {
GRAPH <%(abox)s> {
?newS ?newP ?newO
}
}
WHERE {
graph <%(abox)s> {
?oldS ?oldP ?oldO
}
GRAPH <x-eg:temporary-graph> {
?oldS <x-eg:replaced-by> ?newS
}
GRAPH <x-eg:temporary-graph> {
?oldP <x-eg:replaced-by> ?newP
}
{
GRAPH <x-eg:temporary-graph> {
?oldO <x-eg:replaced-by> ?newO
}
} UNION {
graph <%(abox)s> {
?oldS ?oldP ?oldO
}
FILTER ( isLiteral(?oldO) )
BIND ( ?oldO as ?newO )
}
}
where <%(abox)s> is a variable
At the point where we perform this query we have exclusive access to the blaze graph process.
It took over 4 hours, with approx. the first hour showing some change in the query execution stats, and then the last 3 hours showing no change in the stats (the status page in the NSS display is not very useful with these update queries).
After 4 hours I got bored. Cancel did not work. So I killed blazegraph and restarted.
I then rewrote the code as follows.
I wrote a construct query:
CONSTRUCT {
?newS ?newP ?newO
}
WHERE {
graph <%(abox)s> {
?oldS ?oldP ?oldO
}
GRAPH <x-eg:temporary-graph> {
?oldS <x-eg:replaced-by> ?newS
}
GRAPH <x-eg:temporary-graph> {
?oldP <x-eg:replaced-by> ?newP
}
{
GRAPH <x-eg:temporary-graph> {
?oldO <x-eg:replaced-by> ?newO
}
} UNION {
graph <%(abox)s> {
?oldS ?oldP ?oldO
}
FILTER ( isLiteral(?oldO) )
BIND ( ?oldO as ?newO )
}
}
this created a temporary file.
I replaced the DELETE part with
DROP GRAPH <%(abox)s>
and the INSERT with
LOAD <file://%(tmpfile)s> INTO GRAPH <%(abox)s>
====
The rewritten code took only a few minutes (less than 5 in total)
I was expecting some improvement, but not as much as I saw.
My understanding is that each of the three operations is atomic and isolated, but I lost the guarantee linking the three (which I did not need since I had exclusive lock at a higher level).
Was it the atomicity that cost so much?
Jeremy
|
|
From: Nikolas E. <ni...@gm...> - 2015-04-14 16:45:23
|
I didn't! I suspect sourceforge isn't emailing me. I'll have a look at it this afternoon. Nik On Tue, Apr 14, 2015 at 12:29 PM, Bryan Thompson <br...@sy...> wrote: > Nik, > > Did you see the feedback on that merge request? > > Thanks, > Bryan > > ---- > Bryan Thompson > Chief Scientist & Founder > SYSTAP, LLC > 4501 Tower Road > Greensboro, NC 27410 > br...@sy... > http://blazegraph.com > http://blog.bigdata.com <http://bigdata.com> > http://mapgraph.io > > Blazegraph™ <http://www.blazegraph.com/> is our ultra high-performance > graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints > APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new > technology to use GPUs to accelerate data-parallel graph analytics. > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are > for the sole use of the intended recipient(s) and are confidential or > proprietary to SYSTAP. Any unauthorized review, use, disclosure, > dissemination or copying of this email or its contents or attachments is > prohibited. If you have received this communication in error, please notify > the sender by reply email and permanently delete all copies of the email > and its contents and attachments. > > On Mon, Apr 13, 2015 at 11:09 AM, Nikolas Everett <ni...@gm...> > wrote: > >> I filed 1179 <http://trac.bigdata.com/ticket/1179#ticket> a couple of >> days ago and got together a patch this morning then read >> http://wiki.blazegraph.com/wiki/index.php/Contributors and saw that I >> should email here about it. So here goes: >> >> I want inline URIs to have the same power that inline values do. Right >> now inline values can be modified on the way into and out of the index. >> Inline URIs can only be modified on the way into the index. That leaves you >> pretty limited in what you can represent with them. Its OK if you can >> design the URI scheme around the limitation but we can't. >> >> I've put my patch as a gist >> <https://gist.github.com/nik9000/1dc5248f6035349ca2c1> and I've created >> a "merge request" >> <https://sourceforge.net/p/bigdata/git/merge-requests/1/> for it. It >> gives the InlineURIHandler that built the inline URI a crack at building >> the localName from the inlined value. The cost is an extra HashMap lookup >> whenever the uri is un-inlined and the default behavior is unchanged. It >> doesn't change the on disk representation either. >> >> Nik >> >> >> >> ------------------------------------------------------------------------------ >> BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT >> Develop your own process in accordance with the BPMN 2 standard >> Learn Process modeling best practices with Bonita BPM through live >> exercises >> http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- >> event?utm_ >> source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF >> _______________________________________________ >> Bigdata-developers mailing list >> Big...@li... >> https://lists.sourceforge.net/lists/listinfo/bigdata-developers >> >> > |
|
From: Bryan T. <br...@sy...> - 2015-04-14 16:29:41
|
Nik, Did you see the feedback on that merge request? Thanks, Bryan ---- Bryan Thompson Chief Scientist & Founder SYSTAP, LLC 4501 Tower Road Greensboro, NC 27410 br...@sy... http://blazegraph.com http://blog.bigdata.com <http://bigdata.com> http://mapgraph.io Blazegraph™ <http://www.blazegraph.com/> is our ultra high-performance graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new technology to use GPUs to accelerate data-parallel graph analytics. CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. On Mon, Apr 13, 2015 at 11:09 AM, Nikolas Everett <ni...@gm...> wrote: > I filed 1179 <http://trac.bigdata.com/ticket/1179#ticket> a couple of > days ago and got together a patch this morning then read > http://wiki.blazegraph.com/wiki/index.php/Contributors and saw that I > should email here about it. So here goes: > > I want inline URIs to have the same power that inline values do. Right > now inline values can be modified on the way into and out of the index. > Inline URIs can only be modified on the way into the index. That leaves you > pretty limited in what you can represent with them. Its OK if you can > design the URI scheme around the limitation but we can't. > > I've put my patch as a gist > <https://gist.github.com/nik9000/1dc5248f6035349ca2c1> and I've created a "merge > request" <https://sourceforge.net/p/bigdata/git/merge-requests/1/> for > it. It gives the InlineURIHandler that built the inline URI a crack at > building the localName from the inlined value. The cost is an extra > HashMap lookup whenever the uri is un-inlined and the default behavior is > unchanged. It doesn't change the on disk representation either. > > Nik > > > > ------------------------------------------------------------------------------ > BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT > Develop your own process in accordance with the BPMN 2 standard > Learn Process modeling best practices with Bonita BPM through live > exercises > http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- > event?utm_ > source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF > _______________________________________________ > Bigdata-developers mailing list > Big...@li... > https://lists.sourceforge.net/lists/listinfo/bigdata-developers > > |
|
From: Max O. <ma...@ni...> - 2015-04-14 03:05:25
|
Folks,
I have been finally getting some time to evaluate Blazegraph for a project
but seem to have a problem getting started. I followed the getting started
instructions and with both, Gremlin and Rexter I seem to run into the same
problem that the URL created by those two to access the server (started
with ant start-blazegraph).
I'm lost to even know where to start.
gremlin> g.loadGraphML("graph-example-1.xml")
18:56:20.504 [main] DEBUG org.eclipse.jetty.client.HttpClient - Created
HttpDestination[http://localhost:9999
],queue=0,pool=ConnectionPool[c=0/64,a=0,i=0]
18:56:20.507 [main] DEBUG o.e.jetty.client.HttpDestination - Queued
HttpRequest[POST /bigdata/LBS/read/sparql/sparql HTTP/1.1]@676783d3 for
HttpDestination[http://localhost:9999
],queue=1,pool=ConnectionPool[c=0/64,a=0,i=0]
Any suggestions on how I can debug this further?
Session log attached.
Cheers,
-max
|
|
From: Brad B. <be...@sy...> - 2015-04-14 01:37:59
|
Jack,
OK -- I have replicated your error locally and am looking at a work-around.
Thanks, --Brad
On Mon, Apr 13, 2015 at 5:50 PM, Jack Park <jac...@gm...> wrote:
> Quick review:
>
> Create an embedded repo with the code found in the blueprints test case.
> Essentially, copy that code directly.
>
> If there is no journal in the assigned directory, the javadoc tells me it
> will create one.
>
> The test case reads an XML blueprints GML file and paints the vertices and
> edges properly.
>
> But...
> It does not create the persistent repo. No journal file exists after
> closing.
> Next...
> hand create a journal and drop it in the assigned directory. Now, the
> system blows somewhere in importing the GML file. But, it did put 10 MB of
> stuff in the journal.
>
> It was suggested that there is a missing "properties" of some kind,
> specifically telling the system that the Sail must be a file type, not in
> memory.
>
> What follows is a naive attempt to create a system property (which, it
> turns out, is never read), but in any case, the result is the same. Here is
> that code, and narrative.
>
> File f = new File(DBPATH);
> System.out.println(f.getAbsolutePath());
> System.setProperty(BigdataSail.Options.FILE, f.getAbsolutePath());
> final BigdataGraph graph = BigdataGraphFactory.open(DBPATH, true);
> System.out.println("GRAPH "+graph);
> GraphMLReader.inputGraph(graph, example);
> for (Vertex v : graph.getVertices()) {
> System.err.println(v);
> }
> for (Edge e : graph.getEdges()) {
> System.err.println(e);
> }
> graph.shutdown();
>
> I actually create an empty file at DBPATH mygraphjournal.jnl
> I have to believe that Sail knows about it because it explodes to
> 10,485,760 bytes
>
> But, it was doing that all along.
> Following the code, we land at
> BigdataSail openSail(final String file, final boolean create)
>
> which, if the file doesn't exist, and create == true, then it creates the
> same property internally; it's not assuming anything. That starts at
> BigdataSailFactory line 216
>
> Now, below that starting at line 291:
>
> /**
> * Create a new bigdata instance using the specified options. Since no
> * journal file is specified this must be an in-memory instance.
> */
> public static BigdataSail createSail(final String file,
> final Option... args) {
>
> But, that code was called from line 223 which is where the file does not
> exist, and create == true
>
> So, let us look at that code through my possibly distorted lens:
>
> I call BigdataSail openSail(final String file, final boolean create) {
>
> with a file path, for a file which does not yet exist.
>
> That code first asks: does the file exist?
> If not, then it asks is create == false; if so, toss a bitch.
> Otherwise, call createSail with my file path, But, that code's javadoc
> says "what the hell, since no journal file, let's make it in-memory".
> Really? Read the code, it calls
> createSail(final Properties props,
> final String file, final Option... args)
> with empty properties, and ignores the sent in file.
>
> How can that work?
>
> In any case, back to my situation.
>
> My read of the code calls this:
> BigdataSail openSail(final String file, final boolean create)
>
> arrives with a file that does exist, and create == true.
> So, it takes the else branch, where it creates the necessary property,
> just as I did, which, really, means it never actually consulted system
> environment properties after all, and builds a sail.
>
> Which means the event I am experiencing lies somewhere else in the flow of
> things.,
> After all, it did create a sail and it wrote 10 MB of stuff in there. So,
> it knows what's going on, filewise.
>
> That tells me that something else is going on, having much more to do with
> file loading.
>
> So, now, I am hand stepping through in debug mode. I put breakpoints
> anywhere the code calls the graph (said code being inside the Blueprints
> graph reader).
>
> Always, it ends up in AbstractTripleStore.copyStatements line 3783, where
> it jumps into TempTripleStore to get a temporary store which it made down
> in my user data space, followed by jumping into a ThreadPool, and returning
> a future which, internally, says NotMaterializedException
>
> No present clue what's going on.
>
>
>
> ------------------------------------------------------------------------------
> BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
> Develop your own process in accordance with the BPMN 2 standard
> Learn Process modeling best practices with Bonita BPM through live
> exercises
> http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual-
> event?utm_
> source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF
> _______________________________________________
> Bigdata-developers mailing list
> Big...@li...
> https://lists.sourceforge.net/lists/listinfo/bigdata-developers
>
>
--
_______________
Brad Bebee
Managing Partner
SYSTAP, LLC
e: be...@sy...
m: 202.642.7961
f: 571.367.5000
w: www.systap.com
Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance graph
database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs.
MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new technology
to use GPUs to accelerate data-parallel graph analytics.
CONFIDENTIALITY NOTICE: This email and its contents and attachments are
for the sole use of the intended recipient(s) and are confidential or
proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure,
dissemination or copying of this email or its contents or attachments is
prohibited. If you have received this communication in error, please notify
the sender by reply email and permanently delete all copies of the email
and its contents and attachments.
|
|
From: Jack P. <jac...@gm...> - 2015-04-13 21:50:51
|
Quick review:
Create an embedded repo with the code found in the blueprints test case.
Essentially, copy that code directly.
If there is no journal in the assigned directory, the javadoc tells me it
will create one.
The test case reads an XML blueprints GML file and paints the vertices and
edges properly.
But...
It does not create the persistent repo. No journal file exists after
closing.
Next...
hand create a journal and drop it in the assigned directory. Now, the
system blows somewhere in importing the GML file. But, it did put 10 MB of
stuff in the journal.
It was suggested that there is a missing "properties" of some kind,
specifically telling the system that the Sail must be a file type, not in
memory.
What follows is a naive attempt to create a system property (which, it
turns out, is never read), but in any case, the result is the same. Here is
that code, and narrative.
File f = new File(DBPATH);
System.out.println(f.getAbsolutePath());
System.setProperty(BigdataSail.Options.FILE, f.getAbsolutePath());
final BigdataGraph graph = BigdataGraphFactory.open(DBPATH, true);
System.out.println("GRAPH "+graph);
GraphMLReader.inputGraph(graph, example);
for (Vertex v : graph.getVertices()) {
System.err.println(v);
}
for (Edge e : graph.getEdges()) {
System.err.println(e);
}
graph.shutdown();
I actually create an empty file at DBPATH mygraphjournal.jnl
I have to believe that Sail knows about it because it explodes to
10,485,760 bytes
But, it was doing that all along.
Following the code, we land at
BigdataSail openSail(final String file, final boolean create)
which, if the file doesn't exist, and create == true, then it creates the
same property internally; it's not assuming anything. That starts at
BigdataSailFactory line 216
Now, below that starting at line 291:
/**
* Create a new bigdata instance using the specified options. Since no
* journal file is specified this must be an in-memory instance.
*/
public static BigdataSail createSail(final String file,
final Option... args) {
But, that code was called from line 223 which is where the file does not
exist, and create == true
So, let us look at that code through my possibly distorted lens:
I call BigdataSail openSail(final String file, final boolean create) {
with a file path, for a file which does not yet exist.
That code first asks: does the file exist?
If not, then it asks is create == false; if so, toss a bitch.
Otherwise, call createSail with my file path, But, that code's javadoc says
"what the hell, since no journal file, let's make it in-memory". Really?
Read the code, it calls
createSail(final Properties props,
final String file, final Option... args)
with empty properties, and ignores the sent in file.
How can that work?
In any case, back to my situation.
My read of the code calls this:
BigdataSail openSail(final String file, final boolean create)
arrives with a file that does exist, and create == true.
So, it takes the else branch, where it creates the necessary property, just
as I did, which, really, means it never actually consulted system
environment properties after all, and builds a sail.
Which means the event I am experiencing lies somewhere else in the flow of
things.,
After all, it did create a sail and it wrote 10 MB of stuff in there. So,
it knows what's going on, filewise.
That tells me that something else is going on, having much more to do with
file loading.
So, now, I am hand stepping through in debug mode. I put breakpoints
anywhere the code calls the graph (said code being inside the Blueprints
graph reader).
Always, it ends up in AbstractTripleStore.copyStatements line 3783, where
it jumps into TempTripleStore to get a temporary store which it made down
in my user data space, followed by jumping into a ThreadPool, and returning
a future which, internally, says NotMaterializedException
No present clue what's going on.
|
|
From: Bryan T. <br...@sy...> - 2015-04-13 18:58:55
|
Jack, It would help to have the specific properties used to create the journal and the abstract triple store instance. Personally I am a big fan of unit tests in terms of a repeatable setup that demonstrates a given problem. Thanks, Bryan On Monday, April 13, 2015, Jack Park <jac...@gm...> wrote: > I dropped into debug mode and put a breakpoint at AbstractTripleStore line > 3787 > futures = getIndexManager().getExecutorService().invokeAll( > tasks); > Stepping over that, futures is an arraylist size 2 > > line 3790 elapsed_SPO = futures.get(0).get(); > is to fetch from the first element, but it is a FutureTask with callable = > null > > No clue (yet) why that should be so. > > On Mon, Apr 13, 2015 at 6:41 AM, Mike Personick <mi...@sy... > <javascript:_e(%7B%7D,'cvml','mi...@sy...');>> wrote: > >> Thanks, I'll take a look at it. >> >> --- >> Mike Personick >> Managing Partner >> Systap, LLC >> www.systap.com >> 801-243-3678 >> skype: mike.personick >> >> On Sun, Apr 12, 2015 at 11:17 AM, Jack Park <jac...@gm... >> <javascript:_e(%7B%7D,'cvml','jac...@gm...');>> wrote: >> >>> I created a gist here: >>> https://gist.github.com/KnowledgeGarden/87ac9991cafc69d179e1 >>> >>> The gist shows two bodies of code: >>> >>> My embedded driver code; rather spartan, but something to get started, >>> by copying code found on the web and in blueprints unit tests. >>> >>> My test code, copied from blueprints unit tests, which loads one of the >>> simple blueprinits properties graphs and prints the vertex and edge lists. >>> >>> Included is the output trace of the first test, which shows that it >>> does, indeed, load the graph and print. But, no journal document is >>> created; the data folder is empty. >>> >>> Included below that is the output trace where I hand-created the >>> journal. It promptly ballooned to 10,240kb, which, I presume, means that a >>> graph was loading into it along with other stuff, but it crashed apparently >>> while doing the graph import. The link into my code points to this line: >>> >>> GraphMLReader.inputGraph(graph, example); >>> >>> It is simply not clear to me what is going on here. >>> >>> Thanks in advance for some ideas. >>> >>> Jack >>> >>> >>> ------------------------------------------------------------------------------ >>> BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT >>> Develop your own process in accordance with the BPMN 2 standard >>> Learn Process modeling best practices with Bonita BPM through live >>> exercises >>> http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- >>> event?utm_ >>> source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF >>> _______________________________________________ >>> Bigdata-developers mailing list >>> Big...@li... >>> <javascript:_e(%7B%7D,'cvml','Big...@li...');> >>> https://lists.sourceforge.net/lists/listinfo/bigdata-developers >>> >>> >> > -- ---- Bryan Thompson Chief Scientist & Founder SYSTAP, LLC 4501 Tower Road Greensboro, NC 27410 br...@sy... http://blazegraph.com http://blog.bigdata.com <http://bigdata.com> http://mapgraph.io Blazegraph™ <http://www.blazegraph.com/> is our ultra high-performance graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new technology to use GPUs to accelerate data-parallel graph analytics. CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. |
|
From: Jack P. <jac...@gm...> - 2015-04-13 18:46:14
|
I dropped into debug mode and put a breakpoint at AbstractTripleStore line
3787
futures = getIndexManager().getExecutorService().invokeAll(
tasks);
Stepping over that, futures is an arraylist size 2
line 3790 elapsed_SPO = futures.get(0).get();
is to fetch from the first element, but it is a FutureTask with callable =
null
No clue (yet) why that should be so.
On Mon, Apr 13, 2015 at 6:41 AM, Mike Personick <mi...@sy...> wrote:
> Thanks, I'll take a look at it.
>
> ---
> Mike Personick
> Managing Partner
> Systap, LLC
> www.systap.com
> 801-243-3678
> skype: mike.personick
>
> On Sun, Apr 12, 2015 at 11:17 AM, Jack Park <jac...@gm...> wrote:
>
>> I created a gist here:
>> https://gist.github.com/KnowledgeGarden/87ac9991cafc69d179e1
>>
>> The gist shows two bodies of code:
>>
>> My embedded driver code; rather spartan, but something to get started, by
>> copying code found on the web and in blueprints unit tests.
>>
>> My test code, copied from blueprints unit tests, which loads one of the
>> simple blueprinits properties graphs and prints the vertex and edge lists.
>>
>> Included is the output trace of the first test, which shows that it does,
>> indeed, load the graph and print. But, no journal document is created; the
>> data folder is empty.
>>
>> Included below that is the output trace where I hand-created the journal.
>> It promptly ballooned to 10,240kb, which, I presume, means that a graph was
>> loading into it along with other stuff, but it crashed apparently while
>> doing the graph import. The link into my code points to this line:
>>
>> GraphMLReader.inputGraph(graph, example);
>>
>> It is simply not clear to me what is going on here.
>>
>> Thanks in advance for some ideas.
>>
>> Jack
>>
>>
>> ------------------------------------------------------------------------------
>> BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
>> Develop your own process in accordance with the BPMN 2 standard
>> Learn Process modeling best practices with Bonita BPM through live
>> exercises
>> http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual-
>> event?utm_
>> source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF
>> _______________________________________________
>> Bigdata-developers mailing list
>> Big...@li...
>> https://lists.sourceforge.net/lists/listinfo/bigdata-developers
>>
>>
>
|
|
From: Bryan T. <br...@sy...> - 2015-04-13 15:40:48
|
Nik, I will take a look at this shortly. I am in and out of the office a bit this afternoon, but hopefully I can look at it today. Thanks, Bryan ---- Bryan Thompson Chief Scientist & Founder SYSTAP, LLC 4501 Tower Road Greensboro, NC 27410 br...@sy... http://blazegraph.com http://blog.bigdata.com <http://bigdata.com> http://mapgraph.io Blazegraph™ <http://www.blazegraph.com/> is our ultra high-performance graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new technology to use GPUs to accelerate data-parallel graph analytics. CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. On Mon, Apr 13, 2015 at 11:09 AM, Nikolas Everett <ni...@gm...> wrote: > I filed 1179 <http://trac.bigdata.com/ticket/1179#ticket> a couple of > days ago and got together a patch this morning then read > http://wiki.blazegraph.com/wiki/index.php/Contributors and saw that I > should email here about it. So here goes: > > I want inline URIs to have the same power that inline values do. Right > now inline values can be modified on the way into and out of the index. > Inline URIs can only be modified on the way into the index. That leaves you > pretty limited in what you can represent with them. Its OK if you can > design the URI scheme around the limitation but we can't. > > I've put my patch as a gist > <https://gist.github.com/nik9000/1dc5248f6035349ca2c1> and I've created a "merge > request" <https://sourceforge.net/p/bigdata/git/merge-requests/1/> for > it. It gives the InlineURIHandler that built the inline URI a crack at > building the localName from the inlined value. The cost is an extra > HashMap lookup whenever the uri is un-inlined and the default behavior is > unchanged. It doesn't change the on disk representation either. > > Nik > > > > ------------------------------------------------------------------------------ > BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT > Develop your own process in accordance with the BPMN 2 standard > Learn Process modeling best practices with Bonita BPM through live > exercises > http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- > event?utm_ > source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF > _______________________________________________ > Bigdata-developers mailing list > Big...@li... > https://lists.sourceforge.net/lists/listinfo/bigdata-developers > > |
|
From: Nikolas E. <ni...@gm...> - 2015-04-13 15:09:36
|
I filed 1179 <http://trac.bigdata.com/ticket/1179#ticket> a couple of days ago and got together a patch this morning then read http://wiki.blazegraph.com/wiki/index.php/Contributors and saw that I should email here about it. So here goes: I want inline URIs to have the same power that inline values do. Right now inline values can be modified on the way into and out of the index. Inline URIs can only be modified on the way into the index. That leaves you pretty limited in what you can represent with them. Its OK if you can design the URI scheme around the limitation but we can't. I've put my patch as a gist <https://gist.github.com/nik9000/1dc5248f6035349ca2c1> and I've created a "merge request" <https://sourceforge.net/p/bigdata/git/merge-requests/1/> for it. It gives the InlineURIHandler that built the inline URI a crack at building the localName from the inlined value. The cost is an extra HashMap lookup whenever the uri is un-inlined and the default behavior is unchanged. It doesn't change the on disk representation either. Nik |
27 messages has been excluded from this view by a project administrator.
