bigdata-developers — List for bigdata developers

[Bigdata-developers] GAS model and least common subsumers

[Jim B. <ba...@ne...>]

I would like to obtain the set of least common subsumers of two RDF nodes along some transitive property. For example for two given OWL classes, I want to obtain the set of common superclasses along rdfs:subClassOf of those two classes that aren’t themselves superclasses of any common superclasses of those two classes. My class hierarchy is a DAG but not a tree, so there can be more than one most specific shared super class.

Just to be clear although it might be obvious:
Nurse subClassOf MedicalProfessional
MaleNurse subClassOf Nurse
MaleNurse subClassOf MalePerson
FemaleNurse subClassOf Nurse
FemaleNurse subClassOf FemalePerson
Doctor subClassOf MedicalProfessional
FemaleDoctor subClassOf FemalePerson
MalePerson subClassOf Person
FemalePerson subClassOf Person

Results for various pairs:
(FemaleNurse, FemaleDoctor) => MedicalProfessional, FemalePerson
(MaleNurse, FemaleDoctor) => MedicalProfessional, Person
(MaleNurse, FemaleNurse) => Nurse, Person

I can do this with SPARQL using multiple property paths and FILTER but it is pretty slow on our complete dataset where we have some really deep hierarchies. I have been wondering whether it is possible to apply Gather Apply Scatter to this, but I find it hard to wrap my head around that abstraction, I just keep thinking in terms of SPARQL queries. So before I really try to figure it out I thought I would just ask if it sounds like the sort of question that would benefit from a GAS algorithm. We have an application where we need to do many of these lookups so it would be great to somehow speed that up with MapGraph, maybe after testing with the RDF GAS API.

A related question: for the right problem, are there cases where the RDF GAS API would be faster than equivalent SPARQL queries?

Thank you,
Jim

Re: [Bigdata-developers] filter not exists lookups?

[Stas M. <sma...@wi...>]

Hi!

> prefix wdt: <http://www.wikidata.org/prop/direct/>
> prefix entity: <http://www.wikidata.org/entity/>
> SELECT ?item WHERE {
>  ?item wdt:P31 entity:Q5 .
>  OPTIONAL { ?item wdt:P18 ?dummy0 }
>  FILTER(!bound(?dummy0))
> } limit 5

Works excellent! Thanks a lot, I didn't know that way of doing it.
-- 
Stas Malyshev
sma...@wi...

Re: [Bigdata-developers] filter not exists lookups?

[Michael S. <ms...@me...>]

Stas,

thanks for reporting, I’ll open a ticket. The problem is that FILTER NOT EXISTS is translated using a blocking (hash join) operator, so the query plan cannot pipeline through the first five results early on. There are a couple of optimisation approaches we’ve recently discussed that could help rewriting this into a more efficient plan. 

One thing you can do as a workaround is the “old-fashioned” SPARQL OPTIONAL + FILTER + !bound construct for expressing negation:

prefix wdt: <http://www.wikidata.org/prop/direct/>
prefix entity: <http://www.wikidata.org/entity/>
SELECT ?item WHERE {
 ?item wdt:P31 entity:Q5 .
 OPTIONAL { ?item wdt:P18 ?dummy0 }
 FILTER(!bound(?dummy0))
} limit 5

This gives you a fully pipelined plan and runs amazingly fast :).

Best,
Michael


> On 29 May 2015, at 21:27, Stas Malyshev <sma...@wi...> wrote:
> 
> Hi!
> 
> I am trying to run a query which does a lookup for non-existing links,
> specifically:
> 
> prefix wdt: <http://www.wikidata.org/prop/direct/>
> prefix entity: <http://www.wikidata.org/entity/>
> SELECT ?item WHERE {
>  ?item wdt:P31 entity:Q5 .
>  FILTER NOT EXISTS { ?item wdt:P18 ?dummy0 }
> } limit 5
> 
> This tries to find all items with link to wdt:P31->entity:Q5 that lack
> wdt:P18 predicate. The first line has a lot of matches (about 2.7
> millions) and a lot of them do have wdt:P18 predicate. So the query is
> slow. My question is - can it be imporved? The reverse query - i.e.
> items having both wdt:P31 and  wdt:P18 - is very fast, since I assume it
> uses indexes. But for the negative one looks like it doesn't. Can
> anything be done to improve it?
> 
> -- 
> Stas Malyshev
> sma...@wi...
> 
> ------------------------------------------------------------------------------
> _______________________________________________
> Bigdata-developers mailing list
> Big...@li...
> https://lists.sourceforge.net/lists/listinfo/bigdata-developers

[Bigdata-developers] filter not exists lookups?

[Stas M. <sma...@wi...>]

Hi!

I am trying to run a query which does a lookup for non-existing links,
specifically:

prefix wdt: <http://www.wikidata.org/prop/direct/>
prefix entity: <http://www.wikidata.org/entity/>
SELECT ?item WHERE {
  ?item wdt:P31 entity:Q5 .
  FILTER NOT EXISTS { ?item wdt:P18 ?dummy0 }
} limit 5

This tries to find all items with link to wdt:P31->entity:Q5 that lack
wdt:P18 predicate. The first line has a lot of matches (about 2.7
millions) and a lot of them do have wdt:P18 predicate. So the query is
slow. My question is - can it be imporved? The reverse query - i.e.
items having both wdt:P31 and  wdt:P18 - is very fast, since I assume it
uses indexes. But for the negative one looks like it doesn't. Can
anything be done to improve it?

-- 
Stas Malyshev
sma...@wi...

Re: [Bigdata-developers] SWRL support

[Michael S. <ms...@me...>]

Alex,

sure, I understand — it would ease maintainability, but also when implemented properly at DB level complex inferencing would not be free of (performance) costs. However, afaik there’s currently no SWRL support built-in. 

One option might be to use external reasoners (loading the data in memory), see for instance this recent discussion thread here: http://sourceforge.net/p/bigdata/mailman/message/34073626/ <http://sourceforge.net/p/bigdata/mailman/message/34073626/>. The feasibility of this approach might depend on your use case/requirements, of course. 

Maybe Bryan has other ideas on how to best approach your use case.

Best,
Michael 


> On 26 May 2015, at 07:51, Alex Jouravlev <al...@bu...> wrote:
> 
> Michael,
> 
> The same way you can render OWL redundant - it can also be replaced with Sparql updates. 
> 
> However there is a massive advantage in relying on reasoning happening behind the scene as opposite to generating and inserting inferred triples now and then. You bet more maintainable, intelligent solution. 
> 
> Regards,
> 
> Alex
> 
> On Tuesday, May 26, 2015, Michael Schmidt <ms...@me... <mailto:ms...@me...>> wrote:
> Dear Alex,
> 
> is there anything that speaks against SPARQL UPDATE?
> 
> - http://www.w3.org/TR/sparql11-update/ <http://www.w3.org/TR/sparql11-update/>
> - http://wiki.blazegraph.com/wiki/index.php/SPARQL_Update <http://wiki.blazegraph.com/wiki/index.php/SPARQL_Update>
> 
> If I understand your scenario right, your UPDATE query  (untested!) might look something like:
> 
> INSERT
> {
>   ?from :myNewObjectProperty ?to
> }
> WHERE
> {
>    ?node :from ?from .
>    ?node :to ?to .
>    ?node :dType "givenValue" .
> }
> 
> This query would insert an edge "?from :myNewObjectProperty ?to” whenever there exists a node satisfying the condition (you may need to take care of multivalued properties).
> 
> Best,
> Michael
> 
>> On 25 May 2015, at 23:19, Alex Jouravlev <al...@bu... <javascript:_e(%7B%7D,'cvml','al...@bu...');>> wrote:
>> 
>> Hi guys,
>> 
>> Do you know if Blazegraph supports SWRL? 
>> 
>> If not, would be the best way to approach the following:
>> 
>> I have a node that have object properties "from" and "to" and data properties "dType". I need to derive an object property pointing from "from" object to "to" object when the value of "dType" is equal to given.
>> 
>> Thank you
>> Alex Jouravlev
>>  <>Director, Business Abstraction Pty Ltd 
>> Phone:       +61-(2)-8003-4830
>> Mobile:     +61-4-0408-3258
>> Web: http://www.businessabstraction.com <http://www.businessabstraction.com/>
>> LinkedIn: http://au.linkedin.com/in/alexjouravlev/ <http://au.linkedin.com/in/alexjouravlev/>
>> ------------------------------------------------------------------------------
>> One dashboard for servers and applications across Physical-Virtual-Cloud 
>> Widest out-of-the-box monitoring support with 50+ applications
>> Performance metrics, stats and reports that give you Actionable Insights
>> Deep dive visibility with transaction tracing using APM Insight.
>> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y_______________________________________________ <http://ad.doubleclick.net/ddm/clk/290420510;117567292;y_______________________________________________>
>> Bigdata-developers mailing list
>> Big...@li... <javascript:_e(%7B%7D,'cvml','Big...@li...');>
>> https://lists.sourceforge.net/lists/listinfo/bigdata-developers <https://lists.sourceforge.net/lists/listinfo/bigdata-developers>
> 
> 
> 
> -- 
> Alex Jouravlev
>  <>Director, Business Abstraction Pty Ltd 
> Phone:       +61-(2)-8003-4830
> Mobile:     +61-4-0408-3258
> Web: http://www.businessabstraction.com <http://www.businessabstraction.com/>
> LinkedIn: http://au.linkedin.com/in/alexjouravlev/ <http://au.linkedin.com/in/alexjouravlev/>
> 

Re: [Bigdata-developers] SWRL support

[Michael S. <ms...@me...>]

Dear Alex,

is there anything that speaks against SPARQL UPDATE?

- http://www.w3.org/TR/sparql11-update/ <http://www.w3.org/TR/sparql11-update/>
- http://wiki.blazegraph.com/wiki/index.php/SPARQL_Update <http://wiki.blazegraph.com/wiki/index.php/SPARQL_Update>

If I understand your scenario right, your UPDATE query  (untested!) might look something like:

INSERT
{
  ?from :myNewObjectProperty ?to
}
WHERE
{
   ?node :from ?from .
   ?node :to ?to .
   ?node :dType "givenValue" .
}

This query would insert an edge "?from :myNewObjectProperty ?to” whenever there exists a node satisfying the condition (you may need to take care of multivalued properties).

Best,
Michael

> On 25 May 2015, at 23:19, Alex Jouravlev <al...@bu...> wrote:
> 
> Hi guys,
> 
> Do you know if Blazegraph supports SWRL? 
> 
> If not, would be the best way to approach the following:
> 
> I have a node that have object properties "from" and "to" and data properties "dType". I need to derive an object property pointing from "from" object to "to" object when the value of "dType" is equal to given.
> 
> Thank you
> Alex Jouravlev
>  <>Director, Business Abstraction Pty Ltd 
> Phone:       +61-(2)-8003-4830
> Mobile:     +61-4-0408-3258
> Web: http://www.businessabstraction.com <http://www.businessabstraction.com/>
> LinkedIn: http://au.linkedin.com/in/alexjouravlev/ <http://au.linkedin.com/in/alexjouravlev/>
> ------------------------------------------------------------------------------
> One dashboard for servers and applications across Physical-Virtual-Cloud 
> Widest out-of-the-box monitoring support with 50+ applications
> Performance metrics, stats and reports that give you Actionable Insights
> Deep dive visibility with transaction tracing using APM Insight.
> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y_______________________________________________
> Bigdata-developers mailing list
> Big...@li...
> https://lists.sourceforge.net/lists/listinfo/bigdata-developers

Re: [Bigdata-developers] SWRL support

[Alex J. <al...@bu...>]

Michael,

The same way you can render OWL redundant - it can also be replaced with
Sparql updates.

However there is a massive advantage in relying on reasoning happening
behind the scene as opposite to generating and inserting inferred triples
now and then. You bet more maintainable, intelligent solution.

Regards,

Alex

On Tuesday, May 26, 2015, Michael Schmidt <ms...@me...> wrote:

> Dear Alex,
>
> is there anything that speaks against SPARQL UPDATE?
>
> - http://www.w3.org/TR/sparql11-update/
> - http://wiki.blazegraph.com/wiki/index.php/SPARQL_Update
>
> If I understand your scenario right, your UPDATE query  (untested!) might
> look something like:
>
> INSERT
> {
>   ?from :myNewObjectProperty ?to
> }
> WHERE
> {
>    ?node :from ?from .
>    ?node :to ?to .
>    ?node :dType "givenValue" .
> }
>
> This query would insert an edge "?from :myNewObjectProperty ?to” whenever
> there exists a node satisfying the condition (you may need to take care of
> multivalued properties).
>
> Best,
> Michael
>
> On 25 May 2015, at 23:19, Alex Jouravlev <al...@bu...
> <javascript:_e(%7B%7D,'cvml','al...@bu...');>> wrote:
>
> Hi guys,
>
> Do you know if Blazegraph supports SWRL?
>
> If not, would be the best way to approach the following:
>
> I have a node that have object properties "from" and "to" and data
> properties "dType". I need to derive an object property pointing from
> "from" object to "to" object when the value of "dType" is equal to given.
>
> Thank you
>
> Alex Jouravlev
> Director, Business Abstraction Pty Ltd
> Phone:       +61-(2)-8003-4830
> Mobile:     +61-4-0408-3258
> Web: http://www.businessabstraction.com
> LinkedIn: http://au.linkedin.com/in/alexjouravlev/
>
> ------------------------------------------------------------------------------
> One dashboard for servers and applications across Physical-Virtual-Cloud
> Widest out-of-the-box monitoring support with 50+ applications
> Performance metrics, stats and reports that give you Actionable Insights
> Deep dive visibility with transaction tracing using APM Insight.
>
> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y_______________________________________________
> Bigdata-developers mailing list
> Big...@li...
> <javascript:_e(%7B%7D,'cvml','Big...@li...');>
> https://lists.sourceforge.net/lists/listinfo/bigdata-developers
>
>
>

-- 

Alex Jouravlev
Director, Business Abstraction Pty Ltd
Phone:       +61-(2)-8003-4830
Mobile:     +61-4-0408-3258
Web: http://www.businessabstraction.com
LinkedIn: http://au.linkedin.com/in/alexjouravlev/

[Bigdata-developers] SWRL support

[Alex J. <al...@bu...>]

Hi guys,

Do you know if Blazegraph supports SWRL?

If not, would be the best way to approach the following:

I have a node that have object properties "from" and "to" and data
properties "dType". I need to derive an object property pointing from
"from" object to "to" object when the value of "dType" is equal to given.

Thank you

Alex Jouravlev
Director, Business Abstraction Pty Ltd
Phone:       +61-(2)-8003-4830
Mobile:     +61-4-0408-3258
Web: http://www.businessabstraction.com
LinkedIn: http://au.linkedin.com/in/alexjouravlev/

[Bigdata-developers] Trac Updated with New JIRA Links

[Brad B. <be...@sy...>]

Blazegraphers,

The legacy Trac issue tracking system has been updated with a link to the
corresponding issue in JIRA.

See the most recent comment in http://trac.blazegraph.com/ticket/1104 as an
example.

http://blog.blazegraph.com/?p=894

Thanks, --Brad


-- 
_______________
Brad Bebee
Managing Partner
SYSTAP, LLC
e:  be...@sy...
m: 202.642.7961
f:  571.367.5000
w:  www.systap.com

Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance graph
database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs.
MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new technology
to use GPUs to accelerate data-parallel graph analytics.

CONFIDENTIALITY NOTICE:  This email and its contents and attachments are
for the sole use of the intended recipient(s) and are confidential or
proprietary to SYSTAP, LLC.  Any unauthorized review, use, disclosure,
dissemination or copying of this email or its contents or attachments is
prohibited. If you have received this communication in error, please notify
the sender by reply email and permanently delete all copies of the email
and its contents and attachments.

Re: [Bigdata-developers] Working with prefixes/namespaces

[Brad B. <be...@sy...>]

Alex,

Yes, check out http://wiki.blazegraph.com/wiki/index.php/InlineIVs.  You
can achieve significant performance improvements with Inline values.

Thanks, --Brad

On Mon, May 18, 2015 at 1:17 AM, Alex Jouravlev <
al...@bu...> wrote:

> Actually, internally you call XML/RDF Namespaces "Vocabularies". I
> understand they are quite important - the Wikimedia people were very happy
> about them and cited as Blazegraph advantage. However I could not find much
> documentation.
>
> Alex
>
>
> On Sunday, May 10, 2015, Alex Jouravlev <al...@bu...>
> wrote:
>
>> When you open the console, the series of dropdowns on the top right is
>> called "namespace shortcuts"
>>
>> Yes, they are Sparql/RDF/XML namespaces.
>>
>> Alex
>>
>> Alex Jouravlev
>> Director, Business Abstraction Pty Ltd
>> Phone:       +61-(2)-8003-4830
>> Mobile:     +61-4-0408-3258
>> Web: http://www.businessabstraction.com
>> LinkedIn: http://au.linkedin.com/in/alexjouravlev/
>>
>> On Sun, May 10, 2015 at 7:56 AM, Bryan Thompson <br...@sy...> wrote:
>>
>>> Alex,
>>>
>>> I am not sure which shortcuts you are referring to.  Are you discussing
>>> the PREFIX declarations used in SPARQL? Or the manner in which the
>>> namespaces of the different triple or quad store instances are mapped onto
>>> URLs?
>>>
>>> Thanks,
>>> Bryan
>>>
>>>
>>> On Saturday, May 9, 2015, Alex Jouravlev <al...@bu...>
>>> wrote:
>>>
>>>> Hi Brad,
>>>>
>>>> Thank you for that.
>>>>
>>>> I was actually asking about namespace shortcuts in Bigdata terms. Are
>>>> they defined in DB or in a client only?
>>>>
>>>> Alex
>>>>
>>>> Alex Jouravlev
>>>> Director, Business Abstraction Pty Ltd
>>>> Phone:       +61-(2)-8003-4830
>>>> Mobile:     +61-4-0408-3258
>>>> Web: http://www.businessabstraction.com
>>>> LinkedIn: http://au.linkedin.com/in/alexjouravlev/
>>>>
>>>> On Sat, May 9, 2015 at 11:19 PM, Brad Bebee <be...@sy...> wrote:
>>>>
>>>>> Alex,
>>>>>
>>>>> The namespace abstraction allows you to host multiple knowledge bases,
>>>>> each of which having potentially different configuration options (triples,
>>>>> RDR, inference, quads, etc.), in a single Blazegraph server instance.
>>>>> Here's some of the configuration options  [1].  There is a default
>>>>> namespace ("kb"), which is used if no namespace is specified in the SPARQL
>>>>> endpoint.  In the example below [A] and [B] are equivalent.  [A] uses the
>>>>> default namespace.  [C] specifies using the "biology" namespace.
>>>>>
>>>>> [A] http://localhost:9999/bigdata/sparql
>>>>>
>>>>> [B] http://localhost:9999/bigdata/namespace/kb/sparql
>>>>>
>>>>> [C] http://localhost:9999/bigdata/namespace/biology/sparql
>>>>>
>>>>> Thanks, --Brad
>>>>>
>>>>> [1]
>>>>> http://wiki.blazegraph.com/wiki/index.php/GettingStarted#So_how_do_I_put_the_database_in_triple_store_versus_quad_store_mode.3F
>>>>>
>>>>> On Sat, May 9, 2015 at 1:20 AM, Alex Jouravlev <
>>>>> al...@bu...> wrote:
>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> I cannot understand what can I do with the namespace prefixes. Should
>>>>>> I supply them with any invocation?
>>>>>> Does Bigdata store them?
>>>>>> When supplying new triples/quads, should I convert namespaces to
>>>>>> fully qualified names?
>>>>>>
>>>>>> Alex Jouravlev
>>>>>> Director, Business Abstraction Pty Ltd
>>>>>> Phone:       +61-(2)-8003-4830
>>>>>> Mobile:     +61-4-0408-3258
>>>>>> Web: http://www.businessabstraction.com
>>>>>> LinkedIn: http://au.linkedin.com/in/alexjouravlev/
>>>>>>
>>>>>>
>>>>>> ------------------------------------------------------------------------------
>>>>>> One dashboard for servers and applications across
>>>>>> Physical-Virtual-Cloud
>>>>>> Widest out-of-the-box monitoring support with 50+ applications
>>>>>> Performance metrics, stats and reports that give you Actionable
>>>>>> Insights
>>>>>> Deep dive visibility with transaction tracing using APM Insight.
>>>>>> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
>>>>>> _______________________________________________
>>>>>> Bigdata-developers mailing list
>>>>>> Big...@li...
>>>>>> https://lists.sourceforge.net/lists/listinfo/bigdata-developers
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> _______________
>>>>> Brad Bebee
>>>>> Managing Partner
>>>>> SYSTAP, LLC
>>>>> e:  be...@sy...
>>>>> m: 202.642.7961
>>>>> f:  571.367.5000
>>>>> w:  www.systap.com
>>>>>
>>>>> Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance
>>>>> graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints
>>>>> APIs.  MapGraph™ <http://www.systap.com/mapgraph> is our disruptive
>>>>> new technology to use GPUs to accelerate data-parallel graph analytics.
>>>>>
>>>>> CONFIDENTIALITY NOTICE:  This email and its contents and attachments
>>>>> are for the sole use of the intended recipient(s) and are confidential or
>>>>> proprietary to SYSTAP, LLC.  Any unauthorized review, use, disclosure,
>>>>> dissemination or copying of this email or its contents or attachments is
>>>>> prohibited. If you have received this communication in error, please notify
>>>>> the sender by reply email and permanently delete all copies of the email
>>>>> and its contents and attachments.
>>>>>
>>>>
>>>>
>>>
>>> --
>>> ----
>>> Bryan Thompson
>>> Chief Scientist & Founder
>>> SYSTAP, LLC
>>> 4501 Tower Road
>>> Greensboro, NC 27410
>>> br...@sy...
>>> http://blazegraph.com
>>> http://blog.bigdata.com <http://bigdata.com>
>>> http://mapgraph.io
>>>
>>> Blazegraph™ <http://www.blazegraph.com/> is our ultra high-performance
>>> graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints
>>> APIs.  MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new
>>> technology to use GPUs to accelerate data-parallel graph analytics.
>>>
>>> CONFIDENTIALITY NOTICE:  This email and its contents and attachments
>>> are for the sole use of the intended recipient(s) and are confidential or
>>> proprietary to SYSTAP. Any unauthorized review, use, disclosure,
>>> dissemination or copying of this email or its contents or attachments is
>>> prohibited. If you have received this communication in error, please notify
>>> the sender by reply email and permanently delete all copies of the email
>>> and its contents and attachments.
>>>
>>>
>>
>
> --
>
> Alex Jouravlev
> Director, Business Abstraction Pty Ltd
> Phone:       +61-(2)-8003-4830
> Mobile:     +61-4-0408-3258
> Web: http://www.businessabstraction.com
> LinkedIn: http://au.linkedin.com/in/alexjouravlev/
>
>


-- 
_______________
Brad Bebee
Managing Partner
SYSTAP, LLC
e:  be...@sy...
m: 202.642.7961
f:  571.367.5000
w:  www.systap.com

Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance graph
database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs.
MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new technology
to use GPUs to accelerate data-parallel graph analytics.

CONFIDENTIALITY NOTICE:  This email and its contents and attachments are
for the sole use of the intended recipient(s) and are confidential or
proprietary to SYSTAP, LLC.  Any unauthorized review, use, disclosure,
dissemination or copying of this email or its contents or attachments is
prohibited. If you have received this communication in error, please notify
the sender by reply email and permanently delete all copies of the email
and its contents and attachments.

Re: [Bigdata-developers] Working with prefixes/namespaces

[Alex J. <al...@bu...>]

Actually, internally you call XML/RDF Namespaces "Vocabularies". I
understand they are quite important - the Wikimedia people were very happy
about them and cited as Blazegraph advantage. However I could not find much
documentation.

Alex

On Sunday, May 10, 2015, Alex Jouravlev <al...@bu...>
wrote:

> When you open the console, the series of dropdowns on the top right is
> called "namespace shortcuts"
>
> Yes, they are Sparql/RDF/XML namespaces.
>
> Alex
>
> Alex Jouravlev
> Director, Business Abstraction Pty Ltd
> Phone:       +61-(2)-8003-4830
> Mobile:     +61-4-0408-3258
> Web: http://www.businessabstraction.com
> LinkedIn: http://au.linkedin.com/in/alexjouravlev/
>
> On Sun, May 10, 2015 at 7:56 AM, Bryan Thompson <br...@sy...
> <javascript:_e(%7B%7D,'cvml','br...@sy...');>> wrote:
>
>> Alex,
>>
>> I am not sure which shortcuts you are referring to.  Are you discussing
>> the PREFIX declarations used in SPARQL? Or the manner in which the
>> namespaces of the different triple or quad store instances are mapped onto
>> URLs?
>>
>> Thanks,
>> Bryan
>>
>>
>> On Saturday, May 9, 2015, Alex Jouravlev <al...@bu...
>> <javascript:_e(%7B%7D,'cvml','al...@bu...');>> wrote:
>>
>>> Hi Brad,
>>>
>>> Thank you for that.
>>>
>>> I was actually asking about namespace shortcuts in Bigdata terms. Are
>>> they defined in DB or in a client only?
>>>
>>> Alex
>>>
>>> Alex Jouravlev
>>> Director, Business Abstraction Pty Ltd
>>> Phone:       +61-(2)-8003-4830
>>> Mobile:     +61-4-0408-3258
>>> Web: http://www.businessabstraction.com
>>> LinkedIn: http://au.linkedin.com/in/alexjouravlev/
>>>
>>> On Sat, May 9, 2015 at 11:19 PM, Brad Bebee <be...@sy...> wrote:
>>>
>>>> Alex,
>>>>
>>>> The namespace abstraction allows you to host multiple knowledge bases,
>>>> each of which having potentially different configuration options (triples,
>>>> RDR, inference, quads, etc.), in a single Blazegraph server instance.
>>>> Here's some of the configuration options  [1].  There is a default
>>>> namespace ("kb"), which is used if no namespace is specified in the SPARQL
>>>> endpoint.  In the example below [A] and [B] are equivalent.  [A] uses the
>>>> default namespace.  [C] specifies using the "biology" namespace.
>>>>
>>>> [A] http://localhost:9999/bigdata/sparql
>>>>
>>>> [B] http://localhost:9999/bigdata/namespace/kb/sparql
>>>>
>>>> [C] http://localhost:9999/bigdata/namespace/biology/sparql
>>>>
>>>> Thanks, --Brad
>>>>
>>>> [1]
>>>> http://wiki.blazegraph.com/wiki/index.php/GettingStarted#So_how_do_I_put_the_database_in_triple_store_versus_quad_store_mode.3F
>>>>
>>>> On Sat, May 9, 2015 at 1:20 AM, Alex Jouravlev <
>>>> al...@bu...> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> I cannot understand what can I do with the namespace prefixes. Should
>>>>> I supply them with any invocation?
>>>>> Does Bigdata store them?
>>>>> When supplying new triples/quads, should I convert namespaces to fully
>>>>> qualified names?
>>>>>
>>>>> Alex Jouravlev
>>>>> Director, Business Abstraction Pty Ltd
>>>>> Phone:       +61-(2)-8003-4830
>>>>> Mobile:     +61-4-0408-3258
>>>>> Web: http://www.businessabstraction.com
>>>>> LinkedIn: http://au.linkedin.com/in/alexjouravlev/
>>>>>
>>>>>
>>>>> ------------------------------------------------------------------------------
>>>>> One dashboard for servers and applications across
>>>>> Physical-Virtual-Cloud
>>>>> Widest out-of-the-box monitoring support with 50+ applications
>>>>> Performance metrics, stats and reports that give you Actionable
>>>>> Insights
>>>>> Deep dive visibility with transaction tracing using APM Insight.
>>>>> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
>>>>> _______________________________________________
>>>>> Bigdata-developers mailing list
>>>>> Big...@li...
>>>>> https://lists.sourceforge.net/lists/listinfo/bigdata-developers
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> _______________
>>>> Brad Bebee
>>>> Managing Partner
>>>> SYSTAP, LLC
>>>> e:  be...@sy...
>>>> m: 202.642.7961
>>>> f:  571.367.5000
>>>> w:  www.systap.com
>>>>
>>>> Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance
>>>> graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints
>>>> APIs.  MapGraph™ <http://www.systap.com/mapgraph> is our disruptive
>>>> new technology to use GPUs to accelerate data-parallel graph analytics.
>>>>
>>>> CONFIDENTIALITY NOTICE:  This email and its contents and attachments
>>>> are for the sole use of the intended recipient(s) and are confidential or
>>>> proprietary to SYSTAP, LLC.  Any unauthorized review, use, disclosure,
>>>> dissemination or copying of this email or its contents or attachments is
>>>> prohibited. If you have received this communication in error, please notify
>>>> the sender by reply email and permanently delete all copies of the email
>>>> and its contents and attachments.
>>>>
>>>
>>>
>>
>> --
>> ----
>> Bryan Thompson
>> Chief Scientist & Founder
>> SYSTAP, LLC
>> 4501 Tower Road
>> Greensboro, NC 27410
>> br...@sy... <javascript:_e(%7B%7D,'cvml','br...@sy...');>
>> http://blazegraph.com
>> http://blog.bigdata.com <http://bigdata.com>
>> http://mapgraph.io
>>
>> Blazegraph™ <http://www.blazegraph.com/> is our ultra high-performance
>> graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints
>> APIs.  MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new
>> technology to use GPUs to accelerate data-parallel graph analytics.
>>
>> CONFIDENTIALITY NOTICE:  This email and its contents and attachments are
>> for the sole use of the intended recipient(s) and are confidential or
>> proprietary to SYSTAP. Any unauthorized review, use, disclosure,
>> dissemination or copying of this email or its contents or attachments is
>> prohibited. If you have received this communication in error, please notify
>> the sender by reply email and permanently delete all copies of the email
>> and its contents and attachments.
>>
>>
>

-- 

Alex Jouravlev
Director, Business Abstraction Pty Ltd
Phone:       +61-(2)-8003-4830
Mobile:     +61-4-0408-3258
Web: http://www.businessabstraction.com
LinkedIn: http://au.linkedin.com/in/alexjouravlev/

Re: [Bigdata-developers] Query projections and multiple VALUES clauses

[Brad B. <be...@sy...>]

Bryan, Blazegraphers,

git clone -b BLZG48and50 --single-branch git://git.code.sf.net/p/bigdata/git
BLZG48nd50

Cheers, --Brad

On Fri, May 15, 2015 at 1:21 PM, Bryan Thompson <br...@sy...> wrote:

> Brad, can you publish that branch on Sourceforge git so people can play
> with it?
>
> Thanks,
> Bryan
> ----
> Bryan Thompson
> Chief Scientist & Founder
> SYSTAP, LLC
> 4501 Tower Road
> Greensboro, NC 27410
> br...@sy...
> http://blazegraph.com
> http://blog.bigdata.com
> http://mapgraph.io
>
> Blazegraph™ is our ultra high-performance graph database that supports
> both RDF/SPARQL and Tinkerpop/Blueprints APIs.  MapGraph™ is our
> disruptive new technology to use GPUs to accelerate data-parallel
> graph analytics.
>
> CONFIDENTIALITY NOTICE:  This email and its contents and attachments
> are for the sole use of the intended recipient(s) and are confidential
> or proprietary to SYSTAP. Any unauthorized review, use, disclosure,
> dissemination or copying of this email or its contents or attachments
> is prohibited. If you have received this communication in error,
> please notify the sender by reply email and permanently delete all
> copies of the email and its contents and attachments.
>
>
> On Fri, May 15, 2015 at 1:20 PM, Michael Schmidt <ms...@me...>
> wrote:
> > Dear Lee,
> >
> > thanks for reporting the two issues!
> >
> > We have identified the problems causing the behavior (see my comment in
> the
> > parent task http://jira.blazegraph.com/browse/BLZG-1141). A correctness
> fix
> > for both issues is available in branch BLZG48and50, however the fix might
> > induce some performance regressions. We want to look at performance in
> more
> > depth before merging into master (probably as part of a more exhaustive
> > refactoring), so it might take a while until this will appear in master.
> >
> > Best,
> > Michael
> >
> >
> > On 13 May 2015, at 16:06, Bryan Thompson <br...@sy...> wrote:
> >
> > Lee,
> >
> > Many thanks. I will assign them to Michael (Cc) to take an initial look.
> >
> > Thanks,
> > Bryan
> > ----
> > Bryan Thompson
> > Chief Scientist & Founder
> > SYSTAP, LLC
> > 4501 Tower Road
> > Greensboro, NC 27410
> > br...@sy...
> > http://blazegraph.com
> > http://blog.bigdata.com
> > http://mapgraph.io
> >
> > Blazegraph™ is our ultra high-performance graph database that supports
> > both RDF/SPARQL and Tinkerpop/Blueprints APIs.  MapGraph™ is our
> > disruptive new technology to use GPUs to accelerate data-parallel
> > graph analytics.
> >
> > CONFIDENTIALITY NOTICE:  This email and its contents and attachments
> > are for the sole use of the intended recipient(s) and are confidential
> > or proprietary to SYSTAP. Any unauthorized review, use, disclosure,
> > dissemination or copying of this email or its contents or attachments
> > is prohibited. If you have received this communication in error,
> > please notify the sender by reply email and permanently delete all
> > copies of the email and its contents and attachments.
> >
> >
> > On Wed, May 13, 2015 at 10:03 AM, Lee Kitching <le...@sw...> wrote:
> >
> > Hi Bryan,
> >
> > I've raised these at http://jira.blazegraph.com/browse/BLZG-48 and
> > http://jira.blazegraph.com/browse/BLZG-50.
> >
> > Thanks
> >
> > On Wed, May 13, 2015 at 12:41 PM, Bryan Thompson <br...@sy...>
> wrote:
> >
> >
> > Lee,
> >
> > These definitely look like bugs.  Can you please file tickets at
> > http://jira.blazegraph.com and include sample data and expected
> > solutions for each?  We will try to get the fixes into the 1.5.2
> > release.
> >
> > Thanks,
> > Bryan
> > ----
> > Bryan Thompson
> > Chief Scientist & Founder
> > SYSTAP, LLC
> > 4501 Tower Road
> > Greensboro, NC 27410
> > br...@sy...
> > http://blazegraph.com
> > http://blog.bigdata.com
> > http://mapgraph.io
> >
> > Blazegraph™ is our ultra high-performance graph database that supports
> > both RDF/SPARQL and Tinkerpop/Blueprints APIs.  MapGraph™ is our
> > disruptive new technology to use GPUs to accelerate data-parallel
> > graph analytics.
> >
> > CONFIDENTIALITY NOTICE:  This email and its contents and attachments
> > are for the sole use of the intended recipient(s) and are confidential
> > or proprietary to SYSTAP. Any unauthorized review, use, disclosure,
> > dissemination or copying of this email or its contents or attachments
> > is prohibited. If you have received this communication in error,
> > please notify the sender by reply email and permanently delete all
> > copies of the email and its contents and attachments.
> >
> >
> > On Wed, May 13, 2015 at 6:51 AM, Lee Kitching <le...@sw...> wrote:
> >
> > Hi,
> >
> > We are trying to migrate our native Sesame database to Blazegraph,
> > however
> > we are encountering a problem with the following query which returns no
> > results in Blazegraph:
> >
> > SELECT DISTINCT ?uri WHERE {
> >  {
> >    SELECT DISTINCT (?uri_d as ?uri) WHERE {
> >      VALUES ?type { <http://type1> <http://type2> <http://type3> }
> >      VALUES ?dg { <http://graph1> }
> >      GRAPH ?dg { ?uri_d a ?type . }
> >    }
> >  }
> >  MINUS
> >  {
> >    SELECT DISTINCT (?uri_l as ?uri) WHERE {
> >    VALUES ?type { <http://type1> <http://type2> <http://type3> }
> >    VALUES ?lg { <http://graph2> }
> >    GRAPH ?lg { ?uri_l a ?type . }
> >    }
> >  }
> > }
> >
> > This returns a single result in Sesame since the first subquery returns
> > one
> > result and the subquery in the MINUS clause returns none. Executing the
> > first subquery
> >
> > SELECT DISTINCT (?uri_d as ?uri) WHERE {
> >  VALUES ?type { <http://type1> <http://type2> <http://type3> }
> >  VALUES ?dg { <http://graph1> }
> >  GRAPH ?dg { ?uri_d a ?type . }
> > }
> >
> > returns 0 results in Blazegraph, however moving the single graph value
> > into
> > the GRAPH clause:
> >
> > SELECT DISTINCT (?uri_d as ?uri) WHERE {
> >  VALUES ?type { <http://type1> <http://type2> <http://type3> }
> >  GRAPH <http://graph1> { ?uri_d a ?type . }
> > }
> >
> > returns the expected result. Combining the two VALUES clauses into one:
> >
> > SELECT DISTINCT (?uri_d as ?uri) WHERE {
> >  VALUES (?type ?dg) { (<http://type1> <http://graph1>) (<http://type2>
> > <http://graph1>) (<http://type3> <http://graph1>) }
> >  GRAPH ?dg { ?uri_d a ?type . }
> > }
> >
> > also returns the result. Does Blazegraph support multiple VALUES clauses
> > in
> > the same query? I would expect the three queries above to be equivalent
> > (in
> > the case of a single graph).
> >
> > Another issue is that Blazegraph appears to be inconsistent when
> > projecting
> > variables from inner subqueries. The query:
> >
> > SELECT DISTINCT (?uri_d as ?uri) WHERE {
> >  VALUES ?type { <http://type1> <http://type2> <http://type3> }
> >  GRAPH <http://graph1> { ?uri_d a ?type . }
> > }
> >
> > returns the expected result, however wrapping this in another
> > projection:
> >
> > SELECT ?uri WHERE {
> >  SELECT (?uri_d as ?uri) WHERE {
> >    VALUES ?type { <http://type1> <http://type2> <http://type3> }
> >    GRAPH <http://graph1> { ?uri_d a ?type . }
> >  }
> > }
> >
> > causes no results to be returned. Surprisingly, projecting an unused
> > variable from the inner query:
> >
> > SELECT ?uri WHERE {
> >  SELECT ?type (?uri_d as ?uri) WHERE {
> >    VALUES ?type { <http://type1> <http://type2> <http://type3> }
> >    GRAPH <http://graph1> { ?uri_d a ?type . }
> >  }
> > }
> >
> > causes the result to be returned again.
> >
> > These two issues appear to be preventing the original MINUS query from
> > returning the expected results. Could you confirm these behaviours are
> > bugs?
> > I tried looking on the issue tracker but couldn't find anything directly
> > related.
> >
> > Thanks
> >
> >
> >
> ------------------------------------------------------------------------------
> > One dashboard for servers and applications across Physical-Virtual-Cloud
> > Widest out-of-the-box monitoring support with 50+ applications
> > Performance metrics, stats and reports that give you Actionable Insights
> > Deep dive visibility with transaction tracing using APM Insight.
> > http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
> > _______________________________________________
> > Bigdata-developers mailing list
> > Big...@li...
> > https://lists.sourceforge.net/lists/listinfo/bigdata-developers
> >
> >
> >
> >
>
>
> ------------------------------------------------------------------------------
> One dashboard for servers and applications across Physical-Virtual-Cloud
> Widest out-of-the-box monitoring support with 50+ applications
> Performance metrics, stats and reports that give you Actionable Insights
> Deep dive visibility with transaction tracing using APM Insight.
> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
> _______________________________________________
> Bigdata-developers mailing list
> Big...@li...
> https://lists.sourceforge.net/lists/listinfo/bigdata-developers
>



-- 
_______________
Brad Bebee
Managing Partner
SYSTAP, LLC
e:  be...@sy...
m: 202.642.7961
f:  571.367.5000
w:  www.systap.com

Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance graph
database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs.
MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new technology
to use GPUs to accelerate data-parallel graph analytics.

CONFIDENTIALITY NOTICE:  This email and its contents and attachments are
for the sole use of the intended recipient(s) and are confidential or
proprietary to SYSTAP, LLC.  Any unauthorized review, use, disclosure,
dissemination or copying of this email or its contents or attachments is
prohibited. If you have received this communication in error, please notify
the sender by reply email and permanently delete all copies of the email
and its contents and attachments.

Re: [Bigdata-developers] Query projections and multiple VALUES clauses

[Bryan T. <br...@sy...>]

Brad, can you publish that branch on Sourceforge git so people can play with it?

Thanks,
Bryan
----
Bryan Thompson
Chief Scientist & Founder
SYSTAP, LLC
4501 Tower Road
Greensboro, NC 27410
br...@sy...
http://blazegraph.com
http://blog.bigdata.com
http://mapgraph.io

Blazegraph™ is our ultra high-performance graph database that supports
both RDF/SPARQL and Tinkerpop/Blueprints APIs.  MapGraph™ is our
disruptive new technology to use GPUs to accelerate data-parallel
graph analytics.

CONFIDENTIALITY NOTICE:  This email and its contents and attachments
are for the sole use of the intended recipient(s) and are confidential
or proprietary to SYSTAP. Any unauthorized review, use, disclosure,
dissemination or copying of this email or its contents or attachments
is prohibited. If you have received this communication in error,
please notify the sender by reply email and permanently delete all
copies of the email and its contents and attachments.


On Fri, May 15, 2015 at 1:20 PM, Michael Schmidt <ms...@me...> wrote:
> Dear Lee,
>
> thanks for reporting the two issues!
>
> We have identified the problems causing the behavior (see my comment in the
> parent task http://jira.blazegraph.com/browse/BLZG-1141). A correctness fix
> for both issues is available in branch BLZG48and50, however the fix might
> induce some performance regressions. We want to look at performance in more
> depth before merging into master (probably as part of a more exhaustive
> refactoring), so it might take a while until this will appear in master.
>
> Best,
> Michael
>
>
> On 13 May 2015, at 16:06, Bryan Thompson <br...@sy...> wrote:
>
> Lee,
>
> Many thanks. I will assign them to Michael (Cc) to take an initial look.
>
> Thanks,
> Bryan
> ----
> Bryan Thompson
> Chief Scientist & Founder
> SYSTAP, LLC
> 4501 Tower Road
> Greensboro, NC 27410
> br...@sy...
> http://blazegraph.com
> http://blog.bigdata.com
> http://mapgraph.io
>
> Blazegraph™ is our ultra high-performance graph database that supports
> both RDF/SPARQL and Tinkerpop/Blueprints APIs.  MapGraph™ is our
> disruptive new technology to use GPUs to accelerate data-parallel
> graph analytics.
>
> CONFIDENTIALITY NOTICE:  This email and its contents and attachments
> are for the sole use of the intended recipient(s) and are confidential
> or proprietary to SYSTAP. Any unauthorized review, use, disclosure,
> dissemination or copying of this email or its contents or attachments
> is prohibited. If you have received this communication in error,
> please notify the sender by reply email and permanently delete all
> copies of the email and its contents and attachments.
>
>
> On Wed, May 13, 2015 at 10:03 AM, Lee Kitching <le...@sw...> wrote:
>
> Hi Bryan,
>
> I've raised these at http://jira.blazegraph.com/browse/BLZG-48 and
> http://jira.blazegraph.com/browse/BLZG-50.
>
> Thanks
>
> On Wed, May 13, 2015 at 12:41 PM, Bryan Thompson <br...@sy...> wrote:
>
>
> Lee,
>
> These definitely look like bugs.  Can you please file tickets at
> http://jira.blazegraph.com and include sample data and expected
> solutions for each?  We will try to get the fixes into the 1.5.2
> release.
>
> Thanks,
> Bryan
> ----
> Bryan Thompson
> Chief Scientist & Founder
> SYSTAP, LLC
> 4501 Tower Road
> Greensboro, NC 27410
> br...@sy...
> http://blazegraph.com
> http://blog.bigdata.com
> http://mapgraph.io
>
> Blazegraph™ is our ultra high-performance graph database that supports
> both RDF/SPARQL and Tinkerpop/Blueprints APIs.  MapGraph™ is our
> disruptive new technology to use GPUs to accelerate data-parallel
> graph analytics.
>
> CONFIDENTIALITY NOTICE:  This email and its contents and attachments
> are for the sole use of the intended recipient(s) and are confidential
> or proprietary to SYSTAP. Any unauthorized review, use, disclosure,
> dissemination or copying of this email or its contents or attachments
> is prohibited. If you have received this communication in error,
> please notify the sender by reply email and permanently delete all
> copies of the email and its contents and attachments.
>
>
> On Wed, May 13, 2015 at 6:51 AM, Lee Kitching <le...@sw...> wrote:
>
> Hi,
>
> We are trying to migrate our native Sesame database to Blazegraph,
> however
> we are encountering a problem with the following query which returns no
> results in Blazegraph:
>
> SELECT DISTINCT ?uri WHERE {
>  {
>    SELECT DISTINCT (?uri_d as ?uri) WHERE {
>      VALUES ?type { <http://type1> <http://type2> <http://type3> }
>      VALUES ?dg { <http://graph1> }
>      GRAPH ?dg { ?uri_d a ?type . }
>    }
>  }
>  MINUS
>  {
>    SELECT DISTINCT (?uri_l as ?uri) WHERE {
>    VALUES ?type { <http://type1> <http://type2> <http://type3> }
>    VALUES ?lg { <http://graph2> }
>    GRAPH ?lg { ?uri_l a ?type . }
>    }
>  }
> }
>
> This returns a single result in Sesame since the first subquery returns
> one
> result and the subquery in the MINUS clause returns none. Executing the
> first subquery
>
> SELECT DISTINCT (?uri_d as ?uri) WHERE {
>  VALUES ?type { <http://type1> <http://type2> <http://type3> }
>  VALUES ?dg { <http://graph1> }
>  GRAPH ?dg { ?uri_d a ?type . }
> }
>
> returns 0 results in Blazegraph, however moving the single graph value
> into
> the GRAPH clause:
>
> SELECT DISTINCT (?uri_d as ?uri) WHERE {
>  VALUES ?type { <http://type1> <http://type2> <http://type3> }
>  GRAPH <http://graph1> { ?uri_d a ?type . }
> }
>
> returns the expected result. Combining the two VALUES clauses into one:
>
> SELECT DISTINCT (?uri_d as ?uri) WHERE {
>  VALUES (?type ?dg) { (<http://type1> <http://graph1>) (<http://type2>
> <http://graph1>) (<http://type3> <http://graph1>) }
>  GRAPH ?dg { ?uri_d a ?type . }
> }
>
> also returns the result. Does Blazegraph support multiple VALUES clauses
> in
> the same query? I would expect the three queries above to be equivalent
> (in
> the case of a single graph).
>
> Another issue is that Blazegraph appears to be inconsistent when
> projecting
> variables from inner subqueries. The query:
>
> SELECT DISTINCT (?uri_d as ?uri) WHERE {
>  VALUES ?type { <http://type1> <http://type2> <http://type3> }
>  GRAPH <http://graph1> { ?uri_d a ?type . }
> }
>
> returns the expected result, however wrapping this in another
> projection:
>
> SELECT ?uri WHERE {
>  SELECT (?uri_d as ?uri) WHERE {
>    VALUES ?type { <http://type1> <http://type2> <http://type3> }
>    GRAPH <http://graph1> { ?uri_d a ?type . }
>  }
> }
>
> causes no results to be returned. Surprisingly, projecting an unused
> variable from the inner query:
>
> SELECT ?uri WHERE {
>  SELECT ?type (?uri_d as ?uri) WHERE {
>    VALUES ?type { <http://type1> <http://type2> <http://type3> }
>    GRAPH <http://graph1> { ?uri_d a ?type . }
>  }
> }
>
> causes the result to be returned again.
>
> These two issues appear to be preventing the original MINUS query from
> returning the expected results. Could you confirm these behaviours are
> bugs?
> I tried looking on the issue tracker but couldn't find anything directly
> related.
>
> Thanks
>
>
> ------------------------------------------------------------------------------
> One dashboard for servers and applications across Physical-Virtual-Cloud
> Widest out-of-the-box monitoring support with 50+ applications
> Performance metrics, stats and reports that give you Actionable Insights
> Deep dive visibility with transaction tracing using APM Insight.
> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
> _______________________________________________
> Bigdata-developers mailing list
> Big...@li...
> https://lists.sourceforge.net/lists/listinfo/bigdata-developers
>
>
>
>

Re: [Bigdata-developers] Query projections and multiple VALUES clauses

[Michael S. <ms...@me...>]

Dear Lee,

thanks for reporting the two issues!

We have identified the problems causing the behavior (see my comment in the parent task http://jira.blazegraph.com/browse/BLZG-1141 <http://jira.blazegraph.com/browse/BLZG-1141>). A correctness fix for both issues is available in branch BLZG48and50 <https://github.com/SYSTAP/bigdata/tree/BLZG48and50>, however the fix might induce some performance regressions. We want to look at performance in more depth before merging into master (probably as part of a more exhaustive refactoring), so it might take a while until this will appear in master. 

Best,
Michael


> On 13 May 2015, at 16:06, Bryan Thompson <br...@sy...> wrote:
> 
> Lee,
> 
> Many thanks. I will assign them to Michael (Cc) to take an initial look.
> 
> Thanks,
> Bryan
> ----
> Bryan Thompson
> Chief Scientist & Founder
> SYSTAP, LLC
> 4501 Tower Road
> Greensboro, NC 27410
> br...@sy...
> http://blazegraph.com
> http://blog.bigdata.com
> http://mapgraph.io
> 
> Blazegraph™ is our ultra high-performance graph database that supports
> both RDF/SPARQL and Tinkerpop/Blueprints APIs.  MapGraph™ is our
> disruptive new technology to use GPUs to accelerate data-parallel
> graph analytics.
> 
> CONFIDENTIALITY NOTICE:  This email and its contents and attachments
> are for the sole use of the intended recipient(s) and are confidential
> or proprietary to SYSTAP. Any unauthorized review, use, disclosure,
> dissemination or copying of this email or its contents or attachments
> is prohibited. If you have received this communication in error,
> please notify the sender by reply email and permanently delete all
> copies of the email and its contents and attachments.
> 
> 
> On Wed, May 13, 2015 at 10:03 AM, Lee Kitching <le...@sw...> wrote:
>> Hi Bryan,
>> 
>> I've raised these at http://jira.blazegraph.com/browse/BLZG-48 and
>> http://jira.blazegraph.com/browse/BLZG-50.
>> 
>> Thanks
>> 
>> On Wed, May 13, 2015 at 12:41 PM, Bryan Thompson <br...@sy...> wrote:
>>> 
>>> Lee,
>>> 
>>> These definitely look like bugs.  Can you please file tickets at
>>> http://jira.blazegraph.com and include sample data and expected
>>> solutions for each?  We will try to get the fixes into the 1.5.2
>>> release.
>>> 
>>> Thanks,
>>> Bryan
>>> ----
>>> Bryan Thompson
>>> Chief Scientist & Founder
>>> SYSTAP, LLC
>>> 4501 Tower Road
>>> Greensboro, NC 27410
>>> br...@sy...
>>> http://blazegraph.com
>>> http://blog.bigdata.com
>>> http://mapgraph.io
>>> 
>>> Blazegraph™ is our ultra high-performance graph database that supports
>>> both RDF/SPARQL and Tinkerpop/Blueprints APIs.  MapGraph™ is our
>>> disruptive new technology to use GPUs to accelerate data-parallel
>>> graph analytics.
>>> 
>>> CONFIDENTIALITY NOTICE:  This email and its contents and attachments
>>> are for the sole use of the intended recipient(s) and are confidential
>>> or proprietary to SYSTAP. Any unauthorized review, use, disclosure,
>>> dissemination or copying of this email or its contents or attachments
>>> is prohibited. If you have received this communication in error,
>>> please notify the sender by reply email and permanently delete all
>>> copies of the email and its contents and attachments.
>>> 
>>> 
>>> On Wed, May 13, 2015 at 6:51 AM, Lee Kitching <le...@sw...> wrote:
>>>> Hi,
>>>> 
>>>> We are trying to migrate our native Sesame database to Blazegraph,
>>>> however
>>>> we are encountering a problem with the following query which returns no
>>>> results in Blazegraph:
>>>> 
>>>> SELECT DISTINCT ?uri WHERE {
>>>>  {
>>>>    SELECT DISTINCT (?uri_d as ?uri) WHERE {
>>>>      VALUES ?type { <http://type1> <http://type2> <http://type3> }
>>>>      VALUES ?dg { <http://graph1> }
>>>>      GRAPH ?dg { ?uri_d a ?type . }
>>>>    }
>>>>  }
>>>>  MINUS
>>>>  {
>>>>    SELECT DISTINCT (?uri_l as ?uri) WHERE {
>>>>    VALUES ?type { <http://type1> <http://type2> <http://type3> }
>>>>    VALUES ?lg { <http://graph2> }
>>>>    GRAPH ?lg { ?uri_l a ?type . }
>>>>    }
>>>>  }
>>>> }
>>>> 
>>>> This returns a single result in Sesame since the first subquery returns
>>>> one
>>>> result and the subquery in the MINUS clause returns none. Executing the
>>>> first subquery
>>>> 
>>>> SELECT DISTINCT (?uri_d as ?uri) WHERE {
>>>>  VALUES ?type { <http://type1> <http://type2> <http://type3> }
>>>>  VALUES ?dg { <http://graph1> }
>>>>  GRAPH ?dg { ?uri_d a ?type . }
>>>> }
>>>> 
>>>> returns 0 results in Blazegraph, however moving the single graph value
>>>> into
>>>> the GRAPH clause:
>>>> 
>>>> SELECT DISTINCT (?uri_d as ?uri) WHERE {
>>>>  VALUES ?type { <http://type1> <http://type2> <http://type3> }
>>>>  GRAPH <http://graph1> { ?uri_d a ?type . }
>>>> }
>>>> 
>>>> returns the expected result. Combining the two VALUES clauses into one:
>>>> 
>>>> SELECT DISTINCT (?uri_d as ?uri) WHERE {
>>>>  VALUES (?type ?dg) { (<http://type1> <http://graph1>) (<http://type2>
>>>> <http://graph1>) (<http://type3> <http://graph1>) }
>>>>  GRAPH ?dg { ?uri_d a ?type . }
>>>> }
>>>> 
>>>> also returns the result. Does Blazegraph support multiple VALUES clauses
>>>> in
>>>> the same query? I would expect the three queries above to be equivalent
>>>> (in
>>>> the case of a single graph).
>>>> 
>>>> Another issue is that Blazegraph appears to be inconsistent when
>>>> projecting
>>>> variables from inner subqueries. The query:
>>>> 
>>>> SELECT DISTINCT (?uri_d as ?uri) WHERE {
>>>>  VALUES ?type { <http://type1> <http://type2> <http://type3> }
>>>>  GRAPH <http://graph1> { ?uri_d a ?type . }
>>>> }
>>>> 
>>>> returns the expected result, however wrapping this in another
>>>> projection:
>>>> 
>>>> SELECT ?uri WHERE {
>>>>  SELECT (?uri_d as ?uri) WHERE {
>>>>    VALUES ?type { <http://type1> <http://type2> <http://type3> }
>>>>    GRAPH <http://graph1> { ?uri_d a ?type . }
>>>>  }
>>>> }
>>>> 
>>>> causes no results to be returned. Surprisingly, projecting an unused
>>>> variable from the inner query:
>>>> 
>>>> SELECT ?uri WHERE {
>>>>  SELECT ?type (?uri_d as ?uri) WHERE {
>>>>    VALUES ?type { <http://type1> <http://type2> <http://type3> }
>>>>    GRAPH <http://graph1> { ?uri_d a ?type . }
>>>>  }
>>>> }
>>>> 
>>>> causes the result to be returned again.
>>>> 
>>>> These two issues appear to be preventing the original MINUS query from
>>>> returning the expected results. Could you confirm these behaviours are
>>>> bugs?
>>>> I tried looking on the issue tracker but couldn't find anything directly
>>>> related.
>>>> 
>>>> Thanks
>>>> 
>>>> 
>>>> ------------------------------------------------------------------------------
>>>> One dashboard for servers and applications across Physical-Virtual-Cloud
>>>> Widest out-of-the-box monitoring support with 50+ applications
>>>> Performance metrics, stats and reports that give you Actionable Insights
>>>> Deep dive visibility with transaction tracing using APM Insight.
>>>> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
>>>> _______________________________________________
>>>> Bigdata-developers mailing list
>>>> Big...@li...
>>>> https://lists.sourceforge.net/lists/listinfo/bigdata-developers
>>>> 
>> 
>> 

Re: [Bigdata-developers] Current Revision of Blazegraph: Journal consumes extremely much disk space

[Bryan T. <br...@sy...>]

Andreas,

We have moved to JIRA. This is now
http://jira.blazegraph.com/browse/BLZG-201.

Could you please attach your vocabulary file to the ticket (java code).
Martyn is trying to replicate things using a subset of your data using a part
of the GND rdf data - 1G of RDF statements. He wrote:


But I was only able to do this by commenting out the vocabulary line
#com.bigdata.rdf.store.AbstractTripleStore.vocabularyClass=
de.bsb_muenchen.bigdata.vocab.B3KatVocabulary

As I see it this is the main difference between my load and theirs. How can
I get this class to recreate the load more accurately?


Thanks,
Bryan

----
Bryan Thompson
Chief Scientist & Founder
SYSTAP, LLC
4501 Tower Road
Greensboro, NC 27410
br...@sy...
http://blazegraph.com
http://blog.bigdata.com <http://bigdata.com>
http://mapgraph.io

Blazegraph™ <http://www.blazegraph.com/> is our ultra high-performance
graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints
APIs.  MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new
technology to use GPUs to accelerate data-parallel graph analytics.

CONFIDENTIALITY NOTICE:  This email and its contents and attachments are
for the sole use of the intended recipient(s) and are confidential or
proprietary to SYSTAP. Any unauthorized review, use, disclosure,
dissemination or copying of this email or its contents or attachments is
prohibited. If you have received this communication in error, please notify
the sender by reply email and permanently delete all copies of the email
and its contents and attachments.

On Mon, Apr 27, 2015 at 8:38 AM, Andreas Kahl <ka...@bs...> wrote:

> Hello Bryan & Martin,
>
> Sorry for the long delay. Now I ran two dumpJournal&dumpPages:
> 1. Dump while the SPARQL LOAD was running with groupCommit and
> smallSlotOptimization enabled (the one that cannot finish due to disk space)
> 2. Dump after the whole file was successfully loaded because I disabled
> groupCommit (I could also use groupCommit and disable smallSlots)
>
> I will do what I can to help you testing and tracking down the problem.
> For me here it is not too much trouble working with the knowledge that I
> can only activate one of the both features at a time.
>
> Best Regards
> Andreas
>
> P.S. I also followed your advice to increase
> com.bigdata.rdf.sail.bufferCapacity as you can see from the settings of run
> No. 2:
> triples:/tmp # curl -H "Accept: text/plain"
> http://localhost:8080/bigdata/namespace/gnd/properties
> #Mon Apr 27 14:26:37 CEST 2015
> com.bigdata.namespace.kb.spo.com.bigdata.btree.BTree.branchingFactor=700
> com.bigdata.relation.container=gnd
> com.bigdata.rwstore.RWStore.smallSlotType=1024
> com.bigdata.journal.AbstractJournal.bufferMode=DiskRW
> com.bigdata.journal.AbstractJournal.file=/var/lib/bigdata/bigdata.jnl
> com.bigdata.journal.AbstractJournal.initialExtent=209715200
>
> com.bigdata.rdf.store.AbstractTripleStore.vocabularyClass=de.bsb_muenchen.bigdata.vocab.B3KatVocabulary
> com.bigdata.rdf.store.AbstractTripleStore.textIndex=true
> com.bigdata.btree.BTree.branchingFactor=700
>
> com.bigdata.rdf.store.AbstractTripleStore.axiomsClass=com.bigdata.rdf.axioms.NoAxioms
> com.bigdata.rdf.sail.isolatableIndices=false
> com.bigdata.service.AbstractTransactionService.minReleaseAge=1
> com.bigdata.rdf.sail.bufferCapacity=200000
> com.bigdata.rdf.sail.truthMaintenance=false
> com.bigdata.rdf.sail.namespace=gnd
> com.bigdata.relation.class=com.bigdata.rdf.store.LocalTripleStore
> com.bigdata.rdf.store.AbstractTripleStore.quads=false
> com.bigdata.journal.AbstractJournal.writeCacheBufferCount=2000
> com.bigdata.search.FullTextIndex.fieldsEnabled=false
> com.bigdata.relation.namespace=gnd
> com.bigdata.btree.writeRetentionQueue.capacity=10000
> com.bigdata.rdf.store.AbstractTripleStore.statementIdentifiers=false
>
> >>> Bryan Thompson <br...@sy...> 24.04.15 18.45 Uhr >>>
> Martyn and I discussed this in some depth today.  We've reopened the ticket
> to:
>
> a. gain more understanding of the interaction of the small slot
> optimization and group commit.
> b. verify correct reporting by the allocators in dumpJournal.
> c. modify the small slots optimization allocator policy to make it less
> susceptible to mis-configuration.
>
> In the data as loaded, the OSP index was 66% blob slots (greater than 8k).
> For the small slot optimization to be effective the O(C)SP index should
> target a page size of 64-256 bytes.
>
> (c) should minimize or remove the negative impact of the small slot
> optimization in such cases.
>
> Thanks,
> Bryan
>
>
>
> ----
> Bryan Thompson
> Chief Scientist & Founder
> SYSTAP, LLC
> 4501 Tower Road
> Greensboro, NC 27410
> br...@sy...
> http://blazegraph.com
> http://blog.bigdata.com <http://bigdata.com>
> http://mapgraph.io
>
> Blazegraph™ <http://www.blazegraph.com/> is our ultra high-performance
> graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints
> APIs.  MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new
> technology to use GPUs to accelerate data-parallel graph analytics.
>
> CONFIDENTIALITY NOTICE:  This email and its contents and attachments are
> for the sole use of the intended recipient(s) and are confidential or
> proprietary to SYSTAP. Any unauthorized review, use, disclosure,
> dissemination or copying of this email or its contents or attachments is
> prohibited. If you have received this communication in error, please notify
> the sender by reply email and permanently delete all copies of the email
> and its contents and attachments.
>
> On Fri, Apr 24, 2015 at 8:35 AM, Martyn Cutcher <ma...@sy...> wrote:
>
> >  I don't see how the small slot optimisation can result in more waste
> with
> > larger allocators.
> >
> > It is simply a mechanism to avoid rapid re-allocation of the small
> slotllocator dump, there are a lot of 64 byte allocators.
> > Unlike the larger allocators (128 and greater) a large proportion of the
> 64
> > byte slots will be used for long literal values (note that the mean
> > allocation is only 27 bytes).
> >
> > Counter intuitively, there may well be a case for excluding the 64 byte
> > allocators from the "small slot optimisation".  So "small slot" NOT
> > "smallest slot" ;-)
> >
> > - Martyn
> >
> > On 24/04/2015 00:18, Bryan Thompson wrote:
> >
> > I've updated the ticket.  I've also copied my main conclusions inline
> below.
> >
> > I think that the issue here is the use of the small slot optimization
> > without proper configuration of the indices in order to target small
> > allocation slots for at least one of the indices.  The small slot
> > optimization changes the allocation policy in two ways.
> >
> > 1. It has a strong preference to use only empty 8k pages for small
> > allocations (as configured, for allocations less than 1k).  This allows
> us
> > to coalesce writes by combining them onto the same page.
> > 2. It has a preference to use allocation blocks that are relatively empty
> > for small slots.
> >
> > As a consequence, the small slot optimization MAY recruit more allocators
> > in order to have allocators for small slots that have good sparsity.
> >
> > The main goal of the small slot optimization is to optimize for indices
> > that have very scattered IO patterns.  The indices that exhibits this the
> > most are the OSP and OCSP indices.  In many cases even batched updates
> will
> > modify no more than a single tuple per page on this index.  However, in
> > your configuration (and in mine when I enabled the small slot
> optimization
> > without adjusting the branching factors), the O(C)SP indices were not
> > created with a small branching factor, so the small slot allocation could
> > not be put to any good effect. However it did have a negative effect --
> by
> > recruiting more allocators.  If you want to use the small slot
> > optimization, make sure that at least the O(C)SP index has a relatively
> > small branching factor giving an effective slot size of 256 bytes or less
> > on average.
> >
> > I suggest that you retest w/o the small slot optimization and with group
> > commit still enabled.
> >
> > I've asked Martyn to look over the allocators from the small slot
> > optimization run and think about whether we can make this policy a little
> > more adaptive when the branching factors are not really tuned properly
> and
> > too many allocators with too much wasted space are allocated as a result.
> > Basically, how to avoid file bloat from misconfiguration.
> >
> > Thanks,
> > Bryan
> >
> > ----
> > Bryan Thompson
> > Chief Scientist & Founder
> > SYSTAP, LLC
> > 4501 Tower Road
> > Greensboro, NC 274...@sy...http://blazegraph.comhttp://
> blog.bigdata.com <http://bigdata.com> <http://bigdata.com>
> http://mapgraph.io
> >
> > Blazegraph™ <http://www.blazegraph.com/> <http://www.blazegraph.com/>
> is our ultra high-performance
> > graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints
> > APIs.  MapGraph™ <http://www.systap.com/mapgraph> <
> http://www.systap.com/mapgraph> is our disruptive new
> > technology to use GPUs to accelerate data-parallel graph analytics.
> >
> > CONFIDENTIALITY NOTICE:  This email and its contents and attachments are
> > for the sole use of the intended recipient(s) and are confidential or
> > proprietary to SYSTAP. Any unauthorized review, use, disclosure,
> > dissemination or copying of this email or its contents or attachments is
> > prohibited. If you have received this communication in error, please
> notify
> > the sender by reply email and permanently delete all copies of the email
> > and its contents and attachments.
> >
> > On Thu, Apr 23, 2015 at 9:36 AM, Andreas Kahl <ka...@bs...> <
> ka...@bs...> wrote:
> >
> >
> >  Ok, I can redo the test with smallSlots + groupCommit enabled, and
> runhttp://localhost:8080/bigdata/status?dumpJournal&dumpPages after some
> > minutes. (I cannot run it on the fully loadedjust one of my many
> attempts to improve IO Perfomance on rotating disks.
> >
> > Best Regards
> > Andreas
> >
> >
> >   Bryan Thompson <br...@sy...> <br...@sy...> 23.04.15 15.31
> Uhr >>>
> >
> >   I just noticed that you have the full text index enabled as well.  I
> have
> > not be enabling that.
> >
> > I would like to see the output from this command on the fully loaded data
> > sets.
> > http://localhost:8080/bigdata/status?dumpJournal&dumpPages
> >
> > This will let us if any specific index is taking up a very large number
> of
> > pages.  It will also tell us the distribution over the page sizes for
> each
> > index.
> >
> > Bryan
> >
> > ----
> > Bryan Thompson
> > Chief Scientist & Founder
> > SYSTAP, LLC
> > 4501 Tower Road
> > Greensboro, NC 274...@sy...http://blazegraph.comhttp://
> blog.bigdata.com <http://bigdata.com> <http://bigdata.com>
> http://mapgraph.io
> >
> > Blazegraph™ <http://www.blazegraph.com/> <http://www.blazegraph.com/>
> is our ultra high-performance
> > graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints
> > APIs.  MapGraph™ <http://www.systap.com/mapgraph> <
> http://www.systap.com/mapgraph> is our disruptive new
> > technology to use GPUs to accelerate data-parallel graph analytics.
> >
> > CONFIDENTIALITY NOTICE:  This email and its contents and attachments are
> > for the sole use of the intended recipient(s) and are confidential or
> > proprietary to SYSTAP. Any unauthorized review, use, disclosure,
> > dissemination or copying of this email or its contents or attachments is
> > prohibited. If you have received this communication in error, please
> notify
> > the sender by reply email and permanently delete all copies of the email
> > and its contents and attachments.
> >
> > On Thu, Apr 23, 2015 at 8:54 AM, Andreas Kahl <ka...@bs...> <
> ka...@bs...>
> > wrote:
> >
> >
> >  Bryan,
> >
> > in the meantime, I could successfully load the file into a 18GB journal
> > after disabling groupCommit (I simply commented out the line in
> > RWStore.properties).
> > I can try again with groupCommit enabled, but smallSlotOptimization
> > disabled.
> >
> > Best Regards
> > Andreas
> >
> >
> >   Bryan Thompson <br...@sy...> <br...@sy...> 23.04.2015 13:24
> >>>
> >
> >   Andreas,
> >
> > I was not able to replicate your result.  Unfortunately I navigated away
> > from the browser page in which I had submitted the request, so it loaded
> > all the data but failed to commit.  However, the resulting file is only
> > 16GB.
> >
> > I will redo this run and verify that the journal after the commit has
> >
> >  this
> >
> >  same size on the disk.
> >
> > I was only assuming that this was related to group commit because of your
> > original message.  Perhaps I misinterpreted your message. This is simply
> > about 1.5.1 (with group commit) vs 1.4.0.
> >
> > Perhaps the issue is related to the small slot optimization?  Maybe in
> > combination with group commit?
> >
> > *> com.bigdata.rwstore.RWStore.smallSlotType=1024*
> >
> > I could not replicate your properties exactly because you are using a
> > non-standard vocabulary class.  Therefore I simply deleted the default
> > namespace (in quads mode) and recreated it with the defaults in triples
> > mode.  The small slot optimization and other parameters were not enabled
> >
> >  in
> >
> >  my run.
> >
> > Perhaps you could try to replicate my experience and I will enable the
> > small slots optimization?
> >
> > Thanks,
> > Bryan
> >
> > ----
> > Bryan Thompson
> > Chief Scientist & Founder
> > SYSTAP, LLC
> > 4501 Tower Road
> > Greensboro, NC 274...@sy...http://blazegraph.comhttp://
> blog.bigdata.com <http://bigdata.com> <http://bigdata.com>
> http://mapgraph.io
> >
> > Blazegraph™ <http://www.blazegraph.com/> <http://www.blazegraph.com/>
> is our ultra high-performance
> > graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints
> > APIs.  MapGraph™ <http://www.systap.com/mapgraph> <
> http://www.systap.com/mapgraph> is our disruptive new
> > technology to use GPUs to accelerate data-parallel graph analytics.
> >
> > CONFIDENTIALITY NOTICE:  This email a> prohibited. If you have received
> this communication in error, please
> >
> >  notify
> >
> >  the sender by reply email and permanently delete all copies of the email
> > and its contents and attachments.
> >
> > On Thu, Apr 23, 2015 at 1:51 AM, Andreas Kahl <ka...@bs...> <
> ka...@bs...>
> > wrote:
> >
> >
> >  Bryan & Martyn,
> >
> > Thank you very much for investigating the issue. I assume  from the
> >
> >  ticket
> >
> >  that the error will vanish if I disable groupCommit. I will do so for
> >
> >  the
> >
> >  meantime.
> >
> > Although there is already extensive information in Bryan's ticket,
> >
> >  please
> >
> >  find attached my logs and DumpJournal outputs:
> > - dumpJournal.html contains a dump from the 67GB journal after
> >
> >  Blazegraph
> >
> >  ran into "No space left on device"
> > - dumpJournalWithTraceEnabled.html is the same dump for a running query
> > when the journal was at about 14GB
> > - queryStatus.html is just the status page showing my query
> > - catalina.out.gz contains the trace outputs from starting Tomcat
> >
> >  until I
> >
> >  killed the curl running the SPARQL Update by Ctrl-C
> > - loadGnd.log.gz is Blazegraphs output when loading the data
> >
> > Best Regards
> > Andreas
> >
> >
> >
> >
> >   Bryan Thompson <br...@sy...> <br...@sy...> 22.04.15 20.56
> Uhr >>>
> >
> >   See http://trac.bigdata.com/ticket/1206.  This is still in the
> > investigation stage.
> >
> > Thanks,
> > Bryan
> >
> > ----
> > Bryan Thompson
> > Chief Scientist & Founder
> > SYSTAP, LLC
> > 4501 Tower Road
> > Greensboro, NC 274...@sy...http://blazegraph.comhttp://
> blog.bigdata.com <http://bigdata.com> <http://bigdata.com>
> http://mapgraph.io
> >
> > Blazegraph™ <http://www.blazegraph.com/> <http://www.blazegraph.com/>
> is our ultra high-performance
> > graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints
> > APIs.  MapGraph™ <http://www.systap.com/mapgraph> <
> http://www.systap.com/mapgraph> is our disruptive
> >
> >  new
> >
> >  technology to use GPUs to accelerate data-parallel graph analytics.
> >
> > CONFIDENTIALITY NOTICE:  This email and its contents and attachments
> >
> >  are
> >
> >  for the sole use of the intended recipient(s) and are confidential or
> > proprietary to SYSTAP. Any unauthorized review, use, disclosure,
> > dissemination or copying of this email or its contents or attachments
> >
> >  is
> >
> >  prohibited. If you have received this communication in error, please
> >
> >  notify
> >
> >  the sender by reply email and permanently delete all copies of the
> >
> >  email
> >
> >  and its contents and attachments.
> >
> > On Wed, Apr 22, 2015 at 5:37 AM, Andreas Kahl <ka...@bs...> <
> ka...@bs...>
> > wrote:
> >
> >
> >  Hello everyone,
> >
> > I currently updated to the current Revision (f4c63e5) of Blazegraph
> >
> >  from
> >
> >  Git and tried to load a dataset into the updated Webapp. With Bigdata
> >
> >  1.4.0
> >
> >  this resulted in a journal of ~18GB. Now the process was cancelled
> >
> >  because
> >
> >  the disk was full - the journal was beyond 50GB for the same file
> >
> >   with
> >
> >  the
> >
> >  same settings.
> > The only exception was that I activated GroupCommit.
> >
> > The dataset can be downloaded here:
> >
> >
> >
> http://datendienst.dnb.de/cgi-bin/mabit.pl?cmd=fetch&userID=opendata&pass=opendata&mabheft=GND.rdf.gz
> >
> >   .
> > Please find the settings used to load the file below.
> >
> > Do I have a misconfiguration, or is there a bug eating all disk
> >
> >   memory?
> >
> >   Best regards
> > Andreas
> >
> > Namespace-Properties:
> > curl -H "Accept: text/plain"
> http://localhost:8080/bigdata/namespace/gnd/properties
> > #Wed Apr 22 11:35:31 CEST 2015
> >
> >
> >  com.bigdata.namespace.kb.spo.com.bigdata.btree.BTree.branchingFactor=700
> >
> >  com.bigdata.relation.container=gnd
> > com.bigdata.rwstore.RWStore.smallSlotType=1024
> > com.bigdata.journal.AbstractJournal.bufferMode=DiskRW
> > com.bigdata.journal.AbstractJournal.file=/var/lib/bigdata/bigdata.jnl
> >
> >
> >
> >   com.bigdata.rdf.store.AbstractTripleStore.vocabu.textIndex=true
> >
> >  com.bigdata.btree.BTree.branchingFactor=7ionService.minReleaseAge=1
> > com.bigdata.rdf.sail.bufferCapacity=2000
> > com.bigdata.rdf.sail.truthMaintenance=false
> > com.bigdata.rdf.sail.namespace=gnd
> > com.bigdata.relation.class=com.bigdata.rdf.store.LocalTripleStore
> > com.bigdata.rdf.store.AbstractTripleStore.quads=false
> > com.bigdata.journal.AbstractJournal.writeCacheBufferCount=500
> > com.bigdata.search.FullTextIndex.fieldsEnabled=false
> > com.bigdata.relation.namespace=gndity=10000
> > com.bigdata.rdf.sail.BigdataSail.bufferCapacity=2000
> > com.bigdata.rdf.store.AbstractTripleStore.statementIdentifiers=false
> >
> >
> >
> >
> >
> ------------------------------------------------------------------------------
> >
> >   BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
> > Develop your own process in accordance with the BPMN 2 standard
> > Learn Process modeling best practices with Bonita BPM through live
> > exerciseshttp://
> www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual-
> > event?utm_
> >
> >
> >   source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF
> >
> >   _______________________________________________
> > Bigdata-developers mailing listBigdata-developers
> @lists.sourceforge.nethttps://
> lists.sourceforge.net/lists/listinfo/bigdata-developers
> >
> >
> >
> >
> ------------------------------------------------------------------------------
> > One dashboard for servers and applications across Physical-Virtual-Cloud
> > Widest out-of-the-box monitoring support with 50+ applications
> > Performance metrics, stats and reports that give you Actionable Insights
> > Deep dive visibility with transaction tracing using APM Insight.
> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
> >
> >
> >
> > _______________________________________________
> > Bigdata-developers mailing listBigdata-developers
> @lists.sourceforge.nethttps://
> lists.sourceforge.net/lists/listinfo/bigdata-developers
> >
> >
> >
> >
> >
> ------------------------------------------------------------------------------
> > One dashboard for servers and applications across Physical-Virtual-Cloud
> > Widest out-of-the-box monitoring support with 50+ applications
> > Performance metrics, stats and reports that give you Actionable Insights
> > Deep dive visibility with transaction tracing using APM Insight.
> > http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
> > _______________________________________________
> > Bigdata-developers mailing list
> > Big...@li...
> > https://lists.sourceforge.net/lists/listinfo/bigdata-developers
> >
> >
>
>

[Bigdata-developers] trac => jira

[Bryan T. <br...@sy...>]

All, we have finally completed the migration from trac to jira.
Please visit and use the new jira instance at

  http://jira.blazegraph.com/projects/BLZG

Many thanks to Brad for making this happen!

Note: trac will remain online in a read-only mode.   A cross-walk of
trac to jira tickets is available at

  http://wiki.blazegraph.com/wiki/index.php/TracToJira

Thanks,
Bryan

Re: [Bigdata-developers] Query projections and multiple VALUES clauses

[Lee K. <le...@sw...>]

Hi Bryan,

I've raised these at http://jira.blazegraph.com/browse/BLZG-48 and
http://jira.blazegraph.com/browse/BLZG-50.

Thanks

On Wed, May 13, 2015 at 12:41 PM, Bryan Thompson <br...@sy...> wrote:

> Lee,
>
> These definitely look like bugs.  Can you please file tickets at
> http://jira.blazegraph.com and include sample data and expected
> solutions for each?  We will try to get the fixes into the 1.5.2
> release.
>
> Thanks,
> Bryan
> ----
> Bryan Thompson
> Chief Scientist & Founder
> SYSTAP, LLC
> 4501 Tower Road
> Greensboro, NC 27410
> br...@sy...
> http://blazegraph.com
> http://blog.bigdata.com
> http://mapgraph.io
>
> Blazegraph™ is our ultra high-performance graph database that supports
> both RDF/SPARQL and Tinkerpop/Blueprints APIs.  MapGraph™ is our
> disruptive new technology to use GPUs to accelerate data-parallel
> graph analytics.
>
> CONFIDENTIALITY NOTICE:  This email and its contents and attachments
> are for the sole use of the intended recipient(s) and are confidential
> or proprietary to SYSTAP. Any unauthorized review, use, disclosure,
> dissemination or copying of this email or its contents or attachments
> is prohibited. If you have received this communication in error,
> please notify the sender by reply email and permanently delete all
> copies of the email and its contents and attachments.
>
>
> On Wed, May 13, 2015 at 6:51 AM, Lee Kitching <le...@sw...> wrote:
> > Hi,
> >
> > We are trying to migrate our native Sesame database to Blazegraph,
> however
> > we are encountering a problem with the following query which returns no
> > results in Blazegraph:
> >
> > SELECT DISTINCT ?uri WHERE {
> >   {
> >     SELECT DISTINCT (?uri_d as ?uri) WHERE {
> >       VALUES ?type { <http://type1> <http://type2> <http://type3> }
> >       VALUES ?dg { <http://graph1> }
> >       GRAPH ?dg { ?uri_d a ?type . }
> >     }
> >   }
> >   MINUS
> >   {
> >     SELECT DISTINCT (?uri_l as ?uri) WHERE {
> >     VALUES ?type { <http://type1> <http://type2> <http://type3> }
> >     VALUES ?lg { <http://graph2> }
> >     GRAPH ?lg { ?uri_l a ?type . }
> >     }
> >   }
> > }
> >
> > This returns a single result in Sesame since the first subquery returns
> one
> > result and the subquery in the MINUS clause returns none. Executing the
> > first subquery
> >
> > SELECT DISTINCT (?uri_d as ?uri) WHERE {
> >   VALUES ?type { <http://type1> <http://type2> <http://type3> }
> >   VALUES ?dg { <http://graph1> }
> >   GRAPH ?dg { ?uri_d a ?type . }
> > }
> >
> > returns 0 results in Blazegraph, however moving the single graph value
> into
> > the GRAPH clause:
> >
> > SELECT DISTINCT (?uri_d as ?uri) WHERE {
> >   VALUES ?type { <http://type1> <http://type2> <http://type3> }
> >   GRAPH <http://graph1> { ?uri_d a ?type . }
> > }
> >
> > returns the expected result. Combining the two VALUES clauses into one:
> >
> > SELECT DISTINCT (?uri_d as ?uri) WHERE {
> >   VALUES (?type ?dg) { (<http://type1> <http://graph1>) (<http://type2>
> > <http://graph1>) (<http://type3> <http://graph1>) }
> >   GRAPH ?dg { ?uri_d a ?type . }
> > }
> >
> > also returns the result. Does Blazegraph support multiple VALUES clauses
> in
> > the same query? I would expect the three queries above to be equivalent
> (in
> > the case of a single graph).
> >
> > Another issue is that Blazegraph appears to be inconsistent when
> projecting
> > variables from inner subqueries. The query:
> >
> > SELECT DISTINCT (?uri_d as ?uri) WHERE {
> >   VALUES ?type { <http://type1> <http://type2> <http://type3> }
> >   GRAPH <http://graph1> { ?uri_d a ?type . }
> > }
> >
> > returns the expected result, however wrapping this in another projection:
> >
> > SELECT ?uri WHERE {
> >   SELECT (?uri_d as ?uri) WHERE {
> >     VALUES ?type { <http://type1> <http://type2> <http://type3> }
> >     GRAPH <http://graph1> { ?uri_d a ?type . }
> >   }
> > }
> >
> > causes no results to be returned. Surprisingly, projecting an unused
> > variable from the inner query:
> >
> > SELECT ?uri WHERE {
> >   SELECT ?type (?uri_d as ?uri) WHERE {
> >     VALUES ?type { <http://type1> <http://type2> <http://type3> }
> >     GRAPH <http://graph1> { ?uri_d a ?type . }
> >   }
> > }
> >
> > causes the result to be returned again.
> >
> > These two issues appear to be preventing the original MINUS query from
> > returning the expected results. Could you confirm these behaviours are
> bugs?
> > I tried looking on the issue tracker but couldn't find anything directly
> > related.
> >
> > Thanks
> >
> >
> ------------------------------------------------------------------------------
> > One dashboard for servers and applications across Physical-Virtual-Cloud
> > Widest out-of-the-box monitoring support with 50+ applications
> > Performance metrics, stats and reports that give you Actionable Insights
> > Deep dive visibility with transaction tracing using APM Insight.
> > http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
> > _______________________________________________
> > Bigdata-developers mailing list
> > Big...@li...
> > https://lists.sourceforge.net/lists/listinfo/bigdata-developers
> >
>

Re: [Bigdata-developers] Query projections and multiple VALUES clauses

[Bryan T. <br...@sy...>]

Lee,

Many thanks. I will assign them to Michael (Cc) to take an initial look.

Thanks,
Bryan
----
Bryan Thompson
Chief Scientist & Founder
SYSTAP, LLC
4501 Tower Road
Greensboro, NC 27410
br...@sy...
http://blazegraph.com
http://blog.bigdata.com
http://mapgraph.io

Blazegraph™ is our ultra high-performance graph database that supports
both RDF/SPARQL and Tinkerpop/Blueprints APIs.  MapGraph™ is our
disruptive new technology to use GPUs to accelerate data-parallel
graph analytics.

CONFIDENTIALITY NOTICE:  This email and its contents and attachments
are for the sole use of the intended recipient(s) and are confidential
or proprietary to SYSTAP. Any unauthorized review, use, disclosure,
dissemination or copying of this email or its contents or attachments
is prohibited. If you have received this communication in error,
please notify the sender by reply email and permanently delete all
copies of the email and its contents and attachments.


On Wed, May 13, 2015 at 10:03 AM, Lee Kitching <le...@sw...> wrote:
> Hi Bryan,
>
> I've raised these at http://jira.blazegraph.com/browse/BLZG-48 and
> http://jira.blazegraph.com/browse/BLZG-50.
>
> Thanks
>
> On Wed, May 13, 2015 at 12:41 PM, Bryan Thompson <br...@sy...> wrote:
>>
>> Lee,
>>
>> These definitely look like bugs.  Can you please file tickets at
>> http://jira.blazegraph.com and include sample data and expected
>> solutions for each?  We will try to get the fixes into the 1.5.2
>> release.
>>
>> Thanks,
>> Bryan
>> ----
>> Bryan Thompson
>> Chief Scientist & Founder
>> SYSTAP, LLC
>> 4501 Tower Road
>> Greensboro, NC 27410
>> br...@sy...
>> http://blazegraph.com
>> http://blog.bigdata.com
>> http://mapgraph.io
>>
>> Blazegraph™ is our ultra high-performance graph database that supports
>> both RDF/SPARQL and Tinkerpop/Blueprints APIs.  MapGraph™ is our
>> disruptive new technology to use GPUs to accelerate data-parallel
>> graph analytics.
>>
>> CONFIDENTIALITY NOTICE:  This email and its contents and attachments
>> are for the sole use of the intended recipient(s) and are confidential
>> or proprietary to SYSTAP. Any unauthorized review, use, disclosure,
>> dissemination or copying of this email or its contents or attachments
>> is prohibited. If you have received this communication in error,
>> please notify the sender by reply email and permanently delete all
>> copies of the email and its contents and attachments.
>>
>>
>> On Wed, May 13, 2015 at 6:51 AM, Lee Kitching <le...@sw...> wrote:
>> > Hi,
>> >
>> > We are trying to migrate our native Sesame database to Blazegraph,
>> > however
>> > we are encountering a problem with the following query which returns no
>> > results in Blazegraph:
>> >
>> > SELECT DISTINCT ?uri WHERE {
>> >   {
>> >     SELECT DISTINCT (?uri_d as ?uri) WHERE {
>> >       VALUES ?type { <http://type1> <http://type2> <http://type3> }
>> >       VALUES ?dg { <http://graph1> }
>> >       GRAPH ?dg { ?uri_d a ?type . }
>> >     }
>> >   }
>> >   MINUS
>> >   {
>> >     SELECT DISTINCT (?uri_l as ?uri) WHERE {
>> >     VALUES ?type { <http://type1> <http://type2> <http://type3> }
>> >     VALUES ?lg { <http://graph2> }
>> >     GRAPH ?lg { ?uri_l a ?type . }
>> >     }
>> >   }
>> > }
>> >
>> > This returns a single result in Sesame since the first subquery returns
>> > one
>> > result and the subquery in the MINUS clause returns none. Executing the
>> > first subquery
>> >
>> > SELECT DISTINCT (?uri_d as ?uri) WHERE {
>> >   VALUES ?type { <http://type1> <http://type2> <http://type3> }
>> >   VALUES ?dg { <http://graph1> }
>> >   GRAPH ?dg { ?uri_d a ?type . }
>> > }
>> >
>> > returns 0 results in Blazegraph, however moving the single graph value
>> > into
>> > the GRAPH clause:
>> >
>> > SELECT DISTINCT (?uri_d as ?uri) WHERE {
>> >   VALUES ?type { <http://type1> <http://type2> <http://type3> }
>> >   GRAPH <http://graph1> { ?uri_d a ?type . }
>> > }
>> >
>> > returns the expected result. Combining the two VALUES clauses into one:
>> >
>> > SELECT DISTINCT (?uri_d as ?uri) WHERE {
>> >   VALUES (?type ?dg) { (<http://type1> <http://graph1>) (<http://type2>
>> > <http://graph1>) (<http://type3> <http://graph1>) }
>> >   GRAPH ?dg { ?uri_d a ?type . }
>> > }
>> >
>> > also returns the result. Does Blazegraph support multiple VALUES clauses
>> > in
>> > the same query? I would expect the three queries above to be equivalent
>> > (in
>> > the case of a single graph).
>> >
>> > Another issue is that Blazegraph appears to be inconsistent when
>> > projecting
>> > variables from inner subqueries. The query:
>> >
>> > SELECT DISTINCT (?uri_d as ?uri) WHERE {
>> >   VALUES ?type { <http://type1> <http://type2> <http://type3> }
>> >   GRAPH <http://graph1> { ?uri_d a ?type . }
>> > }
>> >
>> > returns the expected result, however wrapping this in another
>> > projection:
>> >
>> > SELECT ?uri WHERE {
>> >   SELECT (?uri_d as ?uri) WHERE {
>> >     VALUES ?type { <http://type1> <http://type2> <http://type3> }
>> >     GRAPH <http://graph1> { ?uri_d a ?type . }
>> >   }
>> > }
>> >
>> > causes no results to be returned. Surprisingly, projecting an unused
>> > variable from the inner query:
>> >
>> > SELECT ?uri WHERE {
>> >   SELECT ?type (?uri_d as ?uri) WHERE {
>> >     VALUES ?type { <http://type1> <http://type2> <http://type3> }
>> >     GRAPH <http://graph1> { ?uri_d a ?type . }
>> >   }
>> > }
>> >
>> > causes the result to be returned again.
>> >
>> > These two issues appear to be preventing the original MINUS query from
>> > returning the expected results. Could you confirm these behaviours are
>> > bugs?
>> > I tried looking on the issue tracker but couldn't find anything directly
>> > related.
>> >
>> > Thanks
>> >
>> >
>> > ------------------------------------------------------------------------------
>> > One dashboard for servers and applications across Physical-Virtual-Cloud
>> > Widest out-of-the-box monitoring support with 50+ applications
>> > Performance metrics, stats and reports that give you Actionable Insights
>> > Deep dive visibility with transaction tracing using APM Insight.
>> > http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
>> > _______________________________________________
>> > Bigdata-developers mailing list
>> > Big...@li...
>> > https://lists.sourceforge.net/lists/listinfo/bigdata-developers
>> >
>
>

Re: [Bigdata-developers] Query projections and multiple VALUES clauses

[Bryan T. <br...@sy...>]

Lee,

These definitely look like bugs.  Can you please file tickets at
http://jira.blazegraph.com and include sample data and expected
solutions for each?  We will try to get the fixes into the 1.5.2
release.

Thanks,
Bryan
----
Bryan Thompson
Chief Scientist & Founder
SYSTAP, LLC
4501 Tower Road
Greensboro, NC 27410
br...@sy...
http://blazegraph.com
http://blog.bigdata.com
http://mapgraph.io

Blazegraph™ is our ultra high-performance graph database that supports
both RDF/SPARQL and Tinkerpop/Blueprints APIs.  MapGraph™ is our
disruptive new technology to use GPUs to accelerate data-parallel
graph analytics.

CONFIDENTIALITY NOTICE:  This email and its contents and attachments
are for the sole use of the intended recipient(s) and are confidential
or proprietary to SYSTAP. Any unauthorized review, use, disclosure,
dissemination or copying of this email or its contents or attachments
is prohibited. If you have received this communication in error,
please notify the sender by reply email and permanently delete all
copies of the email and its contents and attachments.


On Wed, May 13, 2015 at 6:51 AM, Lee Kitching <le...@sw...> wrote:
> Hi,
>
> We are trying to migrate our native Sesame database to Blazegraph, however
> we are encountering a problem with the following query which returns no
> results in Blazegraph:
>
> SELECT DISTINCT ?uri WHERE {
>   {
>     SELECT DISTINCT (?uri_d as ?uri) WHERE {
>       VALUES ?type { <http://type1> <http://type2> <http://type3> }
>       VALUES ?dg { <http://graph1> }
>       GRAPH ?dg { ?uri_d a ?type . }
>     }
>   }
>   MINUS
>   {
>     SELECT DISTINCT (?uri_l as ?uri) WHERE {
>     VALUES ?type { <http://type1> <http://type2> <http://type3> }
>     VALUES ?lg { <http://graph2> }
>     GRAPH ?lg { ?uri_l a ?type . }
>     }
>   }
> }
>
> This returns a single result in Sesame since the first subquery returns one
> result and the subquery in the MINUS clause returns none. Executing the
> first subquery
>
> SELECT DISTINCT (?uri_d as ?uri) WHERE {
>   VALUES ?type { <http://type1> <http://type2> <http://type3> }
>   VALUES ?dg { <http://graph1> }
>   GRAPH ?dg { ?uri_d a ?type . }
> }
>
> returns 0 results in Blazegraph, however moving the single graph value into
> the GRAPH clause:
>
> SELECT DISTINCT (?uri_d as ?uri) WHERE {
>   VALUES ?type { <http://type1> <http://type2> <http://type3> }
>   GRAPH <http://graph1> { ?uri_d a ?type . }
> }
>
> returns the expected result. Combining the two VALUES clauses into one:
>
> SELECT DISTINCT (?uri_d as ?uri) WHERE {
>   VALUES (?type ?dg) { (<http://type1> <http://graph1>) (<http://type2>
> <http://graph1>) (<http://type3> <http://graph1>) }
>   GRAPH ?dg { ?uri_d a ?type . }
> }
>
> also returns the result. Does Blazegraph support multiple VALUES clauses in
> the same query? I would expect the three queries above to be equivalent (in
> the case of a single graph).
>
> Another issue is that Blazegraph appears to be inconsistent when projecting
> variables from inner subqueries. The query:
>
> SELECT DISTINCT (?uri_d as ?uri) WHERE {
>   VALUES ?type { <http://type1> <http://type2> <http://type3> }
>   GRAPH <http://graph1> { ?uri_d a ?type . }
> }
>
> returns the expected result, however wrapping this in another projection:
>
> SELECT ?uri WHERE {
>   SELECT (?uri_d as ?uri) WHERE {
>     VALUES ?type { <http://type1> <http://type2> <http://type3> }
>     GRAPH <http://graph1> { ?uri_d a ?type . }
>   }
> }
>
> causes no results to be returned. Surprisingly, projecting an unused
> variable from the inner query:
>
> SELECT ?uri WHERE {
>   SELECT ?type (?uri_d as ?uri) WHERE {
>     VALUES ?type { <http://type1> <http://type2> <http://type3> }
>     GRAPH <http://graph1> { ?uri_d a ?type . }
>   }
> }
>
> causes the result to be returned again.
>
> These two issues appear to be preventing the original MINUS query from
> returning the expected results. Could you confirm these behaviours are bugs?
> I tried looking on the issue tracker but couldn't find anything directly
> related.
>
> Thanks
>
> ------------------------------------------------------------------------------
> One dashboard for servers and applications across Physical-Virtual-Cloud
> Widest out-of-the-box monitoring support with 50+ applications
> Performance metrics, stats and reports that give you Actionable Insights
> Deep dive visibility with transaction tracing using APM Insight.
> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
> _______________________________________________
> Bigdata-developers mailing list
> Big...@li...
> https://lists.sourceforge.net/lists/listinfo/bigdata-developers
>

[Bigdata-developers] Query projections and multiple VALUES clauses

[Lee K. <le...@sw...>]

Hi,

We are trying to migrate our native Sesame database to Blazegraph, however
we are encountering a problem with the following query which returns no
results in Blazegraph:

SELECT DISTINCT ?uri WHERE {
  {
    SELECT DISTINCT (?uri_d as ?uri) WHERE {
      VALUES ?type { <http://type1> <http://type2> <http://type3> }
      VALUES ?dg { <http://graph1> }
      GRAPH ?dg { ?uri_d a ?type . }
    }
  }
  MINUS
  {
    SELECT DISTINCT (?uri_l as ?uri) WHERE {
    VALUES ?type { <http://type1> <http://type2> <http://type3> }
    VALUES ?lg { <http://graph2> }
    GRAPH ?lg { ?uri_l a ?type . }
    }
  }
}

This returns a single result in Sesame since the first subquery returns one
result and the subquery in the MINUS clause returns none. Executing the
first subquery

SELECT DISTINCT (?uri_d as ?uri) WHERE {
  VALUES ?type { <http://type1> <http://type2> <http://type3> }
  VALUES ?dg { <http://graph1> }
  GRAPH ?dg { ?uri_d a ?type . }
}

returns 0 results in Blazegraph, however moving the single graph value into
the GRAPH clause:

SELECT DISTINCT (?uri_d as ?uri) WHERE {
  VALUES ?type { <http://type1> <http://type2> <http://type3> }
  GRAPH <http://graph1> { ?uri_d a ?type . }
}

returns the expected result. Combining the two VALUES clauses into one:

SELECT DISTINCT (?uri_d as ?uri) WHERE {
  VALUES (?type ?dg) { (<http://type1> <http://graph1>) (<http://type2> <
http://graph1>) (<http://type3> <http://graph1>) }
  GRAPH ?dg { ?uri_d a ?type . }
}

also returns the result. Does Blazegraph support multiple VALUES clauses in
the same query? I would expect the three queries above to be equivalent (in
the case of a single graph).

Another issue is that Blazegraph appears to be inconsistent when projecting
variables from inner subqueries. The query:

SELECT DISTINCT (?uri_d as ?uri) WHERE {
  VALUES ?type { <http://type1> <http://type2> <http://type3> }
  GRAPH <http://graph1> { ?uri_d a ?type . }
}

returns the expected result, however wrapping this in another projection:

SELECT ?uri WHERE {
  SELECT (?uri_d as ?uri) WHERE {
    VALUES ?type { <http://type1> <http://type2> <http://type3> }
    GRAPH <http://graph1> { ?uri_d a ?type . }
  }
}

causes no results to be returned. Surprisingly, projecting an unused
variable from the inner query:

SELECT ?uri WHERE {
  SELECT ?type (?uri_d as ?uri) WHERE {
    VALUES ?type { <http://type1> <http://type2> <http://type3> }
    GRAPH <http://graph1> { ?uri_d a ?type . }
  }
}

causes the result to be returned again.

These two issues appear to be preventing the original MINUS query from
returning the expected results. Could you confirm these behaviours are
bugs? I tried looking on the issue tracker but couldn't find anything
directly related.

Thanks

Re: [Bigdata-developers] Trac Outage

[Brad B. <be...@sy...>]

All,

Trac is back up in a read-only state.

New issues should be entered via JIRA:  http://jira.blazegraph.com/.  We
are still in the process of migrating the data from Trac to JIRA.  All Trac
accounts for which we had an email address registered were migrated as JIRA
user accounts.  You may request a password reset with your account to login
to JIRA.

If you have any trouble accessing your old account, please contact
blazegraph at systap.com.

Thanks, --Brad

On Fri, May 8, 2015 at 12:38 PM, Brad Bebee <be...@sy...> wrote:

> All,
>
> Trac will going down at 1300 ET today for planned maintenance.  Please
> make any updates, if you are able to access it.
>
> Thanks, --Brad
>
> --
> _______________
> Brad Bebee
> Managing Partner
> SYSTAP, LLC
> e:  be...@sy...
> m: 202.642.7961
> f:  571.367.5000
> w:  www.systap.com
>
> Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance
> graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints
> APIs.  MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new
> technology to use GPUs to accelerate data-parallel graph analytics.
>
> CONFIDENTIALITY NOTICE:  This email and its contents and attachments are
> for the sole use of the intended recipient(s) and are confidential or
> proprietary to SYSTAP, LLC.  Any unauthorized review, use, disclosure,
> dissemination or copying of this email or its contents or attachments is
> prohibited. If you have received this communication in error, please notify
> the sender by reply email and permanently delete all copies of the email
> and its contents and attachments.
>



-- 
_______________
Brad Bebee
Managing Partner
SYSTAP, LLC
e:  be...@sy...
m: 202.642.7961
f:  571.367.5000
w:  www.systap.com

Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance graph
database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs.
MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new technology
to use GPUs to accelerate data-parallel graph analytics.

CONFIDENTIALITY NOTICE:  This email and its contents and attachments are
for the sole use of the intended recipient(s) and are confidential or
proprietary to SYSTAP, LLC.  Any unauthorized review, use, disclosure,
dissemination or copying of this email or its contents or attachments is
prohibited. If you have received this communication in error, please notify
the sender by reply email and permanently delete all copies of the email
and its contents and attachments.

Re: [Bigdata-developers] Bug in getServiceRegistrats@JiniCoreServicesConfiguration

[Ravi P. P. <rav...@fa...>]

Thank you.

Ravi

On Monday 11 May 2015 07:20 PM, Bryan Thompson wrote:
> Hello,
>
> There is a bug here.  The root cause is that Object.wait(long timeout)
> as invoked for the signal object ignores the timeout when it is zero.
> Your change works because it ensures that the timeout (when expressed
> in milliseconds) is GT ZERO.  I have filed a ticket for this and will
> include a fix in the next release. See
> http://jira.blazegraph.com/browse/BLZG-34 (we are in the process of
> migrating to jira to due trac problems related to the deprecation of
> OpenID support by Google).
>
>          try {
>
>              // demand some results.
>              ServiceRegistrar[] registrars = new ServiceRegistrar[0];
>
>              final long begin = System.nanoTime();
>
>              final long nanos = unit.toNanos(timeout);
>
>              long remaining = nanos;
>
>              while (registrars.length < maxCount) {
>
>                  remaining = nanos - (System.nanoTime() - begin);
>
>                  if (remaining <= 0) {
>
>                      // Note: Avoids negative timeout for signal.wait().
>                      break;
>
>                  }
>
>                  if (log.isDebugEnabled())
>                      log.debug("timeout="
>                              + TimeUnit.NANOSECONDS.toMillis(timeout)
>                              + "ms, remaining: "
>                              + TimeUnit.NANOSECONDS.toMillis(remaining)
>                              + "ms, #registrars=" + registrars.length);
>
>                  synchronized (signal) {
>
>                      try {
>
>
> signal.wait(TimeUnit.NANOSECONDS.toMillis(remaining)); // <== WAITS
> FOREVER IF TIMEOUT IS ZERO
>
>                      } catch(InterruptedException ex) {
>
>                          // fall through
>
>                      }
>
>                      if(log.isDebugEnabled())
>                          log.debug("woke up");
>
>                  }
>
>                  registrars = discovery.getRegistrars();
>
>              }
>
> Thanks,
> Bryan
> ----
> Bryan Thompson
> Chief Scientist & Founder
> SYSTAP, LLC
> 4501 Tower Road
> Greensboro, NC 27410
> br...@sy...
> http://blazegraph.com
> http://blog.bigdata.com
> http://mapgraph.io
>
> Blazegraph™ is our ultra high-performance graph database that supports
> both RDF/SPARQL and Tinkerpop/Blueprints APIs.  MapGraph™ is our
> disruptive new technology to use GPUs to accelerate data-parallel
> graph analytics.
>
> CONFIDENTIALITY NOTICE:  This email and its contents and attachments
> are for the sole use of the intended recipient(s) and are confidential
> or proprietary to SYSTAP. Any unauthorized review, use, disclosure,
> dissemination or copying of this email or its contents or attachments
> is prohibited. If you have received this communication in error,
> please notify the sender by reply email and permanently delete all
> copies of the email and its contents and attachments.
>
>
> On Sun, May 10, 2015 at 7:08 AM, Ravi Prakash Putchala
> <rav...@fa...> wrote:
>> Hi,
>>
>> In the main branch of blazegraph, I found an issue in the method
>> getServiceRegistrars in the file
>> bigdata-jini/src/java/com/bigdata/jini/start/config/JiniCoreServicesConfiguration.java
>>
>> When I issue the command "bigdata start" it used to hang and ultimately
>> bail out with an error.
>>
>> After changing
>>
>>     if (remaining <= 0) {
>>
>> to:
>>
>>    if (TimeUnit.NANOSECONDS.toMillis(remaining) <= 0) {
>>
>> it started working. I hope this change is the right fix for the issue.
>>
>> I had trouble to do login in trac, so posting here.
>>
>> Regards,
>>
>> Ravi
>>
>>
>> ------------------------------------------------------------------------------
>> One dashboard for servers and applications across Physical-Virtual-Cloud
>> Widest out-of-the-box monitoring support with 50+ applications
>> Performance metrics, stats and reports that give you Actionable Insights
>> Deep dive visibility with transaction tracing using APM Insight.
>> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
>> _______________________________________________
>> Bigdata-developers mailing list
>> Big...@li...
>> https://lists.sourceforge.net/lists/listinfo/bigdata-developers

Re: [Bigdata-developers] Bug in getServiceRegistrats@JiniCoreServicesConfiguration

[Bryan T. <br...@sy...>]

Hello,

There is a bug here.  The root cause is that Object.wait(long timeout)
as invoked for the signal object ignores the timeout when it is zero.
Your change works because it ensures that the timeout (when expressed
in milliseconds) is GT ZERO.  I have filed a ticket for this and will
include a fix in the next release. See
http://jira.blazegraph.com/browse/BLZG-34 (we are in the process of
migrating to jira to due trac problems related to the deprecation of
OpenID support by Google).

        try {

            // demand some results.
            ServiceRegistrar[] registrars = new ServiceRegistrar[0];

            final long begin = System.nanoTime();

            final long nanos = unit.toNanos(timeout);

            long remaining = nanos;

            while (registrars.length < maxCount) {

                remaining = nanos - (System.nanoTime() - begin);

                if (remaining <= 0) {

                    // Note: Avoids negative timeout for signal.wait().
                    break;

                }

                if (log.isDebugEnabled())
                    log.debug("timeout="
                            + TimeUnit.NANOSECONDS.toMillis(timeout)
                            + "ms, remaining: "
                            + TimeUnit.NANOSECONDS.toMillis(remaining)
                            + "ms, #registrars=" + registrars.length);

                synchronized (signal) {

                    try {


signal.wait(TimeUnit.NANOSECONDS.toMillis(remaining)); // <== WAITS
FOREVER IF TIMEOUT IS ZERO

                    } catch(InterruptedException ex) {

                        // fall through

                    }

                    if(log.isDebugEnabled())
                        log.debug("woke up");

                }

                registrars = discovery.getRegistrars();

            }

Thanks,
Bryan
----
Bryan Thompson
Chief Scientist & Founder
SYSTAP, LLC
4501 Tower Road
Greensboro, NC 27410
br...@sy...
http://blazegraph.com
http://blog.bigdata.com
http://mapgraph.io

Blazegraph™ is our ultra high-performance graph database that supports
both RDF/SPARQL and Tinkerpop/Blueprints APIs.  MapGraph™ is our
disruptive new technology to use GPUs to accelerate data-parallel
graph analytics.

CONFIDENTIALITY NOTICE:  This email and its contents and attachments
are for the sole use of the intended recipient(s) and are confidential
or proprietary to SYSTAP. Any unauthorized review, use, disclosure,
dissemination or copying of this email or its contents or attachments
is prohibited. If you have received this communication in error,
please notify the sender by reply email and permanently delete all
copies of the email and its contents and attachments.


On Sun, May 10, 2015 at 7:08 AM, Ravi Prakash Putchala
<rav...@fa...> wrote:
> Hi,
>
> In the main branch of blazegraph, I found an issue in the method
> getServiceRegistrars in the file
> bigdata-jini/src/java/com/bigdata/jini/start/config/JiniCoreServicesConfiguration.java
>
> When I issue the command "bigdata start" it used to hang and ultimately
> bail out with an error.
>
> After changing
>
>    if (remaining <= 0) {
>
> to:
>
>   if (TimeUnit.NANOSECONDS.toMillis(remaining) <= 0) {
>
> it started working. I hope this change is the right fix for the issue.
>
> I had trouble to do login in trac, so posting here.
>
> Regards,
>
> Ravi
>
>
> ------------------------------------------------------------------------------
> One dashboard for servers and applications across Physical-Virtual-Cloud
> Widest out-of-the-box monitoring support with 50+ applications
> Performance metrics, stats and reports that give you Actionable Insights
> Deep dive visibility with transaction tracing using APM Insight.
> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
> _______________________________________________
> Bigdata-developers mailing list
> Big...@li...
> https://lists.sourceforge.net/lists/listinfo/bigdata-developers

[Bigdata-developers] Bug in getServiceRegistrats@JiniCoreServicesConfiguration

[Ravi P. P. <rav...@fa...>]

Hi,

In the main branch of blazegraph, I found an issue in the method 
getServiceRegistrars in the file 
bigdata-jini/src/java/com/bigdata/jini/start/config/JiniCoreServicesConfiguration.java

When I issue the command "bigdata start" it used to hang and ultimately 
bail out with an error.

After changing

   if (remaining <= 0) {

to:

  if (TimeUnit.NANOSECONDS.toMillis(remaining) <= 0) {

it started working. I hope this change is the right fix for the issue.

I had trouble to do login in trac, so posting here.

Regards,

Ravi

Re: [Bigdata-developers] Working with prefixes/namespaces

[Alex J. <al...@bu...>]

When you open the console, the series of dropdowns on the top right is
called "namespace shortcuts"

Yes, they are Sparql/RDF/XML namespaces.

Alex

Alex Jouravlev
Director, Business Abstraction Pty Ltd
Phone:       +61-(2)-8003-4830
Mobile:     +61-4-0408-3258
Web: http://www.businessabstraction.com
LinkedIn: http://au.linkedin.com/in/alexjouravlev/

On Sun, May 10, 2015 at 7:56 AM, Bryan Thompson <br...@sy...> wrote:

> Alex,
>
> I am not sure which shortcuts you are referring to.  Are you discussing
> the PREFIX declarations used in SPARQL? Or the manner in which the
> namespaces of the different triple or quad store instances are mapped onto
> URLs?
>
> Thanks,
> Bryan
>
>
> On Saturday, May 9, 2015, Alex Jouravlev <al...@bu...>
> wrote:
>
>> Hi Brad,
>>
>> Thank you for that.
>>
>> I was actually asking about namespace shortcuts in Bigdata terms. Are
>> they defined in DB or in a client only?
>>
>> Alex
>>
>> Alex Jouravlev
>> Director, Business Abstraction Pty Ltd
>> Phone:       +61-(2)-8003-4830
>> Mobile:     +61-4-0408-3258
>> Web: http://www.businessabstraction.com
>> LinkedIn: http://au.linkedin.com/in/alexjouravlev/
>>
>> On Sat, May 9, 2015 at 11:19 PM, Brad Bebee <be...@sy...> wrote:
>>
>>> Alex,
>>>
>>> The namespace abstraction allows you to host multiple knowledge bases,
>>> each of which having potentially different configuration options (triples,
>>> RDR, inference, quads, etc.), in a single Blazegraph server instance.
>>> Here's some of the configuration options  [1].  There is a default
>>> namespace ("kb"), which is used if no namespace is specified in the SPARQL
>>> endpoint.  In the example below [A] and [B] are equivalent.  [A] uses the
>>> default namespace.  [C] specifies using the "biology" namespace.
>>>
>>> [A] http://localhost:9999/bigdata/sparql
>>>
>>> [B] http://localhost:9999/bigdata/namespace/kb/sparql
>>>
>>> [C] http://localhost:9999/bigdata/namespace/biology/sparql
>>>
>>> Thanks, --Brad
>>>
>>> [1]
>>> http://wiki.blazegraph.com/wiki/index.php/GettingStarted#So_how_do_I_put_the_database_in_triple_store_versus_quad_store_mode.3F
>>>
>>> On Sat, May 9, 2015 at 1:20 AM, Alex Jouravlev <
>>> al...@bu...> wrote:
>>>
>>>> Hi,
>>>>
>>>> I cannot understand what can I do with the namespace prefixes. Should I
>>>> supply them with any invocation?
>>>> Does Bigdata store them?
>>>> When supplying new triples/quads, should I convert namespaces to fully
>>>> qualified names?
>>>>
>>>> Alex Jouravlev
>>>> Director, Business Abstraction Pty Ltd
>>>> Phone:       +61-(2)-8003-4830
>>>> Mobile:     +61-4-0408-3258
>>>> Web: http://www.businessabstraction.com
>>>> LinkedIn: http://au.linkedin.com/in/alexjouravlev/
>>>>
>>>>
>>>> ------------------------------------------------------------------------------
>>>> One dashboard for servers and applications across Physical-Virtual-Cloud
>>>> Widest out-of-the-box monitoring support with 50+ applications
>>>> Performance metrics, stats and reports that give you Actionable Insights
>>>> Deep dive visibility with transaction tracing using APM Insight.
>>>> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
>>>> _______________________________________________
>>>> Bigdata-developers mailing list
>>>> Big...@li...
>>>> https://lists.sourceforge.net/lists/listinfo/bigdata-developers
>>>>
>>>>
>>>
>>>
>>> --
>>> _______________
>>> Brad Bebee
>>> Managing Partner
>>> SYSTAP, LLC
>>> e:  be...@sy...
>>> m: 202.642.7961
>>> f:  571.367.5000
>>> w:  www.systap.com
>>>
>>> Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance
>>> graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints
>>> APIs.  MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new
>>> technology to use GPUs to accelerate data-parallel graph analytics.
>>>
>>> CONFIDENTIALITY NOTICE:  This email and its contents and attachments
>>> are for the sole use of the intended recipient(s) and are confidential or
>>> proprietary to SYSTAP, LLC.  Any unauthorized review, use, disclosure,
>>> dissemination or copying of this email or its contents or attachments is
>>> prohibited. If you have received this communication in error, please notify
>>> the sender by reply email and permanently delete all copies of the email
>>> and its contents and attachments.
>>>
>>
>>
>
> --
> ----
> Bryan Thompson
> Chief Scientist & Founder
> SYSTAP, LLC
> 4501 Tower Road
> Greensboro, NC 27410
> br...@sy...
> http://blazegraph.com
> http://blog.bigdata.com <http://bigdata.com>
> http://mapgraph.io
>
> Blazegraph™ <http://www.blazegraph.com/> is our ultra high-performance
> graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints
> APIs.  MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new
> technology to use GPUs to accelerate data-parallel graph analytics.
>
> CONFIDENTIALITY NOTICE:  This email and its contents and attachments are
> for the sole use of the intended recipient(s) and are confidential or
> proprietary to SYSTAP. Any unauthorized review, use, disclosure,
> dissemination or copying of this email or its contents or attachments is
> prohibited. If you have received this communication in error, please notify
> the sender by reply email and permanently delete all copies of the email
> and its contents and attachments.
>
>