ng4j-namedgraphs

[namedgraphs] Maven Coordinates?

[Chris S. <chr...@is...>]

Hello,
    Could anyone please assist me in locating the maven coordinates/repository information which will allow me to download NG4J from a maven repository?   Any help would be greatly appreciated.

Thanks,
Chris

Re: [namedgraphs] Maven Coordinates?

[Jennifer C. <jen...@at...>]

I meant to also mention that Tim has been kind enough to host the maven
repository for us.  Looks like I have a chance to say that now since I
neglected to cc the mailing list in the earlier message.  
 
Jennifer

  _____  

From: Jennifer Cormier [mailto:jen...@at...] 
Sent: Tuesday, February 02, 2010 10:28 AM
To: 'Chris Shellenbarger'
Subject: RE: [namedgraphs] Maven Coordinates?


Chris,
 
Sorry for the inconvenience.  I did not realize that the maven information
is not posted somewhere easy to find.  We'll have to add more details to
the project wiki.
 
This old mailing list post
(http://sourceforge.net/mailarchive/message.php?msg_name=200908261646.0428
8.tim.pizey%40oucs.ox.ac.uk) by Tim says "I have just deployed to maven
repository at http://melati.org/maven2/ and deployed the maven generated
project web site at http://paneris.net/ng4j/index.html".
 
I don't yet use Maven myself, so if you (or anyone who does) would like to
add some information on that to the wiki just request an account as
described here
(http://sourceforge.net/apps/mediawiki/ng4j/index.php?title=NG4J_Wiki#Wiki
_Information).  Or send me some basic information and I can format and
post it.
 
Let us know if there are any problems accessing the maven repository.  And
thanks for using NG4J!
 
Jennifer
 


  _____  

From: Chris Shellenbarger [mailto:chr...@is...] 
Sent: Tuesday, February 02, 2010 8:59 AM
To: ng4...@li...
Subject: [namedgraphs] Maven Coordinates?



Hello,

    Could anyone please assist me in locating the maven
coordinates/repository information which will allow me to download NG4J
from a maven repository?   Any help would be greatly appreciated.

 

Thanks,

Chris

[namedgraphs] Using NG4J With SDB

[Chris S. <chr...@is...>]

Hello,
    I am really interested in using NG4J in a project I am working on.  However, the only thing holding me back is that I'd like to back the NG4J usage with the Jena SDB datastore.  I noticed that NG4J has its own Database storage implementation but I was wondering if anyone has been able to successfully plugin SDB in use with NG4J?  Since they both work with the Jena configuration and support named graphs it seems that there should be a way to work with both - I'm having trouble getting it to work however.  If anyone could help, I'd greatly appreciate it.

Thanks,
Chris

Re: [namedgraphs] Using NG4J With SDB

[Jennifer C. <jen...@at...>]

Hi Chris,
 
I agree, it would be wonderful the SDB and NG4J named graphs were
compatible.
 
Unfortunately, although NG4J does use Jena, the way that it implements
"named graphs" is quite different than that of SDB.
 
My understanding is that SDB supports naming a graph that contains
triples.  So each graph is a separate triple store.
 
NG4J uses a quad store.  Its "statements" are quads.  The first item in
each statement is the name of the graph.
 
When I looked at SDB's support of named graphs the other year, I had the
impression that each graph had to be "manually" named and loaded in from a
config file.  If that's the case, then in order for NG4J to work with SDB
(if that's possible) it seems to me that we need an additional "pipe" or
processor/transform tool that would handle the missing steps and automate
everything.  It would need to create a separate (SDB) graph for each NG4J
named graph and give the SDB graph the name corresponding to the NG4J one.
Doing so might remove much of SDB's performance gain.
 
Another thing to consider is that with NG4J, it is not necessary to "know"
the name of each graph.  All the graphs are stored together (e.g. in the
same database) as quads.  You can easily query (using SPARQL) across all
the graphs.  This is possible without loading the graphs into memory.  The
SPARQL query is converted to a SQL database query.
 
I don't know much about SDB, but I suspect that in order to query across
all graphs it would be necessary to first load them all into memory, or
put them together in a single, larger graph.  Once that is done, how then
does one determine to which named graph a statement belongs?  I don't have
the answers.
 
That's my understanding of the situation.  Clarifications welcome.
 
Jennifer
 


  _____  

From: Chris Shellenbarger [mailto:chr...@is...] 
Sent: Tuesday, February 09, 2010 12:13 PM
To: ng4...@li...
Subject: [namedgraphs] Using NG4J With SDB



Hello,

    I am really interested in using NG4J in a project I am working on.
However, the only thing holding me back is that I'd like to back the NG4J
usage with the Jena SDB datastore.  I noticed that NG4J has its own
Database storage implementation but I was wondering if anyone has been
able to successfully plugin SDB in use with NG4J?  Since they both work
with the Jena configuration and support named graphs it seems that there
should be a way to work with both - I'm having trouble getting it to work
however.  If anyone could help, I'd greatly appreciate it.

 

Thanks,

Chris

Re: [namedgraphs] Using NG4J With SDB

[Jennifer C. <jen...@at...>]

Chris,
 
Sounds good.  Please let us know how you make out.  It would be great to
better understand SDB's named graph implementation.  The ability to store
NG4J named graphs in SDB could be a valuable addition to the project,
regardless of its performance.
 
NG4J's database storage is not as efficient as it could be.  One
performance improvement that I'd like to see is using
java.sql.PreparedStatement instead of java.sql.Statement.  Additional
optimization could be done as well.
 
Jennifer
 


  _____  

From: Chris Shellenbarger [mailto:chr...@is...] 
Sent: Tuesday, February 09, 2010 1:24 PM
To: Jennifer Cormier
Subject: RE: [namedgraphs] Using NG4J With SDB



Thank you very much for your prompt reply - I'll look into the concerns
you have mentioned and see how the performance differs with each approach.

 

Thanks again,

 

Chris

 

From: Jennifer Cormier [mailto:jen...@at...] 
Sent: Tuesday, February 09, 2010 11:12 AM
To: Chris Shellenbarger; ng4...@li...
Subject: RE: [namedgraphs] Using NG4J With SDB

 

Hi Chris,

 

I agree, it would be wonderful the SDB and NG4J named graphs were
compatible.

 

Unfortunately, although NG4J does use Jena, the way that it implements
"named graphs" is quite different than that of SDB.

 

My understanding is that SDB supports naming a graph that contains
triples.  So each graph is a separate triple store.

 

NG4J uses a quad store.  Its "statements" are quads.  The first item in
each statement is the name of the graph.

 

When I looked at SDB's support of named graphs the other year, I had the
impression that each graph had to be "manually" named and loaded in from a
config file.  If that's the case, then in order for NG4J to work with SDB
(if that's possible) it seems to me that we need an additional "pipe" or
processor/transform tool that would handle the missing steps and automate
everything.  It would need to create a separate (SDB) graph for each NG4J
named graph and give the SDB graph the name corresponding to the NG4J one.
Doing so might remove much of SDB's performance gain.

 

Another thing to consider is that with NG4J, it is not necessary to "know"
the name of each graph.  All the graphs are stored together (e.g. in the
same database) as quads.  You can easily query (using SPARQL) across all
the graphs.  This is possible without loading the graphs into memory.  The
SPARQL query is converted to a SQL database query.

 

I don't know much about SDB, but I suspect that in order to query across
all graphs it would be necessary to first load them all into memory, or
put them together in a single, larger graph.  Once that is done, how then
does one determine to which named graph a statement belongs?  I don't have
the answers.

 

That's my understanding of the situation.  Clarifications welcome.

 

Jennifer

 

 

  _____  

From: Chris Shellenbarger [mailto:chr...@is...] 
Sent: Tuesday, February 09, 2010 12:13 PM
To: ng4...@li...
Subject: [namedgraphs] Using NG4J With SDB

Hello,

    I am really interested in using NG4J in a project I am working on.
However, the only thing holding me back is that I'd like to back the NG4J
usage with the Jena SDB datastore.  I noticed that NG4J has its own
Database storage implementation but I was wondering if anyone has been
able to successfully plugin SDB in use with NG4J?  Since they both work
with the Jena configuration and support named graphs it seems that there
should be a way to work with both - I'm having trouble getting it to work
however.  If anyone could help, I'd greatly appreciate it.

 

Thanks,

Chris

Re: [namedgraphs] Maven Coordinates?

[Tim P. <ti...@pa...>]

Hi all,

I have, finally, set up my Hudson server.

http://hudson.paneris.net/

I did not get a reply as to whether to commit, so I went ahead as the
Jena Repository url has changed.

We and arc are still dependent upon jenatest-0.6.0.  The class
NodeUtils should be moved into the main jar.
I was given an assurance on teh Jena list that this would happen a while back.

I then had real problems with the maven release plugin which boiled down to:

export CVS_RSH=ssh

You can now perform a release with

mvn release:prepare release:perform

I have released 0.9.3 and we are now working on 0.9.4-SNAPSHOT

I have setup two CI jobs: ng4j which does a complete maven build:

mvn clean deploy, site site:deploy

which deploys to the maven repo at

http://paneris.net/maven2/

and deploys a Maven generated web site to http://paneris.net/ng4j/

The ant build checks that it still completes successfully (test
failures now are a failure).

I have not updated the wiki nor the sourceforge downloads

cheers
Tim

Re: [namedgraphs] Maven Coordinates?

[Olaf H. <ha...@in...>]

Hey all,

I'm back from vacation.

On Wednesday 10 February 2010 19:29:08 Tim Pizey wrote:
> [...]
> I have released 0.9.3 and we are now working on 0.9.4-SNAPSHOT
> [...]
> I have not updated the wiki nor the sourceforge downloads

Does it mean in Maven we have a 0.9.3 but "officially" (i.e. on the Web sites) 
it is still the old 0.9.2?

If so, I better prepare the official 0.9.3 package - i.e. doing the things 
listed in http://sf.net/apps/mediawiki/ng4j/index.php?title=Release_Process
 - Right?
Did you tag the release in CVS?

Greetings,
Olaf

Re: [namedgraphs] Maven Coordinates?

[Tim P. <ti...@pa...>]

Hi Olaf, 


On Monday 15 February 2010 18:11:44 Olaf Hartig wrote:
> Hey all,
> 
> I'm back from vacation.
> 
> On Wednesday 10 February 2010 19:29:08 Tim Pizey wrote:
> > [...]
> > I have released 0.9.3 and we are now working on 0.9.4-SNAPSHOT
> > [...]
> > I have not updated the wiki nor the sourceforge downloads
> 
> Does it mean in Maven we have a 0.9.3 but "officially" (i.e. on the Web sites) 
> it is still the old 0.9.2?

yes
 
> If so, I better prepare the official 0.9.3 package - i.e. doing the things 
> listed in http://sf.net/apps/mediawiki/ng4j/index.php?title=Release_Process
>  - Right?
> Did you tag the release in CVS?

yes


Of the steps in the wiki:

Steps to Create the Source Package 
cvs co 
 Update and commit the file doc/index.html (adjust the sections News and Download). 

no

 If it is the first release of a new year update the copyright notices in the source files and commit these changes. 

No
(Surely not, the copyright is the year the source is written, no?)

ant clean 
rm lib/ng4j* 

No

Change the version property in build.xml. 

Yes

 Change the version in pom.xml. 

Yes

 Change the version number of the SWClLib in src/de/fuberlin/wiwiss/ng4j/semwebclient/CommandLineQuery.java. 

yes

 Reflect the new release in CHANGES. 

yes

ant
 
 Tag the CVS with the new version number (e.g. cvs -q tag v0_9_1). 

yes

 Change the version in build.xml and in pom.xml to reflect the post-release state. 
 Create a new ng4j-${version} directory somewhere. 
 Unzip the new ZIP file in this new directory. 
 Remove all IDE-specific config and project files from the new directory. 

I think that we should store the IDE specific configs that we use: 
there are not many IDEs. 



 Zip the new directory. 
 Steps to Publish the Source Package 
 Create a new release on SourceForge 
 Kindly ask Chris to upload the updated doc/index.html. 
 Announce the new release. 
 Open a beer ;-) 


I used the maven release tool: 
mvn release:prepare 
mvn release:perform

This does the editting of the pom and the tagging and committing. 

I put both the ant and maven builds into http://hudson.paneris.net/ 


I think that the only thing to do is update doc/index.html, 
run ant and upload artifacts to sourceforge. 


cheers
tim





-- 
We are in dialogue.