This list is closed, nobody may subscribe to it.
2010 |
Jan
|
Feb
(19) |
Mar
(8) |
Apr
(25) |
May
(16) |
Jun
(77) |
Jul
(131) |
Aug
(76) |
Sep
(30) |
Oct
(7) |
Nov
(3) |
Dec
|
---|---|---|---|---|---|---|---|---|---|---|---|---|
2011 |
Jan
|
Feb
|
Mar
|
Apr
|
May
(2) |
Jun
(2) |
Jul
(16) |
Aug
(3) |
Sep
(1) |
Oct
|
Nov
(7) |
Dec
(7) |
2012 |
Jan
(10) |
Feb
(1) |
Mar
(8) |
Apr
(6) |
May
(1) |
Jun
(3) |
Jul
(1) |
Aug
|
Sep
(1) |
Oct
|
Nov
(8) |
Dec
(2) |
2013 |
Jan
(5) |
Feb
(12) |
Mar
(2) |
Apr
(1) |
May
(1) |
Jun
(1) |
Jul
(22) |
Aug
(50) |
Sep
(31) |
Oct
(64) |
Nov
(83) |
Dec
(28) |
2014 |
Jan
(31) |
Feb
(18) |
Mar
(27) |
Apr
(39) |
May
(45) |
Jun
(15) |
Jul
(6) |
Aug
(27) |
Sep
(6) |
Oct
(67) |
Nov
(70) |
Dec
(1) |
2015 |
Jan
(3) |
Feb
(18) |
Mar
(22) |
Apr
(121) |
May
(42) |
Jun
(17) |
Jul
(8) |
Aug
(11) |
Sep
(26) |
Oct
(15) |
Nov
(66) |
Dec
(38) |
2016 |
Jan
(14) |
Feb
(59) |
Mar
(28) |
Apr
(44) |
May
(21) |
Jun
(12) |
Jul
(9) |
Aug
(11) |
Sep
(4) |
Oct
(2) |
Nov
(1) |
Dec
|
2017 |
Jan
(20) |
Feb
(7) |
Mar
(4) |
Apr
(18) |
May
(7) |
Jun
(3) |
Jul
(13) |
Aug
(2) |
Sep
(4) |
Oct
(9) |
Nov
(2) |
Dec
(5) |
2018 |
Jan
|
Feb
|
Mar
|
Apr
(2) |
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
2019 |
Jan
|
Feb
|
Mar
(1) |
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
From: Bryan T. <br...@sy...> - 2014-10-08 13:58:16
|
Ok. I am traveling for the next 2 days. I will take a look at this soon. Thanks, Bryan ---- Bryan Thompson Chief Scientist & Founder SYSTAP, LLC 4501 Tower Road Greensboro, NC 27410 br...@sy... http://bigdata.com http://mapgraph.io CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. On Wed, Oct 8, 2014 at 8:36 AM, ryan <ry...@os...> wrote: > Here's a simpler version of the code: just compile and run. > > The setup is one thread starts the repository, and another thread closes > it. > An exception is thrown. > > ry > > On Tuesday, October 07, 2014 05:31:28 PM Bryan Thompson wrote: > > I still do not understand the setup you have going. It sounds simple > > enough, but what "app" are you clicking on? What list? > > > > Please reduce this to code so we can replicate the issue and then we can > > take a look at it. > > > > For example, a unit test would be great. That way we can get the test > into > > the regression suite as well. > > > > Thanks, > > Bryan > > > > ---- > > Bryan Thompson > > Chief Scientist & Founder > > SYSTAP, LLC > > 4501 Tower Road > > Greensboro, NC 27410 > > br...@sy... > > http://bigdata.com > > http://mapgraph.io > > > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are > > for the sole use of the intended recipient(s) and are confidential or > > proprietary to SYSTAP. Any unauthorized review, use, disclosure, > > dissemination or copying of this email or its contents or attachments is > > prohibited. If you have received this communication in error, please > notify > > the sender by reply email and permanently delete all copies of the email > > and its contents and attachments. > > > > On Tue, Oct 7, 2014 at 5:13 PM, ryan <ry...@os...> wrote: > > > With that example, I'm just starting and stopping a local journal file > > > directly. No webserver involved. > > > > > > > > > Bryan Thompson <br...@sy...> wrote: > > > > > > Are you running the NanoSparqlServer or the sesame workbench? > > > > > > Bryan > > > > > > ---- > > > Bryan Thompson > > > Chief Scientist & Founder > > > SYSTAP, LLC > > > 4501 Tower Road > > > Greensboro, NC 27410 > > > br...@sy... > > > http://bigdata.com > > > http://mapgraph.io > > > > > > CONFIDENTIALITY NOTICE: This email and its contents and attachments > are > > > for the sole use of the intended recipient(s) and are confidential or > > > proprietary to SYSTAP. Any unauthorized review, use, disclosure, > > > dissemination or copying of this email or its contents or attachments > is > > > prohibited. If you have received this communication in error, please > > > notify > > > the sender by reply email and permanently delete all copies of the > email > > > and its contents and attachments. > > > > > > On Tue, Oct 7, 2014 at 4:29 PM, ryan <ry...@os...> > wrote: > > >> Here's a (non)working sample. I haven't included my RWStore.properties > > >> file, > > >> but I don't think it matters. > > >> > > >> Basically, start the app with a directory containing an > > >> RWStore.properties > > >> file, then click on it from the list. The repository gets created in > one > > >> thread, and closed in another, and it bombs. > > >> > > >> Thanks for your help, > > >> > > >> ry > > >> > > >> On Tuesday, October 07, 2014 10:00:29 AM Bryan Thompson wrote: > > >> > Can you provide a simple Java class that illustrates the problem? > The > > >> > unisolated connection close logic is below. If the connection is > > >> > > >> already > > >> > > >> > closed, it should return immediately. I suspect that the problem is > > >> > > >> with > > >> > > >> > the invocation of > > >> > > > >> > >>> BigdataSail.*this*.connectionClosed(*this*); > > >> > > > >> > which notifies the base SAIL that the connection is closed. > > >> > > > >> > However, this problem does not show up in our tests so we would > need an > > >> > example in order to replicate it. > > >> > > > >> > Thanks, > > >> > Bryan > > >> > > > >> > *public* *synchronized* *void* close() *throws* > SailException { > > >> > > > >> > // assertOpen(); > > >> > > > >> > *if* (!openConn) { > > >> > > > >> > *return*; > > >> > > > >> > } > > >> > > > >> > > > >> > > > >> > *if* (*txLog*.isInfoEnabled()) > > >> > > > >> > *txLog*.info("SAIL-CLOSE-CONN: conn=" + *this*); > > >> > > > >> > *final* IIndexManager im = > getDatabase().getIndexManager(); > > >> > > > >> > > > >> > *if* (isDirty()) { > > >> > > > >> > /* > > >> > > > >> > * Do implicit rollback() of a dirty connection. > > >> > > > >> > */ > > >> > > > >> > rollback(); > > >> > > > >> > } > > >> > > > >> > > > >> > > > >> > *try* { > > >> > > > >> > // notify the SailBase that the connection is no > longer > > >> > > >> in > > >> > > >> > use. > > >> > > > >> > BigdataSail.*this*.connectionClosed(*this*); > > >> > > > >> > } *finally* { > > >> > > > >> > *if* (lock != *null*) { > > >> > > > >> > // release the reentrant lock > > >> > > > >> > lock.unlock(); > > >> > > > >> > } > > >> > > > >> > *if* (unisolated && im *instanceof* Journal) { > > >> > > > >> > // release the permit. > > >> > > > >> > ((Journal) im).releaseUnisolatedConnection(); > > >> > > > >> > } > > >> > > > >> > openConn = *false*; > > >> > > > >> > } > > >> > > > >> > } > > >> > > > >> > ---- > > >> > Bryan Thompson > > >> > Chief Scientist & Founder > > >> > SYSTAP, LLC > > >> > 4501 Tower Road > > >> > Greensboro, NC 27410 > > >> > br...@sy... > > >> > http://bigdata.com > > >> > http://mapgraph.io > > >> > > > >> > CONFIDENTIALITY NOTICE: This email and its contents and attachments > > >> > are > > >> > for the sole use of the intended recipient(s) and are confidential > or > > >> > proprietary to SYSTAP. Any unauthorized review, use, disclosure, > > >> > dissemination or copying of this email or its contents or > attachments > > >> > is > > >> > prohibited. If you have received this communication in error, please > > >> > > >> notify > > >> > > >> > the sender by reply email and permanently delete all copies of the > > >> > email > > >> > and its contents and attachments. > > >> > > > >> > On Tue, Oct 7, 2014 at 9:36 AM, ryan <ry...@os...> > > >> > > >> wrote: > > >> > > Hi All, > > >> > > I'm trying to add a feature to my project that will allow a user > to > > >> > > disconnect > > >> > > from a locally-connected BigData (1.3.1) engine, start up the > network > > >> > > server, > > >> > > and reconnect to the now-networked repository. > > >> > > > > >> > > The problem is that every time I I try to close my local > connection, > > >> > > >> I get > > >> > > >> > > an > > >> > > IllegalMonitorStateException that appears to be preventing the > > >> > > network > > >> > > server > > >> > > from working correctly. > > >> > > > > >> > > The pertinent stack trace is: > > >> > > java.lang.IllegalMonitorStateException > > >> > > > > >> > > at > > >> > > >> > java.util.concurrent.locks.ReentrantReadWriteLock$Sync.tryRelease(Reentra > > >> n > > >> > > >> > > tReadWriteLock.java:374)> > > >> > > > > >> > > at > > >> > > >> > java.util.concurrent.locks.AbstractQueuedSynchronizer.release(AbstractQue > > >> u > > >> > > >> > > edSynchronizer.java:1260)> > > >> > > > > >> > > at > > >> > > >> > java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.unlock(Reentr > > >> a > > >> > > >> > > ntReadWriteLock.java:1131)> > > >> > > > > >> > > at > > >> > > >> > com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.close(BigdataSail. > > >> j > > >> > > >> > > ava:3349)> > > >> > > > > >> > > at > > >> > > >> > org.openrdf.repository.sail.SailRepositoryConnection.close(SailRepository > > >> C > > >> > > >> > > onnection.java:109) > > >> > > > > >> > > > > >> > > With the default OpenRDF backing store, the system will wait a > little > > >> > > >> bit, > > >> > > >> > > and > > >> > > then close connections for you if you don't close them first. I've > > >> > > >> tried > > >> > > >> > > both > > >> > > ways (closing the connection first, then the repository, and just > > >> > > >> closing > > >> > > >> > > the > > >> > > repository) with no difference. > > >> > > > > >> > > I'm running on java 1.7, bigdata 1.3.1, on a linux host. > > >> > > > > >> > > I'm at a loss for troubleshooting. I'd be grateful for any advice > you > > >> > > might > > >> > > have. > > >> > > > > >> > > Thanks, > > >> > > ry > > >> > > > > >> > > -- > > >> > > ...you can't have five wolves and one sheep voting on what to have > > >> > > for > > >> > > supper. > > >> > > > > >> > > --Larry Flint > > >> > > >> > ------------------------------------------------------------------------- > > >> - > > >> > > >> > > ---- Meet PCI DSS 3.0 Compliance Requirements with EventLog > Analyzer > > >> > > Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS > > >> > > >> Reports > > >> > > >> > > Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White > paper > > >> > > Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog > Analyzer > > >> > > >> > http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clk > > >> t > > >> > > >> > > rk _______________________________________________ > > >> > > Bigdata-developers mailing list > > >> > > Big...@li... > > >> > > https://lists.sourceforge.net/lists/listinfo/bigdata-developers > > >> > > >> -- > > >> Four boxes to be used in defense of liberty: soap, ballot, jury, ammo > - > > >> use in > > >> that order. > > >> > > >> --Ed Howdershelt > > -- > Psychos don't burst into flames when sunlight hits them. I don't [care] how > crazy they are. > |
From: ryan <ry...@os...> - 2014-10-08 12:36:48
|
Here's a simpler version of the code: just compile and run. The setup is one thread starts the repository, and another thread closes it. An exception is thrown. ry On Tuesday, October 07, 2014 05:31:28 PM Bryan Thompson wrote: > I still do not understand the setup you have going. It sounds simple > enough, but what "app" are you clicking on? What list? > > Please reduce this to code so we can replicate the issue and then we can > take a look at it. > > For example, a unit test would be great. That way we can get the test into > the regression suite as well. > > Thanks, > Bryan > > ---- > Bryan Thompson > Chief Scientist & Founder > SYSTAP, LLC > 4501 Tower Road > Greensboro, NC 27410 > br...@sy... > http://bigdata.com > http://mapgraph.io > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are > for the sole use of the intended recipient(s) and are confidential or > proprietary to SYSTAP. Any unauthorized review, use, disclosure, > dissemination or copying of this email or its contents or attachments is > prohibited. If you have received this communication in error, please notify > the sender by reply email and permanently delete all copies of the email > and its contents and attachments. > > On Tue, Oct 7, 2014 at 5:13 PM, ryan <ry...@os...> wrote: > > With that example, I'm just starting and stopping a local journal file > > directly. No webserver involved. > > > > > > Bryan Thompson <br...@sy...> wrote: > > > > Are you running the NanoSparqlServer or the sesame workbench? > > > > Bryan > > > > ---- > > Bryan Thompson > > Chief Scientist & Founder > > SYSTAP, LLC > > 4501 Tower Road > > Greensboro, NC 27410 > > br...@sy... > > http://bigdata.com > > http://mapgraph.io > > > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are > > for the sole use of the intended recipient(s) and are confidential or > > proprietary to SYSTAP. Any unauthorized review, use, disclosure, > > dissemination or copying of this email or its contents or attachments is > > prohibited. If you have received this communication in error, please > > notify > > the sender by reply email and permanently delete all copies of the email > > and its contents and attachments. > > > > On Tue, Oct 7, 2014 at 4:29 PM, ryan <ry...@os...> wrote: > >> Here's a (non)working sample. I haven't included my RWStore.properties > >> file, > >> but I don't think it matters. > >> > >> Basically, start the app with a directory containing an > >> RWStore.properties > >> file, then click on it from the list. The repository gets created in one > >> thread, and closed in another, and it bombs. > >> > >> Thanks for your help, > >> > >> ry > >> > >> On Tuesday, October 07, 2014 10:00:29 AM Bryan Thompson wrote: > >> > Can you provide a simple Java class that illustrates the problem? The > >> > unisolated connection close logic is below. If the connection is > >> > >> already > >> > >> > closed, it should return immediately. I suspect that the problem is > >> > >> with > >> > >> > the invocation of > >> > > >> > >>> BigdataSail.*this*.connectionClosed(*this*); > >> > > >> > which notifies the base SAIL that the connection is closed. > >> > > >> > However, this problem does not show up in our tests so we would need an > >> > example in order to replicate it. > >> > > >> > Thanks, > >> > Bryan > >> > > >> > *public* *synchronized* *void* close() *throws* SailException { > >> > > >> > // assertOpen(); > >> > > >> > *if* (!openConn) { > >> > > >> > *return*; > >> > > >> > } > >> > > >> > > >> > > >> > *if* (*txLog*.isInfoEnabled()) > >> > > >> > *txLog*.info("SAIL-CLOSE-CONN: conn=" + *this*); > >> > > >> > *final* IIndexManager im = getDatabase().getIndexManager(); > >> > > >> > > >> > *if* (isDirty()) { > >> > > >> > /* > >> > > >> > * Do implicit rollback() of a dirty connection. > >> > > >> > */ > >> > > >> > rollback(); > >> > > >> > } > >> > > >> > > >> > > >> > *try* { > >> > > >> > // notify the SailBase that the connection is no longer > >> > >> in > >> > >> > use. > >> > > >> > BigdataSail.*this*.connectionClosed(*this*); > >> > > >> > } *finally* { > >> > > >> > *if* (lock != *null*) { > >> > > >> > // release the reentrant lock > >> > > >> > lock.unlock(); > >> > > >> > } > >> > > >> > *if* (unisolated && im *instanceof* Journal) { > >> > > >> > // release the permit. > >> > > >> > ((Journal) im).releaseUnisolatedConnection(); > >> > > >> > } > >> > > >> > openConn = *false*; > >> > > >> > } > >> > > >> > } > >> > > >> > ---- > >> > Bryan Thompson > >> > Chief Scientist & Founder > >> > SYSTAP, LLC > >> > 4501 Tower Road > >> > Greensboro, NC 27410 > >> > br...@sy... > >> > http://bigdata.com > >> > http://mapgraph.io > >> > > >> > CONFIDENTIALITY NOTICE: This email and its contents and attachments > >> > are > >> > for the sole use of the intended recipient(s) and are confidential or > >> > proprietary to SYSTAP. Any unauthorized review, use, disclosure, > >> > dissemination or copying of this email or its contents or attachments > >> > is > >> > prohibited. If you have received this communication in error, please > >> > >> notify > >> > >> > the sender by reply email and permanently delete all copies of the > >> > email > >> > and its contents and attachments. > >> > > >> > On Tue, Oct 7, 2014 at 9:36 AM, ryan <ry...@os...> > >> > >> wrote: > >> > > Hi All, > >> > > I'm trying to add a feature to my project that will allow a user to > >> > > disconnect > >> > > from a locally-connected BigData (1.3.1) engine, start up the network > >> > > server, > >> > > and reconnect to the now-networked repository. > >> > > > >> > > The problem is that every time I I try to close my local connection, > >> > >> I get > >> > >> > > an > >> > > IllegalMonitorStateException that appears to be preventing the > >> > > network > >> > > server > >> > > from working correctly. > >> > > > >> > > The pertinent stack trace is: > >> > > java.lang.IllegalMonitorStateException > >> > > > >> > > at > >> > >> java.util.concurrent.locks.ReentrantReadWriteLock$Sync.tryRelease(Reentra > >> n > >> > >> > > tReadWriteLock.java:374)> > >> > > > >> > > at > >> > >> java.util.concurrent.locks.AbstractQueuedSynchronizer.release(AbstractQue > >> u > >> > >> > > edSynchronizer.java:1260)> > >> > > > >> > > at > >> > >> java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.unlock(Reentr > >> a > >> > >> > > ntReadWriteLock.java:1131)> > >> > > > >> > > at > >> > >> com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.close(BigdataSail. > >> j > >> > >> > > ava:3349)> > >> > > > >> > > at > >> > >> org.openrdf.repository.sail.SailRepositoryConnection.close(SailRepository > >> C > >> > >> > > onnection.java:109) > >> > > > >> > > > >> > > With the default OpenRDF backing store, the system will wait a little > >> > >> bit, > >> > >> > > and > >> > > then close connections for you if you don't close them first. I've > >> > >> tried > >> > >> > > both > >> > > ways (closing the connection first, then the repository, and just > >> > >> closing > >> > >> > > the > >> > > repository) with no difference. > >> > > > >> > > I'm running on java 1.7, bigdata 1.3.1, on a linux host. > >> > > > >> > > I'm at a loss for troubleshooting. I'd be grateful for any advice you > >> > > might > >> > > have. > >> > > > >> > > Thanks, > >> > > ry > >> > > > >> > > -- > >> > > ...you can't have five wolves and one sheep voting on what to have > >> > > for > >> > > supper. > >> > > > >> > > --Larry Flint > >> > >> ------------------------------------------------------------------------- > >> - > >> > >> > > ---- Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer > >> > > Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS > >> > >> Reports > >> > >> > > Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper > >> > > Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer > >> > >> http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clk > >> t > >> > >> > > rk _______________________________________________ > >> > > Bigdata-developers mailing list > >> > > Big...@li... > >> > > https://lists.sourceforge.net/lists/listinfo/bigdata-developers > >> > >> -- > >> Four boxes to be used in defense of liberty: soap, ballot, jury, ammo - > >> use in > >> that order. > >> > >> --Ed Howdershelt -- Psychos don't burst into flames when sunlight hits them. I don't [care] how crazy they are. |
From: Bryan T. <br...@sy...> - 2014-10-07 21:31:36
|
I still do not understand the setup you have going. It sounds simple enough, but what "app" are you clicking on? What list? Please reduce this to code so we can replicate the issue and then we can take a look at it. For example, a unit test would be great. That way we can get the test into the regression suite as well. Thanks, Bryan ---- Bryan Thompson Chief Scientist & Founder SYSTAP, LLC 4501 Tower Road Greensboro, NC 27410 br...@sy... http://bigdata.com http://mapgraph.io CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. On Tue, Oct 7, 2014 at 5:13 PM, ryan <ry...@os...> wrote: > With that example, I'm just starting and stopping a local journal file > directly. No webserver involved. > > > Bryan Thompson <br...@sy...> wrote: > > Are you running the NanoSparqlServer or the sesame workbench? > > Bryan > > ---- > Bryan Thompson > Chief Scientist & Founder > SYSTAP, LLC > 4501 Tower Road > Greensboro, NC 27410 > br...@sy... > http://bigdata.com > http://mapgraph.io > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are > for the sole use of the intended recipient(s) and are confidential or > proprietary to SYSTAP. Any unauthorized review, use, disclosure, > dissemination or copying of this email or its contents or attachments is > prohibited. If you have received this communication in error, please notify > the sender by reply email and permanently delete all copies of the email > and its contents and attachments. > > On Tue, Oct 7, 2014 at 4:29 PM, ryan <ry...@os...> wrote: > >> Here's a (non)working sample. I haven't included my RWStore.properties >> file, >> but I don't think it matters. >> >> Basically, start the app with a directory containing an RWStore.properties >> file, then click on it from the list. The repository gets created in one >> thread, and closed in another, and it bombs. >> >> Thanks for your help, >> >> ry >> >> On Tuesday, October 07, 2014 10:00:29 AM Bryan Thompson wrote: >> > Can you provide a simple Java class that illustrates the problem? The >> > unisolated connection close logic is below. If the connection is >> already >> > closed, it should return immediately. I suspect that the problem is >> with >> > the invocation of >> > >> > >>> BigdataSail.*this*.connectionClosed(*this*); >> > >> > which notifies the base SAIL that the connection is closed. >> > >> > However, this problem does not show up in our tests so we would need an >> > example in order to replicate it. >> > >> > Thanks, >> > Bryan >> > >> > *public* *synchronized* *void* close() *throws* SailException { >> > >> > >> > // assertOpen(); >> > >> > >> > *if* (!openConn) { >> > >> > >> > >> > *return*; >> > >> > >> > >> > } >> > >> > >> > >> > *if* (*txLog*.isInfoEnabled()) >> > >> > *txLog*.info("SAIL-CLOSE-CONN: conn=" + *this*); >> > >> > >> > *final* IIndexManager im = getDatabase().getIndexManager(); >> > >> > >> > *if* (isDirty()) { >> > >> > /* >> > >> > * Do implicit rollback() of a dirty connection. >> > >> > */ >> > >> > rollback(); >> > >> > } >> > >> > >> > >> > *try* { >> > >> > // notify the SailBase that the connection is no longer >> in >> > use. >> > >> > BigdataSail.*this*.connectionClosed(*this*); >> > >> > } *finally* { >> > >> > *if* (lock != *null*) { >> > >> > // release the reentrant lock >> > >> > lock.unlock(); >> > >> > } >> > >> > *if* (unisolated && im *instanceof* Journal) { >> > >> > // release the permit. >> > >> > ((Journal) im).releaseUnisolatedConnection(); >> > >> > } >> > >> > openConn = *false*; >> > >> > } >> > >> > >> > >> > } >> > >> > ---- >> > Bryan Thompson >> > Chief Scientist & Founder >> > SYSTAP, LLC >> > 4501 Tower Road >> > Greensboro, NC 27410 >> > br...@sy... >> > http://bigdata.com >> > http://mapgraph.io >> > >> > CONFIDENTIALITY NOTICE: This email and its contents and attachments are >> > for the sole use of the intended recipient(s) and are confidential or >> > proprietary to SYSTAP. Any unauthorized review, use, disclosure, >> > dissemination or copying of this email or its contents or attachments is >> > prohibited. If you have received this communication in error, please >> notify >> > the sender by reply email and permanently delete all copies of the email >> > and its contents and attachments. >> > >> > On Tue, Oct 7, 2014 at 9:36 AM, ryan <ry...@os...> >> wrote: >> > > Hi All, >> > > I'm trying to add a feature to my project that will allow a user to >> > > disconnect >> > > from a locally-connected BigData (1.3.1) engine, start up the network >> > > server, >> > > and reconnect to the now-networked repository. >> > > >> > > The problem is that every time I I try to close my local connection, >> I get >> > > an >> > > IllegalMonitorStateException that appears to be preventing the network >> > > server >> > > from working correctly. >> > > >> > > The pertinent stack trace is: >> > > java.lang.IllegalMonitorStateException >> > > >> > > at >> > > >> > > >> java.util.concurrent.locks.ReentrantReadWriteLock$Sync.tryRelease(Reentran >> > > tReadWriteLock.java:374)> >> > > at >> > > >> > > >> java.util.concurrent.locks.AbstractQueuedSynchronizer.release(AbstractQueu >> > > edSynchronizer.java:1260)> >> > > at >> > > >> > > >> java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.unlock(Reentra >> > > ntReadWriteLock.java:1131)> >> > > at >> > > >> > > >> com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.close(BigdataSail.j >> > > ava:3349)> >> > > at >> > > >> > > >> org.openrdf.repository.sail.SailRepositoryConnection.close(SailRepositoryC >> > > onnection.java:109) >> > > >> > > >> > > With the default OpenRDF backing store, the system will wait a little >> bit, >> > > and >> > > then close connections for you if you don't close them first. I've >> tried >> > > both >> > > ways (closing the connection first, then the repository, and just >> closing >> > > the >> > > repository) with no difference. >> > > >> > > I'm running on java 1.7, bigdata 1.3.1, on a linux host. >> > > >> > > I'm at a loss for troubleshooting. I'd be grateful for any advice you >> > > might >> > > have. >> > > >> > > Thanks, >> > > ry >> > > >> > > -- >> > > ...you can't have five wolves and one sheep voting on what to have for >> > > supper. >> > > >> > > --Larry Flint >> > > >> > > >> -------------------------------------------------------------------------- >> > > ---- Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer >> > > Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS >> Reports >> > > Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper >> > > Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer >> > > >> > > >> http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clkt >> > > rk _______________________________________________ >> > > Bigdata-developers mailing list >> > > Big...@li... >> > > https://lists.sourceforge.net/lists/listinfo/bigdata-developers >> >> -- >> Four boxes to be used in defense of liberty: soap, ballot, jury, ammo - >> use in >> that order. >> --Ed Howdershelt >> > > |
From: ryan <ry...@os...> - 2014-10-07 21:14:16
|
With that example, I'm just starting and stopping a local journal file directly. No webserver involved. Bryan Thompson <br...@sy...> wrote: >Are you running the NanoSparqlServer or the sesame workbench? > > >Bryan > > >---- >Bryan Thompson > >Chief Scientist & Founder >SYSTAP, LLC > >4501 Tower Road >Greensboro, NC 27410 > >br...@sy... > >http://bigdata.com > >http://mapgraph.io > >CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. > > > >On Tue, Oct 7, 2014 at 4:29 PM, ryan <ry...@os...> wrote: > >Here's a (non)working sample. I haven't included my RWStore.properties file, >but I don't think it matters. > >Basically, start the app with a directory containing an RWStore.properties >file, then click on it from the list. The repository gets created in one >thread, and closed in another, and it bombs. > >Thanks for your help, > >ry > >On Tuesday, October 07, 2014 10:00:29 AM Bryan Thompson wrote: >> Can you provide a simple Java class that illustrates the problem? The >> unisolated connection close logic is below. If the connection is already >> closed, it should return immediately. I suspect that the problem is with >> the invocation of >> >> >>> BigdataSail.*this*.connectionClosed(*this*); >> >> which notifies the base SAIL that the connection is closed. >> >> However, this problem does not show up in our tests so we would need an >> example in order to replicate it. >> >> Thanks, >> Bryan >> >> *public* *synchronized* *void* close() *throws* SailException { >> >> >> // assertOpen(); >> >> >> *if* (!openConn) { >> >> >> >> *return*; >> >> >> >> } >> >> >> >> *if* (*txLog*.isInfoEnabled()) >> >> *txLog*.info("SAIL-CLOSE-CONN: conn=" + *this*); >> >> >> *final* IIndexManager im = getDatabase().getIndexManager(); >> >> >> *if* (isDirty()) { >> >> /* >> >> * Do implicit rollback() of a dirty connection. >> >> */ >> >> rollback(); >> >> } >> >> >> >> *try* { >> >> // notify the SailBase that the connection is no longer in >> use. >> >> BigdataSail.*this*.connectionClosed(*this*); >> >> } *finally* { >> >> *if* (lock != *null*) { >> >> // release the reentrant lock >> >> lock.unlock(); >> >> } >> >> *if* (unisolated && im *instanceof* Journal) { >> >> // release the permit. >> >> ((Journal) im).releaseUnisolatedConnection(); >> >> } >> >> openConn = *false*; >> >> } >> >> >> >> } >> >> ---- >> Bryan Thompson >> Chief Scientist & Founder >> SYSTAP, LLC >> 4501 Tower Road >> Greensboro, NC 27410 >> br...@sy... >> http://bigdata.com >> http://mapgraph.io >> >> CONFIDENTIALITY NOTICE: This email and its contents and attachments are >> for the sole use of the intended recipient(s) and are confidential or >> proprietary to SYSTAP. Any unauthorized review, use, disclosure, >> dissemination or copying of this email or its contents or attachments is >> prohibited. If you have received this communication in error, please notify >> the sender by reply email and permanently delete all copies of the email >> and its contents and attachments. >> >> On Tue, Oct 7, 2014 at 9:36 AM, ryan <ry...@os...> wrote: >> > Hi All, >> > I'm trying to add a feature to my project that will allow a user to >> > disconnect >> > from a locally-connected BigData (1.3.1) engine, start up the network >> > server, >> > and reconnect to the now-networked repository. >> > >> > The problem is that every time I I try to close my local connection, I get >> > an >> > IllegalMonitorStateException that appears to be preventing the network >> > server >> > from working correctly. >> > >> > The pertinent stack trace is: >> > java.lang.IllegalMonitorStateException >> > >> > at >> > >> > java.util.concurrent.locks.ReentrantReadWriteLock$Sync.tryRelease(Reentran >> > tReadWriteLock.java:374)> >> > at >> > >> > java.util.concurrent.locks.AbstractQueuedSynchronizer.release(AbstractQueu >> > edSynchronizer.java:1260)> >> > at >> > >> > java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.unlock(Reentra >> > ntReadWriteLock.java:1131)> >> > at >> > >> > com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.close(BigdataSail.j >> > ava:3349)> >> > at >> > >> > org.openrdf.repository.sail.SailRepositoryConnection.close(SailRepositoryC >> > onnection.java:109) >> > >> > >> > With the default OpenRDF backing store, the system will wait a little bit, >> > and >> > then close connections for you if you don't close them first. I've tried >> > both >> > ways (closing the connection first, then the repository, and just closing >> > the >> > repository) with no difference. >> > >> > I'm running on java 1.7, bigdata 1.3.1, on a linux host. >> > >> > I'm at a loss for troubleshooting. I'd be grateful for any advice you >> > might >> > have. >> > >> > Thanks, >> > ry >> > >> > -- >> > ...you can't have five wolves and one sheep voting on what to have for >> > supper. >> > >> > --Larry Flint >> > >> > -------------------------------------------------------------------------- >> > ---- Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer >> > Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports >> > Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper >> > Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer >> > >> > http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clkt >> > rk _______________________________________________ >> > Bigdata-developers mailing list >> > Big...@li... >> > https://lists.sourceforge.net/lists/listinfo/bigdata-developers > >-- >Four boxes to be used in defense of liberty: soap, ballot, jury, ammo - use in >that order. > --Ed Howdershelt > > |
From: Bryan T. <br...@sy...> - 2014-10-07 20:38:10
|
Are you running the NanoSparqlServer or the sesame workbench? Bryan ---- Bryan Thompson Chief Scientist & Founder SYSTAP, LLC 4501 Tower Road Greensboro, NC 27410 br...@sy... http://bigdata.com http://mapgraph.io CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. On Tue, Oct 7, 2014 at 4:29 PM, ryan <ry...@os...> wrote: > Here's a (non)working sample. I haven't included my RWStore.properties > file, > but I don't think it matters. > > Basically, start the app with a directory containing an RWStore.properties > file, then click on it from the list. The repository gets created in one > thread, and closed in another, and it bombs. > > Thanks for your help, > > ry > > On Tuesday, October 07, 2014 10:00:29 AM Bryan Thompson wrote: > > Can you provide a simple Java class that illustrates the problem? The > > unisolated connection close logic is below. If the connection is already > > closed, it should return immediately. I suspect that the problem is with > > the invocation of > > > > >>> BigdataSail.*this*.connectionClosed(*this*); > > > > which notifies the base SAIL that the connection is closed. > > > > However, this problem does not show up in our tests so we would need an > > example in order to replicate it. > > > > Thanks, > > Bryan > > > > *public* *synchronized* *void* close() *throws* SailException { > > > > > > // assertOpen(); > > > > > > *if* (!openConn) { > > > > > > > > *return*; > > > > > > > > } > > > > > > > > *if* (*txLog*.isInfoEnabled()) > > > > *txLog*.info("SAIL-CLOSE-CONN: conn=" + *this*); > > > > > > *final* IIndexManager im = getDatabase().getIndexManager(); > > > > > > *if* (isDirty()) { > > > > /* > > > > * Do implicit rollback() of a dirty connection. > > > > */ > > > > rollback(); > > > > } > > > > > > > > *try* { > > > > // notify the SailBase that the connection is no longer > in > > use. > > > > BigdataSail.*this*.connectionClosed(*this*); > > > > } *finally* { > > > > *if* (lock != *null*) { > > > > // release the reentrant lock > > > > lock.unlock(); > > > > } > > > > *if* (unisolated && im *instanceof* Journal) { > > > > // release the permit. > > > > ((Journal) im).releaseUnisolatedConnection(); > > > > } > > > > openConn = *false*; > > > > } > > > > > > > > } > > > > ---- > > Bryan Thompson > > Chief Scientist & Founder > > SYSTAP, LLC > > 4501 Tower Road > > Greensboro, NC 27410 > > br...@sy... > > http://bigdata.com > > http://mapgraph.io > > > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are > > for the sole use of the intended recipient(s) and are confidential or > > proprietary to SYSTAP. Any unauthorized review, use, disclosure, > > dissemination or copying of this email or its contents or attachments is > > prohibited. If you have received this communication in error, please > notify > > the sender by reply email and permanently delete all copies of the email > > and its contents and attachments. > > > > On Tue, Oct 7, 2014 at 9:36 AM, ryan <ry...@os...> wrote: > > > Hi All, > > > I'm trying to add a feature to my project that will allow a user to > > > disconnect > > > from a locally-connected BigData (1.3.1) engine, start up the network > > > server, > > > and reconnect to the now-networked repository. > > > > > > The problem is that every time I I try to close my local connection, I > get > > > an > > > IllegalMonitorStateException that appears to be preventing the network > > > server > > > from working correctly. > > > > > > The pertinent stack trace is: > > > java.lang.IllegalMonitorStateException > > > > > > at > > > > > > > java.util.concurrent.locks.ReentrantReadWriteLock$Sync.tryRelease(Reentran > > > tReadWriteLock.java:374)> > > > at > > > > > > > java.util.concurrent.locks.AbstractQueuedSynchronizer.release(AbstractQueu > > > edSynchronizer.java:1260)> > > > at > > > > > > > java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.unlock(Reentra > > > ntReadWriteLock.java:1131)> > > > at > > > > > > > com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.close(BigdataSail.j > > > ava:3349)> > > > at > > > > > > > org.openrdf.repository.sail.SailRepositoryConnection.close(SailRepositoryC > > > onnection.java:109) > > > > > > > > > With the default OpenRDF backing store, the system will wait a little > bit, > > > and > > > then close connections for you if you don't close them first. I've > tried > > > both > > > ways (closing the connection first, then the repository, and just > closing > > > the > > > repository) with no difference. > > > > > > I'm running on java 1.7, bigdata 1.3.1, on a linux host. > > > > > > I'm at a loss for troubleshooting. I'd be grateful for any advice you > > > might > > > have. > > > > > > Thanks, > > > ry > > > > > > -- > > > ...you can't have five wolves and one sheep voting on what to have for > > > supper. > > > > > > --Larry Flint > > > > > > > -------------------------------------------------------------------------- > > > ---- Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer > > > Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS > Reports > > > Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper > > > Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer > > > > > > > http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clkt > > > rk _______________________________________________ > > > Bigdata-developers mailing list > > > Big...@li... > > > https://lists.sourceforge.net/lists/listinfo/bigdata-developers > > -- > Four boxes to be used in defense of liberty: soap, ballot, jury, ammo - > use in > that order. > --Ed Howdershelt > |
From: ryan <ry...@os...> - 2014-10-07 20:29:37
|
Here's a (non)working sample. I haven't included my RWStore.properties file, but I don't think it matters. Basically, start the app with a directory containing an RWStore.properties file, then click on it from the list. The repository gets created in one thread, and closed in another, and it bombs. Thanks for your help, ry On Tuesday, October 07, 2014 10:00:29 AM Bryan Thompson wrote: > Can you provide a simple Java class that illustrates the problem? The > unisolated connection close logic is below. If the connection is already > closed, it should return immediately. I suspect that the problem is with > the invocation of > > >>> BigdataSail.*this*.connectionClosed(*this*); > > which notifies the base SAIL that the connection is closed. > > However, this problem does not show up in our tests so we would need an > example in order to replicate it. > > Thanks, > Bryan > > *public* *synchronized* *void* close() *throws* SailException { > > > // assertOpen(); > > > *if* (!openConn) { > > > > *return*; > > > > } > > > > *if* (*txLog*.isInfoEnabled()) > > *txLog*.info("SAIL-CLOSE-CONN: conn=" + *this*); > > > *final* IIndexManager im = getDatabase().getIndexManager(); > > > *if* (isDirty()) { > > /* > > * Do implicit rollback() of a dirty connection. > > */ > > rollback(); > > } > > > > *try* { > > // notify the SailBase that the connection is no longer in > use. > > BigdataSail.*this*.connectionClosed(*this*); > > } *finally* { > > *if* (lock != *null*) { > > // release the reentrant lock > > lock.unlock(); > > } > > *if* (unisolated && im *instanceof* Journal) { > > // release the permit. > > ((Journal) im).releaseUnisolatedConnection(); > > } > > openConn = *false*; > > } > > > > } > > ---- > Bryan Thompson > Chief Scientist & Founder > SYSTAP, LLC > 4501 Tower Road > Greensboro, NC 27410 > br...@sy... > http://bigdata.com > http://mapgraph.io > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are > for the sole use of the intended recipient(s) and are confidential or > proprietary to SYSTAP. Any unauthorized review, use, disclosure, > dissemination or copying of this email or its contents or attachments is > prohibited. If you have received this communication in error, please notify > the sender by reply email and permanently delete all copies of the email > and its contents and attachments. > > On Tue, Oct 7, 2014 at 9:36 AM, ryan <ry...@os...> wrote: > > Hi All, > > I'm trying to add a feature to my project that will allow a user to > > disconnect > > from a locally-connected BigData (1.3.1) engine, start up the network > > server, > > and reconnect to the now-networked repository. > > > > The problem is that every time I I try to close my local connection, I get > > an > > IllegalMonitorStateException that appears to be preventing the network > > server > > from working correctly. > > > > The pertinent stack trace is: > > java.lang.IllegalMonitorStateException > > > > at > > > > java.util.concurrent.locks.ReentrantReadWriteLock$Sync.tryRelease(Reentran > > tReadWriteLock.java:374)> > > at > > > > java.util.concurrent.locks.AbstractQueuedSynchronizer.release(AbstractQueu > > edSynchronizer.java:1260)> > > at > > > > java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.unlock(Reentra > > ntReadWriteLock.java:1131)> > > at > > > > com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.close(BigdataSail.j > > ava:3349)> > > at > > > > org.openrdf.repository.sail.SailRepositoryConnection.close(SailRepositoryC > > onnection.java:109) > > > > > > With the default OpenRDF backing store, the system will wait a little bit, > > and > > then close connections for you if you don't close them first. I've tried > > both > > ways (closing the connection first, then the repository, and just closing > > the > > repository) with no difference. > > > > I'm running on java 1.7, bigdata 1.3.1, on a linux host. > > > > I'm at a loss for troubleshooting. I'd be grateful for any advice you > > might > > have. > > > > Thanks, > > ry > > > > -- > > ...you can't have five wolves and one sheep voting on what to have for > > supper. > > > > --Larry Flint > > > > -------------------------------------------------------------------------- > > ---- Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer > > Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports > > Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper > > Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer > > > > http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clkt > > rk _______________________________________________ > > Bigdata-developers mailing list > > Big...@li... > > https://lists.sourceforge.net/lists/listinfo/bigdata-developers -- Four boxes to be used in defense of liberty: soap, ballot, jury, ammo - use in that order. --Ed Howdershelt |
From: Bryan T. <br...@sy...> - 2014-10-07 14:00:41
|
Can you provide a simple Java class that illustrates the problem? The unisolated connection close logic is below. If the connection is already closed, it should return immediately. I suspect that the problem is with the invocation of >>> BigdataSail.*this*.connectionClosed(*this*); which notifies the base SAIL that the connection is closed. However, this problem does not show up in our tests so we would need an example in order to replicate it. Thanks, Bryan *public* *synchronized* *void* close() *throws* SailException { // assertOpen(); *if* (!openConn) { *return*; } *if* (*txLog*.isInfoEnabled()) *txLog*.info("SAIL-CLOSE-CONN: conn=" + *this*); *final* IIndexManager im = getDatabase().getIndexManager(); *if* (isDirty()) { /* * Do implicit rollback() of a dirty connection. */ rollback(); } *try* { // notify the SailBase that the connection is no longer in use. BigdataSail.*this*.connectionClosed(*this*); } *finally* { *if* (lock != *null*) { // release the reentrant lock lock.unlock(); } *if* (unisolated && im *instanceof* Journal) { // release the permit. ((Journal) im).releaseUnisolatedConnection(); } openConn = *false*; } } ---- Bryan Thompson Chief Scientist & Founder SYSTAP, LLC 4501 Tower Road Greensboro, NC 27410 br...@sy... http://bigdata.com http://mapgraph.io CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. On Tue, Oct 7, 2014 at 9:36 AM, ryan <ry...@os...> wrote: > Hi All, > I'm trying to add a feature to my project that will allow a user to > disconnect > from a locally-connected BigData (1.3.1) engine, start up the network > server, > and reconnect to the now-networked repository. > > The problem is that every time I I try to close my local connection, I get > an > IllegalMonitorStateException that appears to be preventing the network > server > from working correctly. > > The pertinent stack trace is: > java.lang.IllegalMonitorStateException > at > > java.util.concurrent.locks.ReentrantReadWriteLock$Sync.tryRelease(ReentrantReadWriteLock.java:374) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer.release(AbstractQueuedSynchronizer.java:1260) > at > > java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.unlock(ReentrantReadWriteLock.java:1131) > at > > com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.close(BigdataSail.java:3349) > at > > org.openrdf.repository.sail.SailRepositoryConnection.close(SailRepositoryConnection.java:109) > > > With the default OpenRDF backing store, the system will wait a little bit, > and > then close connections for you if you don't close them first. I've tried > both > ways (closing the connection first, then the repository, and just closing > the > repository) with no difference. > > I'm running on java 1.7, bigdata 1.3.1, on a linux host. > > I'm at a loss for troubleshooting. I'd be grateful for any advice you might > have. > > Thanks, > ry > > -- > ...you can't have five wolves and one sheep voting on what to have for > supper. > --Larry Flint > > > > ------------------------------------------------------------------------------ > Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer > Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports > Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper > Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer > > http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk > _______________________________________________ > Bigdata-developers mailing list > Big...@li... > https://lists.sourceforge.net/lists/listinfo/bigdata-developers > |
From: ryan <ry...@os...> - 2014-10-07 13:49:46
|
Hi All, I'm trying to add a feature to my project that will allow a user to disconnect from a locally-connected BigData (1.3.1) engine, start up the network server, and reconnect to the now-networked repository. The problem is that every time I I try to close my local connection, I get an IllegalMonitorStateException that appears to be preventing the network server from working correctly. The pertinent stack trace is: java.lang.IllegalMonitorStateException at java.util.concurrent.locks.ReentrantReadWriteLock$Sync.tryRelease(ReentrantReadWriteLock.java:374) at java.util.concurrent.locks.AbstractQueuedSynchronizer.release(AbstractQueuedSynchronizer.java:1260) at java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.unlock(ReentrantReadWriteLock.java:1131) at com.bigdata.rdf.sail.BigdataSail$BigdataSailConnection.close(BigdataSail.java:3349) at org.openrdf.repository.sail.SailRepositoryConnection.close(SailRepositoryConnection.java:109) With the default OpenRDF backing store, the system will wait a little bit, and then close connections for you if you don't close them first. I've tried both ways (closing the connection first, then the repository, and just closing the repository) with no difference. I'm running on java 1.7, bigdata 1.3.1, on a linux host. I'm at a loss for troubleshooting. I'd be grateful for any advice you might have. Thanks, ry -- ...you can't have five wolves and one sheep voting on what to have for supper. --Larry Flint |
From: Bryan T. <br...@sy...> - 2014-10-06 17:32:15
|
Rose, The trunk is no longer used for bigdata. You can checkout the 1.3.2 release from: https://svn.code.sf.net/p/bigdata/code/tags/BIGDATA_RELEASE_1_3_2 The 1.3.x maintenance and development branch is: https://svn.code.sf.net/p/bigdata/code/branches/BIGDATA_RELEASE_1_3_0 You can also download bigdata from our web site: http://www.bigdata.com/download. Be sure to given the Java platform sufficient resources if you are loading large files (-server, -Xmx16G or better, etc.). See wiki.bigdata.com for various information on how to obtain, build, configure, and use the bigdata platform. Thanks, Bryan ---- Bryan Thompson Chief Scientist & Founder SYSTAP, LLC 4501 Tower Road Greensboro, NC 27410 br...@sy... http://bigdata.com http://mapgraph.io CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. On Mon, Oct 6, 2014 at 1:09 PM, Rose Beck <ros...@gm...> wrote: > Dear Bryan, > > I have Uniprot data in turse triple form (ttl) and I want to load it > in bigdata and I want to query it using bigdata. On the web page > http://wiki.bigdata.com/wiki/index.php/NanoSparqlServer it is > mentioned that I should look at the example: NSSEmbeddedExample.java. > However when I check out the code: > svn checkout svn://svn.code.sf.net/p/bigdata/code/trunk bigdata-code > > I am unable to find this example. > > Can you please help me with this. I am a complete novice at Java > (Although I work on C/C++ and Python extensively), therefore I am not > able to understand as to how should I load large datasets into Bigdata > and how should I query them. Perhaps a step-by-step guide for users > like me who are not familiar with Java will be of great help. > > Thanks & Regards, > Jyoti > |
From: Rose B. <ros...@gm...> - 2014-10-06 17:09:41
|
Dear Bryan, I have Uniprot data in turse triple form (ttl) and I want to load it in bigdata and I want to query it using bigdata. On the web page http://wiki.bigdata.com/wiki/index.php/NanoSparqlServer it is mentioned that I should look at the example: NSSEmbeddedExample.java. However when I check out the code: svn checkout svn://svn.code.sf.net/p/bigdata/code/trunk bigdata-code I am unable to find this example. Can you please help me with this. I am a complete novice at Java (Although I work on C/C++ and Python extensively), therefore I am not able to understand as to how should I load large datasets into Bigdata and how should I query them. Perhaps a step-by-step guide for users like me who are not familiar with Java will be of great help. Thanks & Regards, Jyoti On Mon, Oct 6, 2014 at 8:40 PM, Bryan Thompson <br...@sy...> wrote: > Certainly. There are a number of resources at http://blog.bigdata.com. > There is a chapter length paper on the bigdata architecture at [1]. This is > also linked from that blog page. You might also be interested in our other > project, which is http://mapgraph.io. > > If you are only storing the source of a triple, then the named graphs > mechanism is sufficient since the URI of the named graph can be used for the > source URI. > > However, if you want to associate more metadata with each triple then RDR is > the way to go. > > Thanks, > Bryan > > [1] http://www.bigdata.com/whitepapers/bigdata_architecture_whitepaper.pdf > > ---- > Bryan Thompson > Chief Scientist & Founder > SYSTAP, LLC > 4501 Tower Road > Greensboro, NC 27410 > br...@sy... > http://bigdata.com > http://mapgraph.io > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are for > the sole use of the intended recipient(s) and are confidential or > proprietary to SYSTAP. Any unauthorized review, use, disclosure, > dissemination or copying of this email or its contents or attachments is > prohibited. If you have received this communication in error, please notify > the sender by reply email and permanently delete all copies of the email and > its contents and attachments. > > > On Mon, Oct 6, 2014 at 11:05 AM, Rose Beck <ros...@gm...> wrote: >> >> Dear Bryan, >> >> For now we are just using RDR for storing provenance or source of >> triples. All these questions arise in my mind out of curiosity :) >> >> I saw bigdata slides at >> http://www.cse.unsw.edu.au/~iwgdm/2012/Slides/bigdata.pdf. And I am >> pretty curious to read more about: how Bigdata implements vectored >> query execution and what engineering goes behind its analytic mode of >> execution. If possible, can you please point me to resources from >> which I learn more about the same? >> >> >> Thanks & Regards, >> Rose >> >> >> On Mon, Oct 6, 2014 at 8:15 PM, Bryan Thompson <br...@sy...> wrote: >> > Rose, >> > >> > I think that the requirement for statement level metadata should be >> > orthogonal to the decision to use named graphs. Statement level >> > metadata >> > can be used for a variety of purposes. For example, it can be used for >> > security, it can be used to provide the source of the statement (which >> > is >> > often the use case for named graphs), to associate an author with a >> > statement, to associate a creation time with a statement, to associate a >> > weight with an edge of a graph, etc. >> > >> > What is the use case that motivates the RDR mechanisms for you? Perhaps >> > if >> > you can explain that I can provide an example of how this might be >> > relevant >> > in the context of named graphs for your application. However, the >> > feature >> > is not currently supported for the quads mode of the bigdata database, >> > so >> > this is a somewhat academic question. >> > >> > Thanks, >> > Bryan >> > >> > ---- >> > Bryan Thompson >> > Chief Scientist & Founder >> > SYSTAP, LLC >> > 4501 Tower Road >> > Greensboro, NC 27410 >> > br...@sy... >> > http://bigdata.com >> > http://mapgraph.io >> > >> > CONFIDENTIALITY NOTICE: This email and its contents and attachments are >> > for >> > the sole use of the intended recipient(s) and are confidential or >> > proprietary to SYSTAP. Any unauthorized review, use, disclosure, >> > dissemination or copying of this email or its contents or attachments is >> > prohibited. If you have received this communication in error, please >> > notify >> > the sender by reply email and permanently delete all copies of the email >> > and >> > its contents and attachments. >> > >> > >> > On Mon, Oct 6, 2014 at 10:40 AM, Rose Beck <ros...@gm...> >> > wrote: >> >> >> >> Dear Bryan, >> >> >> >> Probably I am new to the field. But since you are an experienced >> >> person in the field, therefore can you please help me understand that: >> >> when we apply RDR mechanism to triples, then what is the practical >> >> use-case application of using named graph mechanism? I mean I >> >> understand intuitively but I still am not able to get the practical >> >> significance of using named graphs. >> >> >> >> >> >> Thanks & Regards, >> >> Rose >> >> >> >> On Mon, Oct 6, 2014 at 8:02 PM, Bryan Thompson <br...@sy...> >> >> wrote: >> >> > The purpose of RDR is to permit statements about statements. >> >> > >> >> > The purpose of named graphs is to allow statements to be collected >> >> > into >> >> > containers. >> >> > >> >> > With RDF* support for named graphs, you could do both. >> >> > >> >> > Whether or not this is a good idea is an interesting question. >> >> > Consider, >> >> > that named graphs could be interpreted as just a special case of a >> >> > statement >> >> > about a statement where the database then applies special indexing >> >> > (typically by maintaining additional indices for fast access by the >> >> > named >> >> > graph). >> >> > >> >> > For example, given: >> >> > >> >> > <<:a :b :c> :namedGraph :d> >> >> > >> >> > If we assume that ":namedGraph" has the semantics of the SPARQL named >> >> > graphs >> >> > mechanism, then this RDR assertion says that the statement :a :b :c >> >> > exists >> >> > in the named graph :d. >> >> > >> >> > If so, then the RDR mechanisms always apply to triples and the named >> >> > graphs >> >> > mechanism just specifies the containers within which a given triple >> >> > (including an RDR triple) is visible. >> >> > >> >> > Thanks, >> >> > Bryan >> >> > >> >> > ---- >> >> > Bryan Thompson >> >> > Chief Scientist & Founder >> >> > SYSTAP, LLC >> >> > 4501 Tower Road >> >> > Greensboro, NC 27410 >> >> > br...@sy... >> >> > http://bigdata.com >> >> > http://mapgraph.io >> >> > >> >> > CONFIDENTIALITY NOTICE: This email and its contents and attachments >> >> > are >> >> > for >> >> > the sole use of the intended recipient(s) and are confidential or >> >> > proprietary to SYSTAP. Any unauthorized review, use, disclosure, >> >> > dissemination or copying of this email or its contents or attachments >> >> > is >> >> > prohibited. If you have received this communication in error, please >> >> > notify >> >> > the sender by reply email and permanently delete all copies of the >> >> > email >> >> > and >> >> > its contents and attachments. >> >> > >> >> > >> >> > On Mon, Oct 6, 2014 at 10:19 AM, Rose Beck <ros...@gm...> >> >> > wrote: >> >> >> >> >> >> Dear Bryan, >> >> >> >> >> >> Thanks for the enlightening write-up about RDR. But I have a >> >> >> question >> >> >> in the write-up you wrote "In the future, we plan to add support for >> >> >> RDF* and SPARQL* to the quads mode of the platform as well. This >> >> >> will >> >> >> allow statement level metadata to co-exist seamlessly with the named >> >> >> graphs model." But I dont understand the need for supporting RDF* >> >> >> and >> >> >> SPARQL* in quads mode. I mean I dont understand as to why do we need >> >> >> to allow statement level metadata to co-exist with named graph >> >> >> model. >> >> >> Can you please explain this with an example. >> >> >> >> >> >> >> >> >> Thanks & Regards, >> >> >> Rose. >> >> >> >> >> >> On Mon, Oct 6, 2014 at 5:59 PM, Bryan Thompson <br...@sy...> >> >> >> wrote: >> >> >> > I've added a page to the wiki based on that blog post: >> >> >> > >> >> >> > wiki.bigdata.com/wiki/index.php/Reification_Done_Right >> >> >> > >> >> >> > Thanks, >> >> >> > Bryan >> >> >> > >> >> >> > ---- >> >> >> > Bryan Thompson >> >> >> > Chief Scientist & Founder >> >> >> > SYSTAP, LLC >> >> >> > 4501 Tower Road >> >> >> > Greensboro, NC 27410 >> >> >> > br...@sy... >> >> >> > http://bigdata.com >> >> >> > http://mapgraph.io >> >> >> > >> >> >> > CONFIDENTIALITY NOTICE: This email and its contents and >> >> >> > attachments >> >> >> > are >> >> >> > for >> >> >> > the sole use of the intended recipient(s) and are confidential or >> >> >> > proprietary to SYSTAP. Any unauthorized review, use, disclosure, >> >> >> > dissemination or copying of this email or its contents or >> >> >> > attachments >> >> >> > is >> >> >> > prohibited. If you have received this communication in error, >> >> >> > please >> >> >> > notify >> >> >> > the sender by reply email and permanently delete all copies of the >> >> >> > email >> >> >> > and >> >> >> > its contents and attachments. >> >> >> > >> >> >> > >> >> >> > On Sun, Oct 5, 2014 at 5:27 PM, Rose Beck <ros...@gm...> >> >> >> > wrote: >> >> >> >> >> >> >> >> Dear all, >> >> >> >> >> >> >> >> I have downloaded bigdata.war and have deployed it using sesame >> >> >> >> HTTP >> >> >> >> API. Now I am not getting as to how should I load rdf >> >> >> >> triples/provenance with triples to bigdata using >> >> >> >> nanosparqlserver? I >> >> >> >> am using sesame HTTP API (using apache tomcat). Can someone >> >> >> >> please >> >> >> >> help. >> >> >> >> >> >> >> >> I intend to use mysql, native java and postgres with sesame. Any >> >> >> >> help >> >> >> >> will be deeply appreciated. >> >> >> >> >> >> >> >> Regards, >> >> >> >> Rose >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> ------------------------------------------------------------------------------ >> >> >> >> Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer >> >> >> >> Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS >> >> >> >> Reports >> >> >> >> Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White >> >> >> >> paper >> >> >> >> Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog >> >> >> >> Analyzer >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk >> >> >> >> _______________________________________________ >> >> >> >> Bigdata-developers mailing list >> >> >> >> Big...@li... >> >> >> >> https://lists.sourceforge.net/lists/listinfo/bigdata-developers >> >> >> > >> >> >> > >> >> > >> >> > >> > >> > > > |
From: Bryan T. <br...@sy...> - 2014-10-06 15:10:59
|
Certainly. There are a number of resources at http://blog.bigdata.com. There is a chapter length paper on the bigdata architecture at [1]. This is also linked from that blog page. You might also be interested in our other project, which is http://mapgraph.io. If you are only storing the source of a triple, then the named graphs mechanism is sufficient since the URI of the named graph can be used for the source URI. However, if you want to associate more metadata with each triple then RDR is the way to go. Thanks, Bryan [1] http://www.bigdata.com/whitepapers/bigdata_architecture_whitepaper.pdf ---- Bryan Thompson Chief Scientist & Founder SYSTAP, LLC 4501 Tower Road Greensboro, NC 27410 br...@sy... http://bigdata.com http://mapgraph.io CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. On Mon, Oct 6, 2014 at 11:05 AM, Rose Beck <ros...@gm...> wrote: > Dear Bryan, > > For now we are just using RDR for storing provenance or source of > triples. All these questions arise in my mind out of curiosity :) > > I saw bigdata slides at > http://www.cse.unsw.edu.au/~iwgdm/2012/Slides/bigdata.pdf. And I am > pretty curious to read more about: how Bigdata implements vectored > query execution and what engineering goes behind its analytic mode of > execution. If possible, can you please point me to resources from > which I learn more about the same? > > > Thanks & Regards, > Rose > > > On Mon, Oct 6, 2014 at 8:15 PM, Bryan Thompson <br...@sy...> wrote: > > Rose, > > > > I think that the requirement for statement level metadata should be > > orthogonal to the decision to use named graphs. Statement level metadata > > can be used for a variety of purposes. For example, it can be used for > > security, it can be used to provide the source of the statement (which is > > often the use case for named graphs), to associate an author with a > > statement, to associate a creation time with a statement, to associate a > > weight with an edge of a graph, etc. > > > > What is the use case that motivates the RDR mechanisms for you? Perhaps > if > > you can explain that I can provide an example of how this might be > relevant > > in the context of named graphs for your application. However, the > feature > > is not currently supported for the quads mode of the bigdata database, so > > this is a somewhat academic question. > > > > Thanks, > > Bryan > > > > ---- > > Bryan Thompson > > Chief Scientist & Founder > > SYSTAP, LLC > > 4501 Tower Road > > Greensboro, NC 27410 > > br...@sy... > > http://bigdata.com > > http://mapgraph.io > > > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are > for > > the sole use of the intended recipient(s) and are confidential or > > proprietary to SYSTAP. Any unauthorized review, use, disclosure, > > dissemination or copying of this email or its contents or attachments is > > prohibited. If you have received this communication in error, please > notify > > the sender by reply email and permanently delete all copies of the email > and > > its contents and attachments. > > > > > > On Mon, Oct 6, 2014 at 10:40 AM, Rose Beck <ros...@gm...> > wrote: > >> > >> Dear Bryan, > >> > >> Probably I am new to the field. But since you are an experienced > >> person in the field, therefore can you please help me understand that: > >> when we apply RDR mechanism to triples, then what is the practical > >> use-case application of using named graph mechanism? I mean I > >> understand intuitively but I still am not able to get the practical > >> significance of using named graphs. > >> > >> > >> Thanks & Regards, > >> Rose > >> > >> On Mon, Oct 6, 2014 at 8:02 PM, Bryan Thompson <br...@sy...> > wrote: > >> > The purpose of RDR is to permit statements about statements. > >> > > >> > The purpose of named graphs is to allow statements to be collected > into > >> > containers. > >> > > >> > With RDF* support for named graphs, you could do both. > >> > > >> > Whether or not this is a good idea is an interesting question. > >> > Consider, > >> > that named graphs could be interpreted as just a special case of a > >> > statement > >> > about a statement where the database then applies special indexing > >> > (typically by maintaining additional indices for fast access by the > >> > named > >> > graph). > >> > > >> > For example, given: > >> > > >> > <<:a :b :c> :namedGraph :d> > >> > > >> > If we assume that ":namedGraph" has the semantics of the SPARQL named > >> > graphs > >> > mechanism, then this RDR assertion says that the statement :a :b :c > >> > exists > >> > in the named graph :d. > >> > > >> > If so, then the RDR mechanisms always apply to triples and the named > >> > graphs > >> > mechanism just specifies the containers within which a given triple > >> > (including an RDR triple) is visible. > >> > > >> > Thanks, > >> > Bryan > >> > > >> > ---- > >> > Bryan Thompson > >> > Chief Scientist & Founder > >> > SYSTAP, LLC > >> > 4501 Tower Road > >> > Greensboro, NC 27410 > >> > br...@sy... > >> > http://bigdata.com > >> > http://mapgraph.io > >> > > >> > CONFIDENTIALITY NOTICE: This email and its contents and attachments > are > >> > for > >> > the sole use of the intended recipient(s) and are confidential or > >> > proprietary to SYSTAP. Any unauthorized review, use, disclosure, > >> > dissemination or copying of this email or its contents or attachments > is > >> > prohibited. If you have received this communication in error, please > >> > notify > >> > the sender by reply email and permanently delete all copies of the > email > >> > and > >> > its contents and attachments. > >> > > >> > > >> > On Mon, Oct 6, 2014 at 10:19 AM, Rose Beck <ros...@gm...> > >> > wrote: > >> >> > >> >> Dear Bryan, > >> >> > >> >> Thanks for the enlightening write-up about RDR. But I have a question > >> >> in the write-up you wrote "In the future, we plan to add support for > >> >> RDF* and SPARQL* to the quads mode of the platform as well. This will > >> >> allow statement level metadata to co-exist seamlessly with the named > >> >> graphs model." But I dont understand the need for supporting RDF* and > >> >> SPARQL* in quads mode. I mean I dont understand as to why do we need > >> >> to allow statement level metadata to co-exist with named graph model. > >> >> Can you please explain this with an example. > >> >> > >> >> > >> >> Thanks & Regards, > >> >> Rose. > >> >> > >> >> On Mon, Oct 6, 2014 at 5:59 PM, Bryan Thompson <br...@sy...> > >> >> wrote: > >> >> > I've added a page to the wiki based on that blog post: > >> >> > > >> >> > wiki.bigdata.com/wiki/index.php/Reification_Done_Right > >> >> > > >> >> > Thanks, > >> >> > Bryan > >> >> > > >> >> > ---- > >> >> > Bryan Thompson > >> >> > Chief Scientist & Founder > >> >> > SYSTAP, LLC > >> >> > 4501 Tower Road > >> >> > Greensboro, NC 27410 > >> >> > br...@sy... > >> >> > http://bigdata.com > >> >> > http://mapgraph.io > >> >> > > >> >> > CONFIDENTIALITY NOTICE: This email and its contents and > attachments > >> >> > are > >> >> > for > >> >> > the sole use of the intended recipient(s) and are confidential or > >> >> > proprietary to SYSTAP. Any unauthorized review, use, disclosure, > >> >> > dissemination or copying of this email or its contents or > attachments > >> >> > is > >> >> > prohibited. If you have received this communication in error, > please > >> >> > notify > >> >> > the sender by reply email and permanently delete all copies of the > >> >> > email > >> >> > and > >> >> > its contents and attachments. > >> >> > > >> >> > > >> >> > On Sun, Oct 5, 2014 at 5:27 PM, Rose Beck <ros...@gm...> > >> >> > wrote: > >> >> >> > >> >> >> Dear all, > >> >> >> > >> >> >> I have downloaded bigdata.war and have deployed it using sesame > HTTP > >> >> >> API. Now I am not getting as to how should I load rdf > >> >> >> triples/provenance with triples to bigdata using > nanosparqlserver? I > >> >> >> am using sesame HTTP API (using apache tomcat). Can someone please > >> >> >> help. > >> >> >> > >> >> >> I intend to use mysql, native java and postgres with sesame. Any > >> >> >> help > >> >> >> will be deeply appreciated. > >> >> >> > >> >> >> Regards, > >> >> >> Rose > >> >> >> > >> >> >> > >> >> >> > >> >> >> > >> >> >> > ------------------------------------------------------------------------------ > >> >> >> Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer > >> >> >> Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS > >> >> >> Reports > >> >> >> Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White > paper > >> >> >> Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog > Analyzer > >> >> >> > >> >> >> > >> >> >> > >> >> >> > http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk > >> >> >> _______________________________________________ > >> >> >> Bigdata-developers mailing list > >> >> >> Big...@li... > >> >> >> https://lists.sourceforge.net/lists/listinfo/bigdata-developers > >> >> > > >> >> > > >> > > >> > > > > > > |
From: Rose B. <ros...@gm...> - 2014-10-06 15:05:33
|
Dear Bryan, For now we are just using RDR for storing provenance or source of triples. All these questions arise in my mind out of curiosity :) I saw bigdata slides at http://www.cse.unsw.edu.au/~iwgdm/2012/Slides/bigdata.pdf. And I am pretty curious to read more about: how Bigdata implements vectored query execution and what engineering goes behind its analytic mode of execution. If possible, can you please point me to resources from which I learn more about the same? Thanks & Regards, Rose On Mon, Oct 6, 2014 at 8:15 PM, Bryan Thompson <br...@sy...> wrote: > Rose, > > I think that the requirement for statement level metadata should be > orthogonal to the decision to use named graphs. Statement level metadata > can be used for a variety of purposes. For example, it can be used for > security, it can be used to provide the source of the statement (which is > often the use case for named graphs), to associate an author with a > statement, to associate a creation time with a statement, to associate a > weight with an edge of a graph, etc. > > What is the use case that motivates the RDR mechanisms for you? Perhaps if > you can explain that I can provide an example of how this might be relevant > in the context of named graphs for your application. However, the feature > is not currently supported for the quads mode of the bigdata database, so > this is a somewhat academic question. > > Thanks, > Bryan > > ---- > Bryan Thompson > Chief Scientist & Founder > SYSTAP, LLC > 4501 Tower Road > Greensboro, NC 27410 > br...@sy... > http://bigdata.com > http://mapgraph.io > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are for > the sole use of the intended recipient(s) and are confidential or > proprietary to SYSTAP. Any unauthorized review, use, disclosure, > dissemination or copying of this email or its contents or attachments is > prohibited. If you have received this communication in error, please notify > the sender by reply email and permanently delete all copies of the email and > its contents and attachments. > > > On Mon, Oct 6, 2014 at 10:40 AM, Rose Beck <ros...@gm...> wrote: >> >> Dear Bryan, >> >> Probably I am new to the field. But since you are an experienced >> person in the field, therefore can you please help me understand that: >> when we apply RDR mechanism to triples, then what is the practical >> use-case application of using named graph mechanism? I mean I >> understand intuitively but I still am not able to get the practical >> significance of using named graphs. >> >> >> Thanks & Regards, >> Rose >> >> On Mon, Oct 6, 2014 at 8:02 PM, Bryan Thompson <br...@sy...> wrote: >> > The purpose of RDR is to permit statements about statements. >> > >> > The purpose of named graphs is to allow statements to be collected into >> > containers. >> > >> > With RDF* support for named graphs, you could do both. >> > >> > Whether or not this is a good idea is an interesting question. >> > Consider, >> > that named graphs could be interpreted as just a special case of a >> > statement >> > about a statement where the database then applies special indexing >> > (typically by maintaining additional indices for fast access by the >> > named >> > graph). >> > >> > For example, given: >> > >> > <<:a :b :c> :namedGraph :d> >> > >> > If we assume that ":namedGraph" has the semantics of the SPARQL named >> > graphs >> > mechanism, then this RDR assertion says that the statement :a :b :c >> > exists >> > in the named graph :d. >> > >> > If so, then the RDR mechanisms always apply to triples and the named >> > graphs >> > mechanism just specifies the containers within which a given triple >> > (including an RDR triple) is visible. >> > >> > Thanks, >> > Bryan >> > >> > ---- >> > Bryan Thompson >> > Chief Scientist & Founder >> > SYSTAP, LLC >> > 4501 Tower Road >> > Greensboro, NC 27410 >> > br...@sy... >> > http://bigdata.com >> > http://mapgraph.io >> > >> > CONFIDENTIALITY NOTICE: This email and its contents and attachments are >> > for >> > the sole use of the intended recipient(s) and are confidential or >> > proprietary to SYSTAP. Any unauthorized review, use, disclosure, >> > dissemination or copying of this email or its contents or attachments is >> > prohibited. If you have received this communication in error, please >> > notify >> > the sender by reply email and permanently delete all copies of the email >> > and >> > its contents and attachments. >> > >> > >> > On Mon, Oct 6, 2014 at 10:19 AM, Rose Beck <ros...@gm...> >> > wrote: >> >> >> >> Dear Bryan, >> >> >> >> Thanks for the enlightening write-up about RDR. But I have a question >> >> in the write-up you wrote "In the future, we plan to add support for >> >> RDF* and SPARQL* to the quads mode of the platform as well. This will >> >> allow statement level metadata to co-exist seamlessly with the named >> >> graphs model." But I dont understand the need for supporting RDF* and >> >> SPARQL* in quads mode. I mean I dont understand as to why do we need >> >> to allow statement level metadata to co-exist with named graph model. >> >> Can you please explain this with an example. >> >> >> >> >> >> Thanks & Regards, >> >> Rose. >> >> >> >> On Mon, Oct 6, 2014 at 5:59 PM, Bryan Thompson <br...@sy...> >> >> wrote: >> >> > I've added a page to the wiki based on that blog post: >> >> > >> >> > wiki.bigdata.com/wiki/index.php/Reification_Done_Right >> >> > >> >> > Thanks, >> >> > Bryan >> >> > >> >> > ---- >> >> > Bryan Thompson >> >> > Chief Scientist & Founder >> >> > SYSTAP, LLC >> >> > 4501 Tower Road >> >> > Greensboro, NC 27410 >> >> > br...@sy... >> >> > http://bigdata.com >> >> > http://mapgraph.io >> >> > >> >> > CONFIDENTIALITY NOTICE: This email and its contents and attachments >> >> > are >> >> > for >> >> > the sole use of the intended recipient(s) and are confidential or >> >> > proprietary to SYSTAP. Any unauthorized review, use, disclosure, >> >> > dissemination or copying of this email or its contents or attachments >> >> > is >> >> > prohibited. If you have received this communication in error, please >> >> > notify >> >> > the sender by reply email and permanently delete all copies of the >> >> > email >> >> > and >> >> > its contents and attachments. >> >> > >> >> > >> >> > On Sun, Oct 5, 2014 at 5:27 PM, Rose Beck <ros...@gm...> >> >> > wrote: >> >> >> >> >> >> Dear all, >> >> >> >> >> >> I have downloaded bigdata.war and have deployed it using sesame HTTP >> >> >> API. Now I am not getting as to how should I load rdf >> >> >> triples/provenance with triples to bigdata using nanosparqlserver? I >> >> >> am using sesame HTTP API (using apache tomcat). Can someone please >> >> >> help. >> >> >> >> >> >> I intend to use mysql, native java and postgres with sesame. Any >> >> >> help >> >> >> will be deeply appreciated. >> >> >> >> >> >> Regards, >> >> >> Rose >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> ------------------------------------------------------------------------------ >> >> >> Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer >> >> >> Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS >> >> >> Reports >> >> >> Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper >> >> >> Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer >> >> >> >> >> >> >> >> >> >> >> >> http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk >> >> >> _______________________________________________ >> >> >> Bigdata-developers mailing list >> >> >> Big...@li... >> >> >> https://lists.sourceforge.net/lists/listinfo/bigdata-developers >> >> > >> >> > >> > >> > > > |
From: Bryan T. <br...@sy...> - 2014-10-06 14:45:59
|
Rose, I think that the requirement for statement level metadata should be orthogonal to the decision to use named graphs. Statement level metadata can be used for a variety of purposes. For example, it can be used for security, it can be used to provide the source of the statement (which is often the use case for named graphs), to associate an author with a statement, to associate a creation time with a statement, to associate a weight with an edge of a graph, etc. What is the use case that motivates the RDR mechanisms for you? Perhaps if you can explain that I can provide an example of how this might be relevant in the context of named graphs for your application. However, the feature is not currently supported for the quads mode of the bigdata database, so this is a somewhat academic question. Thanks, Bryan ---- Bryan Thompson Chief Scientist & Founder SYSTAP, LLC 4501 Tower Road Greensboro, NC 27410 br...@sy... http://bigdata.com http://mapgraph.io CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. On Mon, Oct 6, 2014 at 10:40 AM, Rose Beck <ros...@gm...> wrote: > Dear Bryan, > > Probably I am new to the field. But since you are an experienced > person in the field, therefore can you please help me understand that: > when we apply RDR mechanism to triples, then what is the practical > use-case application of using named graph mechanism? I mean I > understand intuitively but I still am not able to get the practical > significance of using named graphs. > > > Thanks & Regards, > Rose > > On Mon, Oct 6, 2014 at 8:02 PM, Bryan Thompson <br...@sy...> wrote: > > The purpose of RDR is to permit statements about statements. > > > > The purpose of named graphs is to allow statements to be collected into > > containers. > > > > With RDF* support for named graphs, you could do both. > > > > Whether or not this is a good idea is an interesting question. Consider, > > that named graphs could be interpreted as just a special case of a > statement > > about a statement where the database then applies special indexing > > (typically by maintaining additional indices for fast access by the named > > graph). > > > > For example, given: > > > > <<:a :b :c> :namedGraph :d> > > > > If we assume that ":namedGraph" has the semantics of the SPARQL named > graphs > > mechanism, then this RDR assertion says that the statement :a :b :c > exists > > in the named graph :d. > > > > If so, then the RDR mechanisms always apply to triples and the named > graphs > > mechanism just specifies the containers within which a given triple > > (including an RDR triple) is visible. > > > > Thanks, > > Bryan > > > > ---- > > Bryan Thompson > > Chief Scientist & Founder > > SYSTAP, LLC > > 4501 Tower Road > > Greensboro, NC 27410 > > br...@sy... > > http://bigdata.com > > http://mapgraph.io > > > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are > for > > the sole use of the intended recipient(s) and are confidential or > > proprietary to SYSTAP. Any unauthorized review, use, disclosure, > > dissemination or copying of this email or its contents or attachments is > > prohibited. If you have received this communication in error, please > notify > > the sender by reply email and permanently delete all copies of the email > and > > its contents and attachments. > > > > > > On Mon, Oct 6, 2014 at 10:19 AM, Rose Beck <ros...@gm...> > wrote: > >> > >> Dear Bryan, > >> > >> Thanks for the enlightening write-up about RDR. But I have a question > >> in the write-up you wrote "In the future, we plan to add support for > >> RDF* and SPARQL* to the quads mode of the platform as well. This will > >> allow statement level metadata to co-exist seamlessly with the named > >> graphs model." But I dont understand the need for supporting RDF* and > >> SPARQL* in quads mode. I mean I dont understand as to why do we need > >> to allow statement level metadata to co-exist with named graph model. > >> Can you please explain this with an example. > >> > >> > >> Thanks & Regards, > >> Rose. > >> > >> On Mon, Oct 6, 2014 at 5:59 PM, Bryan Thompson <br...@sy...> > wrote: > >> > I've added a page to the wiki based on that blog post: > >> > > >> > wiki.bigdata.com/wiki/index.php/Reification_Done_Right > >> > > >> > Thanks, > >> > Bryan > >> > > >> > ---- > >> > Bryan Thompson > >> > Chief Scientist & Founder > >> > SYSTAP, LLC > >> > 4501 Tower Road > >> > Greensboro, NC 27410 > >> > br...@sy... > >> > http://bigdata.com > >> > http://mapgraph.io > >> > > >> > CONFIDENTIALITY NOTICE: This email and its contents and attachments > are > >> > for > >> > the sole use of the intended recipient(s) and are confidential or > >> > proprietary to SYSTAP. Any unauthorized review, use, disclosure, > >> > dissemination or copying of this email or its contents or attachments > is > >> > prohibited. If you have received this communication in error, please > >> > notify > >> > the sender by reply email and permanently delete all copies of the > email > >> > and > >> > its contents and attachments. > >> > > >> > > >> > On Sun, Oct 5, 2014 at 5:27 PM, Rose Beck <ros...@gm...> > wrote: > >> >> > >> >> Dear all, > >> >> > >> >> I have downloaded bigdata.war and have deployed it using sesame HTTP > >> >> API. Now I am not getting as to how should I load rdf > >> >> triples/provenance with triples to bigdata using nanosparqlserver? I > >> >> am using sesame HTTP API (using apache tomcat). Can someone please > >> >> help. > >> >> > >> >> I intend to use mysql, native java and postgres with sesame. Any help > >> >> will be deeply appreciated. > >> >> > >> >> Regards, > >> >> Rose > >> >> > >> >> > >> >> > >> >> > ------------------------------------------------------------------------------ > >> >> Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer > >> >> Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS > >> >> Reports > >> >> Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper > >> >> Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer > >> >> > >> >> > >> >> > http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk > >> >> _______________________________________________ > >> >> Bigdata-developers mailing list > >> >> Big...@li... > >> >> https://lists.sourceforge.net/lists/listinfo/bigdata-developers > >> > > >> > > > > > > |
From: Rose B. <ros...@gm...> - 2014-10-06 14:40:31
|
Dear Bryan, Probably I am new to the field. But since you are an experienced person in the field, therefore can you please help me understand that: when we apply RDR mechanism to triples, then what is the practical use-case application of using named graph mechanism? I mean I understand intuitively but I still am not able to get the practical significance of using named graphs. Thanks & Regards, Rose On Mon, Oct 6, 2014 at 8:02 PM, Bryan Thompson <br...@sy...> wrote: > The purpose of RDR is to permit statements about statements. > > The purpose of named graphs is to allow statements to be collected into > containers. > > With RDF* support for named graphs, you could do both. > > Whether or not this is a good idea is an interesting question. Consider, > that named graphs could be interpreted as just a special case of a statement > about a statement where the database then applies special indexing > (typically by maintaining additional indices for fast access by the named > graph). > > For example, given: > > <<:a :b :c> :namedGraph :d> > > If we assume that ":namedGraph" has the semantics of the SPARQL named graphs > mechanism, then this RDR assertion says that the statement :a :b :c exists > in the named graph :d. > > If so, then the RDR mechanisms always apply to triples and the named graphs > mechanism just specifies the containers within which a given triple > (including an RDR triple) is visible. > > Thanks, > Bryan > > ---- > Bryan Thompson > Chief Scientist & Founder > SYSTAP, LLC > 4501 Tower Road > Greensboro, NC 27410 > br...@sy... > http://bigdata.com > http://mapgraph.io > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are for > the sole use of the intended recipient(s) and are confidential or > proprietary to SYSTAP. Any unauthorized review, use, disclosure, > dissemination or copying of this email or its contents or attachments is > prohibited. If you have received this communication in error, please notify > the sender by reply email and permanently delete all copies of the email and > its contents and attachments. > > > On Mon, Oct 6, 2014 at 10:19 AM, Rose Beck <ros...@gm...> wrote: >> >> Dear Bryan, >> >> Thanks for the enlightening write-up about RDR. But I have a question >> in the write-up you wrote "In the future, we plan to add support for >> RDF* and SPARQL* to the quads mode of the platform as well. This will >> allow statement level metadata to co-exist seamlessly with the named >> graphs model." But I dont understand the need for supporting RDF* and >> SPARQL* in quads mode. I mean I dont understand as to why do we need >> to allow statement level metadata to co-exist with named graph model. >> Can you please explain this with an example. >> >> >> Thanks & Regards, >> Rose. >> >> On Mon, Oct 6, 2014 at 5:59 PM, Bryan Thompson <br...@sy...> wrote: >> > I've added a page to the wiki based on that blog post: >> > >> > wiki.bigdata.com/wiki/index.php/Reification_Done_Right >> > >> > Thanks, >> > Bryan >> > >> > ---- >> > Bryan Thompson >> > Chief Scientist & Founder >> > SYSTAP, LLC >> > 4501 Tower Road >> > Greensboro, NC 27410 >> > br...@sy... >> > http://bigdata.com >> > http://mapgraph.io >> > >> > CONFIDENTIALITY NOTICE: This email and its contents and attachments are >> > for >> > the sole use of the intended recipient(s) and are confidential or >> > proprietary to SYSTAP. Any unauthorized review, use, disclosure, >> > dissemination or copying of this email or its contents or attachments is >> > prohibited. If you have received this communication in error, please >> > notify >> > the sender by reply email and permanently delete all copies of the email >> > and >> > its contents and attachments. >> > >> > >> > On Sun, Oct 5, 2014 at 5:27 PM, Rose Beck <ros...@gm...> wrote: >> >> >> >> Dear all, >> >> >> >> I have downloaded bigdata.war and have deployed it using sesame HTTP >> >> API. Now I am not getting as to how should I load rdf >> >> triples/provenance with triples to bigdata using nanosparqlserver? I >> >> am using sesame HTTP API (using apache tomcat). Can someone please >> >> help. >> >> >> >> I intend to use mysql, native java and postgres with sesame. Any help >> >> will be deeply appreciated. >> >> >> >> Regards, >> >> Rose >> >> >> >> >> >> >> >> ------------------------------------------------------------------------------ >> >> Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer >> >> Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS >> >> Reports >> >> Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper >> >> Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer >> >> >> >> >> >> http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk >> >> _______________________________________________ >> >> Bigdata-developers mailing list >> >> Big...@li... >> >> https://lists.sourceforge.net/lists/listinfo/bigdata-developers >> > >> > > > |
From: Bryan T. <br...@sy...> - 2014-10-06 14:32:55
|
The purpose of RDR is to permit statements about statements. The purpose of named graphs is to allow statements to be collected into containers. With RDF* support for named graphs, you could do both. Whether or not this is a good idea is an interesting question. Consider, that named graphs could be interpreted as just a special case of a statement about a statement where the database then applies special indexing (typically by maintaining additional indices for fast access by the named graph). For example, given: <<:a :b :c> :namedGraph :d> If we assume that ":namedGraph" has the semantics of the SPARQL named graphs mechanism, then this RDR assertion says that the statement :a :b :c exists in the named graph :d. If so, then the RDR mechanisms always apply to triples and the named graphs mechanism just specifies the containers within which a given triple (including an RDR triple) is visible. Thanks, Bryan ---- Bryan Thompson Chief Scientist & Founder SYSTAP, LLC 4501 Tower Road Greensboro, NC 27410 br...@sy... http://bigdata.com http://mapgraph.io CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. On Mon, Oct 6, 2014 at 10:19 AM, Rose Beck <ros...@gm...> wrote: > Dear Bryan, > > Thanks for the enlightening write-up about RDR. But I have a question > in the write-up you wrote "In the future, we plan to add support for > RDF* and SPARQL* to the quads mode of the platform as well. This will > allow statement level metadata to co-exist seamlessly with the named > graphs model." But I dont understand the need for supporting RDF* and > SPARQL* in quads mode. I mean I dont understand as to why do we need > to allow statement level metadata to co-exist with named graph model. > Can you please explain this with an example. > > > Thanks & Regards, > Rose. > > On Mon, Oct 6, 2014 at 5:59 PM, Bryan Thompson <br...@sy...> wrote: > > I've added a page to the wiki based on that blog post: > > > > wiki.bigdata.com/wiki/index.php/Reification_Done_Right > > > > Thanks, > > Bryan > > > > ---- > > Bryan Thompson > > Chief Scientist & Founder > > SYSTAP, LLC > > 4501 Tower Road > > Greensboro, NC 27410 > > br...@sy... > > http://bigdata.com > > http://mapgraph.io > > > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are > for > > the sole use of the intended recipient(s) and are confidential or > > proprietary to SYSTAP. Any unauthorized review, use, disclosure, > > dissemination or copying of this email or its contents or attachments is > > prohibited. If you have received this communication in error, please > notify > > the sender by reply email and permanently delete all copies of the email > and > > its contents and attachments. > > > > > > On Sun, Oct 5, 2014 at 5:27 PM, Rose Beck <ros...@gm...> wrote: > >> > >> Dear all, > >> > >> I have downloaded bigdata.war and have deployed it using sesame HTTP > >> API. Now I am not getting as to how should I load rdf > >> triples/provenance with triples to bigdata using nanosparqlserver? I > >> am using sesame HTTP API (using apache tomcat). Can someone please > >> help. > >> > >> I intend to use mysql, native java and postgres with sesame. Any help > >> will be deeply appreciated. > >> > >> Regards, > >> Rose > >> > >> > >> > ------------------------------------------------------------------------------ > >> Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer > >> Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports > >> Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper > >> Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer > >> > >> > http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk > >> _______________________________________________ > >> Bigdata-developers mailing list > >> Big...@li... > >> https://lists.sourceforge.net/lists/listinfo/bigdata-developers > > > > > |
From: Rose B. <ros...@gm...> - 2014-10-06 14:19:28
|
Dear Bryan, Thanks for the enlightening write-up about RDR. But I have a question in the write-up you wrote "In the future, we plan to add support for RDF* and SPARQL* to the quads mode of the platform as well. This will allow statement level metadata to co-exist seamlessly with the named graphs model." But I dont understand the need for supporting RDF* and SPARQL* in quads mode. I mean I dont understand as to why do we need to allow statement level metadata to co-exist with named graph model. Can you please explain this with an example. Thanks & Regards, Rose. On Mon, Oct 6, 2014 at 5:59 PM, Bryan Thompson <br...@sy...> wrote: > I've added a page to the wiki based on that blog post: > > wiki.bigdata.com/wiki/index.php/Reification_Done_Right > > Thanks, > Bryan > > ---- > Bryan Thompson > Chief Scientist & Founder > SYSTAP, LLC > 4501 Tower Road > Greensboro, NC 27410 > br...@sy... > http://bigdata.com > http://mapgraph.io > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are for > the sole use of the intended recipient(s) and are confidential or > proprietary to SYSTAP. Any unauthorized review, use, disclosure, > dissemination or copying of this email or its contents or attachments is > prohibited. If you have received this communication in error, please notify > the sender by reply email and permanently delete all copies of the email and > its contents and attachments. > > > On Sun, Oct 5, 2014 at 5:27 PM, Rose Beck <ros...@gm...> wrote: >> >> Dear all, >> >> I have downloaded bigdata.war and have deployed it using sesame HTTP >> API. Now I am not getting as to how should I load rdf >> triples/provenance with triples to bigdata using nanosparqlserver? I >> am using sesame HTTP API (using apache tomcat). Can someone please >> help. >> >> I intend to use mysql, native java and postgres with sesame. Any help >> will be deeply appreciated. >> >> Regards, >> Rose >> >> >> ------------------------------------------------------------------------------ >> Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer >> Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports >> Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper >> Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer >> >> http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk >> _______________________________________________ >> Bigdata-developers mailing list >> Big...@li... >> https://lists.sourceforge.net/lists/listinfo/bigdata-developers > > |
From: Bryan T. <br...@sy...> - 2014-10-06 12:29:44
|
I've added a page to the wiki based on that blog post: wiki.bigdata.com/wiki/index.php/Reification_Done_Right Thanks, Bryan ---- Bryan Thompson Chief Scientist & Founder SYSTAP, LLC 4501 Tower Road Greensboro, NC 27410 br...@sy... http://bigdata.com http://mapgraph.io CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. On Sun, Oct 5, 2014 at 5:27 PM, Rose Beck <ros...@gm...> wrote: > Dear all, > > I have downloaded bigdata.war and have deployed it using sesame HTTP > API. Now I am not getting as to how should I load rdf > triples/provenance with triples to bigdata using nanosparqlserver? I > am using sesame HTTP API (using apache tomcat). Can someone please > help. > > I intend to use mysql, native java and postgres with sesame. Any help > will be deeply appreciated. > > Regards, > Rose > > > ------------------------------------------------------------------------------ > Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer > Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports > Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper > Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer > > http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk > _______________________________________________ > Bigdata-developers mailing list > Big...@li... > https://lists.sourceforge.net/lists/listinfo/bigdata-developers > |
From: Bryan T. <br...@sy...> - 2014-10-06 09:45:12
|
Rose, You can use either the syntax extension described in the the following links or you can just load data with reified statements. If the database mode to support RDR is enabled, then the reified statements will be automatically interpreted as RDR assertions. See http://blog.bigdata.com/?p=716 See http://www.bigdata.com/whitepapers/reifSPARQL.pdf See http://arxiv.org/pdf/1406.3399.pdf Please note that concurrent query against the sesame http interface wrapping the bigdata sail is much less efficient than using the nanoSparqlServer. This is because the openrdf semantics for a connection are always read/write. Bigdata uses read-only connections as well that are non-blocking and which offer substantially higher throughput for concurrent query. The nanoSparqlServer supports these non-blocking connections automatically. Thanks, Bryan On Sunday, October 5, 2014, Rose Beck <ros...@gm...> wrote: > Dear all, > > I have downloaded bigdata.war and have deployed it using sesame HTTP > API. Now I am not getting as to how should I load rdf > triples/provenance with triples to bigdata using nanosparqlserver? I > am using sesame HTTP API (using apache tomcat). Can someone please > help. > > I intend to use mysql, native java and postgres with sesame. Any help > will be deeply appreciated. > > Regards, > Rose > > > ------------------------------------------------------------------------------ > Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer > Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports > Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper > Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer > > http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk > _______________________________________________ > Bigdata-developers mailing list > Big...@li... <javascript:;> > https://lists.sourceforge.net/lists/listinfo/bigdata-developers > -- ---- Bryan Thompson Chief Scientist & Founder SYSTAP, LLC 4501 Tower Road Greensboro, NC 27410 br...@sy... http://bigdata.com http://mapgraph.io CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. |
From: Rose B. <ros...@gm...> - 2014-10-05 21:28:03
|
Dear all, I have downloaded bigdata.war and have deployed it using sesame HTTP API. Now I am not getting as to how should I load rdf triples/provenance with triples to bigdata using nanosparqlserver? I am using sesame HTTP API (using apache tomcat). Can someone please help. I intend to use mysql, native java and postgres with sesame. Any help will be deeply appreciated. Regards, Rose |
From: Bryan T. <br...@sy...> - 2014-09-29 22:47:02
|
Jeremy, I commented out the line to clear the standalone query engine cache and forced a clean checkout from SVN to see if that will clear up the failed CI builds. If you are seeing a leak in that cache, it probably means that you have a hard reference to the QueryEngine. That might occur if you do not shutdown the Journals such that they can be finalized. Without that, the QueryEngine might be left running. Ah. Look at this line in BigdataSail: queryEngine = QueryEngineFactory.*getQueryController*(mainDatabase .getIndexManager()); A hard reference to a BigdataSail pins both the Journal *final* *protected* AbstractTripleStore database; and the QueryEngine: *final* *private* QueryEngine queryEngine; I would look for Test member fields that were references to BigdataSail objects (or BigdataSailConnection objects, etc.). That is probably the source of the leak. Bryan ---- Bryan Thompson Chief Scientist & Founder SYSTAP, LLC 4501 Tower Road Greensboro, NC 27410 br...@sy... http://bigdata.com http://mapgraph.io CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. On Mon, Sep 29, 2014 at 5:53 PM, Bryan Thompson <br...@sy...> wrote: > The code there has not been changed in quite a while. > > private static ConcurrentWeakValueCache<IBTreeManager, QueryEngine> > standaloneQECache = new ConcurrentWeakValueCache<IBTreeManager, > QueryEngine>( > 0/* queueCapacity */ > ); > > The IBTreeManager is a Journal. Tthe QueryEngine becomes only weakly > reachable and gets queued for finalization. When the reference queue > receives that notice, the entry in the ConcurrentWeakValueMap is removed. > That causes the Journal to no longer be strongly reachable, at which point > the Journal is also available for GC. > > ConcurrentWeakValueMap:: > > protected void removeClearedEntries() > { > > if (referenceQueue == null) > return; > > int counter = 0; > > > > > > > > > > > > > > > > > > > * for (Reference<? extends V> ref = referenceQueue.poll(); ref != > null; ref = referenceQueue .poll()) { final K k = > ((WeakRef<K, V>) ref).k; if (map.get(k) == ref) { > if (DEBUG) { log.debug("Removing cleared reference: > key=" + k); } > removeMapEntry(k); counter++; > * } > > } > > if( counter > 1 ) { > > if( INFO ) { > > log.info("Removed " + counter + " cleared references"); > > } > > } > > } > > > Bryan > > ---- > Bryan Thompson > Chief Scientist & Founder > SYSTAP, LLC > 4501 Tower Road > Greensboro, NC 27410 > br...@sy... > http://bigdata.com > http://mapgraph.io > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are > for the sole use of the intended recipient(s) and are confidential or > proprietary to SYSTAP. Any unauthorized review, use, disclosure, > dissemination or copying of this email or its contents or attachments is > prohibited. If you have received this communication in error, please notify > the sender by reply email and permanently delete all copies of the email > and its contents and attachments. > > On Mon, Sep 29, 2014 at 4:01 PM, Jeremy J Carroll <jj...@sy...> wrote: > >> What about the com.bigdata.bop.fed.QueryEngineFactory.standaloneQECache ? >> >> Was I mistaken to read that as a real leak? The code would be cleaner to >> not have that method and its call, maybe the destroy and the nulling out is >> sufficient? >> >> Jeremy J Carroll >> Principal Architect >> Syapse, Inc. >> >> >> >> On Sep 29, 2014, at 12:12 PM, Bryan Thompson <br...@sy...> wrote: >> >> I have looked through those issues and verified that (a) the references >> are eventually released; and (b) you can force yourkit to take them through >> a GC and release many of them. There is a >> ConcurrentWeakValueHashMapWithTimeout that has a ring buffer which gets >> cleared down as things age out. Until that happens some kinds of references >> will remain in CI, but they do get cleared out eventually. >> >> ---- >> Bryan Thompson >> Chief Scientist & Founder >> SYSTAP, LLC >> 4501 Tower Road >> Greensboro, NC 27410 >> br...@sy... >> http://bigdata.com >> http://mapgraph.io >> >> CONFIDENTIALITY NOTICE: This email and its contents and attachments are >> for the sole use of the intended recipient(s) and are confidential or >> proprietary to SYSTAP. Any unauthorized review, use, disclosure, >> dissemination or copying of this email or its contents or attachments is >> prohibited. If you have received this communication in error, please notify >> the sender by reply email and permanently delete all copies of the email >> and its contents and attachments. >> >> On Mon, Sep 29, 2014 at 3:03 PM, Jeremy J Carroll <jj...@sy...> wrote: >> >>> >>> >>> Congrats on getting latest release out. >>> >>> Better late than never, I got to looking once more at the memory leaks >>> in TestProtocolAll and have made commit r8670 which I believe addresses >>> them. >>> >>> This adds a method to tear down the 'mode' quads/triples/sids and its >>> related index etc at the right point. >>> >>> Some concerns: >>> - yourkit was suggesting leaks through >>> com.bigdata.bop.fed.QueryEngineFactory.standaloneQECache >>> >>> and I somewhat inelegantly added a method: >>> >>> com.bigdata.bop.fed.QueryEngineFactory.clearStandAloneQECacheDuringTesting() >>> which I call again at the end of each mode of the protocol tests >>> >>> However, the test issue in this area may be indicative of a real memory >>> leak here (which i believe is fairly new code). >>> My own, fairly casual assessment, is that the strong reference to the >>> key in this cache may well be problematic. If so, fixing that and removing >>> my clearStandAloneQECacheDuringTesting() would be better. >>> >>> Further I was having some issues with clearing references through the >>> WeakHashMap at >>> >>> com.bigdata.btree.ReadWriteLockManager.locks >>> >>> I slightly convinced myself that these were artifacts of my test runs, >>> and that the finalizers would eventually run and the memory would >>> eventually be released. That is certainly the theory, but I have had bad >>> experiences with finalizers and the finalizer queue in the past, and I am >>> pretty suspicious of WeakHashMaps as a result. However, despite these >>> concerns, I made no code changes in this area. >>> >>> Jeremy >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> ------------------------------------------------------------------------------ >>> Slashdot TV. Videos for Nerds. Stuff that Matters. >>> >>> http://pubads.g.doubleclick.net/gampad/clk?id=160591471&iu=/4140/ostg.clktrk >>> _______________________________________________ >>> Bigdata-developers mailing list >>> Big...@li... >>> https://lists.sourceforge.net/lists/listinfo/bigdata-developers >>> >> >> >> > |
From: Bryan T. <br...@sy...> - 2014-09-29 21:53:58
|
The code there has not been changed in quite a while. private static ConcurrentWeakValueCache<IBTreeManager, QueryEngine> standaloneQECache = new ConcurrentWeakValueCache<IBTreeManager, QueryEngine>( 0/* queueCapacity */ ); The IBTreeManager is a Journal. Tthe QueryEngine becomes only weakly reachable and gets queued for finalization. When the reference queue receives that notice, the entry in the ConcurrentWeakValueMap is removed. That causes the Journal to no longer be strongly reachable, at which point the Journal is also available for GC. ConcurrentWeakValueMap:: protected void removeClearedEntries() { if (referenceQueue == null) return; int counter = 0; * for (Reference<? extends V> ref = referenceQueue.poll(); ref != null; ref = referenceQueue .poll()) { final K k = ((WeakRef<K, V>) ref).k; if (map.get(k) == ref) { if (DEBUG) { log.debug("Removing cleared reference: key=" + k); } removeMapEntry(k); counter++; * } } if( counter > 1 ) { if( INFO ) { log.info("Removed " + counter + " cleared references"); } } } Bryan ---- Bryan Thompson Chief Scientist & Founder SYSTAP, LLC 4501 Tower Road Greensboro, NC 27410 br...@sy... http://bigdata.com http://mapgraph.io CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. On Mon, Sep 29, 2014 at 4:01 PM, Jeremy J Carroll <jj...@sy...> wrote: > What about the com.bigdata.bop.fed.QueryEngineFactory.standaloneQECache ? > > Was I mistaken to read that as a real leak? The code would be cleaner to > not have that method and its call, maybe the destroy and the nulling out is > sufficient? > > Jeremy J Carroll > Principal Architect > Syapse, Inc. > > > > On Sep 29, 2014, at 12:12 PM, Bryan Thompson <br...@sy...> wrote: > > I have looked through those issues and verified that (a) the references > are eventually released; and (b) you can force yourkit to take them through > a GC and release many of them. There is a > ConcurrentWeakValueHashMapWithTimeout that has a ring buffer which gets > cleared down as things age out. Until that happens some kinds of references > will remain in CI, but they do get cleared out eventually. > > ---- > Bryan Thompson > Chief Scientist & Founder > SYSTAP, LLC > 4501 Tower Road > Greensboro, NC 27410 > br...@sy... > http://bigdata.com > http://mapgraph.io > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are > for the sole use of the intended recipient(s) and are confidential or > proprietary to SYSTAP. Any unauthorized review, use, disclosure, > dissemination or copying of this email or its contents or attachments is > prohibited. If you have received this communication in error, please notify > the sender by reply email and permanently delete all copies of the email > and its contents and attachments. > > On Mon, Sep 29, 2014 at 3:03 PM, Jeremy J Carroll <jj...@sy...> wrote: > >> >> >> Congrats on getting latest release out. >> >> Better late than never, I got to looking once more at the memory leaks in >> TestProtocolAll and have made commit r8670 which I believe addresses them. >> >> This adds a method to tear down the 'mode' quads/triples/sids and its >> related index etc at the right point. >> >> Some concerns: >> - yourkit was suggesting leaks through >> com.bigdata.bop.fed.QueryEngineFactory.standaloneQECache >> >> and I somewhat inelegantly added a method: >> >> com.bigdata.bop.fed.QueryEngineFactory.clearStandAloneQECacheDuringTesting() >> which I call again at the end of each mode of the protocol tests >> >> However, the test issue in this area may be indicative of a real memory >> leak here (which i believe is fairly new code). >> My own, fairly casual assessment, is that the strong reference to the key >> in this cache may well be problematic. If so, fixing that and removing my >> clearStandAloneQECacheDuringTesting() would be better. >> >> Further I was having some issues with clearing references through the >> WeakHashMap at >> >> com.bigdata.btree.ReadWriteLockManager.locks >> >> I slightly convinced myself that these were artifacts of my test runs, >> and that the finalizers would eventually run and the memory would >> eventually be released. That is certainly the theory, but I have had bad >> experiences with finalizers and the finalizer queue in the past, and I am >> pretty suspicious of WeakHashMaps as a result. However, despite these >> concerns, I made no code changes in this area. >> >> Jeremy >> >> >> >> >> >> >> >> >> >> >> >> ------------------------------------------------------------------------------ >> Slashdot TV. Videos for Nerds. Stuff that Matters. >> >> http://pubads.g.doubleclick.net/gampad/clk?id=160591471&iu=/4140/ostg.clktrk >> _______________________________________________ >> Bigdata-developers mailing list >> Big...@li... >> https://lists.sourceforge.net/lists/listinfo/bigdata-developers >> > > > |
From: Jeremy J C. <jj...@sy...> - 2014-09-29 21:16:11
|
What about the com.bigdata.bop.fed.QueryEngineFactory.standaloneQECache ? Was I mistaken to read that as a real leak? The code would be cleaner to not have that method and its call, maybe the destroy and the nulling out is sufficient? Jeremy J Carroll Principal Architect Syapse, Inc. On Sep 29, 2014, at 12:12 PM, Bryan Thompson <br...@sy...> wrote: > I have looked through those issues and verified that (a) the references are eventually released; and (b) you can force yourkit to take them through a GC and release many of them. There is a ConcurrentWeakValueHashMapWithTimeout that has a ring buffer which gets cleared down as things age out. Until that happens some kinds of references will remain in CI, but they do get cleared out eventually. > > ---- > Bryan Thompson > Chief Scientist & Founder > SYSTAP, LLC > 4501 Tower Road > Greensboro, NC 27410 > br...@sy... > http://bigdata.com > http://mapgraph.io > CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. > > > > On Mon, Sep 29, 2014 at 3:03 PM, Jeremy J Carroll <jj...@sy...> wrote: > > > Congrats on getting latest release out. > > Better late than never, I got to looking once more at the memory leaks in TestProtocolAll and have made commit r8670 which I believe addresses them. > > This adds a method to tear down the 'mode' quads/triples/sids and its related index etc at the right point. > > Some concerns: > - yourkit was suggesting leaks through > com.bigdata.bop.fed.QueryEngineFactory.standaloneQECache > > and I somewhat inelegantly added a method: > com.bigdata.bop.fed.QueryEngineFactory.clearStandAloneQECacheDuringTesting() > which I call again at the end of each mode of the protocol tests > > However, the test issue in this area may be indicative of a real memory leak here (which i believe is fairly new code). > My own, fairly casual assessment, is that the strong reference to the key in this cache may well be problematic. If so, fixing that and removing my clearStandAloneQECacheDuringTesting() would be better. > > Further I was having some issues with clearing references through the WeakHashMap at > > com.bigdata.btree.ReadWriteLockManager.locks > > I slightly convinced myself that these were artifacts of my test runs, and that the finalizers would eventually run and the memory would eventually be released. That is certainly the theory, but I have had bad experiences with finalizers and the finalizer queue in the past, and I am pretty suspicious of WeakHashMaps as a result. However, despite these concerns, I made no code changes in this area. > > Jeremy > > > > > > > > > > > ------------------------------------------------------------------------------ > Slashdot TV. Videos for Nerds. Stuff that Matters. > http://pubads.g.doubleclick.net/gampad/clk?id=160591471&iu=/4140/ostg.clktrk > _______________________________________________ > Bigdata-developers mailing list > Big...@li... > https://lists.sourceforge.net/lists/listinfo/bigdata-developers > |
From: Bryan T. <br...@sy...> - 2014-09-29 19:20:32
|
I have looked through those issues and verified that (a) the references are eventually released; and (b) you can force yourkit to take them through a GC and release many of them. There is a ConcurrentWeakValueHashMapWithTimeout that has a ring buffer which gets cleared down as things age out. Until that happens some kinds of references will remain in CI, but they do get cleared out eventually. ---- Bryan Thompson Chief Scientist & Founder SYSTAP, LLC 4501 Tower Road Greensboro, NC 27410 br...@sy... http://bigdata.com http://mapgraph.io CONFIDENTIALITY NOTICE: This email and its contents and attachments are for the sole use of the intended recipient(s) and are confidential or proprietary to SYSTAP. Any unauthorized review, use, disclosure, dissemination or copying of this email or its contents or attachments is prohibited. If you have received this communication in error, please notify the sender by reply email and permanently delete all copies of the email and its contents and attachments. On Mon, Sep 29, 2014 at 3:03 PM, Jeremy J Carroll <jj...@sy...> wrote: > > > Congrats on getting latest release out. > > Better late than never, I got to looking once more at the memory leaks in > TestProtocolAll and have made commit r8670 which I believe addresses them. > > This adds a method to tear down the 'mode' quads/triples/sids and its > related index etc at the right point. > > Some concerns: > - yourkit was suggesting leaks through > com.bigdata.bop.fed.QueryEngineFactory.standaloneQECache > > and I somewhat inelegantly added a method: > > com.bigdata.bop.fed.QueryEngineFactory.clearStandAloneQECacheDuringTesting() > which I call again at the end of each mode of the protocol tests > > However, the test issue in this area may be indicative of a real memory > leak here (which i believe is fairly new code). > My own, fairly casual assessment, is that the strong reference to the key > in this cache may well be problematic. If so, fixing that and removing my > clearStandAloneQECacheDuringTesting() would be better. > > Further I was having some issues with clearing references through the > WeakHashMap at > > com.bigdata.btree.ReadWriteLockManager.locks > > I slightly convinced myself that these were artifacts of my test runs, and > that the finalizers would eventually run and the memory would eventually be > released. That is certainly the theory, but I have had bad experiences with > finalizers and the finalizer queue in the past, and I am pretty suspicious > of WeakHashMaps as a result. However, despite these concerns, I made no > code changes in this area. > > Jeremy > > > > > > > > > > > > ------------------------------------------------------------------------------ > Slashdot TV. Videos for Nerds. Stuff that Matters. > > http://pubads.g.doubleclick.net/gampad/clk?id=160591471&iu=/4140/ostg.clktrk > _______________________________________________ > Bigdata-developers mailing list > Big...@li... > https://lists.sourceforge.net/lists/listinfo/bigdata-developers > |
From: Jeremy J C. <jj...@sy...> - 2014-09-29 19:03:45
|
Congrats on getting latest release out. Better late than never, I got to looking once more at the memory leaks in TestProtocolAll and have made commit r8670 which I believe addresses them. This adds a method to tear down the 'mode' quads/triples/sids and its related index etc at the right point. Some concerns: - yourkit was suggesting leaks through com.bigdata.bop.fed.QueryEngineFactory.standaloneQECache and I somewhat inelegantly added a method: com.bigdata.bop.fed.QueryEngineFactory.clearStandAloneQECacheDuringTesting() which I call again at the end of each mode of the protocol tests However, the test issue in this area may be indicative of a real memory leak here (which i believe is fairly new code). My own, fairly casual assessment, is that the strong reference to the key in this cache may well be problematic. If so, fixing that and removing my clearStandAloneQECacheDuringTesting() would be better. Further I was having some issues with clearing references through the WeakHashMap at com.bigdata.btree.ReadWriteLockManager.locks I slightly convinced myself that these were artifacts of my test runs, and that the finalizers would eventually run and the memory would eventually be released. That is certainly the theory, but I have had bad experiences with finalizers and the finalizer queue in the past, and I am pretty suspicious of WeakHashMaps as a result. However, despite these concerns, I made no code changes in this area. Jeremy |