karmatool-users Mailing List for Karma Provenance Collection Tool
Brought to you by:
datatoinsight,
yuanluo
Menu
▾
▴
karmatool-users — Karma Users
You can subscribe to this list here.
| 2011 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
(4) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2012 |
Jan
(6) |
Feb
(1) |
Mar
(1) |
Apr
(1) |
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
(4) |
Nov
|
Dec
|
| 2013 |
Jan
(1) |
Feb
(2) |
Mar
(3) |
Apr
(7) |
May
(2) |
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
|
From: Devarshi G. <dgh...@um...> - 2013-05-10 23:26:16
|
Hi Michael, Only entities (annotableEntityType) and files are valid for addAnnotation. However annotations can be added for all types of provenance objects, like entities (processes), data-objects (artifacts), and relationships (causal dependencies). This is possible to embed the annotation along with the original event. As for adding annotations 'after the fact' (using addAnnotation), only file and entity annotations can be added that way. For causal dependencies you can add annotations (after the fact) by using their internal-ids (these ids are record-ids assigned to each relationship tuple in the corresponding database table). An example to add an annotation for a tuple with invocation_id=2 in exe_invocation table is given below: <ns:addRelationshipAnnotationByIdType xmlns:ns=" http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv=" http://schemas.xmlsoap.org/soap/envelope/"> <ns:relationshipID>2</ns:relationshipID> <ns:annotableRelationshipType>INVOCATION</ns:annotableRelationshipType> <ns:annotations> <ns:property>some-property</ns:property> <ns:value>somevalue</ns:value> </ns:annotations> <ns:annotatingTimestamp>2012-01-13T00:32:56</ns:annotatingTimestamp> <ns:notificationtimestamp>2012-01-13T00:32:56</ns:notificationtimestamp> </ns:addRelationshipAnnotationByIdType> On Thu, May 9, 2013 at 10:17 AM, Black, Michael (IS) <Mic...@ng... > wrote: > I got the annotableFileType working and am now wondering what other > annotations are available. > <ns:addAnnotation xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" > xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/"> > <ns:annotableFile> > <ns:fileURI>file:DamScape_002</ns:fileURI> > <ns:ownerDN>Amy_Elliott</ns:ownerDN> > </ns:annotableFile> > <ns:annotableObjectType>FILE</ns:annotableObjectType> > <ns:annotations> > <ns:property>% Out of Bounds</ns:property> > <ns:value>0</ns:value> > </ns:annotations> > <ns:annotatingTimestamp>2011-09-14T00:39:16</ns:annotatingTimestamp> > > <ns:notificationtimestamp>2011-09-16T19:31:59.065-04:00</ns:notificationtimestamp> > </ns:addAnnotation> > > > I see annotableEntityType and it appears that's the only other one > available for addAnnotation? Correct? > > I also see > <simpleType name="annotableRelationshipEnumType"> > <restriction base="string"> > <enumeration value="INVOCATION"/> > <enumeration value="DATA_TRANSFER"/> > </restriction> > </simpleType> > > Is there an example for those? I'm at a bit of a loss trying to figure > out the syntax for these transactions from the XSD. > > > > Michael D. Black > Senior Scientist > Analytics, Production and Services > Advanced GEOINT Systems > Northrop Grumman Information Systems > > > ------------------------------------------------------------------------------ > Learn Graph Databases - Download FREE O'Reilly Book > "Graph Databases" is the definitive new guide to graph databases and > their applications. This 200-page book is written by three acclaimed > leaders in the field. The early access version is available now. > Download your free book today! http://p.sf.net/sfu/neotech_d2d_may > _______________________________________________ > Karmatool-users mailing list > Kar...@li... > https://lists.sourceforge.net/lists/listinfo/karmatool-users > -- Thanks & regards, Devarshi |
|
From: Black, M. (IS) <Mic...@ng...> - 2013-05-09 14:17:43
|
I got the annotableFileType working and am now wondering what other annotations are available. <ns:addAnnotation xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/"> <ns:annotableFile> <ns:fileURI>file:DamScape_002</ns:fileURI> <ns:ownerDN>Amy_Elliott</ns:ownerDN> </ns:annotableFile> <ns:annotableObjectType>FILE</ns:annotableObjectType> <ns:annotations> <ns:property>% Out of Bounds</ns:property> <ns:value>0</ns:value> </ns:annotations> <ns:annotatingTimestamp>2011-09-14T00:39:16</ns:annotatingTimestamp> <ns:notificationtimestamp>2011-09-16T19:31:59.065-04:00</ns:notificationtimestamp> </ns:addAnnotation> I see annotableEntityType and it appears that's the only other one available for addAnnotation? Correct? I also see <simpleType name="annotableRelationshipEnumType"> <restriction base="string"> <enumeration value="INVOCATION"/> <enumeration value="DATA_TRANSFER"/> </restriction> </simpleType> Is there an example for those? I'm at a bit of a loss trying to figure out the syntax for these transactions from the XSD. Michael D. Black Senior Scientist Analytics, Production and Services Advanced GEOINT Systems Northrop Grumman Information Systems |
|
From: Black, M. (IS) <Mic...@ng...> - 2013-04-29 16:52:33
|
Is there a way to add annotations to items so that the annotations will show up in the OPM output?
For example I notice this entry:
<ns:dataObject>
<ns:file>
<ns:fileURI>file:GFI_001</ns:fileURI>
<ns:ownerDN>Amy_Elliott</ns:ownerDN>
<ns:createDate>2013-04-19T16:00:00.000-05:00</ns:createDate>
<ns:size>868013951</ns:size>
<ns:objectName>GFI_001</ns:objectName>
</ns:file>
</ns:dataObject>
Produces this OPM output:
<v1:artifact id="File_1">
<v1:annotation>
<v1:property uri="artifact-size">
<v1:value>
<size>868013951</size>
</v1:value>
</v1:property>
<v1:property uri="artifact-uri">
<v1:value>
<fileURI>file:GFI_001</fileURI>
</v1:value>
</v1:property>
</v1:annotation>
</v1:artifact>
So it picked up fileURI and size but not ownerDN, createDate.
I want to be able to add my own fields that will show up in the OPM data.
Michael D. Black
Senior Scientist
Analytics, Production and Services
Advanced GEOINT Systems
Northrop Grumman Information Systems
|
|
From: Black, M. (IS) <Mic...@ng...> - 2013-04-23 22:26:18
|
The following files do not seem to generate a correct OPM file when you query the workflowID. I'm using 3.2.3 There is an "Agent_2" referenced in the OPM file you get from the quey but no definition of "Agent_2" anywhere else in the OPM file. So "Agent_2" has no source reference to define it. Agent_1 is correctly done with an Agent_1 referenced (Amy)...just not Agent_2 (Dan should be defined but he's not). # GFI_Process invokde by Amy Elliott consumes OpenSource and produces GFI_Dam_001 bin/sendNotification.sh config/karma.properties $CurDir/serviceInvoked_GFI_Process1.xml bin/sendNotification.sh config/karma.properties $CurDir/dataConsumed_GFI_001.xml bin/sendNotification.sh config/karma.properties $CurDir/dataProduced_DamScape_001.xml # Wiki consumes DamScape_001, GWPS, and MAID bin/sendNotification.sh config/karma.properties $CurDir/dataConsumed_DamScape_001.xml bin/sendNotification.sh config/karma.properties $CurDir/dataConsumed_GWPS.xml bin/sendNotification.sh config/karma.properties $CurDir/dataConsumed_MAID_Data.xml # MAID produces MAID_Data bin/sendNotification.sh config/karma.properties $CurDir/dataProduced_MAID_Data.xml # Analyst (Dan) produces Report1 bin/sendNotification.sh config/karma.properties $CurDir/serviceInvoked_Wiki.xml bin/sendNotification.sh config/karma.properties $CurDir/dataProduced_Report1.xml <ns:dataConsumed xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/"> <ns:action>CONSUME</ns:action> <ns:actor> <ns:serviceInformation> <ns:workflowID>NGC_20130422_015</ns:workflowID> <ns:workflowNodeID>WFNode:WFNode1</ns:workflowNodeID> <ns:timestep>-356643003</ns:timestep> <ns:serviceID>svc:Wiki</ns:serviceID> </ns:serviceInformation> <ns:type>SERVICE</ns:type> </ns:actor> <ns:dataObject> <ns:file> <ns:fileURI>file:DamScape_001</ns:fileURI> <ns:ownerDN>Amy_Elliott</ns:ownerDN> <ns:createDate>2013-04-19T16:00:00.000-05:00</ns:createDate> <ns:size>868013951</ns:size> <ns:objectName>GFI_Dam_001</ns:objectName> </ns:file> </ns:dataObject> <ns:timestamp>2013-04-19T16:10:00.000-05:00</ns:timestamp> <ns:dataRole>File Consumed</ns:dataRole> <ns:annotations> <ns:property>execution_environment</ns:property> <ns:value> <value>POSIX</value> </ns:value> </ns:annotations> </ns:dataConsumed> <ns:dataConsumed xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/"> <ns:action>CONSUME</ns:action> <ns:actor> <ns:serviceInformation> <ns:workflowID>NGC_20130422_015</ns:workflowID> <ns:workflowNodeID>WFNode:WFNode1</ns:workflowNodeID> <ns:timestep>-356643003</ns:timestep> <ns:serviceID>svc:GFI_Process1</ns:serviceID> </ns:serviceInformation> <ns:type>SERVICE</ns:type> </ns:actor> <ns:dataObject> <ns:file> <ns:fileURI>file:GFI_001</ns:fileURI> <ns:ownerDN>Amy_Elliott</ns:ownerDN> <ns:createDate>2013-04-19T16:00:00.000-05:00</ns:createDate> <ns:size>868013951</ns:size> <ns:objectName>GFI_001</ns:objectName> </ns:file> </ns:dataObject> <ns:timestamp>2013-04-19T16:01:01.000-05:00</ns:timestamp> <ns:dataRole>File Consumed</ns:dataRole> <ns:annotations> <ns:property>execution_environment</ns:property> <ns:value> <value>POSIX</value> </ns:value> </ns:annotations> </ns:dataConsumed> <ns:dataConsumed xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/"> <ns:action>CONSUME</ns:action> <ns:actor> <ns:serviceInformation> <ns:workflowID>NGC_20130422_015</ns:workflowID> <ns:workflowNodeID>WFNode:WFNode1</ns:workflowNodeID> <ns:timestep>-356643003</ns:timestep> <ns:serviceID>svc:Wiki</ns:serviceID> </ns:serviceInformation> <ns:type>SERVICE</ns:type> </ns:actor> <ns:dataObject> <ns:file> <ns:fileURI>file:GWPS</ns:fileURI> <ns:ownerDN>Amy_Elliott</ns:ownerDN> <ns:createDate>2013-04-19T16:00:00.000-05:00</ns:createDate> <ns:size>868013951</ns:size> <ns:objectName>GWPS</ns:objectName> </ns:file> </ns:dataObject> <ns:timestamp>2013-04-19T16:10:00.000-05:00</ns:timestamp> <ns:dataRole>File Consumed</ns:dataRole> <ns:annotations> <ns:property>execution_environment</ns:property> <ns:value> <value>POSIX</value> </ns:value> </ns:annotations> </ns:dataConsumed> <ns:dataConsumed xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/"> <ns:action>CONSUME</ns:action> <ns:actor> <ns:serviceInformation> <ns:workflowID>NGC_20130422_015</ns:workflowID> <ns:workflowNodeID>WFNode:WFNode1</ns:workflowNodeID> <ns:timestep>-356643003</ns:timestep> <ns:serviceID>svc:Wiki</ns:serviceID> </ns:serviceInformation> <ns:type>SERVICE</ns:type> </ns:actor> <ns:dataObject> <ns:file> <ns:fileURI>file:MAID_data</ns:fileURI> <ns:ownerDN>Amy_Elliott</ns:ownerDN> <ns:createDate>2013-04-19T16:00:00.000-05:00</ns:createDate> <ns:size>868013951</ns:size> <ns:objectName>MAID_Data</ns:objectName> </ns:file> </ns:dataObject> <ns:timestamp>2013-04-19T16:10:00.000-05:00</ns:timestamp> <ns:dataRole>File Consumed</ns:dataRole> <ns:annotations> <ns:property>execution_environment</ns:property> <ns:value> <value>POSIX</value> </ns:value> </ns:annotations> </ns:dataConsumed> <ns:dataConsumed xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/"> <ns:action>CONSUME</ns:action> <ns:actor> <ns:serviceInformation> <ns:workflowID>NGC_20130422_015</ns:workflowID> <ns:workflowNodeID>WFNode:WFNode1</ns:workflowNodeID> <ns:timestep>-356643003</ns:timestep> <ns:serviceID>svc:Wiki</ns:serviceID> </ns:serviceInformation> <ns:type>SERVICE</ns:type> </ns:actor> <ns:dataObject> <ns:file> <ns:fileURI>file:MAID_data</ns:fileURI> <ns:ownerDN>Amy_Elliott</ns:ownerDN> <ns:createDate>2013-04-19T16:00:00.000-05:00</ns:createDate> <ns:size>868013951</ns:size> <ns:objectName>MAID_Data</ns:objectName> </ns:file> </ns:dataObject> <ns:timestamp>2013-04-19T16:10:00.000-05:00</ns:timestamp> <ns:dataRole>File Consumed</ns:dataRole> <ns:annotations> <ns:property>execution_environment</ns:property> <ns:value> <value>POSIX</value> </ns:value> </ns:annotations> </ns:dataConsumed> <ns:dataProduced xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/"> <ns:action>PRODUCE</ns:action> <ns:actor> <ns:serviceInformation> <ns:workflowID>NGC_20130422_015</ns:workflowID> <ns:workflowNodeID>WFNode:WFNode1</ns:workflowNodeID> <ns:timestep>-356643003</ns:timestep> <ns:serviceID>svc:GFI_Process1</ns:serviceID> </ns:serviceInformation> <ns:type>SERVICE</ns:type> </ns:actor> <ns:dataObject> <ns:file> <ns:fileURI>file:DamScape_001</ns:fileURI> <ns:ownerDN>Amy_Elliott</ns:ownerDN> <ns:createDate>2013-04-19T16:01:02.000-05:00</ns:createDate> <ns:size>868013951</ns:size> <ns:objectName>OS_Snapshot</ns:objectName> </ns:file> </ns:dataObject> <ns:timestamp>2013-04-19T16:01:02.000-05:00</ns:timestamp> <ns:annotations> <ns:property>execution_environment</ns:property> <ns:value> <value>POSIX</value> </ns:value> </ns:annotations> </ns:dataProduced> <ns:dataProduced xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/"> <ns:action>PRODUCE</ns:action> <ns:actor> <ns:serviceInformation> <ns:workflowID>NGC_20130422_015</ns:workflowID> <ns:workflowNodeID>WFNode:WFNode1</ns:workflowNodeID> <ns:timestep>-356643003</ns:timestep> <ns:serviceID>svc:MAID</ns:serviceID> </ns:serviceInformation> <ns:type>SERVICE</ns:type> </ns:actor> <ns:dataObject> <ns:file> <ns:fileURI>file:MAID_Data</ns:fileURI> <ns:ownerDN>44433975</ns:ownerDN> <ns:createDate>2013-04-19T16:25:00.000-05:00</ns:createDate> <ns:size>868013951</ns:size> <ns:objectName>OS_Snapshot</ns:objectName> </ns:file> </ns:dataObject> <ns:timestamp>2013-04-19T16:25:01.000-05:00</ns:timestamp> <ns:annotations> <ns:property>execution_environment</ns:property> <ns:value> <value>POSIX</value> </ns:value> </ns:annotations> </ns:dataProduced> <ns:dataProduced xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/"> <ns:action>PRODUCE</ns:action> <ns:actor> <ns:serviceInformation> <ns:workflowID>NGC_20130422_015</ns:workflowID> <ns:workflowNodeID>WFNode:WFNode1</ns:workflowNodeID> <ns:timestep>-356643003</ns:timestep> <ns:serviceID>svc:Wiki</ns:serviceID> </ns:serviceInformation> <ns:type>SERVICE</ns:type> </ns:actor> <ns:dataObject> <ns:file> <ns:fileURI>file:Report1</ns:fileURI> <ns:ownerDN>Dan_Forsyth</ns:ownerDN> <ns:createDate>2013-04-22T16:18:00.000-05:00</ns:createDate> <ns:size>868013951</ns:size> <ns:objectName>Report1</ns:objectName> </ns:file> </ns:dataObject> <ns:timestamp>2013-04-22T16:22:00.000-05:00</ns:timestamp> <ns:annotations> <ns:property>execution_environment</ns:property> <ns:value> <value>POSIX</value> </ns:value> </ns:annotations> </ns:dataProduced> <ns:serviceInvoked xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/"> <ns:invoker> <ns:userInformation> <ns:userDN>Amy_Elliott</ns:userDN> <ns:type>PERSON</ns:type> <ns:email>Amy...@ng...</ns:email> </ns:userInformation> <ns:type>USER</ns:type> </ns:invoker> <ns:invokee> <ns:serviceInformation> <ns:workflowID>NGC_20130422_015</ns:workflowID> <ns:workflowNodeID>WFNode:WFNode1</ns:workflowNodeID> <ns:timestep>-356643003</ns:timestep> <ns:serviceID>svc:GFI_Process1</ns:serviceID> </ns:serviceInformation> <ns:type>SERVICE</ns:type> </ns:invokee> <ns:invocationTime>2013-04-18T16:01:00.000-05:00</ns:invocationTime> </ns:serviceInvoked> <ns:serviceInvoked xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/"> <ns:invoker> <ns:userInformation> <ns:userDN>Dan_Forsyth</ns:userDN> <ns:type>PERSON</ns:type> <ns:email>Dan...@ng...</ns:email> </ns:userInformation> <ns:type>USER</ns:type> </ns:invoker> <ns:invokee> <ns:serviceInformation> <ns:workflowID>NGC_20130422_015</ns:workflowID> <ns:workflowNodeID>WFNode:WFNode1</ns:workflowNodeID> <ns:timestep>-356643003</ns:timestep> <ns:serviceID>svc:Wiki</ns:serviceID> </ns:serviceInformation> <ns:type>SERVICE</ns:type> </ns:invokee> <ns:invocationTime>2013-04-22T16:08:00.000-05:00</ns:invocationTime> </ns:serviceInvoked> And here's the OPM I get from this which should have 2 Agent_2 references but only has 1 -- the "wasControlledBy" -- and should have been defined under <v1:agent> but was not. <ns:getWorkflowGraphResponse xmlns:ns="http://www.dataandsearch.org/karma/query/2010/10/"> <v1:opmGraph xmlns:v1="http://openprovenance.org/model/v1.1.a"> <v1:processes> <v1:process id="Process_1"> <v1:annotation> <v1:property uri="process-type"> <v1:value> <type>SERVICE</type> </v1:value> </v1:property> <v1:property uri="process-workflowID"> <v1:value> <workflowID>NGC_20130422_015</workflowID> </v1:value> </v1:property> <v1:property uri="process-serviceID"> <v1:value> <serviceID>svc:GFI_Process1</serviceID> </v1:value> </v1:property> <v1:property uri="process-timestep"> <v1:value> <timestep>-356643003</timestep> </v1:value> </v1:property> <v1:property uri="process-workflowNodeID"> <v1:value> <workflowNodeID>WFNode:WFNode1</workflowNodeID> </v1:value> </v1:property> </v1:annotation> </v1:process> <v1:process id="Process_2"> <v1:annotation> <v1:property uri="process-type"> <v1:value> <type>SERVICE</type> </v1:value> </v1:property> <v1:property uri="process-workflowID"> <v1:value> <workflowID>NGC_20130422_015</workflowID> </v1:value> </v1:property> <v1:property uri="process-serviceID"> <v1:value> <serviceID>svc:Wiki</serviceID> </v1:value> </v1:property> <v1:property uri="process-timestep"> <v1:value> <timestep>-356643003</timestep> </v1:value> </v1:property> <v1:property uri="process-workflowNodeID"> <v1:value> <workflowNodeID>WFNode:WFNode1</workflowNodeID> </v1:value> </v1:property> </v1:annotation> </v1:process> <v1:process id="Process_3"> <v1:annotation> <v1:property uri="process-type"> <v1:value> <type>SERVICE</type> </v1:value> </v1:property> <v1:property uri="process-workflowID"> <v1:value> <workflowID>NGC_20130422_015</workflowID> </v1:value> </v1:property> <v1:property uri="process-serviceID"> <v1:value> <serviceID>svc:MAID</serviceID> </v1:value> </v1:property> <v1:property uri="process-timestep"> <v1:value> <timestep>-356643003</timestep> </v1:value> </v1:property> <v1:property uri="process-workflowNodeID"> <v1:value> <workflowNodeID>WFNode:WFNode1</workflowNodeID> </v1:value> </v1:property> </v1:annotation> </v1:process> </v1:processes> <v1:artifacts> <v1:artifact id="File_3"> <v1:annotation> <v1:property uri="artifact-size"> <v1:value> <size>868013951</size> </v1:value> </v1:property> <v1:property uri="artifact-uri"> <v1:value> <fileURI>file:GWPS</fileURI> </v1:value> </v1:property> </v1:annotation> </v1:artifact> <v1:artifact id="File_4"> <v1:annotation> <v1:property uri="artifact-size"> <v1:value> <size>868013951</size> </v1:value> </v1:property> <v1:property uri="artifact-uri"> <v1:value> <fileURI>file:MAID_data</fileURI> </v1:value> </v1:property> </v1:annotation> </v1:artifact> <v1:artifact id="File_5"> <v1:annotation> <v1:property uri="artifact-size"> <v1:value> <size>868013951</size> </v1:value> </v1:property> <v1:property uri="artifact-uri"> <v1:value> <fileURI>file:Report1</fileURI> </v1:value> </v1:property> </v1:annotation> </v1:artifact> <v1:artifact id="File_1"> <v1:annotation> <v1:property uri="artifact-size"> <v1:value> <size>868013951</size> </v1:value> </v1:property> <v1:property uri="artifact-uri"> <v1:value> <fileURI>file:GFI_001</fileURI> </v1:value> </v1:property> </v1:annotation> </v1:artifact> <v1:artifact id="File_2"> <v1:annotation> <v1:property uri="artifact-size"> <v1:value> <size>868013951</size> </v1:value> </v1:property> <v1:property uri="artifact-uri"> <v1:value> <fileURI>file:DamScape_001</fileURI> </v1:value> </v1:property> </v1:annotation> </v1:artifact> </v1:artifacts> <v1:agents> <v1:agent id="Agent_1"> <v1:annotation> <v1:property uri="agent-dn"> <v1:value> <dn>Amy_Elliott</dn> </v1:value> </v1:property> <v1:property uri="agent-email"> <v1:value> <email>Amy...@ng...</email> </v1:value> </v1:property> </v1:annotation> </v1:agent> </v1:agents> <v1:causalDependencies> <v1:used> <v1:effect ref="Process_1"/> <v1:role value="File Consumed"/> <v1:cause ref="File_1"/> <v1:time noEarlierThan="2013-04-19T17:01:01.000-04:00" noLaterThan="2013-04-19T17:01:01.000-04:00"/> <v1:annotation id="Data-Lifecycle-Annotation_1"> <v1:property uri="data-lifecycle-annotation/EXTERNAL_SOURCE/execution_environment"> <v1:value> <value xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/">POSIX</value> </v1:value> </v1:property> </v1:annotation> </v1:used> <v1:used> <v1:effect ref="Process_2"/> <v1:role value="File Consumed"/> <v1:cause ref="File_2"/> <v1:time noEarlierThan="2013-04-19T17:01:02.000-04:00" noLaterThan="2013-04-19T17:10:00.000-04:00"/> <v1:annotation id="Data-Lifecycle-Annotation_3"> <v1:property uri="data-lifecycle-annotation/EXTERNAL_SOURCE/execution_environment"> <v1:value> <value xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/">POSIX</value> </v1:value> </v1:property> </v1:annotation> </v1:used> <v1:used> <v1:effect ref="Process_2"/> <v1:role value="File Consumed"/> <v1:cause ref="File_3"/> <v1:time noEarlierThan="2013-04-19T17:10:00.000-04:00" noLaterThan="2013-04-19T17:10:00.000-04:00"/> <v1:annotation id="Data-Lifecycle-Annotation_4"> <v1:property uri="data-lifecycle-annotation/EXTERNAL_SOURCE/execution_environment"> <v1:value> <value xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/">POSIX</value> </v1:value> </v1:property> </v1:annotation> </v1:used> <v1:used> <v1:effect ref="Process_2"/> <v1:role value="File Consumed"/> <v1:cause ref="File_4"/> <v1:time noEarlierThan="2013-04-19T17:25:01.000-04:00" noLaterThan="2013-04-19T17:10:00.000-04:00"/> <v1:annotation id="Data-Lifecycle-Annotation_5"> <v1:property uri="data-lifecycle-annotation/EXTERNAL_SOURCE/execution_environment"> <v1:value> <value xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/">POSIX</value> </v1:value> </v1:property> </v1:annotation> </v1:used> <v1:wasDerivedFrom> <v1:effect ref="File_2"/> <v1:cause ref="File_1"/> <v1:time noEarlierThan="2013-04-19T17:01:01.000-04:00" noLaterThan="2013-04-19T17:01:02.000-04:00"/> <v1:annotation id="Data-Lifecycle-Annotation_1"> <v1:property uri="data-lifecycle-annotation/EXTERNAL_SOURCE/execution_environment"> <v1:value> <value xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/">POSIX</value> </v1:value> </v1:property> </v1:annotation> <v1:annotation id="Data-Lifecycle-Annotation_2"> <v1:property uri="data-lifecycle-annotation/EXTERNAL_SOURCE/execution_environment"> <v1:value> <value xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/">POSIX</value> </v1:value> </v1:property> </v1:annotation> </v1:wasDerivedFrom> <v1:wasDerivedFrom> <v1:effect ref="File_5"/> <v1:cause ref="File_2"/> <v1:time noEarlierThan="2013-04-19T17:10:00.000-04:00" noLaterThan="2013-04-22T17:22:00.000-04:00"/> <v1:annotation id="Data-Lifecycle-Annotation_3"> <v1:property uri="data-lifecycle-annotation/EXTERNAL_SOURCE/execution_environment"> <v1:value> <value xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/">POSIX</value> </v1:value> </v1:property> </v1:annotation> <v1:annotation id="Data-Lifecycle-Annotation_7"> <v1:property uri="data-lifecycle-annotation/EXTERNAL_SOURCE/execution_environment"> <v1:value> <value xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/">POSIX</value> </v1:value> </v1:property> </v1:annotation> </v1:wasDerivedFrom> <v1:wasDerivedFrom> <v1:effect ref="File_5"/> <v1:cause ref="File_3"/> <v1:time noEarlierThan="2013-04-19T17:10:00.000-04:00" noLaterThan="2013-04-22T17:22:00.000-04:00"/> <v1:annotation id="Data-Lifecycle-Annotation_4"> <v1:property uri="data-lifecycle-annotation/EXTERNAL_SOURCE/execution_environment"> <v1:value> <value xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/">POSIX</value> </v1:value> </v1:property> </v1:annotation> <v1:annotation id="Data-Lifecycle-Annotation_7"> <v1:property uri="data-lifecycle-annotation/EXTERNAL_SOURCE/execution_environment"> <v1:value> <value xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/">POSIX</value> </v1:value> </v1:property> </v1:annotation> </v1:wasDerivedFrom> <v1:wasDerivedFrom> <v1:effect ref="File_5"/> <v1:cause ref="File_4"/> <v1:time noEarlierThan="2013-04-19T17:10:00.000-04:00" noLaterThan="2013-04-22T17:22:00.000-04:00"/> <v1:annotation id="Data-Lifecycle-Annotation_5"> <v1:property uri="data-lifecycle-annotation/EXTERNAL_SOURCE/execution_environment"> <v1:value> <value xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/">POSIX</value> </v1:value> </v1:property> </v1:annotation> <v1:annotation id="Data-Lifecycle-Annotation_7"> <v1:property uri="data-lifecycle-annotation/EXTERNAL_SOURCE/execution_environment"> <v1:value> <value xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/">POSIX</value> </v1:value> </v1:property> </v1:annotation> </v1:wasDerivedFrom> <v1:wasTriggeredBy> <v1:effect ref="Process_2"/> <v1:cause ref="Process_1"/> <v1:time noEarlierThan="2013-04-19T17:01:02.000-04:00" noLaterThan="2013-04-19T17:10:00.000-04:00"/> <v1:annotation id="Data-Lifecycle-Annotation_3"> <v1:property uri="data-lifecycle-annotation/EXTERNAL_SOURCE/execution_environment"> <v1:value> <value xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/">POSIX</value> </v1:value> </v1:property> </v1:annotation> <v1:annotation id="Data-Lifecycle-Annotation_2"> <v1:property uri="data-lifecycle-annotation/EXTERNAL_SOURCE/execution_environment"> <v1:value> <value xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/">POSIX</value> </v1:value> </v1:property> </v1:annotation> </v1:wasTriggeredBy> <v1:wasTriggeredBy> <v1:effect ref="Process_2"/> <v1:cause ref="Process_3"/> <v1:time noEarlierThan="2013-04-19T17:25:01.000-04:00" noLaterThan="2013-04-19T17:10:00.000-04:00"/> <v1:annotation id="Data-Lifecycle-Annotation_5"> <v1:property uri="data-lifecycle-annotation/EXTERNAL_SOURCE/execution_environment"> <v1:value> <value xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/">POSIX</value> </v1:value> </v1:property> </v1:annotation> <v1:annotation id="Data-Lifecycle-Annotation_6"> <v1:property uri="data-lifecycle-annotation/EXTERNAL_SOURCE/execution_environment"> <v1:value> <value xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/">POSIX</value> </v1:value> </v1:property> </v1:annotation> </v1:wasTriggeredBy> <v1:wasGeneratedBy> <v1:effect ref="File_2"/> <v1:role value="Output"/> <v1:cause ref="Process_1"/> <v1:time noEarlierThan="2013-04-19T17:01:02.000-04:00" noLaterThan="2013-04-19T17:10:00.000-04:00"/> <v1:annotation id="Data-Lifecycle-Annotation_2"> <v1:property uri="data-lifecycle-annotation/EXTERNAL_SOURCE/execution_environment"> <v1:value> <value xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/">POSIX</value> </v1:value> </v1:property> </v1:annotation> </v1:wasGeneratedBy> <v1:wasGeneratedBy> <v1:effect ref="File_4"/> <v1:role value="Output"/> <v1:cause ref="Process_3"/> <v1:time noEarlierThan="2013-04-19T17:25:01.000-04:00" noLaterThan="2013-04-19T17:10:00.000-04:00"/> <v1:annotation id="Data-Lifecycle-Annotation_6"> <v1:property uri="data-lifecycle-annotation/EXTERNAL_SOURCE/execution_environment"> <v1:value> <value xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/">POSIX</value> </v1:value> </v1:property> </v1:annotation> </v1:wasGeneratedBy> <v1:wasGeneratedBy> <v1:effect ref="File_5"/> <v1:role value="Output"/> <v1:cause ref="Process_2"/> <v1:time noEarlierThan="2013-04-22T17:22:00.000-04:00" noLaterThan="2013-04-22T17:22:00.000-04:00"/> <v1:annotation id="Data-Lifecycle-Annotation_7"> <v1:property uri="data-lifecycle-annotation/EXTERNAL_SOURCE/execution_environment"> <v1:value> <value xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/">POSIX</value> </v1:value> </v1:property> </v1:annotation> </v1:wasGeneratedBy> <v1:wasControlledBy> <v1:effect ref="Process_1"/> <v1:role value="ProcessControl"/> <v1:cause ref="Agent_1"/> <v1:startTime noEarlierThan="2013-04-18T17:01:00.000-04:00"/> <v1:endTime noLaterThan="2013-04-18T17:01:00.000-04:00"/> </v1:wasControlledBy> <v1:wasControlledBy> <v1:effect ref="Process_2"/> <v1:role value="ProcessControl"/> <v1:cause ref="Agent_2"/> <v1:startTime noEarlierThan="2013-04-22T17:08:00.000-04:00"/> <v1:endTime noLaterThan="2013-04-22T17:08:00.000-04:00"/> </v1:wasControlledBy> </v1:causalDependencies> </v1:opmGraph> </ns:getWorkflowGraphResponse> Michael D. Black Senior Scientist Analytics, Production and Services Advanced GEOINT Systems Northrop Grumman Information Systems |
|
From: Black, M. (IS) <Mic...@ng...> - 2013-04-20 13:19:41
|
As a followup to this just adding the workflow by itself causes the added "No <serviceID> exists" OPM node to appear.
So what am I missing on this?
There has to be a way to hook up the workflow to Service1 without this intermediate node appearing.
Michael D. Black
Senior Scientist
Analytics, Production and Services
Advanced GEOINT Systems
Northrop Grumman Information Systems
________________________________________
From: Black, Michael (IS)
Sent: Friday, April 19, 2013 6:52 PM
To: kar...@li...
Subject: OPM extra data?
OK...getting things working now but now there's some extra data in the OPM file that I don't know where it's coming from.
There's only one process declared (as far as I can tell) but 2 processes show up and id#4 has "No <serviceID> Exists".
Here's the OPM from this and I don't know where node id=4 comes from.
Service1 should be "controlled by" "Michael Black" as that's what I thought I specified so where is the intermediate step being created?
<?xml version="1.0" encoding="UTF-8"?>
<graphml>
<graph id="NGC_20130419_010" edgedefault="directed">
<key id="name" for="node" attr.name="name" attr.type="string"/>
<key id="type" for="node" attr.name="type" attr.type="string"/>
<key id="relation" for="edge" attr.name="relation" attr.type="string"/>
<node id="1">
<data key="name">file:File1</data>
<data key="type">file</data>
</node>
<node id="2">
<data key="name">file:File2</data>
<data key="type">file</data>
</node>
<node id="3">
<data key="name">svc:Service1</data>
<data key="type">process</data>
</node>
<node id="4">
<data key="name">No <serviceID> Exists</data>
<data key="type">process</data>
</node>
<node id="5">
<data key="name">Michael_Black</data>
<data key="type">agent</data>
</node>
<edge source="1" target="3">
<data key="relation">Used</data>
</edge>
<edge source="1" target="2">
<data key="relation">Was Derived From</data>
</edge>
<edge source="4" target="3">
<data key="relation">Was Triggered By</data>
</edge>
<edge source="3" target="2">
<data key="relation">Was Generated By</data>
</edge>
<edge source="5" target="4">
<data key="relation">Was Controlled By</data>
</edge>
</graph>
</graphml>
Here's my input for this simple case:
bin/sendNotification.sh config/karma.properties $CurDir/workflowInvoked.xml
bin/sendNotification.sh config/karma.properties $CurDir/serviceInvoked1.xml
bin/sendNotification.sh config/karma.properties $CurDir/dataProduced1.xml
bin/sendNotification.sh config/karma.properties $CurDir/dataConsumed1.xml
<ns:workflowInvoked xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns
:soapenv="http://schemas.xmlsoap.org/soap/envelope/">
<ns:invoker>
<ns:userInformation>
<ns:userDN>Michael_Black</ns:userDN>
<ns:type>PERSON</ns:type>
<ns:email>Mic...@ng...</ns:email>
</ns:userInformation>
<ns:type>USER</ns:type>
</ns:invoker>
<ns:invokee>
<ns:workflowInformation>
<ns:workflowID>NGC_20130419_010</ns:workflowID>
<ns:workflowNodeID>WFNode:WFNode1</ns:workflowNodeID>
<ns:timestep>1476332968</ns:timestep>
</ns:workflowInformation>
<ns:type>WORKFLOW</ns:type>
</ns:invokee>
<ns:invocationTime>2013-04-18T16:08:01.000-05:00</ns:invocationTime>
</ns:workflowInvoked>
<ns:serviceInvoked xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:
soapenv="http://schemas.xmlsoap.org/soap/envelope/">
<ns:invoker>
<ns:workflowInformation>
<ns:workflowID>NGC_20130419_010</ns:workflowID>
<ns:workflowNodeID>WFNode:WFNode1</ns:workflowNodeID>
<ns:timestep>1476332968</ns:timestep>
</ns:workflowInformation>
<ns:type>WORKFLOW</ns:type>
</ns:invoker>
<ns:invokee>
<ns:serviceInformation>
<ns:workflowID>NGC_20130419_010</ns:workflowID>
<ns:workflowNodeID>WFNode:WFNode1</ns:workflowNodeID>
<ns:timestep>-356643003</ns:timestep>
<ns:serviceID>svc:Service1</ns:serviceID>
</ns:serviceInformation>
<ns:type>SERVICE</ns:type>
</ns:invokee>
<ns:invocationTime>2013-04-18T16:08:00.000-05:00</ns:invocationTime>
</ns:serviceInvoked>
<ns:dataConsumed xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:so
apenv="http://schemas.xmlsoap.org/soap/envelope/">
<ns:action>CONSUME</ns:action>
<ns:actor>
<ns:serviceInformation>
<ns:workflowID>NGC_20130419_010</ns:workflowID>
<ns:workflowNodeID>WFNode:WFNode1</ns:workflowNodeID>
<ns:timestep>-356643003</ns:timestep>
<ns:serviceID>svc:Service1</ns:serviceID>
</ns:serviceInformation>
<ns:type>SERVICE</ns:type>
</ns:actor>
<ns:dataObject>
<ns:file>
<ns:fileURI>file:File1</ns:fileURI>
<ns:ownerDN>-644433975</ns:ownerDN>
<ns:createDate>2013-04-19T16:00:00.000-05:00</ns:createDate>
<ns:size>868013951</ns:size>
<ns:objectName>File1</ns:objectName>
</ns:file>
</ns:dataObject>
<ns:timestamp>2013-04-19T16:10:00.000-05:00</ns:timestamp>
<ns:dataRole>File Consumed</ns:dataRole>
<ns:annotations>
<ns:property>execution_environment</ns:property>
<ns:value>
<value>POSIX</value>
</ns:value>
</ns:annotations>
</ns:dataConsumed>
<ns:dataProduced xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:so
apenv="http://schemas.xmlsoap.org/soap/envelope/">
<ns:action>PRODUCE</ns:action>
<ns:actor>
<ns:serviceInformation>
<ns:workflowID>NGC_20130419_010</ns:workflowID>
<ns:workflowNodeID>WFNode:WFNode1</ns:workflowNodeID>
<ns:timestep>-356643003</ns:timestep>
<ns:serviceID>svc:Service1</ns:serviceID>
</ns:serviceInformation>
<ns:type>SERVICE</ns:type>
</ns:actor>
<ns:dataObject>
<ns:file>
<ns:fileURI>file:File2</ns:fileURI>
<ns:ownerDN>-644433975</ns:ownerDN>
<ns:createDate>2013-04-19T16:25:00.000-05:00</ns:createDate>
<ns:size>868013951</ns:size>
<ns:objectName>File2</ns:objectName>
</ns:file>
</ns:dataObject>
<ns:timestamp>2013-04-19T16:25:01.000-05:00</ns:timestamp>
<ns:annotations>
<ns:property>execution_environment</ns:property>
<ns:value>
<value>POSIX</value>
</ns:value>
</ns:annotations>
</ns:dataProduced>
Michael D. Black
Senior Scientist
Analytics, Production and Services
Advanced GEOINT Systems
Northrop Grumman Information Systems
|
|
From: Black, M. (IS) <Mic...@ng...> - 2013-04-19 23:52:35
|
OK...getting things working now but now there's some extra data in the OPM file that I don't know where it's coming from.
There's only one process declared (as far as I can tell) but 2 processes show up and id#4 has "No <serviceID> Exists".
Here's the OPM from this and I don't know where node id=4 comes from.
Service1 should be "controlled by" "Michael Black" as that's what I thought I specified so where is the intermediate step being created?
<?xml version="1.0" encoding="UTF-8"?>
<graphml>
<graph id="NGC_20130419_010" edgedefault="directed">
<key id="name" for="node" attr.name="name" attr.type="string"/>
<key id="type" for="node" attr.name="type" attr.type="string"/>
<key id="relation" for="edge" attr.name="relation" attr.type="string"/>
<node id="1">
<data key="name">file:File1</data>
<data key="type">file</data>
</node>
<node id="2">
<data key="name">file:File2</data>
<data key="type">file</data>
</node>
<node id="3">
<data key="name">svc:Service1</data>
<data key="type">process</data>
</node>
<node id="4">
<data key="name">No <serviceID> Exists</data>
<data key="type">process</data>
</node>
<node id="5">
<data key="name">Michael_Black</data>
<data key="type">agent</data>
</node>
<edge source="1" target="3">
<data key="relation">Used</data>
</edge>
<edge source="1" target="2">
<data key="relation">Was Derived From</data>
</edge>
<edge source="4" target="3">
<data key="relation">Was Triggered By</data>
</edge>
<edge source="3" target="2">
<data key="relation">Was Generated By</data>
</edge>
<edge source="5" target="4">
<data key="relation">Was Controlled By</data>
</edge>
</graph>
</graphml>
Here's my input for this simple case:
bin/sendNotification.sh config/karma.properties $CurDir/workflowInvoked.xml
bin/sendNotification.sh config/karma.properties $CurDir/serviceInvoked1.xml
bin/sendNotification.sh config/karma.properties $CurDir/dataProduced1.xml
bin/sendNotification.sh config/karma.properties $CurDir/dataConsumed1.xml
<ns:workflowInvoked xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns
:soapenv="http://schemas.xmlsoap.org/soap/envelope/">
<ns:invoker>
<ns:userInformation>
<ns:userDN>Michael_Black</ns:userDN>
<ns:type>PERSON</ns:type>
<ns:email>Mic...@ng...</ns:email>
</ns:userInformation>
<ns:type>USER</ns:type>
</ns:invoker>
<ns:invokee>
<ns:workflowInformation>
<ns:workflowID>NGC_20130419_010</ns:workflowID>
<ns:workflowNodeID>WFNode:WFNode1</ns:workflowNodeID>
<ns:timestep>1476332968</ns:timestep>
</ns:workflowInformation>
<ns:type>WORKFLOW</ns:type>
</ns:invokee>
<ns:invocationTime>2013-04-18T16:08:01.000-05:00</ns:invocationTime>
</ns:workflowInvoked>
<ns:serviceInvoked xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:
soapenv="http://schemas.xmlsoap.org/soap/envelope/">
<ns:invoker>
<ns:workflowInformation>
<ns:workflowID>NGC_20130419_010</ns:workflowID>
<ns:workflowNodeID>WFNode:WFNode1</ns:workflowNodeID>
<ns:timestep>1476332968</ns:timestep>
</ns:workflowInformation>
<ns:type>WORKFLOW</ns:type>
</ns:invoker>
<ns:invokee>
<ns:serviceInformation>
<ns:workflowID>NGC_20130419_010</ns:workflowID>
<ns:workflowNodeID>WFNode:WFNode1</ns:workflowNodeID>
<ns:timestep>-356643003</ns:timestep>
<ns:serviceID>svc:Service1</ns:serviceID>
</ns:serviceInformation>
<ns:type>SERVICE</ns:type>
</ns:invokee>
<ns:invocationTime>2013-04-18T16:08:00.000-05:00</ns:invocationTime>
</ns:serviceInvoked>
<ns:dataConsumed xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:so
apenv="http://schemas.xmlsoap.org/soap/envelope/">
<ns:action>CONSUME</ns:action>
<ns:actor>
<ns:serviceInformation>
<ns:workflowID>NGC_20130419_010</ns:workflowID>
<ns:workflowNodeID>WFNode:WFNode1</ns:workflowNodeID>
<ns:timestep>-356643003</ns:timestep>
<ns:serviceID>svc:Service1</ns:serviceID>
</ns:serviceInformation>
<ns:type>SERVICE</ns:type>
</ns:actor>
<ns:dataObject>
<ns:file>
<ns:fileURI>file:File1</ns:fileURI>
<ns:ownerDN>-644433975</ns:ownerDN>
<ns:createDate>2013-04-19T16:00:00.000-05:00</ns:createDate>
<ns:size>868013951</ns:size>
<ns:objectName>File1</ns:objectName>
</ns:file>
</ns:dataObject>
<ns:timestamp>2013-04-19T16:10:00.000-05:00</ns:timestamp>
<ns:dataRole>File Consumed</ns:dataRole>
<ns:annotations>
<ns:property>execution_environment</ns:property>
<ns:value>
<value>POSIX</value>
</ns:value>
</ns:annotations>
</ns:dataConsumed>
<ns:dataProduced xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" xmlns:so
apenv="http://schemas.xmlsoap.org/soap/envelope/">
<ns:action>PRODUCE</ns:action>
<ns:actor>
<ns:serviceInformation>
<ns:workflowID>NGC_20130419_010</ns:workflowID>
<ns:workflowNodeID>WFNode:WFNode1</ns:workflowNodeID>
<ns:timestep>-356643003</ns:timestep>
<ns:serviceID>svc:Service1</ns:serviceID>
</ns:serviceInformation>
<ns:type>SERVICE</ns:type>
</ns:actor>
<ns:dataObject>
<ns:file>
<ns:fileURI>file:File2</ns:fileURI>
<ns:ownerDN>-644433975</ns:ownerDN>
<ns:createDate>2013-04-19T16:25:00.000-05:00</ns:createDate>
<ns:size>868013951</ns:size>
<ns:objectName>File2</ns:objectName>
</ns:file>
</ns:dataObject>
<ns:timestamp>2013-04-19T16:25:01.000-05:00</ns:timestamp>
<ns:annotations>
<ns:property>execution_environment</ns:property>
<ns:value>
<value>POSIX</value>
</ns:value>
</ns:annotations>
</ns:dataProduced>
Michael D. Black
Senior Scientist
Analytics, Production and Services
Advanced GEOINT Systems
Northrop Grumman Information Systems
|
|
From: Yuan L. <yu...@in...> - 2013-04-19 21:51:41
|
Hi Michael, The timestep in Karma refers to the logical timestamp in distributed system. It's optional. There is ingest schema and query schema available in the service-core package, config/karma_ingest_type_schema.xsd config/karma_query_schema.xsd I see several problems in the notification xml files: 1) The workflowID in all notification should be the same. 2) The serviceID in your case should be Process1's ID. So all the serviceIDs in serviceInvoked1.xml, dataProduced1.xml, and dataConsumed1.xml should match. After modifying and ingesting the notification, could you please check the raw_notification and exe_entity tables if the new entries are actually stored? You may want to give a new workflowID for clean ingest. Could you send me the karma log file if the problem remains? Thanks, Yuan On Fri, Apr 19, 2013 at 5:19 PM, Black, Michael (IS) <Mic...@ng... > wrote: > One thing that would help would be a simple example with accompanying > explanation of what is what. > > There are so many IDs flying around inside the XML I don't know who refers > to what. And what does "timestep" do? > > And the only behavior I get is no successful entry in Karma (or at least > no retrievable OPM). > > I was able to do some simple renaming but I'm at a loss to make a trivlal > example. > > Actor1 runs Process 1 which Consumes File1 and produces File2 > > bin/sendNotification.sh config/karma.properties > $CurDir/workflowInvoked.xml > bin/sendNotification.sh config/karma.properties > $CurDir/serviceInvoked1.xml > bin/sendNotification.sh config/karma.properties $CurDir/dataProduced1.xml > bin/sendNotification.sh config/karma.properties $CurDir/dataConsumed1.xml > > > workflowInvoked: > <ns:workflowInvoked xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" > xmlns > :soapenv="http://schemas.xmlsoap.org/soap/envelope/"> > <ns:invoker> > <ns:userInformation> > <ns:userDN>Michael_Black</ns:userDN> > <ns:type>PERSON</ns:type> > <ns:email>Mic...@ng...</ns:email> > </ns:userInformation> > <ns:type>USER</ns:type> > </ns:invoker> > <ns:invokee> > <ns:workflowInformation> > <ns:workflowID>NGC_20130419_003</ns:workflowID> > <ns:workflowNodeID>WFNode:WFNode1</ns:workflowNodeID> > <ns:timestep>1476332968</ns:timestep> > </ns:workflowInformation> > <ns:type>WORKFLOW</ns:type> > </ns:invokee> > <ns:invocationTime>2013-04-18T16:08:00.000-05:00</ns:invocationTime> > </ns:workflowInvoked> > > serviceInvoked1 > <ns:serviceInvoked xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" > xmlns: > soapenv="http://schemas.xmlsoap.org/soap/envelope/"> > <ns:invoker> > <ns:workflowInformation> > <ns:workflowID>NGC_20130419_002</ns:workflowID> > <ns:workflowNodeID>WFNode:WFNode1</ns:workflowNodeID> > <ns:timestep>1476332968</ns:timestep> > </ns:workflowInformation> > <ns:type>WORKFLOW</ns:type> > </ns:invoker> > <ns:invokee> > <ns:serviceInformation> > <ns:workflowID>NGC_20130419_002</ns:workflowID> > <ns:workflowNodeID>WFNode:WFNode2</ns:workflowNodeID> > <ns:timestep>-356643003</ns:timestep> > <ns:serviceID>svc:TestService_-356643003</ns:serviceID> > </ns:serviceInformation> > <ns:type>SERVICE</ns:type> > </ns:invokee> > <ns:invocationTime>2013-04-18T16:10:00.0 > > dataConsumed1 > <ns:dataConsumed xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" > xmlns:so > apenv="http://schemas.xmlsoap.org/soap/envelope/"> > <ns:action>CONSUME</ns:action> > <ns:actor> > <ns:serviceInformation> > <ns:workflowID>NGC_20130419_002</ns:workflowID> > > <ns:workflowNodeID>WFNode:KarmaProcessor-180041393</ns:workflowNodeID> > <ns:timestep>-180041393</ns:timestep> > <ns:serviceID>svc:TestService_-180041393</ns:serviceID> > </ns:serviceInformation> > <ns:type>SERVICE</ns:type> > </ns:actor> > <ns:dataObject> > <ns:file> > <ns:fileURI>file:File_-644433975</ns:fileURI> > <ns:ownerDN>-644433975</ns:ownerDN> > <ns:createDate>2013-02-01T14:49:23.550-05:00</ns:createDate> > <ns:size>868013951</ns:size> > <ns:objectName>testKarmaFile_-644433975.txt</ns:objectName> > </ns:file> > </ns:dataObject> > <ns:timestamp>2013-02-01T14:49:23.621-05:00</ns:timestamp> > <ns:dataRole>File Consumed</ns:dataRole> > <ns:annotations> > <ns:property>execution_environment</ns:property> > <ns:value> > <value>POSIX</value> > </ns:value> > </ns:annotations> > > <ns:dataProduced xmlns:ns="http://www.dataandsearch.org/karma/2010/08/" > xmlns:so > apenv="http://schemas.xmlsoap.org/soap/envelope/"> > <ns:action>PRODUCE</ns:action> > <ns:actor> > <ns:serviceInformation> > <ns:workflowID>NGC_20130419_002</ns:workflowID> > <ns:workflowNodeID>WFNode:WFNode2</ns:workflowNodeID> > <ns:timestep>-356643003</ns:timestep> > <ns:serviceID>svc:TestService_-356643003</ns:serviceID> > </ns:serviceInformation> > <ns:type>SERVICE</ns:type> > </ns:actor> > <ns:dataObject> > <ns:file> > <ns:fileURI>file:File_-644433975</ns:fileURI> > <ns:ownerDN>-644433975</ns:ownerDN> > <ns:createDate>2013-02-01T14:49:23.550-05:00</ns:createDate> > <ns:size>868013951</ns:size> > <ns:objectName>testKarmaFile_-644433975.txt</ns:objectName> > </ns:file> > </ns:dataObject> > <ns:timestamp>2013-02-01T14:49:23.551-05:00</ns:timestamp> > <ns:annotations> > <ns:property>execution_environment</ns:property> > <ns:value> > <value>POSIX</value> > </ns:value> > </ns:annotations> > </ns:dataProduced> > > > > > Michael D. Black > Senior Scientist > Analytics, Production and Services > Advanced GEOINT Systems > Northrop Grumman Information Systems > ------------------------------ > *From:* yu...@um... [yu...@um...] on behalf of Yuan Luo > [yu...@in...] > *Sent:* Friday, April 19, 2013 3:52 PM > *To:* Black, Michael (IS) > *Subject:* EXT :Re: [Karmatool-users] Adding workflow > > Hi Michael, > > Sure. Let me know if you still get error. > > Yes. We don't have that kind of docs at this moment, but will bring this > up in our internal meetings. For now, please follow that sample and let me > know if you have any problem writing notifications. > > Thanks, > > Yuan > > > On Fri, Apr 19, 2013 at 4:10 PM, Black, Michael (IS) < > Mic...@ng...> wrote: > >> Yes..you the path that I'm trying to modify. >> >> I think the error may have been on my part...I'm going to experiment here >> and if I have problems I'll send the sample files and perhaps you can help >> me figure out what I'm messing up if it doesn't work. >> >> One problem is I don't see any docs on how to actually enter a workflow >> in the system...what minimums are expected or such. >> >> Michael D. Black >> Senior Scientist >> Analytics, Production and Services >> Advanced GEOINT Systems >> Northrop Grumman Information Systems >> ------------------------------ >> *From:* Yuan Luo [yu...@in...] >> *Sent:* Friday, April 19, 2013 1:38 PM >> *To:* Michael Black >> *Cc:* karmatool-users >> *Subject:* EXT :Re: [Karmatool-users] Adding workflow >> >> Hi Michael, >> >> Does sample1 come from >> client-core/samples/sampleWorkflow1/notification? Please see my inline >> reply. I might have missed your points, so correct me if I misunderstood >> anything. >> >> Thanks, >> >> Yuan >> >> >> On Fri, Apr 19, 2013 at 1:01 PM, Michael Black <mdb...@ya...>wrote: >> >>> I am able to load a workflow using the sample1 workflow recently added. >>> **** >>> >>> ** ** >>> >>> But…when I try and make changes to that workflow to experiment with >>> different names and such the OPM file produced will contain the old names. >>> **** >>> >>> I was trying just to slowly migrate over to what I want to put in the >>> system by changing user name for example with a new workFlowID. But the >>> old user name still shows in the OPM file.**** >>> >>> ** >>> >> In Karma system, we only have add/append modes. A workflow will be added >> into the system when ingesting the first notification that contains a new >> workflowID. The following notifications with that workflowID will be >> appended to that workflow. There's no deletion or modification for a >> workflow. If you change a workflowID (I assume you changed all the >> notifications with new workflowID in the sampleWorkflow1 directory), it >> will be considered as a new workflow. Both the old and new workflow will >> exist. >> >> >>> ** >>> >>> And if I zap the tables and try to insert my modified workflow no OPM >>> file gets produced at all. So there appears to be some dependency that I >>> don’t see.**** >>> >>> ** >>> >> There should be no problem to get new workflow ingested and queried after >> zapping tables. Could you please provide more details? >> >> >>> ** >>> >>> So I’m wondering if there’s some document somewhere I should read that >>> explains this process as I’m completely befuddled.**** >>> >>> ** >>> >> The latest document is >> http://iweb.dl.sourceforge.net/project/karmatool/v3.2.3/KarmaUserGuide.pdf >> >> Some pointers of Karma and Provenance: >> http://www.cs.indiana.edu/~plale/papers/Plale-FGCS-preprintJan2011.pdf >> http://www.cs.indiana.edu/~plale/papers/KarmaInfoModel_SWF09.pdf >> http://link.springer.com/chapter/10.1007%2F978-3-642-29931-5_3 >> >> >>> ** >>> >>> Is there some tool to generate a generic workflow? >>> >> Are you referring to a tool that can generate notifications? If yes, >> KarmaAdaptor is one solution for that. The KarmaAdaptor takes a customized >> rule file and apply to the workflow log files to get the provenance >> information and ingest to Karma Server with notifications. The adaptor and >> its doc is here http://sourceforge.net/projects/karmatool/files/v3.2.3. >> Or are you asking for these workflow tools such as Kepler >> https://kepler-project.org/? >> If it's something else, please let me know. >> >>> **** >>> >>> ** ** >>> >>> ** ** >>> >>> Michael Black**** >>> >>> ** ** >>> >>> >>> ------------------------------------------------------------------------------ >>> Precog is a next-generation analytics platform capable of advanced >>> analytics on semi-structured data. The platform includes APIs for >>> building >>> apps and a phenomenal toolset for data science. Developers can use >>> our toolset for easy data analysis & visualization. Get a free account! >>> http://www2.precog.com/precogplatform/slashdotnewsletter >>> _______________________________________________ >>> Karmatool-users mailing list >>> Kar...@li... >>> https://lists.sourceforge.net/lists/listinfo/karmatool-users >>> >>> >> >> >> -- >> >> Yuan Luo >> School of Informatics and Computing, Indiana University >> Data to Insight Center, Indiana University >> Cell: (812)272-0208 http://www.yuanluo.net >> >> > > > -- > > Yuan Luo > School of Informatics and Computing, Indiana University > Data to Insight Center, Indiana University > Cell: (812)272-0208 http://www.yuanluo.net > > -- Yuan Luo School of Informatics and Computing, Indiana University Data to Insight Center, Indiana University Cell: (812)272-0208 http://www.yuanluo.net |
|
From: Yuan L. <yu...@in...> - 2013-04-19 18:38:53
|
Hi Michael, Does sample1 come from client-core/samples/sampleWorkflow1/notification? Please see my inline reply. I might have missed your points, so correct me if I misunderstood anything. Thanks, Yuan On Fri, Apr 19, 2013 at 1:01 PM, Michael Black <mdb...@ya...> wrote: > I am able to load a workflow using the sample1 workflow recently added.*** > * > > ** ** > > But…when I try and make changes to that workflow to experiment with > different names and such the OPM file produced will contain the old names. > **** > > I was trying just to slowly migrate over to what I want to put in the > system by changing user name for example with a new workFlowID. But the > old user name still shows in the OPM file.**** > > ** > In Karma system, we only have add/append modes. A workflow will be added into the system when ingesting the first notification that contains a new workflowID. The following notifications with that workflowID will be appended to that workflow. There's no deletion or modification for a workflow. If you change a workflowID (I assume you changed all the notifications with new workflowID in the sampleWorkflow1 directory), it will be considered as a new workflow. Both the old and new workflow will exist. > ** > > And if I zap the tables and try to insert my modified workflow no OPM file > gets produced at all. So there appears to be some dependency that I don’t > see.**** > > ** > There should be no problem to get new workflow ingested and queried after zapping tables. Could you please provide more details? > ** > > So I’m wondering if there’s some document somewhere I should read that > explains this process as I’m completely befuddled.**** > > ** > The latest document is http://iweb.dl.sourceforge.net/project/karmatool/v3.2.3/KarmaUserGuide.pdf Some pointers of Karma and Provenance: http://www.cs.indiana.edu/~plale/papers/Plale-FGCS-preprintJan2011.pdf http://www.cs.indiana.edu/~plale/papers/KarmaInfoModel_SWF09.pdf http://link.springer.com/chapter/10.1007%2F978-3-642-29931-5_3 > ** > > Is there some tool to generate a generic workflow? > Are you referring to a tool that can generate notifications? If yes, KarmaAdaptor is one solution for that. The KarmaAdaptor takes a customized rule file and apply to the workflow log files to get the provenance information and ingest to Karma Server with notifications. The adaptor and its doc is here http://sourceforge.net/projects/karmatool/files/v3.2.3. Or are you asking for these workflow tools such as Kepler https://kepler-project.org/? If it's something else, please let me know. > **** > > ** ** > > ** ** > > Michael Black**** > > ** ** > > > ------------------------------------------------------------------------------ > Precog is a next-generation analytics platform capable of advanced > analytics on semi-structured data. The platform includes APIs for building > apps and a phenomenal toolset for data science. Developers can use > our toolset for easy data analysis & visualization. Get a free account! > http://www2.precog.com/precogplatform/slashdotnewsletter > _______________________________________________ > Karmatool-users mailing list > Kar...@li... > https://lists.sourceforge.net/lists/listinfo/karmatool-users > > -- Yuan Luo School of Informatics and Computing, Indiana University Data to Insight Center, Indiana University Cell: (812)272-0208 http://www.yuanluo.net |
|
From: Michael B. <mdb...@ya...> - 2013-04-19 17:01:59
|
I am able to load a workflow using the sample1 workflow recently added. But.when I try and make changes to that workflow to experiment with different names and such the OPM file produced will contain the old names. I was trying just to slowly migrate over to what I want to put in the system by changing user name for example with a new workFlowID. But the old user name still shows in the OPM file. And if I zap the tables and try to insert my modified workflow no OPM file gets produced at all. So there appears to be some dependency that I don't see. So I'm wondering if there's some document somewhere I should read that explains this process as I'm completely befuddled. Is there some tool to generate a generic workflow? Michael Black |
|
From: Devarshi G. <dgh...@um...> - 2013-03-15 17:53:47
|
Hi Michael, The user-manual describes giving grants to the mysql metadata table 'proc' as shown below: *GRANT SELECT, INSERT, UPDATE ON `mysql`.`proc` TO '<user>'@'<hostname>';* The error should be a result of not having the required grants to the table. Let us know if the error persists. You might also try giving the following grant in case the grant statement above doesn't resolve the issue: GRANT EXECUTE ON PROCEDURE karma.PR_OBJECT_LOCK TO '<user>'@'hostname'; On Fri, Mar 15, 2013 at 1:20 PM, Black, Michael (IS) <Mic...@ng... > wrote: > I found this in the karma.log if it helps. > > 15 Mar 2013 13:14:16,052 [Thread-7] INFO > edu.indiana.dsi.karma.messaging.NotificationReceiverRunnable -[Karma > server: Listening to Messaging System] > 15 Mar 2013 13:14:16,503 [AsynProc-0] INFO > edu.indiana.dsi.karma.ingest.db.BaseDBIngester -Store invocation > 15 Mar 2013 13:14:16,503 [AsynProc-0] DEBUG > edu.indiana.dsi.karma.ingest.db.BaseDBIngesterImplementer > -manageDBLock-Error: SQLException during call to PR_OBJECT_LOCK:User does > not have access to metadata required to determine stored procedure > parameter types. If rights can not be granted, configure connection with > "noAccessToProcedureBodies=true" to have driver generate parameters that > represent INOUT strings irregardless of actual parameter types. > 15 Mar 2013 13:14:16,503 [AsynProc-0] ERROR > edu.indiana.dsi.karma.ingest.db.BaseDBIngester -Unable to process raw > notification with internalID 855 > java.lang.NullPointerException > at > edu.indiana.dsi.karma.ingest.db.BaseDBIngesterImplementer.manageDBLock(BaseDBIngesterImplementer.java:3814) > at > edu.indiana.dsi.karma.ingest.db.BaseDBIngesterImplementer.insertEntityRecord(BaseDBIngesterImplementer.java:3752) > at > edu.indiana.dsi.karma.ingest.db.BaseDBIngesterImplementer.saveInvocation(BaseDBIngesterImplementer.java:4073) > at > edu.indiana.dsi.karma.ingest.db.BaseDBIngesterImplementer.saveInvocationStatus(BaseDBIngesterImplementer.java:2396) > at > edu.indiana.dsi.karma.ingest.db.BaseDBIngesterImplementer.storeInvocationStatus(BaseDBIngesterImplementer.java:4109) > at > edu.indiana.dsi.karma.ingest.db.BaseDBIngester.invokedProcessHelper(BaseDBIngester.java:1210) > at > edu.indiana.dsi.karma.ingest.db.BaseDBIngester.processWorkflowInvoked(BaseDBIngester.java:1184) > at > edu.indiana.dsi.karma.ingest.db.BaseDBIngester.processNotifications(BaseDBIngester.java:937) > at > edu.indiana.dsi.karma.ingest.AsyncRawNotificationProcessor.run(AsyncRawNotificationProcessor.java:116) > at java.lang.Thread.run(Thread.java:736) > 15 Mar 2013 13:14:16,504 [AsynProc-0] DEBUG > edu.indiana.dsi.karma.ingest.db.BaseDBIngesterImplementer -Number of > entries marked ERROR: 1 > > > > Michael D. Black > Senior Scientist > Analytics, Production and Services > Advanced GEOINT Systems > Northrop Grumman Information Systems > ------------------------------ > > > > ------------------------------------------------------------------------------ > Everyone hates slow websites. So do we. > Make your web apps faster with AppDynamics > Download AppDynamics Lite for free today: > http://p.sf.net/sfu/appdyn_d2d_mar > _______________________________________________ > Karmatool-users mailing list > Kar...@li... > https://lists.sourceforge.net/lists/listinfo/karmatool-users > > -- Thanks & regards, Devarshi |
|
From: Black, M. (IS) <Mic...@ng...> - 2013-03-15 17:21:07
|
I found this in the karma.log if it helps.
15 Mar 2013 13:14:16,052 [Thread-7] INFO edu.indiana.dsi.karma.messaging.NotificationReceiverRunnable -[Karma server: Listening to Messaging System]
15 Mar 2013 13:14:16,503 [AsynProc-0] INFO edu.indiana.dsi.karma.ingest.db.BaseDBIngester -Store invocation
15 Mar 2013 13:14:16,503 [AsynProc-0] DEBUG edu.indiana.dsi.karma.ingest.db.BaseDBIngesterImplementer -manageDBLock-Error: SQLException during call to PR_OBJECT_LOCK:User does not have access to metadata required to determine stored procedure parameter types. If rights can not be granted, configure connection with "noAccessToProcedureBodies=true" to have driver generate parameters that represent INOUT strings irregardless of actual parameter types.
15 Mar 2013 13:14:16,503 [AsynProc-0] ERROR edu.indiana.dsi.karma.ingest.db.BaseDBIngester -Unable to process raw notification with internalID 855
java.lang.NullPointerException
at edu.indiana.dsi.karma.ingest.db.BaseDBIngesterImplementer.manageDBLock(BaseDBIngesterImplementer.java:3814)
at edu.indiana.dsi.karma.ingest.db.BaseDBIngesterImplementer.insertEntityRecord(BaseDBIngesterImplementer.java:3752)
at edu.indiana.dsi.karma.ingest.db.BaseDBIngesterImplementer.saveInvocation(BaseDBIngesterImplementer.java:4073)
at edu.indiana.dsi.karma.ingest.db.BaseDBIngesterImplementer.saveInvocationStatus(BaseDBIngesterImplementer.java:2396)
at edu.indiana.dsi.karma.ingest.db.BaseDBIngesterImplementer.storeInvocationStatus(BaseDBIngesterImplementer.java:4109)
at edu.indiana.dsi.karma.ingest.db.BaseDBIngester.invokedProcessHelper(BaseDBIngester.java:1210)
at edu.indiana.dsi.karma.ingest.db.BaseDBIngester.processWorkflowInvoked(BaseDBIngester.java:1184)
at edu.indiana.dsi.karma.ingest.db.BaseDBIngester.processNotifications(BaseDBIngester.java:937)
at edu.indiana.dsi.karma.ingest.AsyncRawNotificationProcessor.run(AsyncRawNotificationProcessor.java:116)
at java.lang.Thread.run(Thread.java:736)
15 Mar 2013 13:14:16,504 [AsynProc-0] DEBUG edu.indiana.dsi.karma.ingest.db.BaseDBIngesterImplementer -Number of entries marked ERROR: 1
Michael D. Black
Senior Scientist
Analytics, Production and Services
Advanced GEOINT Systems
Northrop Grumman Information Systems
________________________________
|
|
From: Black, M. (IS) <Mic...@ng...> - 2013-03-15 16:12:18
|
OK...more questions.... I can successfully run the new sample. But...seems if I change most ANYTHING it doesn't work and there are no error messages during ingest. Apparently there is some magic incantation that's necessary for a workflow to "complete" but I'm missing the magic. #1 I tried changing the workflowID to a custom entry and it the workflow does not show up (completely replaced the "tag:...." with "mystuff:...." #2 I tried eliminating a step or 2 at several places in the ingest flow and the workflow does not show up if I miss most any step. Only thing I've been able to do so far is change the last part of the workflow so I can at least see that it does work and new workflows get added (I'm accessing the database directly to see all the available workflowIDs) Can you provide an absolute minimum example. My anticipated usage is that the workflows will get updated as time goes on and so additional information would be added. I assume that's possible? Michael D. Black Senior Scientist Analytics, Production and Services Advanced GEOINT Systems Northrop Grumman Information Systems ________________________________ From: yu...@um... [yu...@um...] on behalf of Yuan Luo [yu...@in...] Sent: Friday, February 01, 2013 4:14 PM To: Black, Michael (IS) Cc: karmatool-users Subject: EXT :Re: [Karmatool-users] Adding workflow via RabbitMQ? Hi Michael, I added a complete set of notifications here, http://karmatool.svn.sourceforge.net/karmatool/karma/trunk/client-core/samples/sampleWorkflow1 Please refer to the new README file for instructions. Let me know if you have any other questions. Thanks, Yuan On Fri, Feb 1, 2013 at 1:07 PM, Black, Michael (IS) <Mic...@ng...<mailto:Mic...@ng...>> wrote: I ran the samples...but it appears there's no "workflowID" produced. Does the SVN project contain a complete set of notifications/queries that result in a workflowID that can be queried? It doesn't appear so. I ran all the notifications. I modified getWorkflowGraphRequest.xml to query workflow_8. But the query replies "Unknown Query"....which I assume really means "Unknown workflowID". And I don't see where, for example, "workflow_8" ends up in the database to try to figure this out on my own. Can you show a COMPLETE example using what's in SVN? Michael D. Black Senior Scientist Analytics, Production and Services Advanced GEOINT Systems Northrop Grumman Information Systems ________________________________ From: yu...@um...<mailto:yu...@um...> [yu...@um...<mailto:yu...@um...>] on behalf of Yuan Luo [yu...@in...<mailto:yu...@in...>] Sent: Friday, February 01, 2013 2:21 AM To: Black, Michael (IS) Cc: kar...@li...<mailto:kar...@li...> Subject: EXT :Re: [Karmatool-users] Adding workflow via RabbitMQ? Hi Michael, Thanks for your interests in Karma. A workflow is ingested to Karma via multiple notifications in xml format. A notification represents an activity (event) during the workflow run. For example, if you have a simple workflow that consist of two services (S1 and S2) and one data product (D1), and S1 invokes S2 and S2 produces D1, then the workflow can be ingested as two notifications: 1. A serviceInvoked notification in which S1 is the invoker and S2 is the invokee. 2. A dataProduced notification in which S2 produces D1. Please check out the latest version from SVN. Samples of these notification files can be found in SVN http://karmatool.svn.sourceforge.net/karmatool/karma/trunk/client-core/samples/notification/ Once you have the notification files ready, please follow the client-core README file to send the notifications, and query the graph. Query samples can be found here http://karmatool.svn.sourceforge.net/karmatool/karma/trunk/client-core/samples/notification/ If you have already played with the web service client test code. You can actually find some notifications in the raw_notification table in the database. Hope this helps. Please let me know if you have any questions. Regards, Yuan On Thu, Jan 31, 2013 at 1:36 PM, Black, Michael (IS) <Mic...@ng...<mailto:Mic...@ng...>> wrote: Been playing with the RabbitMQ client. Able to retrieve a workflow just fine. Is it possible to create a workflow through the RabbitMQ interface? I guess I'm trying to find the easiest and most straightforward way to insert a workflow. For example, kind of like reverse engineering a graphml or SIF file and put it in Karma to get an OPM file out. Michael D. Black Senior Scientist Analytics, Production and Services Advanced GEOINT Systems Northrop Grumman Information Systems ------------------------------------------------------------------------------ Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_jan _______________________________________________ Karmatool-users mailing list Kar...@li...<mailto:Kar...@li...> https://lists.sourceforge.net/lists/listinfo/karmatool-users -- Yuan Luo School of Informatics and Computing, Indiana University Data to Insight Center, Indiana University Cell: (812)272-0208<tel:%28812%29272-0208> http://www.yuanluo.net<http://www.yuanluo.net/> -- Yuan Luo School of Informatics and Computing, Indiana University Data to Insight Center, Indiana University Cell: (812)272-0208 http://www.yuanluo.net<http://www.yuanluo.net/> |
|
From: Yuan L. <yu...@in...> - 2013-02-01 22:14:42
|
Hi Michael, I added a complete set of notifications here, http://karmatool.svn.sourceforge.net/karmatool/karma/trunk/client-core/samples/sampleWorkflow1 Please refer to the new README file for instructions. Let me know if you have any other questions. Thanks, Yuan On Fri, Feb 1, 2013 at 1:07 PM, Black, Michael (IS) <Mic...@ng...>wrote: > I ran the samples...but it appears there's no "workflowID" produced. > > > Does the SVN project contain a complete set of notifications/queries that > result in a workflowID that can be queried? > It doesn't appear so. > I ran all the notifications. > I modified getWorkflowGraphRequest.xml to query workflow_8. > But the query replies "Unknown Query"....which I assume really means > "Unknown workflowID". > > > And I don't see where, for example, "workflow_8" ends up in the database > to try to figure this out on my own. > > Can you show a COMPLETE example using what's in SVN? > > > Michael D. Black > Senior Scientist > Analytics, Production and Services > Advanced GEOINT Systems > Northrop Grumman Information Systems > ------------------------------ > *From:* yu...@um... [yu...@um...] on behalf of Yuan Luo > [yu...@in...] > *Sent:* Friday, February 01, 2013 2:21 AM > *To:* Black, Michael (IS) > *Cc:* kar...@li... > *Subject:* EXT :Re: [Karmatool-users] Adding workflow via RabbitMQ? > > Hi Michael, > > Thanks for your interests in Karma. > > A workflow is ingested to Karma via multiple notifications in xml > format. A notification represents an activity (event) during the workflow > run. For example, if you have a simple workflow that consist of two > services (S1 and S2) and one data product (D1), and S1 invokes S2 and S2 > produces D1, then the workflow can be ingested as two notifications: > > 1. A serviceInvoked notification in which S1 is the invoker and S2 is > the invokee. > 2. A dataProduced notification in which S2 produces D1. > > Please check out the latest version from SVN. Samples of these > notification files can be found in SVN > http://karmatool.svn.sourceforge.net/karmatool/karma/trunk/client-core/samples/notification/ > > Once you have the notification files ready, please follow the > client-core README file to send the notifications, and query the graph. > Query samples can be found here > http://karmatool.svn.sourceforge.net/karmatool/karma/trunk/client-core/samples/notification/ > > If you have already played with the web service client test code. You > can actually find some notifications in the raw_notification table in the > database. > > Hope this helps. Please let me know if you have any questions. > > Regards, > > Yuan > > > On Thu, Jan 31, 2013 at 1:36 PM, Black, Michael (IS) < > Mic...@ng...> wrote: > >> Been playing with the RabbitMQ client. Able to retrieve a workflow just >> fine. >> Is it possible to create a workflow through the RabbitMQ interface? >> >> I guess I'm trying to find the easiest and most straightforward way to >> insert a workflow. For example, kind of like reverse engineering a graphml >> or SIF file and put it in Karma to get an OPM file out. >> >> >> >> Michael D. Black >> Senior Scientist >> Analytics, Production and Services >> Advanced GEOINT Systems >> Northrop Grumman Information Systems >> >> >> ------------------------------------------------------------------------------ >> Everyone hates slow websites. So do we. >> Make your web apps faster with AppDynamics >> Download AppDynamics Lite for free today: >> http://p.sf.net/sfu/appdyn_d2d_jan >> _______________________________________________ >> Karmatool-users mailing list >> Kar...@li... >> https://lists.sourceforge.net/lists/listinfo/karmatool-users >> > > > > -- > > Yuan Luo > School of Informatics and Computing, Indiana University > Data to Insight Center, Indiana University > Cell: (812)272-0208 http://www.yuanluo.net > > -- Yuan Luo School of Informatics and Computing, Indiana University Data to Insight Center, Indiana University Cell: (812)272-0208 http://www.yuanluo.net |
|
From: Yuan L. <yu...@in...> - 2013-02-01 08:43:45
|
Hi Michael, Thanks for your interests in Karma. A workflow is ingested to Karma via multiple notifications in xml format. A notification represents an activity (event) during the workflow run. For example, if you have a simple workflow that consist of two services (S1 and S2) and one data product (D1), and S1 invokes S2 and S2 produces D1, then the workflow can be ingested as two notifications: 1. A serviceInvoked notification in which S1 is the invoker and S2 is the invokee. 2. A dataProduced notification in which S2 produces D1. Please check out the latest version from SVN. Samples of these notification files can be found in SVN http://karmatool.svn.sourceforge.net/karmatool/karma/trunk/client-core/samples/notification/ Once you have the notification files ready, please follow the client-core README file to send the notifications, and query the graph. Query samples can be found here http://karmatool.svn.sourceforge.net/karmatool/karma/trunk/client-core/samples/notification/ If you have already played with the web service client test code. You can actually find some notifications in the raw_notification table in the database. Hope this helps. Please let me know if you have any questions. Regards, Yuan On Thu, Jan 31, 2013 at 1:36 PM, Black, Michael (IS) <Mic...@ng... > wrote: > Been playing with the RabbitMQ client. Able to retrieve a workflow just > fine. > Is it possible to create a workflow through the RabbitMQ interface? > > I guess I'm trying to find the easiest and most straightforward way to > insert a workflow. For example, kind of like reverse engineering a graphml > or SIF file and put it in Karma to get an OPM file out. > > > > Michael D. Black > Senior Scientist > Analytics, Production and Services > Advanced GEOINT Systems > Northrop Grumman Information Systems > > > ------------------------------------------------------------------------------ > Everyone hates slow websites. So do we. > Make your web apps faster with AppDynamics > Download AppDynamics Lite for free today: > http://p.sf.net/sfu/appdyn_d2d_jan > _______________________________________________ > Karmatool-users mailing list > Kar...@li... > https://lists.sourceforge.net/lists/listinfo/karmatool-users > -- Yuan Luo School of Informatics and Computing, Indiana University Data to Insight Center, Indiana University Cell: (812)272-0208 http://www.yuanluo.net |
|
From: Black, M. (IS) <Mic...@ng...> - 2013-01-31 18:37:11
|
Been playing with the RabbitMQ client. Able to retrieve a workflow just fine. Is it possible to create a workflow through the RabbitMQ interface? I guess I'm trying to find the easiest and most straightforward way to insert a workflow. For example, kind of like reverse engineering a graphml or SIF file and put it in Karma to get an OPM file out. Michael D. Black Senior Scientist Analytics, Production and Services Advanced GEOINT Systems Northrop Grumman Information Systems |
|
From: Peng C. <che...@um...> - 2012-10-30 18:30:08
|
Hi Michael, Thank you for your interest in the visualization tool. This vis tool supports query with a specified workflowID. Normally, you'll get the workflowID when you ingest data into Karma repository. For example, if you are using our NetKarma Adaptor Version 2.5.1 (http://d2i.indiana.edu/provenance_netkarma), workflowID will be part of the standard out. To use the workflowID from tests, you need to look into it's standard output as well: "Test-23: Graph test... Giving 3 seconds for processing of notifications... Resuming... getWorkflowGraph() for workflowID: tag:www.d2i.indiana.edu/TestWorkflow/instance-152427955" Also thank you for bringing this question to me, I'll update the user manual to clarify this soon. Pleas let me know if there is anything else I can help. Best, Peng On Tue, Oct 30, 2012 at 1:50 PM, Black, Michael (IS) <Mic...@ng...> wrote: > I'm up to running 2.8.1 Cytoscape but I'm stuck now. > > The visulization.pdf says "prompts for the workflosID". > I have no idea what that is...it's the first time it's been mentioned in the docs. > > If I give it a random name I get a pretty-much blank XML file as the result which doesn't surprise me. > > Isn't there any workflod already in the system from the tests that could be used? How do I find out what that workflodID is? > > > > Michael D. Black > Senior Scientist > Advanced Analytics Directorate > Advanced GEOINT Solutions Operating Unit > Northrop Grumman Information Systems > > ------------------------------------------------------------------------------ > Everyone hates slow websites. So do we. > Make your web apps faster with AppDynamics > Download AppDynamics Lite for free today: > http://p.sf.net/sfu/appdyn_sfd2d_oct > _______________________________________________ > Karmatool-users mailing list > Kar...@li... > https://lists.sourceforge.net/lists/listinfo/karmatool-users -- Wish you all my best, yours sincerely, Peng Chen Computer Science Ph.D. Program, School of Informatics and Computing, Indiana University Data to Insight Center, Pervasive Technology Institute, Indiana University Cellphone: (812)361-8295 Email: che...@in... |
|
From: Black, M. (IS) <Mic...@ng...> - 2012-10-30 17:50:32
|
I'm up to running 2.8.1 Cytoscape but I'm stuck now. The visulization.pdf says "prompts for the workflosID". I have no idea what that is...it's the first time it's been mentioned in the docs. If I give it a random name I get a pretty-much blank XML file as the result which doesn't surprise me. Isn't there any workflod already in the system from the tests that could be used? How do I find out what that workflodID is? Michael D. Black Senior Scientist Advanced Analytics Directorate Advanced GEOINT Solutions Operating Unit Northrop Grumman Information Systems |
|
From: You-Wei C. <yo...@um...> - 2012-10-25 00:39:15
|
Hi Michael, Thank you for using the Karma provenance tool. >From your error messages, it would seem that the test graph is not being ingested into the database. To help with further debugging, do you happen to have the logs from the Karma axis2 service? Please do not hesitate to ask us further if you have questions. Sincerely, ~You-Wei On Wed, Oct 24, 2012 at 5:12 PM, Black, Michael (IS) <Mic...@ng... > wrote: > Was installing 3.2.1 and got to testing....every test is OK until #23 and > then ran into this problem...any idea what's causing it or how to fix it? > > Test-22: Add-Annotation-By-ID Notification...[OK] > Test-23: Graph test... > Giving 3 seconds for processing of notifications... > Resuming... > getWorkflowGraph() for workflowID: tag: > www.d2i.indiana.edu/TestWorkflow/instance-152427955 > Output for getWorkflowGraph(): > <ns:getWorkflowGraphResponse xmlns:ns=" > http://www.dataandsearch.org/karma/query/2010/10/" xmlns:soapenv=" > http://schemas.xmlsoap.org/soap/envelope/"> > <v1:opmGraph xmlns:v1="http://openprovenance.org/model/v1.1.a"> > <v1:causalDependencies/> > </v1:opmGraph> > </ns:getWorkflowGraphResponse> > [OK] > [FAILED] > java.lang.NullPointerException > at > edu.indiana.dsi.karma.test.KarmaAxis2Tester.graphTest(KarmaAxis2Tester.java:1694) > at > edu.indiana.dsi.karma.test.KarmaAxis2Tester.startProcess(KarmaAxis2Tester.java:1847) > at > edu.indiana.dsi.karma.test.KarmaAxis2Tester.run(KarmaAxis2Tester.java:1856) > at java.lang.Thread.run(Thread.java:736) > > > > Michael D. Black > Senior Scientist > Advanced Analytics Directorate > Advanced GEOINT Solutions Operating Unit > Northrop Grumman Information Systems > > > ------------------------------------------------------------------------------ > Everyone hates slow websites. So do we. > Make your web apps faster with AppDynamics > Download AppDynamics Lite for free today: > http://p.sf.net/sfu/appdyn_sfd2d_oct > _______________________________________________ > Karmatool-users mailing list > Kar...@li... > https://lists.sourceforge.net/lists/listinfo/karmatool-users > |
|
From: Black, M. (IS) <Mic...@ng...> - 2012-10-24 21:27:35
|
Was installing 3.2.1 and got to testing....every test is OK until #23 and then ran into this problem...any idea what's causing it or how to fix it? Test-22: Add-Annotation-By-ID Notification...[OK] Test-23: Graph test... Giving 3 seconds for processing of notifications... Resuming... getWorkflowGraph() for workflowID: tag:www.d2i.indiana.edu/TestWorkflow/instance-152427955 Output for getWorkflowGraph(): <ns:getWorkflowGraphResponse xmlns:ns="http://www.dataandsearch.org/karma/query/2010/10/" xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/"> <v1:opmGraph xmlns:v1="http://openprovenance.org/model/v1.1.a"> <v1:causalDependencies/> </v1:opmGraph> </ns:getWorkflowGraphResponse> [OK] [FAILED] java.lang.NullPointerException at edu.indiana.dsi.karma.test.KarmaAxis2Tester.graphTest(KarmaAxis2Tester.java:1694) at edu.indiana.dsi.karma.test.KarmaAxis2Tester.startProcess(KarmaAxis2Tester.java:1847) at edu.indiana.dsi.karma.test.KarmaAxis2Tester.run(KarmaAxis2Tester.java:1856) at java.lang.Thread.run(Thread.java:736) Michael D. Black Senior Scientist Advanced Analytics Directorate Advanced GEOINT Solutions Operating Unit Northrop Grumman Information Systems |
|
From: You-Wei C. <yo...@um...> - 2012-04-03 23:58:16
|
Hi Jean-Denis, This bug has now been addressed. Collection support is not fully implemented yet for the other graph API calls yet (getProvenanceHistory and getDataForwardFlow), so you may run into problems with using those. We will work to complete support for Collections in those APIs. Please do not hesitate to report any bugs or problems to us. We would like to thank you again for using and providing valuable feedback of Karma. Regards, ~You-Wei On Tue, Apr 3, 2012 at 9:28 AM, Ping, Robert James via RT <he...@da...> wrote: > A new ticket has been created and assigned an ID of [RAC RT #74457]. > <URL: https://rt.rtinfo.indiana.edu/Ticket/Display.html?id=74457 > > --- > > From: "Ping, Robert James" <ro...@in...> > > Submitted on Tuesday, April 3, 2012 - 9:27am > Submitted by anonymous user: [128.178.187.210] > Submitted values are: > > Your Name: Jean-Denis Courcol > Your Email: jea...@ep... > Subject: issue with collection and QueryByWorkflowUtil. > Message: > Dear Karma team, > we encountered an issue while using collections. The <Used> tag is duplicated > in the OPM graph returned by QueryByWorkflowUtil. > it seems that the line 1593 (usedList.add(used)) is duplicated (in line > 1607). > regards, > Jean-Denis > > > The results of this submission may be viewed at: > http://d2i.indiana.edu/node/15249/submission/6 > _______________________________________________ > IU-Karma-Dev mailing list > IU-...@cs... > http://mailman.cs.indiana.edu/mailman/listinfo/iu-karma-dev |
|
From: Courcol Jean-D. <jea...@ep...> - 2012-03-26 12:46:26
|
Hi You-Wei, it seems that the new API is working fine. thank you for the update. regards, Jean-Denis ________________________________________ De : You-Wei Cheah [yo...@um...] Date d'envoi : vendredi, 17. février 2012 06:13 À : Courcol Jean-Denis Cc : iu-...@cs...; kar...@li... Objet : Re: [Iu-karma-dev] [RAC RT #70057] Karma Project Contact Page Submission Hi Jean-Denis, We have now implemented a API call by the name of getDataForwardFlow() that should mirror getProvenanceHistory(). Please check out the latest copy from our SVN repository, and also let us know if you run into any problems. Thank you. Regards, ~You-Wei On Fri, Feb 3, 2012 at 9:31 AM, rt...@rt... via RT <he...@da...> wrote: > A new ticket has been created and assigned an ID of [RAC RT #70057]. > <URL: https://rt.rtinfo.indiana.edu/Ticket/Display.html?id=70057 > > --- > > From: rt...@rt... <rt...@rt...> > > Submitted on Friday, February 3, 2012 - 9:31am > Submitted by anonymous user: [128.178.187.180] > Submitted values are: > > Your Name: Jean-Denis Courcol > Your Email: jea...@ep... > Subject: usage of an artifact. > Message: > Dear Karma team, > We are trying to retrieve all the services ids that have taken a specific > artifact id as an input. > Unfortunately, we did not succeed to find a way to get it. > getProvenanceHistory takes an artifact and returned in the OPM the service > that generated that artifact (i.e. the upstream provenance information). > we would like to find a service that gives the downstream provenance > information : who used that artifact. > we went through the karma_query_schema.xsd but we did not find a service to > perform that request. > > regards, > Jean-Denis > > > The results of this submission may be viewed at: > https://pti.iu.edu/node/15249/submission/927 > _______________________________________________ > IU-Karma-Dev mailing list > IU-...@cs... > http://mailman.cs.indiana.edu/mailman/listinfo/iu-karma-dev |
|
From: You-Wei C. <yo...@um...> - 2012-02-17 05:13:40
|
Hi Jean-Denis, We have now implemented a API call by the name of getDataForwardFlow() that should mirror getProvenanceHistory(). Please check out the latest copy from our SVN repository, and also let us know if you run into any problems. Thank you. Regards, ~You-Wei On Fri, Feb 3, 2012 at 9:31 AM, rt...@rt... via RT <he...@da...> wrote: > A new ticket has been created and assigned an ID of [RAC RT #70057]. > <URL: https://rt.rtinfo.indiana.edu/Ticket/Display.html?id=70057 > > --- > > From: rt...@rt... <rt...@rt...> > > Submitted on Friday, February 3, 2012 - 9:31am > Submitted by anonymous user: [128.178.187.180] > Submitted values are: > > Your Name: Jean-Denis Courcol > Your Email: jea...@ep... > Subject: usage of an artifact. > Message: > Dear Karma team, > We are trying to retrieve all the services ids that have taken a specific > artifact id as an input. > Unfortunately, we did not succeed to find a way to get it. > getProvenanceHistory takes an artifact and returned in the OPM the service > that generated that artifact (i.e. the upstream provenance information). > we would like to find a service that gives the downstream provenance > information : who used that artifact. > we went through the karma_query_schema.xsd but we did not find a service to > perform that request. > > regards, > Jean-Denis > > > The results of this submission may be viewed at: > https://pti.iu.edu/node/15249/submission/927 > _______________________________________________ > IU-Karma-Dev mailing list > IU-...@cs... > http://mailman.cs.indiana.edu/mailman/listinfo/iu-karma-dev |
|
From: You-Wei C. <yo...@um...> - 2012-01-25 20:16:40
|
Dear Jean-Denis, Thank you for your bringing this bug to our attention. We have now fixed the copy in the svn trunk. This bug is present in both QueryByWorkflowURIUtil.java and QueryDataProvenanceHistoryUtil.java, so please update accordingly. We thank you again for reporting your issues to us and thank you again for your interest in Karma. Regards, ~You-Wei On Jan 25, 2012, at 2:45 AM, rt...@rt... via RT wrote: > A new ticket has been created and assigned an ID of [RAC RT #69727]. > <URL: https://rt.rtinfo.indiana.edu/Ticket/Display.html?id=69727 > > --- > > From: rt...@rt... <rt...@rt...> > > Submitted on Wednesday, January 25, 2012 - 2:44am > Submitted by anonymous user: [128.178.187.180] > Submitted values are: > > Your Name: Jean-Denis Courcol > Your Email: jea...@ep... > Subject: issue in getOPMAgents method while running get OPMGraphDocument. > Message: > Dear Karma team, > > In some cases, the getOPMGraphDocuments method returns an empty OPM Graph. > I'm using the current trunk and I found that the issue is caused by the > getOPMAgents method in QueryByWorkflowURIUtil.java at line 889: > 887 roleResultSet = getRoleStmt.executeQuery(); > 888 if (roleResultSet.next()) { > 889 String role = result.getString("role"); > > the column role is being retrieved from result variable instead of > roleResultSet, leading to a SQL exception since the role column does not > exist on the GET_USER_CONTROLLER_BY_ID statement. > > regards, > Jean-Denis > > > The results of this submission may be viewed at: > https://pti.iu.edu/node/15249/submission/910 > _______________________________________________ > Iu-karma-dev mailing list > Iu-...@cs... > http://mailman.cs.indiana.edu/mailman/listinfo/iu-karma-dev |
|
From: Yuan L. <yu...@in...> - 2012-01-18 00:34:05
|
Hi Jean-Denis, One of my colleague suggested you to try the following commands using root. GRANT [SELECT, INSERT, UPDATE] ON `mysql`.`proc` TO '<user>'@'localhost'; GRANT EXECUTE ON PROCEDURE karma.PR_OBJECT_LOCK TO '<user>'@'localhost'; Let us know how it goes. Thanks, Yuan On Mon, Jan 16, 2012 at 5:02 AM, rt...@rt... via RT < he...@da...> wrote: > A new ticket has been created and assigned an ID of [RAC RT #69474]. > <URL: https://rt.rtinfo.indiana.edu/Ticket/Display.html?id=69474 > > --- > > From: rt...@rt... <rt...@rt...> > > Submitted on Monday, January 16, 2012 - 4:41am > Submitted by anonymous user: [128.178.187.180] > Submitted values are: > > Your Name: Jean-Denis Courcol > Your Email: jea...@ep... > Subject: issue with ManageDBLock. > Message: > Dear Karma team, > I upgraded to the latest release available in the SVN repository.(rev > 1482). > For your information and for other users I had to run the following SQL > statement : > GRANT SELECT ON `mysql`.`proc` to `root`@`localhost` ; > otherwise I got this error : > "User does not have access to metadata required to determine stored > procedure > parameter types. If rights can not be granted, configure connection with > "noAccessToProcedureBodies=true" to have driver generate parameters that > represent INOUT strings irregardless of actual parameter types." during the > execution of PR_OBJECT_LOCK. > > Now I get the following error : > > Jan 2012 09:02:08,805 [AsynProc-0] ERROR > edu.indiana.dsi.karma.ingest.db.BaseDBIngester -Unable to process raw > notification with internalID 4739 > edu.indiana.dsi.karma.ingest.IngestException: Max retries 10 for the lock > reached for the object: xxxxxx > at > > edu.indiana.dsi.karma.ingest.db.BaseDBIngesterImplementer.manageDBLock(BaseDBIngesterImplementer.java:3800) > at > > edu.indiana.dsi.karma.ingest.db.BaseDBIngesterImplementer.insertEntityRecord(BaseDBIngesterImplementer.java:3752) > at > > edu.indiana.dsi.karma.ingest.db.BaseDBIngesterImplementer.saveInvocation(BaseDBIngesterImplementer.java:4073) > at > > edu.indiana.dsi.karma.ingest.db.BaseDBIngesterImplementer.saveInvocationStatus(BaseDBIngesterImplementer.java:2396) > at > > edu.indiana.dsi.karma.ingest.db.BaseDBIngesterImplementer.storeInvocationStatus(BaseDBIngesterImplementer.java:4109) > at > > edu.indiana.dsi.karma.ingest.db.BaseDBIngester.invocationStatusProcessHelper(BaseDBIngester.java:1327) > at > > edu.indiana.dsi.karma.ingest.db.BaseDBIngester.processInvokingWorkflowStatus(BaseDBIngester.java:1300) > at > > edu.indiana.dsi.karma.ingest.db.BaseDBIngester.processNotifications(BaseDBIngester.java:871) > at > > edu.indiana.dsi.karma.ingest.AsyncRawNotificationProcessor.run(AsyncRawNotificationProcessor.java:116) > at java.lang.Thread.run(Unknown Source) > I got that error for a lot of different entities. > > As a temporary workaround , I commented out the calls to manageDBLocks to > continue my tests. > > regards, > Jean-Denis > > > > > > The results of this submission may be viewed at: > https://pti.iu.edu/node/15249/submission/889 > > -- Yuan Luo School of Informatics and Computing, Indiana University Data to Insight Center, Indiana University Cell: (812)272-0208 http://www.yuanluo.net |
|
From: You-Wei C. <yo...@um...> - 2012-01-12 06:33:38
|
Hi Jean-Denis, Happy new year! We have added the handling of the data role in both getWorkflowGraph() and getProvenanceHistory() in our latest svn build. The role in the OPM graph should now return "Input"/"Output" if unspecified, but will be filled in with the role in exe_data_lifecycle if there is one. We would like to thank you again for using and providing valuable feedback of Karma. Regards, ~You-Wei On Jan 11, 2012, at 7:39 AM, rt...@rt... via RT wrote: > A new ticket has been created and assigned an ID of [RAC RT #68742]. > <URL: https://rt.rtinfo.indiana.edu/Ticket/Display.html?id=68742 > > --- > > From: rt...@rt... <rt...@rt...> > > Submitted on Wednesday, January 11, 2012 - 7:38am > Submitted by anonymous user: [128.178.187.143] > Submitted values are: > > Your Name: jean-denis courcol > Your Email: jea...@ep... > Subject: issue with role attribute in wasGeneratedBy and used relationships. > Message: > Dear Karma team, > first, happy new year ! > > I've an issue with the role returned by the getWorkflowGraph service. The > role node found in the wadGeneratedBy or used by relationships is always > either "output" or "input" even if I set a different role through the > DataLifeCycleType::setDataRole method. > I can see that the column "role" in exe_data_lifecycle is set properly. > unfortunately, the code in QueryDataProvenanceHistoryUtil does not read the > column from the database and sets systematically "output" or "input". > > regards, > Jean-Denis > > > The results of this submission may be viewed at: > https://pti.iu.edu/node/15249/submission/887 > _______________________________________________ > Iu-karma-dev mailing list > Iu-...@cs... > http://mailman.cs.indiana.edu/mailman/listinfo/iu-karma-dev |
6 messages has been excluded from this view by a project administrator.
