Re: [Karmatool-users] Adding workflow

[Yuan L. <yu...@in...>]

Hi Michael,

Does sample1 come from client-core/samples/sampleWorkflow1/notification?
Please see my inline reply. I might have missed your points, so correct me
if I misunderstood anything.

Thanks,

Yuan


On Fri, Apr 19, 2013 at 1:01 PM, Michael Black <mdb...@ya...> wrote:

> I am able to load a workflow using the sample1 workflow recently added.***
> *
>
> ** **
>
> But…when I try and make changes to that workflow to experiment with
> different names and such the OPM file produced will contain the old names.
> ****
>
> I was trying just to slowly migrate over to what I want to put in the
> system by changing user name for example with a new workFlowID.  But the
> old user name still shows in the OPM file.****
>
> **
>
In Karma system, we only have add/append modes. A workflow will be added
into the system when ingesting the first notification that contains a new
workflowID. The following notifications with that workflowID will be
appended to that workflow. There's no deletion or modification for a
workflow. If you change a workflowID (I assume you changed all the
notifications with new workflowID in the sampleWorkflow1 directory), it
will be considered as a new workflow. Both the old and new workflow will
exist.


> **
>
> And if I zap the tables and try to insert my modified workflow no OPM file
> gets produced at all.  So there appears to be some dependency that I don’t
> see.****
>
> **
>
There should be no problem to get new workflow ingested and queried after
zapping tables. Could you please provide more details?


> **
>
> So I’m wondering if there’s some document somewhere I should read that
> explains this process as I’m completely befuddled.****
>
> **
>
The latest document is
http://iweb.dl.sourceforge.net/project/karmatool/v3.2.3/KarmaUserGuide.pdf

Some pointers of Karma and Provenance:
http://www.cs.indiana.edu/~plale/papers/Plale-FGCS-preprintJan2011.pdf
http://www.cs.indiana.edu/~plale/papers/KarmaInfoModel_SWF09.pdf
http://link.springer.com/chapter/10.1007%2F978-3-642-29931-5_3


> **
>
> Is there some tool to generate a generic workflow?
>
Are you referring to a tool that can generate notifications? If yes,
KarmaAdaptor is one solution for that. The KarmaAdaptor takes a customized
rule file and apply to the workflow log files to get the provenance
information and ingest to Karma Server with notifications. The adaptor and
its doc is here http://sourceforge.net/projects/karmatool/files/v3.2.3.
Or are you asking for these workflow tools such as Kepler
https://kepler-project.org/?
If it's something else, please let me know.

> ****
>
> ** **
>
> ** **
>
> Michael Black****
>
> ** **
>
>
> ------------------------------------------------------------------------------
> Precog is a next-generation analytics platform capable of advanced
> analytics on semi-structured data. The platform includes APIs for building
> apps and a phenomenal toolset for data science. Developers can use
> our toolset for easy data analysis & visualization. Get a free account!
> http://www2.precog.com/precogplatform/slashdotnewsletter
> _______________________________________________
> Karmatool-users mailing list
> Kar...@li...
> https://lists.sourceforge.net/lists/listinfo/karmatool-users
>
>


-- 

Yuan Luo
School of Informatics and Computing, Indiana University
Data to Insight Center, Indiana University
Cell: (812)272-0208   http://www.yuanluo.net