OGSA-DAI Activity List

Introduction

This page lists all the activities that have been proposed or implemented for OGSA-DAI. This includes those we have released in various OGSA-DAI versions as well as general activities and others we are aware of by third parties.

Please contact us if:

• You have a suggestion for a new activity.
• You would like to implement one of these activities.
• You have developed activities and would like them added to this page.

OGSA-DAI 3.0+ activities

These activities are shipped with releases post OGSA-DAI 3.0.

Block

Name	Description	Class	Available since
ByteArraysResize	Resize a list of byte arrays to a specific size.	uk.org.ogsadai.activity.block.ByteArraysResizeActivity	3.0
CharArraysResize	Resize a list of character arrays to a specific size.	uk.org.ogsadai.activity.block.CharArraysResizeActivity	3.0
ControlledRepeat	Repeats the value of its first input as many times as the second input is available.	uk.org.ogsadai.activity.block.ControlledRepeatActivity	3.0
ListConcatenate	Concatenates all input lists into one output list.	uk.org.ogsadai.activity.block.ListConcatenateActivity	3.0
ListControlledRepeat	Repeats the value of its first input as a list as many times as the second input is available.	uk.org.ogsadai.activity.block.ListControlledRepeatActivity	3.0
ListMultiply	Computes the cartesian product of the two input lists and produces a set of pairs each of which is split across two output lists.	uk.org.ogsadai.activity.block.ListMultiplyActivity	3.0
ListRandomSplit	Splits an input (which may be a list or list of lists etc) into N random partitions	uk.org.ogsadai.activity.block.ListRandomSplitActivity	From ADMIRE. 3.1.
ListRemove	Reduces the granularity of its input e.g. if given a list it outputs the member blocks, if given a list of lists it outputs the sub-lists.	uk.org.ogsadai.activity.block.ListRemoveActivity	3.0
RandomSplit	Splits an input into N random partitions.	uk.org.ogsadai.activity.block.RandomSplitActivity	From ADMIRE. 3.1.
Split	Copies each input to successive outputs in turn.	uk.org.ogsadai.activity.block.SplitActivity	3.0
Tee	Copies each input to all of its outputs.	uk.org.ogsadai.activity.block.TeeActivity	3.0

Delivery

Name	Description	Class	Availability
DeliverToDataSink	Pushes data to a local or remote data sink.	uk.org.ogsadai.activity.delivery.DeliverToDataSinkActivity	3.0
DeliverToFTP	Push data as a file to an FTP server.	uk.org.ogsadai.activity.delivery.DeliverToFTPActivity	3.0
DeliverToGFTP	Push data as a file to a GridFTP server.	uk.org.ogsadai.activity.delivery.DeliverToGFTPActivity	3.0
DeliverToGFTPExtended	Another push data to GridFTP activity that allows more control over how the delivery is done	uk.org.ogsadai.activity.delivery.DeliverToGFTPExtendedActivity	3.2
DeliverToRequestStatus	Delivers data into the OGSA-DAI request status.	uk.org.ogsadai.activity.delivery.DeliverToRequestStatusActivity	3.0
DeliverToSession	Writes a value to a session resource.	uk.org.ogsadai.activity.delivery.DeliverToSessionActivity	3.0
DeliverToSMTP	Deliver data via e-mail.	uk.org.ogsadai.activity.delivery.DeliverToSMTPActivity	3.0
GetDataSinkResource	Gets a client proxy to communicate with a remote OGSA-DAI data sink	uk.org.ogsadai.activity.delivery.GetDataSinkResourceActivity	3.2
GetDataSourceResource	Gets a client proxy to communicate with a remote OGSA-DAI data source	uk.org.ogsadai.activity.delivery.GetDataSourceResourceActivity	3.2
ObtainFromDataSource	Pulls data from a local or remote data source.	uk.org.ogsadai.activity.delivery.ObtainFromDataSourceActivity	3.0
ObtainFromFTP	Pull a file from an FTP server.	uk.org.ogsadai.activity.delivery.ObtainFromFTPActivity	3.0
ObtainFromGFTP	Pull a file from a GridFTP server.	uk.org.ogsadai.activity.delivery.ObtainFromGFTPActivity	3.0
ObtainFromGFTPExtended	Another pull data from GridFTP activity that allows more control over how the delivery is done	uk.org.ogsadai.activity.delivery.ObtainFromGFTPExtendedActivity	3.2
ObtainFromHTTP	Pull data from an HTTP server.	uk.org.ogsadai.activity.delivery.ObtainFromHTTPActivity	3.0
ObtainFromSession	Reads a value from a session resource.	uk.org.ogsadai.activity.delivery.ObtainFromSessionActivity	3.0
ReadFromDataSink	Reads data from a data sink available on the server that a client has populated with data.	uk.org.ogsadai.activity.delivery.ReadFromDataSinkActivity	3.0
WriteToDataSource	Populates a data source with data.	uk.org.ogsadai.activity.delivery.WriteToDataSourceActivity	3.0
WriteToWebServerFile	Writes data to a file on the OGSA-DAI web server	uk.org.ogsadai.activity.delivery.WriteToWebServerFileActivity	4.0

DQP resources

Name	Description	Class	Availability
CreateDQPResource	Creates a DQP resource on the server	uk.org.ogsadai.activity.dqp.CreateDQPResourceActivity	3.2
ExtractTableSchema	Extracts the global schema for the databases exposed by a DQP resource	uk.org.ogsadai.activity.dqp.ExtractTableSchemaActivity	3.2
SQLQuery	Runs a query across the databases exposed by a DQP resource	uk.org.ogsadai.activity.dqp.SQLActivity	3.2

File system resource activities

Name	Description	Class	Availability
ListDirectory	List the files and directories in a file system resource.	uk.org.ogsadai.activity.file.ListDirectoryActivity	3.0
ReadFromFile	Read the contents of a file in a file system resource.	uk.org.ogsadai.activity.file.ReadFromFileActivity	3.0

Generic activities

Name	Description	Class	Availability
Generic	Processes inputs using a JavaScript or other script supplied by the client.	uk.org.ogsadai.activity.generic.GenericActivity	4.0
GenericTupleJoin	Joins tuples using a JavaScript or other script supplied by the client.	uk.org.ogsadai.activity.generic.GenericTupleJoinActivity	4.0
GenericTupleTransform	Transforms tuples using a JavaScript or other script supplied by the client.	uk.org.ogsadai.activity.generic.GenericTupleTransformActivity	4.0

Indexed file activities for file system resources

Name	Description	Class	Availability
CreateFileIndex	Index a file using Lucene	uk.org.ogsadai.activity.indexedfile.CreateFileIndexActivity	4.0
CreateAnalyzer	Create a Lucene file analyser given a class name	uk.org.ogsadai.activity.indexedfile.CreateAnalyzerActivity	4.0
CreateMapper	Create an indexed file mapper given a class name	uk.org.ogsadai.activity.indexedfile.CreateMapperActivity	4.0
LookupIndexFile	Use the Lucene full-text search engine to search an index	uk.org.ogsadai.activity.indexedfile.LookupIndexFileActivity	4.0

Management

Name	Description	Class	Availability
CreateDataSink	Creates an OGSA-DAI data sink on the server.	uk.org.ogsadai.activity.management.CreateDataSinkActivity	3.0
CreateDataSource	Creates an OGSA-DAI data source on the server.	uk.org.ogsadai.activity.management.CreateDataSourceActivity	3.0
CreateRelationalResource	Creates an OGSA-DAI relational resource on the server - client provides ID of relational resource template configuration on the server.	uk.org.ogsadai.activity.management.CreateRelationalResourceActivity	OGSA-DAI 3.0 dynamic resource creation extension pack. 3.1.
CreateResourceGroup	Creates an OGSA-DAI resource group on the server.	uk.org.ogsadai.activity.management.CreateResourceGroupActivity	3.0
ExtendedCreateRelationalResource	Creates an OGSA-DAI relational resource on the server - client can provide connection URL, driver class name, username and password.	uk.org.ogsadai.activity.management.ExtendedCreateRelationalResourceActivity	OGSA-DAI 3.0 dynamic resource creation extension pack. 3.1.

Relational resources

Name	Description	Class	Availability
ExtractPhysicalSchemaToXML	Extracts the physical schema for a database. Supports MySQL, SQL Server and PostgreSQL. Can be configured to support other databases.	uk.org.ogsadai.activity.sql.ExtractPhysicalSchemaToXMLActivity	OGSA-DAI 3.0 DQP 3.2 extension pack. 3.1.
ExtractTableSchema	Extracts the schema of one or more database tables.	uk.org.ogsadai.activity.sql.ExtractTableSchemaActivity	3.0
GetAvailableTables	Get a list of tables in the database.	uk.org.ogsadai.activity.sql.GetAvailableTablesActivity	3.0
GroupBy	Group tuples by column(s) and apply aggregator functions.	uk.org.ogsadai.activity.relational.GroupByActivity	3.2
MetadataRename	Rename a column in tuple meta data.	uk.org.ogsadai.activity.relational.MetadataRenameActivity	3.2
OneTupleOnly	Validate that a tuple list contains exactly one tuple.	uk.org.ogsadai.activity.relational.OneTupleOnlyActivity.	3.2
SortedTupleListDifference	Perform a set difference operation across two tuple lists	uk.org.ogsadai.activity.relational.SortedTupleListDifferenceActivity	3.2
SQLBulkLoadTuple	Bulk loads a list of tuples into a table.	uk.org.ogsadai.activity.sql.SQLBulkLoadTupleActivity	3.0
SQLNestedInClauseJoin	Executes an SQL query and performs a join (inner join or left outer join) between the result tuples and a lst of input tuples.	uk.org.ogsadai.activity.sql.SQLNestedInClauseJoinActivity	OGSA-DAI 3.0 extension pack 1. 3.1.
SQLNestedInClauseQuery	Executes an SQL query where the query contains an IN clause into which values are inserted from the input to this activity. This allows SQL queries to extract only those records where a column value is equal to a column value given as an activity input.	uk.org.ogsadai.activity.sql.SQLNestedInClauseQueryActivity	OGSA-DAI 3.0 extension pack 1. 3.1.
SQLParameterisedQuery	Runs a parameterised SQL query. The parameter values can be provided by other activities.	uk.org.ogsadai.activity.sql.SQLParameterisedQueryActivity	3.0
SQLParameterisedUpdate	Runs a parameterised SQL update. The parameter values can be provided by other activities.	uk.org.ogsadai.activity.sql.SQLParameterisedUpdateActivity	3.0
SQLQuery	Runs an SQL query.	uk.org.ogsadai.activity.sql.SQLQueryActivity	3.0
SQLStatement	Runs an SQL statement (query, update, function, stored procedure).	uk.org.ogsadai.activity.sql.SQLStatementActivity	4.1
SQLUpdate	Runs an SQL update.	uk.org.ogsadai.activity.sql.SQLUpdateActivity	3.0
TupleArithmeticProject	Projects columns according to a given set of arithmetic expressions.	uk.org.ogsadai.activity.relational.TupleArithmeticProjectActivity	3.2
TupleArithmeticProject	Projects columns according to a given set of arithmetic expressions.	uk.org.ogsadai.activity.relational.TupleArithmeticProjectActivity	3.2
TupleMergeJoin	Joins (inner join or left outer join) two lists of ordered tuples and outputs a list of the joined tuples. Two tuples are joined if the values in the specified join columns of both tuples are equal. Also supports optional projection of the result tuples.	uk.org.ogsadai.activity.sql.TupleMergeJoinActivity	OGSA-DAI 3.0 extension pack 1. 3.1.
TupleProduct	Produce the product of two tuple lists	uk.org.ogsadai.activity.relational.TupleProductActivity	3.2
TupleSelect	Select tuples from a list that meet a condition.	uk.org.ogsadai.activity.relational.TupleSelectActivity	3.2
TupleSemiJoin	Produce a semi-join of two tuple lists.	uk.org.ogsadai.activity.relational.TupleSemiJoinActivity	3.2
TupleSort	Sort a tuple list	uk.org.ogsadai.activity.relational.TupleSortActivity	3.2

Relational resource group resources

Name	Description	Class	Availability
SQLBag	Runs an SQL query across all the relational resources in a resource group and returns the union of the results.	uk.org.ogsadai.activity.sql.SQLBagActivity	3.0
SQLResilient	Runs an SQL query across all the relational resources in a resource group and returns the first successful query results.	uk.org.ogsadai.activity.sql.SQLResilientActivity	3.0

Remote resources

Name	Description	Class	Availability
RemoteAsynchSQLQuery	Runs an SQL query across a relational resource exposed by a remote OGSA-DAI server.	uk.org.ogsadai.activity.remote.RemoteAsynchSQLActivity	OGSA-DAI 3.0 remote resources extension pack. 3.1.

Security activities

Name	Description	Class	Availability
ApplyGSISecureConversation	Apply GSI Secure Conversation to a client toolkit resource proxy.	uk.org.ogsadai.activity.security.ApplyGSISecureConversationActivity	3.2
ApplyGSITransportLevelSecurity	Apply GSI Transport-level Security to a client toolkit resource proxy.	uk.org.ogsadai.activity.security.ApplyGSITransportLevelSecurityActivity	3.2
GetGSSCredentialFromDelegationService	Get credentials from a delegation service	uk.org.ogsadai.activity.security.GetGSSCredentialFromDelegationServiceActivity	3.2
GetGSSCredentialFromSecurityContext	Get credentials from the OGSA-DAI security context	uk.org.ogsadai.activity.security.GetGSSCredentialFromSecurityContextActivity	3.2

Transformation

Name	Description	Class	Availability
ByteArraysToTuple	Converts a binary stream into tuples.	uk.org.ogsadai.activity.transform.ByteArraysToTuple	3.2.
CalculateMean	Calculates the mean values of numeric columns in a list of tuples.	uk.org.ogsadai.activity.transform.CalculateMeanActivity	From ADMIRE. 3.1.
CharArraysToDOM	Converts a list of character arrays into a DOM object.	uk.org.ogsadai.activity.transform.CharArraysToDOMActivity	3.1
CSVToTuple	Converts a list of character arrays representing comma-separated values into a list of tuples.	uk.org.ogsadai.activity.transform.CSVToTupleActivity	3.0
NumberToString	Converts Java numbers to strings. There is no client-toolkit class at present.	uk.org.ogsadai.activity.transform.NumberToStringActivity	3.0
ReplaceWithValue	Replaces a value in a tuple	uk.org.ogsadai.activity.transform.ReplaceWithValueActivity	From ADMIRE. 3.1.
StringConcatenate	Concatenates strings from two or more inputs into a single output string. There is no client-toolkit class at present.	uk.org.ogsadai.activity.transform.StringConcatenateActivity	3.0
StringTokenize	Tokenises an input string into a sequence of output strings. The characters to split the input upon are also taken as an input. There is no client-toolkit class at present.	uk.org.ogsadai.activity.transform.StringTokenizeActivity	3.0
SummaryTupleToKMLPlacemarks	Converts tuples into character arrays representing a KML document where each tuple represents a count of some "thing".	uk.org.ogsadai.activity.transform.SummaryTupleToKMLPlacemarksActivity	4.0
TableMetadataToXMLCharArrays	Converts a representation of relational database table meta data (as output by ExtractTableSchema) and converts it to a list of character arrays that represent an XML document.	uk.org.ogsadai.activity.transform.TableMetadataToXMLCharArraysActivity	3.0 (deprecated in 4.0)
TableMetadataToXMLCharArraysList	Converts a representation of relational database table meta data (as output by ExtractTableSchema) and converts it to a list of character arrays that represent an XML document. Bug-fixed version of TableMetadataToXMLCharArrays.	uk.org.ogsadai.activity.transform.TableMetadataToXMLCharArraysListActivity	3.1
TupleProjectByIDS	Takes a list of strings or integers and outputs a list of tuples that are the input tuples projected onto selected columns. Columns can be selected by name or index. This is a more usable version of TupleProjection.	uk.org.ogsadai.activity.transform.TupleProjectByIDSActivity	3.1
TupleProjection	Takes a list of tuples and outputs a list of tuples that are the input tuples projected onto selected columns.	uk.org.ogsadai.activity.transform.TupleProjectionActivity	3.0
TupleSimpleMerge	Merges N tuple input lists into a single list of tuples. The Nth output tuple combines all the columns of the Nth input tuples.	uk.org.ogsadai.activity.transform.TupleSimpleMergeActivity	3.0
TupleSplit	Takes a list of tuples and outputs N lists, one list for each column in the tuples.	uk.org.ogsadai.activity.transform.TupleSplitActivity	3.0
TupleToByteArrays	Converts tuples into a binary stream.	uk.org.ogsadai.activity.transform.TupleToByteArrays	3.2.
TupleToCSV	Converts a list of tuples into a list of character arrays representing comma-separated values.	uk.org.ogsadai.activity.transform.TupleToCSVActivity	3.0
TupleToKMLPlacemarks	Converts tuples into character arrays representing a KML document.	uk.org.ogsadai.activity.transform.TupleToKMLPlacemarksActivity	4.0
TupleToWebRowSetCharArrays	Converts a list of tuples into a list of character arrays representing WebRowSet-compliant XML.	uk.org.ogsadai.activity.transform.TupleToWebRowSetCharArraysActivity	3.0
TupleUnionAll	Performs a UNION ALL on input tuple lists.	uk.org.ogsadai.activity.transform.TupleUnionAllActivity	From ADMIRE. 3.1.
WebRowSetCharacterDataToTuple	Converts a list of character arrays representing WebRowSet-complaint XML into a list of tuples.	uk.org.ogsadai.activity.transform.WebRowSetCharacterDataToTupleActivity	3.0
XSLTransform	Applies an XSL transform. The XSL transform and XML document input and the transformed document output are all represented as character arrays.	uk.org.ogsadai.activity.transform.XSLTransformActivity	3.0

Utility

Name	Description	Class	Availability
ActivityUserErrorProducer	Raises a client-caused exception. Used in OGSA-DAI testing.	uk.org.ogsadai.activity.util.ActivityUserErrorProducerActivity	3.0
CloneableObjectProducer	Outputs a test object that is cloneable. Used in OGSA-DAI testing.	uk.org.ogsadai.activity.util.CloneableObjectProducerActivity	3.0
Counter	Outputs integers from 1 up to some client-specified maximum. Used in OGSA-DAI testing.	uk.org.ogsadai.activity.util.CounterActivity	3.0
DeliverToNull	Activity that throws away inputs.	uk.org.ogsadai.activity.util.DeliverToNull	3.2
DOMToCharArrays	Convert DOM objects into lists of character arrays.	uk.org.ogsadai.activity.util.DOMToCharArrays	3.2
DQPPattern	Tests DQP usage pattern. Creates N data sinks then sums all the data delivered onto these by clients. Used in OGSA-DAI testing.	uk.org.ogsadai.activity.util.DQPPatternActivity	3.0
Echo	Echoes its input onto its output and optionally reports an error for the Nth input value. Used in OGSA-DAI testing.	uk.org.ogsadai.activity.util.EchoActivity	3.0
HashCode	Outputs the hash-code of its input.	uk.org.ogsadai.activity.util.HashCodeActivity	3.0
ReadString	Read the string held in an OGSA-DAI test string resource.Used in OGSA-DAI testing.	uk.org.ogsadai.activity.util.ReadStringActivity	3.0
Sleep	Waits for a specified duration.	uk.org.ogsadai.activity.util.SleepActivity	3.0
Timestamp	Outputs the current time in milliseconds since 01/01/1970 00:00:00.	uk.org.ogsadai.activity.util.TimestampActivity	3.0

Views resources

Name	Description	Class	Availability
ExtractTableSchema	Extracts the schema for the databases exposed by an SQL views resource	uk.org.ogsadai.activity.views.ExtractTableSchemaActivity	3.2
SQLQuery	Runs a query across the database exposed by an SQL views resource	uk.org.ogsadai.activity.views.SQLActivity	3.2

XMLDB resources

Name	Description	Class	Availability
AddDocuments	Adds XML documents - where each document is a list of XML character arrays.	uk.org.ogsadai.activity.xmldb.AddDocumentsActivity	3.1
CreateSubCollection	Creates a sub-collection.	uk.org.ogsadai.activity.xmldb.CreateSubCollectionActivity	3.1
GetDocuments	Gets XML documents. The XML documents are output as lists of character arrays.	uk.org.ogsadai.activity.xmldb.GetDocumentsActivity	3.1
RemoveDocuments	Removes XML documents.	uk.org.ogsadai.activity.xmldb.RemoveDocumentsActivity	3.1
RemoveSubCollection	Removes a sub-collection.	uk.org.ogsadai.activity.xmldb.RemoveSubCollectionActivity	3.1
XMLListCollections	Lists the collections in an XMLDB data resource or sub-collection thereof.	uk.org.ogsadai.activity.xmldb.XMLListCollectionsActivity	3.0
XMLListResources	Lists the XMLDB resources in an XMLDB data resource or sub-collection thereof.	uk.org.ogsadai.activity.xmldb.XMLListResourcesActivity	3.0
XPathQuery	Runs an XPath query in an XMLDB data resource. The resulting XML document is output as a list of character arrays.	uk.org.ogsadai.activity.xmldb.XPathQueryActivity	3.0
XQuery	Runs an XQuery query in an XMLDB data resource. The resulting XML document is output as a list of character arrays.	uk.org.ogsadai.activity.xmldb.XQueryActivity	3.0
XUpdate	Runs an XUpdate.	uk.org.ogsadai.activity.xmldb.XUpdateActivity	3.1

OGSA-DAI 3.0 activities - work-in-progress

Work was started on these activities but wasn't completed. They're in various states of completion.

They're in CVS in:

ogsa-dai-cvs/source/activities/src/not-in-release ogsa-dai-cvs/source/client/not-in-release

Block

Name	Description	Class
ListProcessingWrapper	Applies a function to all members of a list.	uk.org.ogsadai.activity.block.ListProcessingWrapperActivity
ListRandomSample	Outputs a random sample of the input blocks.	uk.org.ogsadai.activity.block.ListRandomSampleActivity
ListRoundRobinInterleave	Takes blocks from a number of inputs one by one and outputs them on a single output.	uk.org.ogsadai.activity.block.ListRoundRobinInterleaveActivity
ListSplit	Takes a list and outputs its blocks in order on each of the activity's N outputs.	uk.org.ogsadai.activity.block.ListSplitActivity

File

Name	Description	Class
WriteToFile	Writes data to a file in a file system data resource. If no file exists then one is created.	uk.org.ogsadai.activity.file.WriteToFileActivity

Relational resources

Name	Description	Class
SQLBagWithResourceID	Variant of SQLBag which outputs the IDs of the source resources for each tuple as an additional column in the tuples.	uk.org.ogsadai.activity.sql.SQLBagWithResourceIDActivity
SQLResilientWithResourceID	Variant of SQLResilient which outputs the IDs of the source resource for each tuple as an additional column in the tuples.	uk.org.ogsadai.activity.sql.SQLResilientWithResourceIDActivity

Transformation

Name	Description	Class
BinaryDataToCharArrays	Converts byte arrays into character arrays.	uk.org.ogsadai.activity.transform.BinaryDataToCharArraysActivity
CharacterDataToByteArrays	Converts character arrays into byte arrays.	uk.org.ogsadai.activity.transform.CharacterDataToByteArraysActivity
FrequencyDistribute	Distributes numeric values onto spaces.	uk.org.ogsadai.activity.transform.FrequencyDistributeActivity
TupleMultiProjection	Projects a tuple onto a subset of its columns.	uk.org.ogsadai.activity.transform.TupleMultiProjectionActivity

OGSA-DAI WS-DAIR activities

These activities are shipped with OGSA-DAI WS-DAIR 1.0.

Delivery

Name	Description	Class
ReadFromSQLResponse	Streams query and update results from an SQLResponse resource.	uk.org.ogsadai.wsdai.dair.activities.ReadFromSQLResponseActivity
WriteToSQLResponse	Streams query and update results into an SQLResponse resource.	uk.org.ogsadai.wsdai.dair.activities.WriteToSQLResponseActivity

Management

Name	Description	Class
CreateSQLResponseResource	Creates an SQLResponse resource on the OGSA-DAI server.	uk.org.ogsadai.wsdai.dair.activities.CreateSQLResponseResourceActivity
CreateSQLRowsetResource	Creates an SQLRowset resource on the OGSA-DAI server.	uk.org.ogsadai.wsdai.dair.activities.CreateSQLRowsetResourceActivity
CreateXMLSequenceResource	Creates an XMLSequence resource on the OGSA-DAI server.	uk.org.ogsadai.wsdai.daix.activities.CreateXMLSequenceResourceActivity

Query

Name	Description	Class
GetTuples	Get tuples from an SQLRowset resource.	uk.org.ogsadai.wsdai.dair.GetTuplesActivity
SQLStatement	Run an SQL statement (query or update)	uk.org.ogsadai.wsdai.dair.SQLStatementActivity

OGSA-DAI WS-DAIX activities

These activities are shipped with OGSA-DAI WS-DAIX 1.0 and 1.1.

Delivery

Name	Description	Class
WriteToXMLSequence	Streams an XML document represented as a DOM object into an XMLSequence resource.	uk.org.ogsadai.wsdai.daix.activities.WriteToXMLSequenceActivity

Management

Name	Description	Class
CreateXMLCollectionResource	Creates an XMLCollection resource on the OGSA-DAI server.	uk.org.ogsadai.wsdai.daix.activities.CreateXMLCollectionResourceActivity
CreateXMLDocumentResource	Creates an XMLDocument resource on the OGSA-DAI server.	uk.org.ogsadai.wsdai.daix.activities.CreateXMLDocumentResourceActivity
CreateXMLSequenceResource	Creates an XMLSequence resource on the OGSA-DAI server.	uk.org.ogsadai.wsdai.daix.activities.CreateXMLSequenceResourceActivity

Transformation

Name	Description	Class
CharArraysToDOM	Converts a list of character arrays into a DOM object. Ported version in 3.1.	uk.org.ogsadai.wsdai.core.activities.CharArraysToDOMActivity

WS-DAIX XMLCollections

Name	Description	Class
AddDocuments	Adds XML documents - where each document is a list of XML character arrays - to an OGSA-DAI WS-DAIX XMLCollection resource. Ported version in 3.1.	uk.org.ogsadai.wsdai.daix.activities.AddDocumentsActivity
CreateSubCollection	Creates a sub-collection in an OGSA-DAI WS-DAIX XMLCollection resource. Ported version in 3.1.	uk.org.ogsadai.wsdai.daix.activities.CreateSubCollectionActivity
GetDocuments	Gets XML documents from an OGSA-DAI WS-DAIX XMLCollection resource. The XML documents are output as lists of character arrays. Ported version in 3.1.	uk.org.ogsadai.wsdai.daix.activities.GetDocumentsActivity
RemoveDocuments	Removes XML documents from an OGSA-DAI WS-DAIX XMLCollection resource. Ported version in 3.1.	uk.org.ogsadai.wsdai.daix.activities.RemoveDocumentsActivity
RemoveSubCollection	Removes a sub-collection in an OGSA-DAI WS-DAIX XMLCollection resource. Ported version in 3.1.	uk.org.ogsadai.wsdai.daix.activities.RemoveSubCollectionActivity

WS-DAIX XMLCollections and XMLDocuments

Name	Description	Class
XUpdate	Runs an XUpdate on an OGSA-DAI WS-DAIX XMLCollection or XMLDocument resource. Ported version in 3.1.	uk.org.ogsadai.wsdai.daix.activities.XUpdateActivity

WS-DAIX XMLSequences

Name	Description	Class
GetItems	Gets N items from an XMLSequence resource. The output is a list of character arrays which together form an XML document.	uk.org.ogsadai.wsdai.daix.activities.GetItemsActivity

OGSA-DAI 2.2 activities - to be ported

These activities are shipped with OGSA-DAI 2.2. They are not currently compatible with OGSA-DAI 3.0 but could be ported with varying degrees of ease - ask us for information.

Block

None.

Delivery

Name	Description
DeliverToAttachment	Delivers results as a SOAP attachment. For 3.0 this might be more complex and require new data source and sink resource, data source and sink service and data request execution service implementations.
deliverToNull	Throws the input blocks away.
deliverToResourceProperty	Writes results to a resource property. In 3.0 this could be to a resource property of the request resource which corresponds to the workflow in which the activity is executing.

File system resources

Name	Description
DeliverToFile	Delivers data to a file on the container's local filesystem. In 3.0 a file system resource would be the target for this activity.
FileAccessActivity	Reads data from a file. The file can be text or binary and a portion of the file can be specified in terms of start byte/line and offset. This is a more powerful version of ReadFile. This activity handled both text and binary files and is very difficult to understand. It would be best be refactored as two activities, e.g. ReadTextFile and ReadBinaryFile, that are targeted at files in a file system resource.
FileManipulationActivity	Creates, deletes, copies and moves fles. This would best be refactored as a set of activities, e.g. CreateFile, DeleteFile, CopyFile, MoveFile, that are targeted at files in a file system resource.
FileWritingActivity	Inserts, deletes, appends or replaces content in a text or binary file. This activity handled both text and binary files and is very difficult to understand. It would best be refactored as a set of activities, e.g. InsertIntoTextFile, AppendToTextFile, ReplaceInTextFile, DeleteFromTextFile (and likewise for binary files), that are targeted at files in a file system resource.
Grep	Does a GREP regular expression search across files.

Management

Name	Description
RemoveResource	Withdraws a data service resource from a service. In 3.0 this could be implemented as a destroy resource operation.

Relational resources

Name	Description
SQLStoredProcedure	Runs an SQL stored procedure.
SwissSQLQuery	A version of SQLQuery that uses SwissSQL. This was not released in 2.2 but was prototyped just after. Source code from that point is available. Design doc: SwisSQLActivity-0506.pdf.

Transformation

Name	Description
BytesToString	Converts a byte array to a string. This was not released in 2.2 but was prototyped just after. Source code from that point is available.
FrequencyDistributor	Distributes numeric values onto spaces.
GZIPCompression	GNUZIP compresses its input and outputs the compressed data.
GZIPDecompression	GNUZIP decompresses its input and outputs the decompressed data.
RandomSample	Generates a random sample of the input blocks.
RemoveDuplicates	Removes duplicate rows from a WebRowSet document resulting from an SQLBag query. Equivalent to removing duplicated tuples from a list in 3.0.
StringToBytes	Converts a string to a byte array. This was not released in 2.2 but was prototyped just after. Source code from that point is available.
SwissSQLTransform	Transforms an SQL query to SwissSQL. This was not released in 2.2 but was prototyped just after. Source code from that point is available. Design doc: SwisSQLActivity-0506.pdf.
ZIPArchive	ZIP compresses its input and outputs the compressed data.

Utility

Name	Description
BytesToTempFile	Writes a stream of bytes to a temporary file and then outputs a reference to this temporary file. This would be useful if passing round large amounts of binary data. It would however prove risky for the server if a client were to dump a number of large files on the server.
DataStore	Caches parameters and results. In 3.0 this could be done via the use of sessions, ObtainFromSession and DeliverToSession.
Notification	Sends or receive notifications as to the execution of other activities. This just outputs data that is input but also has an additional output for the notification message.

XMLDB resources

Name	Description
XMLBulkLoad	Bulk loads resources into a collection. Equivalent to OGSA-DAI WS-DAIX AddDocuments.
XMLCollectionManagement	Creates or removes collections within an XML database. Equivalent to OGSA-DAI WS-DAIX CreateSubcollection and RemoveSubcollection.
XMLResourceManagement	Creates or removes resources within an XML database. Equivalent to OGSA-DAI WS-DAIX AddDocuments and RemoveDocuments.
XUpdateStatement	Runs an XUpdate statement against an XML database. Equivalent to OGSA-DAI WS-DAIX XUpdate.

OGSA-DAI OGSI activities - to be ported

These activities are shipped with OGSA-DAI OGSI 6.0. They are highly incompatible with OGSA-DAI 3.0 but might be ported with varying degrees of ease - ask us for information.

BinX files

Name	Description
Bf	An activity that runs an XPath expression over a binary XML file.

SEE-GEO OGSA-DAI 3.0-compliant OGC activities

A collection of reusable low-level activities (and example clients) that can be combined to create well-structured complex geospatial processes that scale well. The activities include those to run requests on GDAS and WFS servers, perform GeoLink join operations, convert between geo-spatial vector formats and execute WCS requests.

These were developed by SEE-GEO and are released as part of the OGSA-DAI with OGC geo-spatial extensions: http://edina.ac.uk/projects/seesaw/seegeo/about_geodownload.html

Name	Description	Class
GdasGetDataActivity	Runs a GDAS GetData request and outputs a GDAS dataset - a hash table of result values.	edina.grid.ogsadai.server.GdasGetDataActivity
GeolinkActivity	Geo-links a GDAS dataset with WFS framework data and outputs enriched geo-linked GML containing the GDAS attributes.	edina.grid.ogsadai.server.GeolinkActivity
WCSGetCoverageActivity	Runs a WCS GetCoverage request as defined in the WCS 1.0 standard and outputs WCS image that results.	edina.grid.ogsadai.server.WCSGetCoverageActivity
WFSGetFeatureActivity	Runs a WFS GetFeature request and outputs XML WFS framework data.	edina.grid.ogsadai.server.WFSGetFeatureActivity
WriteToFileActivity	Writes a file to an output directory on the server. The directory is specified as part of the activity configuration and is output by the activity.	edina.grid.ogsadai.server.WriteToFileActivity

Designed activities

A large number of activities have been designed to be compliant with OGSA-DAI 3.0. These are described in:

Redesigned and New Activities, Kostas Karasavvas, Malcolm Atkinson and Ally Hume Version: 1.13 (26-11-07). PDF.

Many of these have already been implemented as OGSA-DAI 3.0 activities. But many remain and may be useful.

Proposed activities

These are other activities that have been suggested throughout the lifetime of OGSA-DAI.

Block

Name	Description
ImplicitListRemove	Needs strongly-typed lists.

Delivery

Name	Description
DeliverToParallelHTTP
DeliverToSFTP
DeliverToStorageResourceBroker	May be better in conjunction with an OGSA-DAI data resource that represents SRB.
InitiateRFT	Initiate a reliable file transfer using Globus RFT.
ObtainFromParallelHTTP
ObtainFromSFTP
ObtainFromSOAPAttachment	Complement of 2.2's DeliverToSOAPAttachment - similar comments apply.
ObtainFromStorageResourceBroker	May be better in conjunction with an OGSA-DAI data resource that represents SRB.

File system resources

Name	Description
ChangeFileResourceRoot	Management activity to change this configuration property of a file system resource.
FileLastUpdated	When was the file last updated.
SetFreshnessTolerance	Set freshness tolerance for a file.

Indexed files Management

Name	Description
CreateResourceGroupDistributed	Creates a ResourceGroup that stores both service URLs and ResourceIDs. Needs a new type of resource group data resource implementation.
CreateResourceGroupDirect	Creates a ResourceGroup that stores database URLs. Needs a new type of resource group data resource implementation.

Relational resources

Name	Description
CreateStoredProcedure	Create a stored procedure in a database.
GenericJoin	Execute a join where the join logic is in a binary provided by the client. Very risky!
SQLQueryRestricted	Version of SQLQuery that supports a "fetch size" parameter.

Transformation

Name	Description
ConvertToSwissSQL	Convert vendor-specific SQL to SwissSQL.
ConvertFromSwissSQL	Convert from SwissSQL to vendor-specific SQL. May be more appropriate if targeted at a relational data resource.

Utility

Name	Description
ExecuteClientCode	Execute a binary provided by the client. Very risky!
RSHActivity	Run an RSH command on the server. Very risky!
ViewerActivity	Dumps received data into a resource. Exposes data as resource properties. Would need to define the data resource also.

XMLDB resources