OGSA-DAI Activity List
Outline
- OGSA-DAI Activity List
- Introduction
-
OGSA-DAI 3.0+ activities
- Block
-
Delivery
-
File system resources
-
Management
-
Relational resources
-
Relational resource group resources
-
Remote resources
-
Transformation
-
Utility
-
XMLDB resources
-
OGSA-DAI 3.0 activities - suspended
- Block
-
File
-
Relational resources
-
Transformation
-
OGSA-DAI WS-DAIX 1.0 activities
- Delivery
-
Management
-
Transformation
-
WS-DAIX XMLCollections
-
WS-DAIX XMLCollections and XMLDocuments
-
WS-DAIX XMLSequences
-
OGSA-DAI 2.2 activities - to be ported
- Block
-
Delivery
-
File system resources
-
Indexed files
-
Management
-
Relational resources
-
Transformation
-
Utility
-
XMLDB resources
-
OGSA-DAI OGSI activities - to be ported
- BinX files
-
SEE-GEO OGSA-DAI 3.0-compliant OGC activities
-
Designed activities
-
Proposed activities
-
Block
-
Delivery
- File system resources
-
Indexed files Management
-
Relational resources
-
Transformation
-
Utility
-
XMLDB resources
Introduction
This page lists all the activities that have been proposed or implemented for OGSA-DAI. This includes those we have released in OGSA-DAI 3.0 and earlier as well as general activities and others we are aware of by third parties.
Please contact us if:
- You have a suggestion for a new activity.
- You would like to implement for OGSA-DAI 3.0 and beyond one of the OGSA-DAI 3.0 activities - postponed, OGSA-DAI 2.2 activities - to be ported, OGSA-DAI OGSI 6.0 activities - to be ported, Designed activities, or Proposed activities.
- You have developed activities and would like them added to this page.
OGSA-DAI 3.0+ activities
These activities are shipped with OGSA-DAI 3.0 or OGSA-DAI 3.0-compliant extension packs. All 3.0 and extension pack activities are shipped in 3.1.
Block
| Name | Description | Class | Availability
|
| ByteArraysResize | Resize a list of byte arrays to a specific size. | uk.org.ogsadai.activity.block.ByteArraysResizeActivity | 3.0
|
| CharArraysResize | Resize a list of character arrays to a specific size. | uk.org.ogsadai.activity.block.CharArraysResizeActivity | 3.0
|
| ControlledRepeat | Repeats the value of its first input as many times as the second input is available. | uk.org.ogsadai.activity.block.ControlledRepeatActivity | 3.0
|
| ListConcatenate | Concatenates all input lists into one output list. | uk.org.ogsadai.activity.block.ListConcatenateActivity | 3.0
|
| ListControlledRepeat | Repeats the value of its first input as a list as many times as the second input is available. | uk.org.ogsadai.activity.block.ListControlledRepeatActivity | 3.0
|
| ListMultiply | Computes the cartesian product of the two input lists and produces a set of pairs each of which is split across two output lists. | uk.org.ogsadai.activity.block.ListMultiplyActivity | 3.0
|
| ListRandomSplit | Splits an input (which may be a list or list of lists etc) into N random partitions | uk.org.ogsadai.activity.block.ListRandomSplitActivity | From ADMIRE. 3.1.
|
| ListRemove | Reduces the granularity of its input e.g. if given a list it outputs the member blocks, if given a list of lists it outputs the sub-lists. | uk.org.ogsadai.activity.block.ListRemoveActivity | 3.0
|
| RandomSplit | Splits an input into N random partitions. | uk.org.ogsadai.activity.block.RandomSplitActivity | From ADMIRE. 3.1.
|
| Split | Copies each input to successive outputs in turn. | uk.org.ogsadai.activity.block.SplitActivity | 3.0
|
| Tee | Copies each input to all of its outputs. | uk.org.ogsadai.activity.block.TeeActivity | 3.0
|
Delivery
| Name | Description | Class | Availability
|
| DeliverToDataSink | Pushes data to a local or remote data sink. | uk.org.ogsadai.activity.delivery.DeliverToDataSinkActivity | 3.0
|
| DeliverToFTP | Push data as a file to an FTP server. | uk.org.ogsadai.activity.delivery.DeliverToFTPActivity | 3.0
|
| DeliverToGFTP | Push data as a file to a GridFTP server. | uk.org.ogsadai.activity.delivery.DeliverToGFTPActivity | 3.0
|
| DeliverToHTTP | Deliver data to an HTTP server. There is no client-toolkit class at present. | uk.org.ogsadai.activity.delivery.DeliverToHTTPActivity | 3.0
|
| DeliverToRequestStatus | Delivers data into the OGSA-DAI request status. | uk.org.ogsadai.activity.delivery.DeliverToRequestStatusActivity | 3.0
|
| DeliverToSession | Writes a value to a session resource. | uk.org.ogsadai.activity.delivery.DeliverToSessionActivity | 3.0
|
| DeliverToSMTP | Deliver data via e-mail. | uk.org.ogsadai.activity.delivery.DeliverToSMTPActivity | 3.0
|
| ObtainFromDataSource | Pulls data from a local or remote data source. | uk.org.ogsadai.activity.delivery.ObtainFromDataSourceActivity | 3.0
|
| ObtainFromFTP | Pull a file from an FTP server. | uk.org.ogsadai.activity.delivery.ObtainFromFTPActivity | 3.0
|
| ObtainFromGFTP | Pull a file from a GridFTP server. | uk.org.ogsadai.activity.delivery.ObtainFromGFTPActivity | 3.0
|
| ObtainFromHTTP | Pull data from an HTTP server. | uk.org.ogsadai.activity.delivery.ObtainFromHTTPActivity | 3.0
|
| ObtainFromSession | Reads a value from a session resource. | uk.org.ogsadai.activity.delivery.ObtainFromSessionActivity | 3.0
|
| ReadFromDataSink | Reads data from a data sink available on the server that a client has populated with data. | uk.org.ogsadai.activity.delivery.ReadFromDataSinkActivity | 3.0
|
| WriteToDataSource | Populates a data source with data. | uk.org.ogsadai.activity.delivery.WriteToDataSourceActivity | 3.0
|
File system resources
| Name | Description | Class | Availability
|
| ListDirectory | List the files and directories in a file system resource. | uk.org.ogsadai.activity.file.ListDirectoryActivity | 3.0
|
| ReadFromFile | Read the contents of a file in a file system resource. | uk.org.ogsadai.activity.file.ReadFromFileActivity | 3.0
|
Management
| Name | Description | Class | Availability
|
| CreateDataSink | Creates an OGSA-DAI data sink on the server. | uk.org.ogsadai.activity.management.CreateDataSinkActivity | 3.0
|
| CreateDataSource | Creates an OGSA-DAI data source on the server. | uk.org.ogsadai.activity.management.CreateDataSourceActivity | 3.0
|
| CreateRelationalResource | Creates an OGSA-DAI relational resource on the server - client provides ID of relational resource template configuration on the server. | uk.org.ogsadai.activity.management.CreateRelationalResourceActivity | OGSA-DAI 3.0 dynamic resource creation extension pack. 3.1.
|
| CreateResourceGroup | Creates an OGSA-DAI resource group on the server. | uk.org.ogsadai.activity.management.CreateResourceGroupActivity | 3.0
|
| ExtendedCreateRelationalResource | Creates an OGSA-DAI relational resource on the server - client can provide connection URL, driver class name, username and password. | uk.org.ogsadai.activity.management.ExtendedCreateRelationalResourceActivity | OGSA-DAI 3.0 dynamic resource creation extension pack. 3.1.
|
Relational resources
| Name | Description | Class | Availability
|
| ExtractPhysicalSchemaToXML | Extracts the physical schema for a database. Supports MySQL, SQL Server and PostgreSQL. Can be configured to support other databases. | uk.org.ogsadai.activity.sql.ExtractPhysicalSchemaToXMLActivity | OGSA-DAI 3.0 DQP 3.2 extension pack. 3.1.
|
| ExtractTableSchema | Extracts the schema of one or more database tables. | uk.org.ogsadai.activity.sql.ExtractTableSchemaActivity | 3.0
|
| GetAvailableTables | Get a list of tables in the database. | uk.org.ogsadai.activity.sql.GetAvailableTablesActivity | 3.0
|
| SQLBulkLoadTuple | Bulk loads a list of tuples into a table. | uk.org.ogsadai.activity.sql.SQLBulkLoadTupleActivity | 3.0
|
| SQLNestedInClauseJoin | Executes an SQL query and performs a join (inner join or left outer join) between the result tuples and a lst of input tuples. | uk.org.ogsadai.activity.sql.SQLNestedInClauseJoinActivity | OGSA-DAI 3.0 extension pack 1. 3.1.
|
| SQLNestedInClauseQuery | Executes an SQL query where the query contains an IN clause into which values are inserted from the input to this activity. This allows SQL queries to extract only those records where a column value is equal to a column value given as an activity input. | uk.org.ogsadai.activity.sql.SQLNestedInClauseQueryActivity OGSA-DAI 3.0 extension pack 1. 3.1.
|
| SQLParameterisedQuery | Runs a parameterised SQL query. The parameter values can be provided by other activities. | uk.org.ogsadai.activity.sql.SQLParameterisedQueryActivity | 3.0
|
| SQLParameterisedUpdate | Runs a parameterised SQL update. The parameter values can be provided by other activities. | uk.org.ogsadai.activity.sql.SQLParameterisedUpdateActivity | 3.0
|
| SQLQuery | Runs an SQL query. | uk.org.ogsadai.activity.sql.SQLQueryActivity | 3.0
|
| SQLUpdate | Runs an SQL update. | uk.org.ogsadai.activity.sql.SQLUpdateActivity | 3.0
|
| TupleMergeJoin | Joins (inner join or left outer join) two lists of ordered tuples and outputs a list of the joined tuples. Two tuples are joined if the values in the specified join columns of both tuples are equal. Also supports optional projection of the result tuples. | uk.org.ogsadai.activity.sql.TupleMergeJoinActivity | OGSA-DAI 3.0 extension pack 1. 3.1.
|
Relational resource group resources
| Name | Description | Class | Availability
|
| SQLBag | Runs an SQL query across all the relational resources in a resource group and returns the union of the results. | uk.org.ogsadai.activity.sql.SQLBagActivity | 3.0
|
| SQLResilient | Runs an SQL query across all the relational resources in a resource group and returns the first successful query results. | uk.org.ogsadai.activity.sql.SQLResilientActivity | 3.0
|
Remote resources
| Name | Description | Class | Availability
|
| RemoteAsynchSQLQuery | Runs an SQL query across a relational resource exposed by a remote OGSA-DAI server. | uk.org.ogsadai.activity.remote.RemoteAsynchSQLActivity | OGSA-DAI 3.0 remote resources extension pack. 3.1.
|
| Name | Description | Class | Availability
|
| CalculateMean | Calculates the mean values of numeric columns in a list of tuples. | uk.org.ogsadai.activity.transform.CalculateMeanActivity | From ADMIRE. 3.1.
|
| CharArraysToDOM | Converts a list of character arrays into a DOM object. | uk.org.ogsadai.activity.transform.CharArraysToDOMActivity | 3.1
|
| CSVToTuple | Converts a list of character arrays representing comma-separated values into a list of tuples. | uk.org.ogsadai.activity.transform.CSVToTupleActivity | 3.0
|
| DOMToCharArrays | Converts a DOM object into a list of character arrays. | uk.org.ogsadai.activity.transform.DOMToCharArraysActivity | 3.1
|
| NumberToString | Converts Java numbers to strings. There is no client-toolkit class at present. | uk.org.ogsadai.activity.transform.NumberToStringActivity | 3.0
|
| ReplaceWithValue | Replaces a value in a tuple | uk.org.ogsadai.activity.transform.ReplaceWithValueActivity | From ADMIRE. 3.1.
|
| StringConcatenate | Concatenates strings from two or more inputs into a single output string. There is no client-toolkit class at present. | uk.org.ogsadai.activity.transform.StringConcatenateActivity | 3.0
|
| StringTokenize | Tokenises an input string into a sequence of output strings. The characters to split the input upon are also taken as an input. There is no client-toolkit class at present. | uk.org.ogsadai.activity.transform.StringTokenizeActivity | 3.0
|
| TableMetadataToXMLCharArrays | Converts a representation of relational database table meta data (as output by ExtractTableSchema) and converts it to a list of character arrays that represent an XML document. | uk.org.ogsadai.activity.transform.TableMetadataToXMLCharArraysActivity | 3.0
|
| TableMetadataToXMLCharArraysList | Converts a representation of relational database table meta data (as output by ExtractTableSchema) and converts it to a list of character arrays that represent an XML document. Bug-fixed version of TableMetadataToXMLCharArrays. | uk.org.ogsadai.activity.transform.TableMetadataToXMLCharArraysListActivity | 3.1
|
| TupleProjectByIDS | Takes a list of strings or integers and outputs a list of tuples that are the input tuples projected onto selected columns. Columns can be selected by name or index. This is a more usable version of TupleProjection. | uk.org.ogsadai.activity.transform.TupleProjectByIDSActivity | 3.1
|
| TupleProjection | Takes a list of tuples and outputs a list of tuples that are the input tuples projected onto selected columns. | uk.org.ogsadai.activity.transform.TupleProjectionActivity | 3.0
|
| TupleSimpleMerge | Merges N tuple input lists into a single list of tuples. The Nth output tuple combines all the columns of the Nth input tuples. | uk.org.ogsadai.activity.transform.TupleSimpleMergeActivity | 3.0
|
| TupleSplit | Takes a list of tuples and outputs N lists, one list for each column in the tuples. | uk.org.ogsadai.activity.transform.TupleSplitActivity | 3.0
|
| TupleToCSV | Converts a list of tuples into a list of character arrays representing comma-separated values. | uk.org.ogsadai.activity.transform.TupleToCSVActivity | 3.0
|
| TupleToWebRowSetCharArrays | Converts a list of tuples into a list of character arrays representing WebRowSet-compliant XML. | uk.org.ogsadai.activity.transform.TupleToWebRowSetCharArraysActivity | 3.0
|
| TupleUnionAll | Performs a UNION ALL on input tuple lists. | uk.org.ogsadai.activity.transform.TupleUnionAllActivity | From ADMIRE. 3.1.
|
| WebRowSetCharacterDataToTuple | Converts a list of character arrays representing WebRowSet-complaint XML into a list of tuples. | uk.org.ogsadai.activity.transform.WebRowSetCharacterDataToTupleActivity | 3.0
|
| XSLTransform | Applies an XSL transform. The XSL transform and XML document input and the transformed document output are all represented as character arrays. | uk.org.ogsadai.activity.transform.XSLTransformActivity | 3.0
|
Utility
| Name | Description | Class | Availability
|
| ActivityUserErrorProducer | Raises a client-caused exception. Used in OGSA-DAI testing. | uk.org.ogsadai.activity.util.ActivityUserErrorProducerActivity | 3.0
|
| CloneableObjectProducer | Outputs a test object that is cloneable. Used in OGSA-DAI testing. | uk.org.ogsadai.activity.util.CloneableObjectProducerActivity | 3.0
|
| Counter | Outputs integers from 1 up to some client-specified maximum. Used in OGSA-DAI testing. | uk.org.ogsadai.activity.util.CounterActivity | 3.0
|
| DQPPattern | Tests DQP usage pattern. Creates N data sinks then sums all the data delivered onto these by clients. Used in OGSA-DAI testing. | uk.org.ogsadai.activity.util.DQPPatternActivity | 3.0
|
| Echo | Echoes its input onto its output and optionally reports an error for the Nth input value. Used in OGSA-DAI testing. | uk.org.ogsadai.activity.util.EchoActivity | 3.0
|
| HashCode | Outputs the hash-code of its input. | uk.org.ogsadai.activity.util.HashCodeActivity | 3.0
|
| ReadString | Read the string held in an OGSA-DAI test string resource.Used in OGSA-DAI testing. | uk.org.ogsadai.activity.util.ReadStringActivity | 3.0
|
| Sleep | Waits for a specified duration. | uk.org.ogsadai.activity.util.SleepActivity | 3.0
|
| Timestamp | Outputs the current time in milliseconds since 01/01/1970 00:00:00. | uk.org.ogsadai.activity.util.TimestampActivity | 3.0
|
XMLDB resources
| Name | Description | Class | Availability
|
| AddDocuments | Adds XML documents - where each document is a list of XML character arrays. | uk.org.ogsadai.activity.xmldb.AddDocumentsActivity | 3.1
|
| CreateSubCollection | Creates a sub-collection. | uk.org.ogsadai.activity.xmldb.CreateSubCollectionActivity | 3.1
|
| GetDocuments | Gets XML documents. The XML documents are output as lists of character arrays. | uk.org.ogsadai.activity.xmldb.GetDocumentsActivity | 3.1
|
| RemoveDocuments | Removes XML documents. | uk.org.ogsadai.activity.xmldb.RemoveDocumentsActivity | 3.1
|
| RemoveSubCollection | Removes a sub-collection. | uk.org.ogsadai.activity.xmldb.RemoveSubCollectionActivity | 3.1
|
| XMLListCollections | Lists the collections in an XMLDB data resource or sub-collection thereof. | uk.org.ogsadai.activity.xmldb.XMLListCollectionsActivity | 3.0
|
| XMLListResources | Lists the XMLDB resources in an XMLDB data resource or sub-collection thereof. | uk.org.ogsadai.activity.xmldb.XMLListResourcesActivity | 3.0
|
| XPathQuery | Runs an XPath query in an XMLDB data resource. The resulting XML document is output as a list of character arrays. | uk.org.ogsadai.activity.xmldb.XPathQueryActivity | 3.0
|
| XQuery | Runs an XQuery query in an XMLDB data resource. The resulting XML document is output as a list of character arrays. | uk.org.ogsadai.activity.xmldb.XQueryActivity | 3.0
|
| XUpdate | Runs an XUpdate. | uk.org.ogsadai.activity.xmldb.XUpdateActivity | 3.1
|
OGSA-DAI 3.0 activities - suspended
Work was started on these activities but wasn't completed. They're in various states of completion.
They're in CVS in:
ogsa-dai-cvs/source/activities/src/not-in-release
ogsa-dai-cvs/source/client/not-in-release
Block
| Name | Description | Class
|
| ListProcessingWrapper | Applies a function to all members of a list. | uk.org.ogsadai.activity.block.ListProcessingWrapperActivity
|
| ListRandomSample | Outputs a random sample of the input blocks. | uk.org.ogsadai.activity.block.ListRandomSampleActivity
|
| ListRoundRobinInterleave | Takes blocks from a number of inputs one by one and outputs them on a single output. | uk.org.ogsadai.activity.block.ListRoundRobinInterleaveActivity
|
| ListSplit | Takes a list and outputs its blocks in order on each of the activity's N outputs. | uk.org.ogsadai.activity.block.ListSplitActivity
|
File
| Name | Description | Class
|
| WriteToFile | Writes data to a file in a file system data resource. If no file exists then one is created. | uk.org.ogsadai.activity.file.WriteToFileActivity
|
Relational resources
| Name | Description | Class
|
| SQLBagWithResourceID | Variant of SQLBag which outputs the IDs of the source resources for each tuple as an additional column in the tuples. | uk.org.ogsadai.activity.sql.SQLBagWithResourceIDActivity
|
| SQLResilientWithResourceID | Variant of SQLResilient which outputs the IDs of the source resource for each tuple as an additional column in the tuples. | uk.org.ogsadai.activity.sql.SQLResilientWithResourceIDActivity
|
| Name | Description | Class
|
| BinaryDataToCharArrays | Converts byte arrays into character arrays. | uk.org.ogsadai.activity.transform.BinaryDataToCharArraysActivity
|
| CharacterDataToByteArrays | Converts character arrays into byte arrays. | uk.org.ogsadai.activity.transform.CharacterDataToByteArraysActivity
|
| FrequencyDistribute | Distributes numeric values onto spaces. | uk.org.ogsadai.activity.transform.FrequencyDistributeActivity
|
| TupleMultiProjection | Projects a tuple onto a subset of its columns. | uk.org.ogsadai.activity.transform.TupleMultiProjectionActivity
|
OGSA-DAI WS-DAIX 1.0 activities
These activities are shipped with OGSA-DAI WS-DAIX 1.0.
Delivery
| Name | Description | Class
|
| WriteToXMLSequence | Streams an XML document represented as a DOM object into an XMLSequence resource. | uk.org.ogsadai.wsdai.daix.activities.WriteToXMLSequenceActivity
|
Management
| Name | Description | Class
|
| CreateXMLCollectionResource | Creates an XMLCollection resource on the OGSA-DAI server. | uk.org.ogsadai.wsdai.daix.activities.CreateXMLCollectionResourceActivity
|
| CreateXMLDocumentResource | Creates an XMLDocument resource on the OGSA-DAI server. | uk.org.ogsadai.wsdai.daix.activities.CreateXMLDocumentResourceActivity
|
| CreateXMLSequenceResource | Creates an XMLSequence resource on the OGSA-DAI server. | uk.org.ogsadai.wsdai.daix.activities.CreateXMLSequenceResourceActivity
|
| Name | Description | Class
|
| CharArraysToDOM | Converts a list of character arrays into a DOM object. Ported version in 3.1. | uk.org.ogsadai.wsdai.core.activities.CharArraysToDOMActivity
|
WS-DAIX XMLCollections
| Name | Description | Class
|
| AddDocuments | Adds XML documents - where each document is a list of XML character arrays - to an OGSA-DAI WS-DAIX XMLCollection resource. Ported version in 3.1. | uk.org.ogsadai.wsdai.daix.activities.AddDocumentsActivity
|
| CreateSubCollection | Creates a sub-collection in an OGSA-DAI WS-DAIX XMLCollection resource. Ported version in 3.1. | uk.org.ogsadai.wsdai.daix.activities.CreateSubCollectionActivity
|
| GetDocuments | Gets XML documents from an OGSA-DAI WS-DAIX XMLCollection resource. The XML documents are output as lists of character arrays. Ported version in 3.1. | uk.org.ogsadai.wsdai.daix.activities.GetDocumentsActivity
|
| RemoveDocuments | Removes XML documents from an OGSA-DAI WS-DAIX XMLCollection resource. Ported version in 3.1. | uk.org.ogsadai.wsdai.daix.activities.RemoveDocumentsActivity
|
| RemoveSubCollection | Removes a sub-collection in an OGSA-DAI WS-DAIX XMLCollection resource. Ported version in 3.1. | uk.org.ogsadai.wsdai.daix.activities.RemoveSubCollectionActivity
|
WS-DAIX XMLCollections and XMLDocuments
| Name | Description | Class
|
| XUpdate | Runs an XUpdate on an OGSA-DAI WS-DAIX XMLCollection or XMLDocument resource. Ported version in 3.1. | uk.org.ogsadai.wsdai.daix.activities.XUpdateActivity
|
WS-DAIX XMLSequences
| Name | Description | Class
|
| GetItems | Gets N items from an XMLSequence resource. The output is a list of character arrays which together form an XML document. | uk.org.ogsadai.wsdai.daix.activities.GetItemsActivity
|
OGSA-DAI 2.2 activities - to be ported
These activities are shipped with OGSA-DAI 2.2. They are not currently compatible with OGSA-DAI 3.0 but could be ported with varying degrees of ease - ask us for information.
Block
None.
Delivery
| Name | Description
|
| DeliverToAttachment | Delivers results as a SOAP attachment. For 3.0 this might be more complex and require new data source and sink resource, data source and sink service and data request execution service implementations.
|
| deliverToNull | Throws the input blocks away.
|
| deliverToResourceProperty | Writes results to a resource property. In 3.0 this could be to a resource property of the request resource which corresponds to the workflow in which the activity is executing.
|
File system resources
Porting these to OGSA-DAI 3.x is one of the OGSA-DAI project's current tasks (Q1/2009)
| Name | Description
|
| DeliverToFile | Delivers data to a file on the container's local filesystem. In 3.0 a file system resource would be the target for this activity.
|
| FileAccessActivity | Reads data from a file. The file can be text or binary and a portion of the file can be specified in terms of start byte/line and offset. This is a more powerful version of ReadFile. This activity handled both text and binary files and is very difficult to understand. It would be best be refactored as two activities, e.g. ReadTextFile and ReadBinaryFile, that are targeted at files in a file system resource.
|
| FileManipulationActivity | Creates, deletes, copies and moves fles. This would best be refactored as a set of activities, e.g. CreateFile, DeleteFile, CopyFile, MoveFile, that are targeted at files in a file system resource.
|
| FileWritingActivity | Inserts, deletes, appends or replaces content in a text or binary file. This activity handled both text and binary files and is very difficult to understand. It would best be refactored as a set of activities, e.g. InsertIntoTextFile, AppendToTextFile, ReplaceInTextFile, DeleteFromTextFile (and likewise for binary files), that are targeted at files in a file system resource.
|
| Grep | Does a GREP regular expression search across files.
|
Indexed files
Porting these to OGSA-DAI 3.x is one of the OGSA-DAI project's current tasks (Q1/2009)
To support these in 3.0 would be best achieved via the development of OGSA-DAI data resource plug-ins for indexed files.
| Name | Description
|
| AddIndexFile | Imports a new text file and create an index on it.
|
| SearchIndexedFile | Performs a full-text search across an indexed file.
|
Management
| Name | Description
|
| RemoveResource | Withdraws a data service resource from a service. In 3.0 this could be implemented as a destroy resource operation.
|
Relational resources
| Name | Description
|
| SQLStoredProcedure | Runs an SQL stored procedure.
|
| SwissSQLQuery | A version of SQLQuery that uses SwissSQL. This was not released in 2.2 but was prototyped just after. Source code from that point is available. Design doc: SwisSQLActivity-0506.pdf.
|
| Name | Description
|
| BytesToString | Converts a byte array to a string. This was not released in 2.2 but was prototyped just after. Source code from that point is available.
|
| FrequencyDistributor | Distributes numeric values onto spaces.
|
| GZIPCompression | GNUZIP compresses its input and outputs the compressed data.
|
| GZIPDecompression | GNUZIP decompresses its input and outputs the decompressed data.
|
| RandomSample | Generates a random sample of the input blocks.
|
| RemoveDuplicates | Removes duplicate rows from a WebRowSet document resulting from an SQLBag query. Equivalent to removing duplicated tuples from a list in 3.0.
|
| StringToBytes | Converts a string to a byte array. This was not released in 2.2 but was prototyped just after. Source code from that point is available.
|
| SwissSQLTransform | Transforms an SQL query to SwissSQL. This was not released in 2.2 but was prototyped just after. Source code from that point is available. Design doc: SwisSQLActivity-0506.pdf.
|
| ZIPArchive | ZIP compresses its input and outputs the compressed data.
|
Utility
| Name | Description
|
| BytesToTempFile | Writes a stream of bytes to a temporary file and then outputs a reference to this temporary file. This would be useful if passing round large amounts of binary data. It would however prove risky for the server if a client were to dump a number of large files on the server.
|
| DataStore | Caches parameters and results. In 3.0 this could be done via the use of sessions, ObtainFromSession and DeliverToSession.
|
| Notification | Sends or receive notifications as to the execution of other activities. This just outputs data that is input but also has an additional output for the notification message.
|
XMLDB resources
| Name | Description
|
| XMLBulkLoad | Bulk loads resources into a collection. Equivalent to OGSA-DAI WS-DAIX AddDocuments.
|
| XMLCollectionManagement | Creates or removes collections within an XML database. Equivalent to OGSA-DAI WS-DAIX CreateSubcollection and RemoveSubcollection.
|
| XMLResourceManagement | Creates or removes resources within an XML database. Equivalent to OGSA-DAI WS-DAIX AddDocuments and RemoveDocuments.
|
| XUpdateStatement | Runs an XUpdate statement against an XML database. Equivalent to OGSA-DAI WS-DAIX XUpdate.
|
OGSA-DAI OGSI activities - to be ported
These activities are shipped with OGSA-DAI OGSI 6.0. They are highly incompatible with OGSA-DAI 3.0 but might be ported with varying degrees of ease - ask us for information.
BinX files
| Name | Description
|
| Bf | An activity that runs an XPath expression over a binary XML file.
|
SEE-GEO OGSA-DAI 3.0-compliant OGC activities
A collection of reusable low-level activities (and example clients) that can be combined to create well-structured complex geospatial processes that scale well. The activities include those to run requests on GDAS and WFS servers, perform GeoLink join operations, convert between geo-spatial vector formats and execute WCS requests.
These were developed by SEE-GEO and are released as part of the OGSA-DAI with OGC geo-spatial extensions: http://edina.ac.uk/projects/seesaw/seegeo/about_geodownload.html
| Name | Description | Class
|
| GdasGetDataActivity | Runs a GDAS GetData request and outputs a GDAS dataset - a hash table of result values. | edina.grid.ogsadai.server.GdasGetDataActivity
|
| GeolinkActivity | Geo-links a GDAS dataset with WFS framework data and outputs enriched geo-linked GML containing the GDAS attributes. | edina.grid.ogsadai.server.GeolinkActivity
|
| WCSGetCoverageActivity | Runs a WCS GetCoverage request as defined in the WCS 1.0 standard and outputs WCS image that results. | edina.grid.ogsadai.server.WCSGetCoverageActivity
|
| WFSGetFeatureActivity | Runs a WFS GetFeature request and outputs XML WFS framework data. | edina.grid.ogsadai.server.WFSGetFeatureActivity
|
| WriteToFileActivity | Writes a file to an output directory on the server. The directory is specified as part of the activity configuration and is output by the activity. | edina.grid.ogsadai.server.WriteToFileActivity
|
Designed activities
A large number of activities have been designed to be compliant with OGSA-DAI 3.0. These are described in:
Redesigned and New Activities, Kostas Karasavvas, Malcolm Atkinson and Ally Hume Version: 1.13 (26-11-07). PDF.
Many of these have already been implemented as OGSA-DAI 3.0 activities. But many remain and may be useful.
Proposed activities
These are other activities that have been suggested throughout the lifetime of OGSA-DAI.
Block
| Name | Description
|
| ImplicitListRemove | Needs strongly-typed lists.
|
Delivery
| Name | Description
|
| DeliverToParallelHTTP |
|
| DeliverToSFTP |
|
| DeliverToStorageResourceBroker | May be better in conjunction with an OGSA-DAI data resource that represents SRB.
|
| InitiateRFT | Initiate a reliable file transfer using Globus RFT.
|
| ObtainFromParallelHTTP |
|
| ObtainFromSFTP |
|
| ObtainFromSOAPAttachment | Complement of 2.2's DeliverToSOAPAttachment - similar comments apply.
|
| ObtainFromStorageResourceBroker | May be better in conjunction with an OGSA-DAI data resource that represents SRB.
|
File system resources
| Name | Description
|
| ChangeFileResourceRoot | Management activity to change this configuration property of a file system resource.
|
| FileLastUpdated | When was the file last updated.
|
| SetFreshnessTolerance | Set freshness tolerance for a file.
|
Indexed files Management
| Name | Description
|
| CreateResourceGroupDistributed | Creates a ResourceGroup that stores both service URLs and ResourceIDs. Needs a new type of resource group data resource implementation.
|
| CreateResourceGroupDirect | Creates a ResourceGroup that stores database URLs. Needs a new type of resource group data resource implementation.
|
Relational resources
| Name | Description
|
| CreateStoredProcedure | Create a stored procedure in a database.
|
| GenericJoin | Execute a join where the join logic is in a binary provided by the client. Very risky!
|
| SQLQueryRestricted | Version of SQLQuery that supports a "fetch size" parameter.
|
| Name | Description
|
| ConvertToSwissSQL | Convert vendor-specific SQL to SwissSQL.
|
| ConvertFromSwissSQL | Convert from SwissSQL to vendor-specific SQL. May be more appropriate if targeted at a relational data resource.
|
Utility
| Name | Description
|
| ExecuteClientCode | Execute a binary provided by the client. Very risky!
|
| RSHActivity | Run an RSH command on the server. Very risky!
|
| ViewerActivity | Dumps received data into a resource. Exposes data as resource properties. Would need to define the data resource also.
|
XMLDB resources