Search Results for "dataflow"

DataflowTemplates is the source repository for Google-provided Dataflow templates that are intended to solve large-scale in-cloud data processing tasks without requiring users to build everything from scratch in a full development environment. The repository is centered on templated pipelines powered by Google Cloud Dataflow and Apache Beam, making it easier to run common integration and movement jobs such as data import, export, backup, restore, and bulk API operations. ...

...These pipelines are executed on one of Beam’s supported distributed processing back-ends, which include Apache Apex, Apache Flink, Apache Spark, and Google Cloud Dataflow. Beam is especially useful for Embarrassingly Parallel data processing tasks, and caters to the different needs and backgrounds of end users, SDK writers and runner writers.

The T. J. Watson Libraries for Analysis (WALA) provide static analysis capabilities for Java bytecode and related languages and for JavaScript. The system is licensed under the Eclipse Public License, which has been approved by the OSI (Open Source Initiative) as a fully certified open-source license. The initial WALA infrastructure was independently developed as part of the DOMO research project at the IBM T.J. Watson Research Center. In 2006, IBM donated the software to the community. The...

ElasticJob is a distributed scheduling solution consisting of two separate projects, ElasticJob-Lite and ElasticJob-Cloud. ElasticJob-Lite is a lightweight, decentralized solution that provides distributed task sharding services. ElasticJob-Cloud uses Mesos to manage and isolate resources. It uses a unified job API for each project. Developers only need code one time and can deploy at will. Support job sharding and high availability in distributed system. Scale out for throughput and...

Apache Flink is a distributed engine for stateful computations over data streams and batches, designed for low-latency processing at scale. Its core runtime executes dataflow graphs with fine-grained backpressure and checkpointing, allowing applications to recover consistently from failures. Flink’s event-time model and watermarks enable accurate out-of-order processing, windowing, and complex time semantics that typical real-time systems struggle with. Developers program against high-level APIs—DataStream and Table/SQL—to express transformations, joins, and stateful patterns, while specialized libraries support CEP, machine learning workflows, and connectors. ...

autoCode4 is an engine that synthesizes controllers from formal specifications described under a subset of linear temporal logic (LTL). Importantly, it synthesizes synchronous dataflow controllers (in Lustre or in Ptolemy II form) and maintains requirement-to-code traceability. Such feature is mandated in developing safety-critical systems and are considered essential for specification validation or integrating manual implementation such as legacy code. The LTL specification captures the desired behavior of a controller where the environment takes the first move (i.e., sense/input then react/output), so the synthesized controller can be viewed as a Mealy machine. ...

ICon (Input Configurator) is a Java-based system for managing input devices and building advanced interaction techniques using a dataflow model. It contains a runtime engine, a rich library of input devices, several processing modules and a visual editor.

The Open RVC-CAL Compiler (Orcc) is a compiler under BSD license for the RVC-CAL dataflow programming language. Please consult the project homepage at http://orcc.sourceforge.net for more information.

PARUS is a data-flow parallel programming language that allows to build parallel programs for clusters and MPP multiprocessors. The data-flow graph is automatically converted to the C++/MPI source and linked with the libparus runtime library. Also there are available tools for benchmarking cluster interconnect and visualize it.

A graphical process designer and engine extension for JBoss jBPM with dataflow capabilities, common task nodes: SQL, FTP, R (Stats), Groovy and email and round-trip process engineering/management from an Eclipse-based editor

PSF is a path-sensitive, inter-procedural program analysis framework developed on top of Soot.

An environment for building and executing actor/dataflow models, including support for the CAL actor language.

The Squidy Interaction Library eases the design of "post-WIMP" user interfaces by unifying various device drivers, frameworks and tracking toolkits in a common library and provides a central and easy-to-use visual design environment. www.squidy-lib.de

sdf4j is a Java framework to manipulate Static Dataflow graphs (SDF).

Tableflow is a Java web component to connect tabular data using an executable dataflow paradigm. This project includes an advanced data grid component, compatible with JSF that has build in support for filtering, paging, sorting and much more.