Search Results for "streaming"

Apache Beam is an open source, unified programming model to define both batch and streaming data-parallel processing pipelines, as well as certain language-specific SDKs for constructing pipelines and Runners. These pipelines are executed on one of Beam’s supported distributed processing back-ends, which include Apache Apex, Apache Flink, Apache Spark, and Google Cloud Dataflow. Beam is especially useful for Embarrassingly Parallel data processing tasks, and caters to the different needs and backgrounds of end users, SDK writers and runner writers.

...InLong supports both batch and stream data processing at the same time, which offers great power to build data analysis, modeling and other real-time applications based on streaming data. InLong (应龙) is a divine beast in Chinese mythology who guides the river into the sea, and it is regarded as a metaphor of the InLong system for reporting data streams. InLong was originally built at Tencent, which has served online businesses for more than 8 years, to support massive data (data scale of more than 80 trillion pieces of data per day) reporting services in big data scenarios. ...

Apache Flink is a distributed engine for stateful computations over data streams and batches, designed for low-latency processing at scale. Its core runtime executes dataflow graphs with fine-grained backpressure and checkpointing, allowing applications to recover consistently from failures. Flink’s event-time model and watermarks enable accurate out-of-order processing, windowing, and complex time semantics that typical real-time systems struggle with. Developers program against high-level...

StreamAID facilitates fast prototyping of P2P live algorithms that can be built in a modular approach.

...Key Features: * embeddable, open source and free * fast and scalable * uses target database features to do transformations and loads * manual and automatic data mapping * data streaming * bulk data loads * data quality features using SQL, JavaScript? and regex * data transformations Requirements * Java 1.6 and up * At least 4 MB of RAM New in 3.2 (01/18/2013) * Improved auto-update functionality * Bug fixes

An event driven software system for easy and efficient streaming of structured data. Instead of creating temporary objects and holding them in lists for passing around, chain$tar streams data directly to a sequence of chained methods.

A high-performance, multi-stage, event-driven networking framework written entirely in Java using NIO. It is designed to abstract most (if not all) of the networking complexities so that beginner or expert, you can concentrate on what really counts... yo

The JProactor is a high performance communication toolkit that facilitates development of networking applications using asynchronous programming model. The Jproactor utilises Java NIO (new IO) api and JSSE (Java SSL Engine), and supports multiple communi

WebLOQ IO is a Java NIO framework which allows for tens of thousands of concurrent TCP/IP connections through a very small thread pool (assuming proper OS and network settings). There is built in support for SSL and non-SSL connections.