Apache Beam

Apache Beam is an open source, unified programming model to define both batch and streaming data-parallel processing pipelines, as well as certain language-specific SDKs for constructing pipelines and Runners. These pipelines are executed on one of Beam’s supported distributed processing back-ends, which include Apache Apex, Apache Flink, Apache Spark, and Google Cloud Dataflow.

Beam is especially useful for Embarrassingly Parallel data processing tasks, and caters to the different needs and backgrounds of end users, SDK writers and runner writers.

Features

Supports executing programs on multiple distributed processing backends
Particularly useful for Embarrassingly Parallel data processing tasks
Supports multiple language specific SDKs

Project Samples

Project Activity

See All Activity >

License

Apache License V2.0

Follow Apache Beam

Apache Beam Web Site

Other Useful Business Software

Go from Code to Production URL in Seconds

Cloud Run deploys apps in any language instantly. Scales to zero. Pay only when code runs.

Skip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.

Start Free

Rate This Project

User Reviews

Be the first to post a review of Apache Beam!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Programming Language

Java

Related Categories

Java Frameworks

Registered

2020-03-13

Similar Business Software

Horovod

Horovod was originally developed by Uber to make distributed deep learning fast and easy to use, bringing model training time down from days and weeks to hours and minutes. With Horovod, an existing training script can be scaled up to run on hundreds of GPUs in just a few lines of Python code....

See Software
Apache Mahout

Apache Mahout is a powerful, scalable, and versatile machine learning library designed for distributed data processing. It offers a comprehensive set of algorithms for various tasks, including classification, clustering, recommendation, and pattern mining. Built on top of the Apache Hadoop...

See Software
Titanium SDK

Write in JavaScript, and run natively everywhere. Titanium lets you develop cross-platform native mobile applications and build great mobile experiences using JavaScript. Access your application's hundreds of native UI and non-visual components (such as networks and media APIs). Easily include...

See Software
Ionic

The Ionic Platform allows you to bring your apps to market faster with an integrated app platform built on the leading cross-platform mobile SDK. Build, secure, and deliver new mobile apps—and transform existing ones—across iOS, Android, and Web platforms from a single codebase. Full...

See Software
Tekton

Tekton is a cloud-native solution for building CI/CD systems. It consists of Tekton Pipelines, which provides the building blocks, and of supporting components, such as Tekton CLI and Tekton Catalog, that make Tekton a complete ecosystem. Tekton standardizes CI/CD tooling and processes across...

See Software
getcss

getcss - An intuitive CSS framework. Create responsive web apps with getcss. It's simple, easy to use, free, and open source. Features: * Accelerate your development - Write less, get more * Zero dependencies * Latest technologies - Supports latest browsers, HTML5, CSS3 * Easy to learn,...

See Software