Apache Beam

Apache Beam is an open source, unified programming model to define both batch and streaming data-parallel processing pipelines, as well as certain language-specific SDKs for constructing pipelines and Runners. These pipelines are executed on one of Beam’s supported distributed processing back-ends, which include Apache Apex, Apache Flink, Apache Spark, and Google Cloud Dataflow.

Beam is especially useful for Embarrassingly Parallel data processing tasks, and caters to the different needs and backgrounds of end users, SDK writers and runner writers.

Features

Supports executing programs on multiple distributed processing backends
Particularly useful for Embarrassingly Parallel data processing tasks
Supports multiple language specific SDKs

Project Samples

Project Activity

See All Activity >

License

Apache License V2.0

Follow Apache Beam

Apache Beam Web Site

Other Useful Business Software

Gemini 3 and 200+ AI Models on One Platform

Access Google's best plus Claude, Llama, and Gemma. Fine-tune and deploy from one console.

Build generative AI apps with Vertex AI. Switch between models without switching platforms.

Start Free

Rate This Project

User Reviews

Be the first to post a review of Apache Beam!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Programming Language

Java

Related Categories

Java Frameworks

Registered

2020-03-13

Similar Business Software

Horovod

Horovod was originally developed by Uber to make distributed deep learning fast and easy to use, bringing model training time down from days and weeks to hours and minutes. With Horovod, an existing training script can be scaled up to run on hundreds of GPUs in just a few lines of Python code....

See Software
Apache Mahout

Apache Mahout is a powerful, scalable, and versatile machine learning library designed for distributed data processing. It offers a comprehensive set of algorithms for various tasks, including classification, clustering, recommendation, and pattern mining. Built on top of the Apache Hadoop...

See Software
Titanium SDK

Write in JavaScript, and run natively everywhere. Titanium lets you develop cross-platform native mobile applications and build great mobile experiences using JavaScript. Access your application's hundreds of native UI and non-visual components (such as networks and media APIs). Easily include...

See Software
Tekton

Tekton is a cloud-native solution for building CI/CD systems. It consists of Tekton Pipelines, which provides the building blocks, and of supporting components, such as Tekton CLI and Tekton Catalog, that make Tekton a complete ecosystem. Tekton standardizes CI/CD tooling and processes across...

See Software
getcss

getcss - An intuitive CSS framework. Create responsive web apps with getcss. It's simple, easy to use, free, and open source. Features: * Accelerate your development - Write less, get more * Zero dependencies * Latest technologies - Supports latest browsers, HTML5, CSS3 * Easy to learn,...

See Software
Grails

A powerful Groovy-based web application framework for the JVM built on top of Spring Boot. Convention-over-configuration, sensible defaults, opinionated APIs, and the Groovy language combine to make the Grails® framework easy to learn for Java developers. The Grails framework is built on top of...

See Software