Arroyo

Arroyo is a distributed stream processing engine written in Rust, designed to efficiently perform stateful computations on streams of data. Unlike traditional batch processing, streaming engines can operate on both bounded and unbounded sources, emitting results as soon as they are available.

Features

SQL and Rust pipelines
Scales up to millions of events per second
Stateful operations like windows and joins
State checkpointing for fault-tolerance and recovery of pipelines
Timely stream processing via the Dataflow model
Documentation available
Examples available

Project Samples

Project Activity

See All Activity >

License

Apache License V2.0

Follow Arroyo

Arroyo Web Site

Other Useful Business Software

Build Agents and Models on One Platform

Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

Gemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.

Start Free

Rate This Project

User Reviews

Be the first to post a review of Arroyo!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Programming Language

Rust

Related Categories

Rust Big Data Tool, Rust Stream Processing Tool

Registered

2024-08-12

Similar Business Software

Google Cloud Platform

Google Cloud is a cloud-based service that allows you to create anything from simple websites to complex applications for businesses of all sizes. New customers get $300 in free credits to run, test, and deploy workloads. All customers can use 25+ products for free, up to monthly usage...

See Software
Google Cloud BigQuery

BigQuery is a serverless, multicloud data warehouse that simplifies the process of working with all types of data so you can focus on getting valuable business insights quickly. At the core of Google’s data cloud, BigQuery allows you to simplify data integration, cost effectively and securely...

See Software
dbt

dbt helps data teams transform raw data into trusted, analysis-ready datasets faster. With dbt, data analysts and data engineers can collaborate on version-controlled SQL models, enforce testing and documentation standards, lean on detailed metadata to troubleshoot and optimize pipelines, and...

See Software
TIMi

The most efficient, sovereign & unified "on-premise" data platform available today. Think about the Azure data platform, but on steroids and 100% Sovereign. TIMi is an ethical solution: Zero Lock-In: We gain your trust through exceptional performance and service, not artificial vendor...

See Software
Teradata VantageCloud

Teradata VantageCloud: The complete cloud analytics and data platform for AI. Teradata VantageCloud is an enterprise-grade, cloud-native data and analytics platform that unifies data management, advanced analytics, and AI/ML capabilities in a single environment. Designed for scalability and...

See Software
RaimaDB

RaimaDB is an embedded time series database for IoT and Edge devices that can run in-memory. It is an extremely powerful, lightweight and secure RDBMS. Field tested by over 20 000 developers worldwide and has more than 25 000 000 deployments. RaimaDB is a high-performance, cross-platform...

See Software