Apache DataFusion

Apache DataFusion

Apache Software Foundation
R2 SQL

R2 SQL

Cloudflare
+
+

Related Products

  • DbVisualizer
    593 Ratings
    Visit Website
  • Google Cloud BigQuery
    2,027 Ratings
    Visit Website
  • RaimaDB
    12 Ratings
    Visit Website
  • FusionAuth
    192 Ratings
    Visit Website
  • Google Cloud Platform
    61,066 Ratings
    Visit Website
  • Altium Develop
    1,451 Ratings
    Visit Website
  • Azore CFD
    26 Ratings
    Visit Website
  • Epsilon3
    265 Ratings
    Visit Website
  • Couchbase
    417 Ratings
    Visit Website
  • TIMi
    68 Ratings
    Visit Website

About

Apache DataFusion is an extensible, high-performance query engine written in Rust that utilizes Apache Arrow as its in-memory format. Designed for developers building data-centric systems such as databases, data frames, machine learning, and streaming applications, DataFusion offers SQL and DataFrame APIs, a vectorized, multi-threaded, streaming execution engine, and support for partitioned data sources. It natively supports formats like CSV, Parquet, JSON, and Avro, and allows for seamless integration with object stores including AWS S3, Azure Blob Storage, and Google Cloud Storage. The engine features a comprehensive query planner, a state-of-the-art optimizer with capabilities like expression coercion and simplification, projection and filter pushdown, sort and distribution-aware optimizations, and automatic join reordering. DataFusion is highly customizable, enabling the addition of user-defined scalar, aggregate, and window functions, custom data sources, query languages, etc.

About

R2 SQL is Cloudflare’s serverless, distributed analytics query engine (currently in open beta) that enables you to run SQL queries over Apache Iceberg tables stored in R2 Data Catalog without needing to manage your own compute clusters. It is built to efficiently query large volumes of data by leveraging metadata pruning, partition-level statistics, file and row-group filtering, and Cloudflare’s globally distributed compute infrastructure to parallelize execution. The system works by integrating with R2 object storage and an Iceberg catalog layer, so you can ingest data via Cloudflare Pipelines into Iceberg tables, and then query that data with minimal overhead. Queries can be issued via the Wrangler CLI or HTTP API (with an API token granting permissions across R2 SQL, Data Catalog, and storage). During the open beta period, using R2 SQL itself is not billed, only storage and standard R2 operations incur charges.

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Not Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Not Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Audience

Professional developers and data engineers seeking a solution for building data-centric systems

Audience

Data engineers and backend developers needing a solution to run scalable analytics over large datasets stored in R2 using SQL

Support

Phone Support Supported
24/7 Live Support Not Supported
Online Supported

Support

Phone Support Supported
24/7 Live Support Not Supported
Online Supported

API

Offers API Supported

API

Offers API Supported

Screenshots and Videos

Screenshots and Videos

Pricing

Free
Free Version Supported
Free Trial Not Supported

Pricing

Free
Free Version Supported
Free Trial Not Supported

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Supported

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Supported

Company Information

Apache Software Foundation
Founded: 2019
United States
datafusion.apache.org

Company Information

Cloudflare
Founded: 2009
United States
developers.cloudflare.com/r2-sql/

Alternatives

Alternatives

Cloudflare R2

Cloudflare R2

Cloudflare
Apache Iceberg

Apache Iceberg

Apache Software Foundation
OLake Go

OLake Go

Datazip
OLake Fusion

OLake Fusion

Datazip

Categories

Database Supported

Categories

Query Engines Supported

Integrations

SQL Supported
Amazon S3 Supported
Apache Arrow Supported
Apache Avro Supported
Apache Iceberg Not Supported
Apache Parquet Supported
Azure Blob Storage Supported
C Supported
Cloudflare Not Supported
Google Cloud Storage Supported
Google Sheets Supported
JSON Supported
Microsoft Excel Supported
Python Supported
Rust Supported
SDF Supported

Integrations

SQL Supported
Amazon S3 Not Supported
Apache Arrow Not Supported
Apache Avro Not Supported
Apache Iceberg Supported
Apache Parquet Not Supported
Azure Blob Storage Not Supported
C Not Supported
Cloudflare Supported
Google Cloud Storage Not Supported
Google Sheets Not Supported
JSON Not Supported
Microsoft Excel Not Supported
Python Not Supported
Rust Not Supported
SDF Not Supported
Claim Apache DataFusion and update features and information
Claim Apache DataFusion and update features and information
Claim R2 SQL and update features and information
Claim R2 SQL and update features and information