Apache DataFusion

Apache DataFusion

Apache Software Foundation
+
+

Related Products

  • DbVisualizer
    593 Ratings
    Visit Website
  • Google Cloud BigQuery
    2,027 Ratings
    Visit Website
  • RaimaDB
    12 Ratings
    Visit Website
  • FusionAuth
    192 Ratings
    Visit Website
  • Google Cloud Platform
    61,066 Ratings
    Visit Website
  • Altium Develop
    1,448 Ratings
    Visit Website
  • Epsilon3
    265 Ratings
    Visit Website
  • Azore CFD
    26 Ratings
    Visit Website
  • Couchbase
    417 Ratings
    Visit Website
  • TIMi
    68 Ratings
    Visit Website

About

Apache DataFusion is an extensible, high-performance query engine written in Rust that utilizes Apache Arrow as its in-memory format. Designed for developers building data-centric systems such as databases, data frames, machine learning, and streaming applications, DataFusion offers SQL and DataFrame APIs, a vectorized, multi-threaded, streaming execution engine, and support for partitioned data sources. It natively supports formats like CSV, Parquet, JSON, and Avro, and allows for seamless integration with object stores including AWS S3, Azure Blob Storage, and Google Cloud Storage. The engine features a comprehensive query planner, a state-of-the-art optimizer with capabilities like expression coercion and simplification, projection and filter pushdown, sort and distribution-aware optimizations, and automatic join reordering. DataFusion is highly customizable, enabling the addition of user-defined scalar, aggregate, and window functions, custom data sources, query languages, etc.

About

StarTree, powered by Apache Pinot™, is a fully managed real-time analytics platform built for customer-facing applications that demand instant insights on the freshest data. Unlike traditional data warehouses or OLTP databases—optimized for back-office reporting or transactions—StarTree is engineered for real-time OLAP at true scale, meaning: - Data Volume: query performance sustained at petabyte scale - Ingest Rates: millions of events per second, continuously indexed for freshness - Concurrency: thousands to millions of simultaneous users served with sub-second latency With StarTree, businesses deliver always-fresh insights at interactive speed, enabling applications that personalize, monitor, and act in real time.

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Not Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Audience

Professional developers and data engineers seeking a solution for building data-centric systems

Audience

Companies with up to petabytes of data needing to run high queries-per-second (QPS) workloads

Support

Phone Support Supported
24/7 Live Support Not Supported
Online Supported

Support

Phone Support Not Supported
24/7 Live Support Supported
Online Supported

API

Offers API Supported

API

Offers API Supported

Screenshots and Videos

Screenshots and Videos

Pricing

Free
Free Version Supported
Free Trial Not Supported

Pricing

Free
StarTree offers flexible pricing plans for companies of any size, including a free forever tier.
Free Version Supported
Free Trial Supported

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Supported

Training

Documentation Supported
Webinars Supported
Live Online Supported
In Person Supported

Company Information

Apache Software Foundation
Founded: 2019
United States
datafusion.apache.org

Company Information

StarTree
Founded: 2019
United States
www.startree.ai

Alternatives

Alternatives

CelerData Cloud

CelerData Cloud

CelerData

Categories

Database Supported

Categories

Database Features

Backup and Recovery Supported
Creation / Development Not Supported
Data Migration Not Supported
Data Replication Not Supported
Data Search Supported
Data Security Supported
Database Conversion Not Supported
Mobile Access Not Supported
Monitoring Supported
NOSQL Not Supported
Performance Analysis Not Supported
Queries Supported
Relational Interface Supported
Virtualization Not Supported

Big Data Features

Collaboration Not Supported
Data Blends Not Supported
Data Cleansing Not Supported
Data Mining Not Supported
Data Visualization Not Supported
Data Warehousing Not Supported
High Volume Processing Supported
No-Code Sandbox Not Supported
Predictive Analytics Not Supported
Templates Not Supported

Data Analysis Features

Data Discovery Not Supported
Data Visualization Not Supported
High Volume Processing Supported
Predictive Analytics Not Supported
Regression Analysis Not Supported
Sentiment Analysis Not Supported
Statistical Modeling Not Supported
Text Analytics Supported

Streaming Analytics Features

Data Enrichment Not Supported
Data Wrangling / Data Prep Not Supported
Multiple Data Source Support Not Supported
Process Automation Not Supported
Real-time Analysis / Reporting Supported
Visualization Dashboards Not Supported

Integrations

Amazon S3 Supported
Amazon Kinesis Not Supported
Apache Arrow Supported
Apache Avro Supported
Apache Pinot Not Supported
Confluent Not Supported
Databricks Not Supported
Delta Lake Not Supported
Embeddable Not Supported
Google Cloud Storage Supported
Google Sheets Supported
Hadoop Not Supported
JSON Supported
Microsoft Azure Not Supported
Microsoft Excel Supported
Python Supported
Rust Supported
SDF Supported
Snowflake Not Supported
Tableau Not Supported

Integrations

Amazon S3 Supported
Amazon Kinesis Supported
Apache Arrow Not Supported
Apache Avro Not Supported
Apache Pinot Supported
Confluent Supported
Databricks Supported
Delta Lake Supported
Embeddable Supported
Google Cloud Storage Not Supported
Google Sheets Not Supported
Hadoop Supported
JSON Not Supported
Microsoft Azure Supported
Microsoft Excel Not Supported
Python Not Supported
Rust Not Supported
SDF Not Supported
Snowflake Supported
Tableau Supported
Claim Apache DataFusion and update features and information
Claim Apache DataFusion and update features and information
Claim StarTree and update features and information
Claim StarTree and update features and information