Apache DataFusion

Apache DataFusion

Apache Software Foundation
OLake Go

OLake Go

Datazip
+
+

Related Products

  • DbVisualizer
    593 Ratings
    Visit Website
  • Google Cloud BigQuery
    2,027 Ratings
    Visit Website
  • RaimaDB
    12 Ratings
    Visit Website
  • FusionAuth
    192 Ratings
    Visit Website
  • Google Cloud Platform
    61,066 Ratings
    Visit Website
  • Altium Develop
    1,446 Ratings
    Visit Website
  • Epsilon3
    265 Ratings
    Visit Website
  • Azore CFD
    26 Ratings
    Visit Website
  • Couchbase
    417 Ratings
    Visit Website
  • TIMi
    68 Ratings
    Visit Website

About

Apache DataFusion is an extensible, high-performance query engine written in Rust that utilizes Apache Arrow as its in-memory format. Designed for developers building data-centric systems such as databases, data frames, machine learning, and streaming applications, DataFusion offers SQL and DataFrame APIs, a vectorized, multi-threaded, streaming execution engine, and support for partitioned data sources. It natively supports formats like CSV, Parquet, JSON, and Avro, and allows for seamless integration with object stores including AWS S3, Azure Blob Storage, and Google Cloud Storage. The engine features a comprehensive query planner, a state-of-the-art optimizer with capabilities like expression coercion and simplification, projection and filter pushdown, sort and distribution-aware optimizations, and automatic join reordering. DataFusion is highly customizable, enabling the addition of user-defined scalar, aggregate, and window functions, custom data sources, query languages, etc.

About

OLake Go is an open-source data replication platform for moving operational data into data lakehouse storage. It connects to databases such as PostgreSQL, MySQL, MongoDB, Oracle Database, SQL Server, and IBM Db2, as well as Apache Kafka and object storage. The platform supports full-load and incremental ingestion, including change data capture for supported connectors, and writes data to Apache Iceberg tables and Parquet files using supported catalogs and storage targets. Data engineers and analytics platform teams can run ingestion jobs through the OLake UI or command-line workflows, deploy the software in their own infrastructure, and prepare synchronized lakehouse datasets for downstream querying and analytics. Docker-based deployment and connector-specific configuration let teams manage source connections, destinations, and data movement in a self-hosted environment.

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Not Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Not Supported
On-Premises Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Audience

Professional developers and data engineers seeking a solution for building data-centric systems

Audience

Data engineers and analytics platform teams that need to replicate operational database, Kafka, or object-storage data into Apache Iceberg or Parquet for downstream analytics.

Support

Phone Support Supported
24/7 Live Support Not Supported
Online Supported

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Supported

API

Offers API Supported

API

Offers API Supported

Screenshots and Videos

Screenshots and Videos

Pricing

Free
Free Version Supported
Free Trial Not Supported

Pricing

$0
OLake Go is open-source software distributed under the Apache 2.0 license, with no software license fee. Self-hosting requires separately provisioned compute, storage, and other infrastructure.
Free Version Supported
Free Trial Not Supported

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Supported

Training

Documentation Supported
Webinars Supported
Live Online Not Supported
In Person Not Supported

Company Information

Apache Software Foundation
Founded: 2019
United States
datafusion.apache.org

Company Information

Datazip
Founded: 2022
United States
olake.io

Alternatives

Alternatives

OLake Fusion

OLake Fusion

Datazip
Apache Spark

Apache Spark

Apache Software Foundation
Apache Doris

Apache Doris

The Apache Software Foundation

Categories

Database Supported

Categories

Data Replication Supported

Integrations

Amazon S3 Supported
Google Cloud Storage Supported
Apache Arrow Supported
Apache Avro Supported
Apache Iceberg Not Supported
Apache Kafka Not Supported
Apache Parquet Supported
Azure Blob Storage Supported
Google Cloud BigQuery Not Supported
Google Sheets Supported
IBM Db2 Not Supported
JSON Supported
Microsoft Excel Supported
MinIO Not Supported
OLake Fusion Not Supported
Oracle Database Not Supported
PostgreSQL Not Supported
Python Supported
SDF Supported
SQL Supported

Integrations

Amazon S3 Supported
Google Cloud Storage Supported
Apache Arrow Not Supported
Apache Avro Not Supported
Apache Iceberg Supported
Apache Kafka Supported
Apache Parquet Not Supported
Azure Blob Storage Not Supported
Google Cloud BigQuery Supported
Google Sheets Not Supported
IBM Db2 Supported
JSON Not Supported
Microsoft Excel Not Supported
MinIO Supported
OLake Fusion Supported
Oracle Database Supported
PostgreSQL Supported
Python Not Supported
SDF Not Supported
SQL Not Supported
Claim Apache DataFusion and update features and information
Claim Apache DataFusion and update features and information
Claim OLake Go and update features and information
Claim OLake Go and update features and information