| Apache DataFusionApache Software Foundation | ||||||
| Related Products
 | ||||||
| About
            Apache DataFusion is an extensible, high-performance query engine written in Rust that utilizes Apache Arrow as its in-memory format. Designed for developers building data-centric systems such as databases, data frames, machine learning, and streaming applications, DataFusion offers SQL and DataFrame APIs, a vectorized, multi-threaded, streaming execution engine, and support for partitioned data sources. It natively supports formats like CSV, Parquet, JSON, and Avro, and allows for seamless integration with object stores including AWS S3, Azure Blob Storage, and Google Cloud Storage. The engine features a comprehensive query planner, a state-of-the-art optimizer with capabilities like expression coercion and simplification, projection and filter pushdown, sort and distribution-aware optimizations, and automatic join reordering. DataFusion is highly customizable, enabling the addition of user-defined scalar, aggregate, and window functions, custom data sources, query languages, etc.
             | About
            OpenObserve is an open source observability platform for logs, metrics, and traces that emphasizes high performance, scalability, and dramatically lower cost. It supports petabyte-scale observability thanks to features like data compression using columnar storage and the ability to use “bring your own bucket” storage (local disk, S3, GCS, Azure Blob, etc.). It is written in Rust, uses the DataFusion query engine to directly query Parquet files, and provides a stateless, horizontally scalable architecture with caching (both result and disk) to maintain speed under heavy load. It embraces open standards (OpenTelemetry compatibility, vendor-neutral APIs), so it fits into existing monitoring/logging workflows. Key modules include logs, metrics, traces, frontend monitoring, pipelines, alerts, and dashboards/visualizations. 
             | |||||
| Platforms Supported
            
                Windows
            
            
         
            
                Mac
            
            
         
            
                Linux
            
            
         
            
                Cloud
            
            
         
            
                On-Premises
            
            
         
            
                iPhone
            
            
         
            
                iPad
            
            
         
            
                Android
            
            
         
            
                Chromebook
            
            
         | Platforms Supported
            
                Windows
            
            
         
            
                Mac
            
            
         
            
                Linux
            
            
         
            
                Cloud
            
            
         
            
                On-Premises
            
            
         
            
                iPhone
            
            
         
            
                iPad
            
            
         
            
                Android
            
            
         
            
                Chromebook
            
            
         | |||||
| Audience
        Professional developers and data engineers seeking a solution for building data-centric systems
         | Audience
        DevOps and companies wanting a solution to manage and optimize their logs, metrics, and traces
         | |||||
| Support
            
                Phone Support
            
            
         
            
                24/7 Live Support
            
            
         
            
                Online
            
            
         | Support
            
                Phone Support
            
            
         
            
                24/7 Live Support
            
            
         
            
                Online
            
            
         | |||||
| API
            
                Offers API
            
            
         | API
            
                Offers API
            
            
         | |||||
| Screenshots and Videos | Screenshots and Videos | |||||
| Pricing
        Free
        
     
            
                Free Version
            
            
         
            
                Free Trial
            
            
         | Pricing
        $0.30 per GB
        
     
            
                Free Version
            
            
         
            
                Free Trial
            
            
         | |||||
| 
Reviews/ | 
Reviews/ | |||||
| Training
            
                Documentation
            
            
         
            
                Webinars
            
            
         
            
                Live Online
            
            
         
            
                In Person
            
            
         | Training
            
                Documentation
            
            
         
            
                Webinars
            
            
         
            
                Live Online
            
            
         
            
                In Person
            
            
         | |||||
| Company InformationApache Software Foundation Founded: 2019 United States datafusion.apache.org | Company InformationOpenObserve Founded: 2022 United States openobserve.ai/ | |||||
| Alternatives | Alternatives | |||||
|  | ||||||
|  |  | |||||
| Categories | Categories | |||||
| Integrations
            
                
    Amazon S3
            
            
         
            
                
    Apache Parquet
            
            
         
            
                
    Azure Blob Storage
            
            
         
            
                
    Rust
            
            
         
            
                
    Amazon Web Services (AWS)
            
            
         
            
                
    Apache Arrow
            
            
         
            
                
    Apache Avro
            
            
         
            
                
    C
            
            
         
            
                
    Google Cloud Platform
            
            
         
            
                
    Google Cloud Storage
            
            
         | Integrations
            
                
    Amazon S3
            
            
         
            
                
    Apache Parquet
            
            
         
            
                
    Azure Blob Storage
            
            
         
            
                
    Rust
            
            
         
            
                
    Amazon Web Services (AWS)
            
            
         
            
                
    Apache Arrow
            
            
         
            
                
    Apache Avro
            
            
         
            
                
    C
            
            
         
            
                
    Google Cloud Platform
            
            
         
            
                
    Google Cloud Storage
            
            
         | |||||
|  |  |