| Apache DataFusionApache Software Foundation | ||||||
| Related Products
 | ||||||
| About
            Apache DataFusion is an extensible, high-performance query engine written in Rust that utilizes Apache Arrow as its in-memory format. Designed for developers building data-centric systems such as databases, data frames, machine learning, and streaming applications, DataFusion offers SQL and DataFrame APIs, a vectorized, multi-threaded, streaming execution engine, and support for partitioned data sources. It natively supports formats like CSV, Parquet, JSON, and Avro, and allows for seamless integration with object stores including AWS S3, Azure Blob Storage, and Google Cloud Storage. The engine features a comprehensive query planner, a state-of-the-art optimizer with capabilities like expression coercion and simplification, projection and filter pushdown, sort and distribution-aware optimizations, and automatic join reordering. DataFusion is highly customizable, enabling the addition of user-defined scalar, aggregate, and window functions, custom data sources, query languages, etc.
             | About
            Knowing of data wrangling habits, Polars exposes a complete Python API, including the full set of features to manipulate DataFrames using an expression language that will empower you to create readable and performant code. Polars is written in Rust, uncompromising in its choices to provide a feature-complete DataFrame API to the Rust ecosystem. Use it as a DataFrame library or as a query engine backend for your data models. 
             | |||||
| Platforms Supported
            
                Windows
            
            
         
            
                Mac
            
            
         
            
                Linux
            
            
         
            
                Cloud
            
            
         
            
                On-Premises
            
            
         
            
                iPhone
            
            
         
            
                iPad
            
            
         
            
                Android
            
            
         
            
                Chromebook
            
            
         | Platforms Supported
            
                Windows
            
            
         
            
                Mac
            
            
         
            
                Linux
            
            
         
            
                Cloud
            
            
         
            
                On-Premises
            
            
         
            
                iPhone
            
            
         
            
                iPad
            
            
         
            
                Android
            
            
         
            
                Chromebook
            
            
         | |||||
| Audience
        Professional developers and data engineers seeking a solution for building data-centric systems
         | Audience
        IT teams seeking a dataframe interface solution thats implemented in Rust
         | |||||
| Support
            
                Phone Support
            
            
         
            
                24/7 Live Support
            
            
         
            
                Online
            
            
         | Support
            
                Phone Support
            
            
         
            
                24/7 Live Support
            
            
         
            
                Online
            
            
         | |||||
| API
            
                Offers API
            
            
         | API
            
                Offers API
            
            
         | |||||
| Screenshots and Videos | Screenshots and Videos | |||||
| Pricing
        Free
        
     
            
                Free Version
            
            
         
            
                Free Trial
            
            
         | Pricing
        No information available.
        
        
     
            
                Free Version
            
            
         
            
                Free Trial
            
            
         | |||||
| 
Reviews/ | 
Reviews/ | |||||
| Training
            
                Documentation
            
            
         
            
                Webinars
            
            
         
            
                Live Online
            
            
         
            
                In Person
            
            
         | Training
            
                Documentation
            
            
         
            
                Webinars
            
            
         
            
                Live Online
            
            
         
            
                In Person
            
            
         | |||||
| Company InformationApache Software Foundation Founded: 2019 United States datafusion.apache.org | Company InformationPolars www.pola.rs/ | |||||
| Alternatives | Alternatives | |||||
|  | ||||||
|  |  | |||||
| Categories | Categories | |||||
| Integrations
            
                
    Python
            
            
         
            
                
    Rust
            
            
         
            
                
    SDF
            
            
         
            
                
    SQL
            
            
         
            
                
    Amazon S3
            
            
         
            
                
    Apache Arrow
            
            
         
            
                
    Apache Avro
            
            
         
            
                
    Apache Parquet
            
            
         
            
                
    Azure Blob Storage
            
            
         
            
                
    C
            
            
         | Integrations
            
                
    Python
            
            
         
            
                
    Rust
            
            
         
            
                
    SDF
            
            
         
            
                
    SQL
            
            
         
            
                
    Amazon S3
            
            
         
            
                
    Apache Arrow
            
            
         
            
                
    Apache Avro
            
            
         
            
                
    Apache Parquet
            
            
         
            
                
    Azure Blob Storage
            
            
         
            
                
    C
            
            
         | |||||
|  |  | 
 
        