Apache Airflow

Apache Airflow

The Apache Software Foundation
+
+

Related Products

  • ActiveBatch Workload Automation
    349 Ratings
    Visit Website
  • JS7 JobScheduler
    1 Rating
    Visit Website
  • Stonebranch
    129 Ratings
    Visit Website
  • DataBuck
    6 Ratings
    Visit Website
  • RunMyJobs by Redwood
    238 Ratings
    Visit Website
  • MaintainX
    1,707 Ratings
    Visit Website
  • Docubee
    105 Ratings
    Visit Website
  • Planfix
    57 Ratings
    Visit Website
  • onPhase
    181 Ratings
    Visit Website
  • Adaptive Compliance Engine (ACE)
    58 Ratings
    Visit Website

About

Airflow is a platform created by the community to programmatically author, schedule and monitor workflows. Airflow has a modular architecture and uses a message queue to orchestrate an arbitrary number of workers. Airflow is ready to scale to infinity. Airflow pipelines are defined in Python, allowing for dynamic pipeline generation. This allows for writing code that instantiates pipelines dynamically. Easily define your own operators and extend libraries to fit the level of abstraction that suits your environment. Airflow pipelines are lean and explicit. Parametrization is built into its core using the powerful Jinja templating engine. No more command-line or XML black-magic! Use standard Python features to create your workflows, including date time formats for scheduling and loops to dynamically generate tasks. This allows you to maintain full flexibility when building your workflows.

About

The Databricks Data Intelligence Platform allows your entire organization to use data and AI. It’s built on a lakehouse to provide an open, unified foundation for all data and governance, and is powered by a Data Intelligence Engine that understands the uniqueness of your data. The winners in every industry will be data and AI companies. From ETL to data warehousing to generative AI, Databricks helps you simplify and accelerate your data and AI goals. Databricks combines generative AI with the unification benefits of a lakehouse to power a Data Intelligence Engine that understands the unique semantics of your data. This allows the Databricks Platform to automatically optimize performance and manage infrastructure in ways unique to your business. The Data Intelligence Engine understands your organization’s language, so search and discovery of new data is as easy as asking a question like you would to a coworker.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Anyone who wants to to programmatically author, schedule and monitor workflows

Audience

Organizations that want all their data, analytics and AI on one unified data platform

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

No information available.
Free Version
Free Trial

Pricing

No information available.
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

The Apache Software Foundation
Founded: 1999
United States
airflow.apache.org

Company Information

Databricks
Founded: 2013
United States
databricks.com

Alternatives

Alternatives

Vertex AI

Vertex AI

Google
Union Cloud

Union Cloud

Union.ai
Amazon MWAA

Amazon MWAA

Amazon

Categories

Categories

Artificial Intelligence Features

Chatbot
For eCommerce
For Healthcare
For Sales
Image Recognition
Machine Learning
Multi-Language
Natural Language Processing
Predictive Analytics
Process/Workflow Automation
Rules-Based Automation
Virtual Personal Assistant (VPA)

Big Data Features

Collaboration
Data Blends
Data Cleansing
Data Mining
Data Visualization
Data Warehousing
High Volume Processing
No-Code Sandbox
Predictive Analytics
Templates

Business Intelligence Features

Ad Hoc Reports
Benchmarking
Budgeting & Forecasting
Dashboard
Data Analysis
Key Performance Indicators
Natural Language Generation (NLG)
Performance Metrics
Predictive Analytics
Profitability Analysis
Strategic Planning
Trend / Problem Indicators
Visual Analytics

Dashboard Features

Annotations
Data Source Integrations
Functions / Calculations
Interactive
KPIs
OLAP
Private Dashboards
Public Dashboards
Scorecards
Themes
Visual Analytics
Widgets

Data Analysis Features

Data Discovery
Data Visualization
High Volume Processing
Predictive Analytics
Regression Analysis
Sentiment Analysis
Statistical Modeling
Text Analytics

Data Fabric Features

Data Access Management
Data Analytics
Data Collaboration
Data Lineage Tools
Data Networking / Connecting
Metadata Functionality
No Data Redundancy
Persistent Data Management

Data Governance Features

Access Control
Data Discovery
Data Mapping
Data Profiling
Deletion Management
Email Management
Policy Management
Process Management
Roles Management
Storage Management

Data Lineage Features

Database Change Impact Analysis
Filter Lineage Links
Implicit Connection Discovery
Lineage Object Filtering
Object Lineage Tracing
Point-in-Time Visibility
User/Client/Target Connection Visibility
Visual & Text Lineage View

Data Management Features

Customer Data
Data Analysis
Data Capture
Data Integration
Data Migration
Data Quality Control
Data Security
Information Governance
Master Data Management
Match & Merge

Data Science Features

Access Control
Advanced Modeling
Audit Logs
Data Discovery
Data Ingestion
Data Preparation
Data Visualization
Model Deployment
Reports

Data Visualization Features

Analytics
Content Management
Dashboard Creation
Filtered Views
OLAP
Relational Display
Simulation Models
Visual Discovery

Data Warehouse Features

Ad hoc Query
Analytics
Data Integration
Data Migration
Data Quality Control
ETL - Extract / Transfer / Load
In-Memory Processing
Match & Merge

ETL Features

Data Analysis
Data Filtering
Data Quality Control
Job Scheduling
Match & Merge
Metadata Management
Non-Relational Transformations
Version Control

Machine Learning Features

Deep Learning
ML Algorithm Library
Model Training
Natural Language Processing (NLP)
Predictive Modeling
Statistical / Mathematical Tools
Templates
Visualization

Integrations

Acryl Data
Ascend
Dagster
DataBuck
DataHub
Decube
Foundational
Great Expectations
IBM Databand
Mode
Orchestra
Pantomath
Prophecy
Ray
Secoda
Soda
Tobiko
lakeFS
Determined AI
Stackable

Integrations

Acryl Data
Ascend
Dagster
DataBuck
DataHub
Decube
Foundational
Great Expectations
IBM Databand
Mode
Orchestra
Pantomath
Prophecy
Ray
Secoda
Soda
Tobiko
lakeFS
Determined AI
Stackable
Claim Apache Airflow and update features and information
Claim Apache Airflow and update features and information
Claim Databricks Data Intelligence Platform and update features and information
Claim Databricks Data Intelligence Platform and update features and information