Apache Airflow

Apache Airflow

The Apache Software Foundation
+
+

Related Products

  • JAMS Scheduler
    285 Ratings
    Visit Website
  • DataBuck
    6 Ratings
    Visit Website
  • ActiveBatch Workload Automation
    383 Ratings
    Visit Website
  • JS7 JobScheduler
    1 Rating
    Visit Website
  • Anaconda
    625 Ratings
    Visit Website
  • Stonebranch
    183 Ratings
    Visit Website
  • RunMyJobs by Redwood
    424 Ratings
    Visit Website
  • Coevera
    753 Ratings
    Visit Website
  • Wrike
    7,635 Ratings
    Visit Website
  • Titan
    378 Ratings
    Visit Website

About

Airflow is a platform created by the community to programmatically author, schedule and monitor workflows. Airflow has a modular architecture and uses a message queue to orchestrate an arbitrary number of workers. Airflow is ready to scale to infinity. Airflow pipelines are defined in Python, allowing for dynamic pipeline generation. This allows for writing code that instantiates pipelines dynamically. Easily define your own operators and extend libraries to fit the level of abstraction that suits your environment. Airflow pipelines are lean and explicit. Parametrization is built into its core using the powerful Jinja templating engine. No more command-line or XML black-magic! Use standard Python features to create your workflows, including date time formats for scheduling and loops to dynamically generate tasks. This allows you to maintain full flexibility when building your workflows.

About

DataKitchen is a DataOps software platform that helps organizations automate data quality testing, monitor data pipelines, and manage analytics workflows. Its product suite includes DataOps Data Quality TestGen, DataOps Process Observability, and DataOps Automation. TestGen automatically profiles databases, generates data quality tests, identifies anomalies, and monitors data reliability across existing data environments. DataOps Process Observability provides end-to-end visibility into data pipelines, datasets, and workflows to detect failures, delays, and performance bottlenecks. DataOps Automation enables teams to orchestrate data pipelines, manage development environments, automate deployments, and integrate testing into production workflows. The platform supports integrations with Snowflake, Databricks, BigQuery, Airflow, dbt, and other data technologies, with open-source and enterprise deployment options.

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Not Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Not Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Audience

Anyone who wants to to programmatically author, schedule and monitor workflows

Audience

Data engineers, analytics engineers, data scientists, data architects, DataOps teams, database administrators, business intelligence professionals, IT operations teams, and enterprises seeking automated data quality testing, pipeline observability, data workflow orchestration, and reliable analytics infrastructure

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Not Supported

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Not Supported

API

Offers API Not Supported

API

Offers API Not Supported

Screenshots and Videos

Screenshots and Videos

Pricing

No information available.
Free Version Not Supported
Free Trial Not Supported

Pricing

No information available.
Free Version Not Supported
Free Trial Not Supported

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation Not Supported
Webinars Not Supported
Live Online Not Supported
In Person Not Supported

Training

Documentation Not Supported
Webinars Not Supported
Live Online Not Supported
In Person Not Supported

Company Information

The Apache Software Foundation
Founded: 1999
United States
airflow.apache.org

Company Information

DataKitchen
Founded: 2013
United States
datakitchen.io

Alternatives

JAMS Scheduler

JAMS Scheduler

JAMS Software

Alternatives

dbt

dbt

dbt Labs
Amazon MWAA

Amazon MWAA

Amazon

Categories

AI Orchestration Supported
Data Pipeline Supported
DataOps Supported
Job Scheduler Supported

Categories

Automated Testing Supported
Data Observability Supported
Data Pipeline Supported
Data Quality Supported
DataOps Supported

Integrations

Acryl Data Supported
Cake AI Supported
Control-M Supported
DQOps Supported
DataHub Supported
Datafold Supported
Datakin Supported
Decube Supported
IRI Voracity Supported
Jira Not Supported
Microsoft Purview Supported
Mode Supported
RTILA Supported
Snowflake Not Supported
Snowflake CoCo Supported
Stackable Supported
Yandex Data Proc Supported
ZenML Supported
intermix.io Supported
rudol Supported

Integrations

Acryl Data Not Supported
Cake AI Not Supported
Control-M Not Supported
DQOps Not Supported
DataHub Not Supported
Datafold Not Supported
Datakin Not Supported
Decube Not Supported
IRI Voracity Not Supported
Jira Supported
Microsoft Purview Not Supported
Mode Not Supported
RTILA Not Supported
Snowflake Supported
Snowflake CoCo Not Supported
Stackable Not Supported
Yandex Data Proc Not Supported
ZenML Not Supported
intermix.io Not Supported
rudol Not Supported
Claim Apache Airflow and update features and information
Claim Apache Airflow and update features and information
Claim DataKitchen DataOps Automation and update features and information
Claim DataKitchen DataOps Automation and update features and information