Apache Airflow

Apache Airflow

The Apache Software Foundation
Flyte

Flyte

Union.ai
+

Related Products

  • GW Apps
    37 Ratings
    Visit Website
  • Moxo
    212 Ratings
    Visit Website
  • ActiveBatch Workload Automation
    353 Ratings
    Visit Website
  • Docubee
    115 Ratings
    Visit Website
  • Process Street
    1,094 Ratings
    Visit Website
  • Odoo
    1,601 Ratings
    Visit Website
  • Serviceaide
    140 Ratings
    Visit Website
  • Pipefy
    585 Ratings
    Visit Website
  • Epsilon3
    262 Ratings
    Visit Website
  • Jotform
    6,933 Ratings
    Visit Website

About

AWS Step Functions is a serverless function orchestrator that makes it easy to sequence AWS Lambda functions and multiple AWS services into business-critical applications. Through its visual interface, you can create and run a series of checkpointed and event-driven workflows that maintain the application state. The output of one step acts as an input to the next. Each step in your application executes in order, as defined by your business logic. Orchestrating a series of individual serverless applications, managing retries, and debugging failures can be challenging. As your distributed applications become more complex, the complexity of managing them also grows. With its built-in operational controls, Step Functions manages sequencing, error handling, retry logic, and state, removing a significant operational burden from your team. AWS Step Functions lets you build visual workflows that enable fast translation of business requirements into technical requirements.

About

Airflow is a platform created by the community to programmatically author, schedule and monitor workflows. Airflow has a modular architecture and uses a message queue to orchestrate an arbitrary number of workers. Airflow is ready to scale to infinity. Airflow pipelines are defined in Python, allowing for dynamic pipeline generation. This allows for writing code that instantiates pipelines dynamically. Easily define your own operators and extend libraries to fit the level of abstraction that suits your environment. Airflow pipelines are lean and explicit. Parametrization is built into its core using the powerful Jinja templating engine. No more command-line or XML black-magic! Use standard Python features to create your workflows, including date time formats for scheduling and loops to dynamically generate tasks. This allows you to maintain full flexibility when building your workflows.

About

The workflow automation platform for complex, mission-critical data and ML processes at scale. Flyte makes it easy to create concurrent, scalable, and maintainable workflows for machine learning and data processing. Flyte is used in production at Lyft, Spotify, Freenome, and others. At Lyft, Flyte has been serving production model training and data processing for over four years, becoming the de-facto platform for teams like pricing, locations, ETA, mapping, autonomous, and more. In fact, Flyte manages over 10,000 unique workflows at Lyft, totaling over 1,000,000 executions every month, 20 million tasks, and 40 million containers. Flyte has been battle-tested at Lyft, Spotify, Freenome, and others. It is entirely open-source with an Apache 2.0 license under the Linux Foundation with a cross-industry overseeing committee. Configuring machine learning and data workflows can get complex and error-prone with YAML.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Enterprises and businesses in search of a workflow management solution to assemble functions into business-critical applications

Audience

Anyone who wants to to programmatically author, schedule and monitor workflows

Audience

Developers in need of a workflow automation platform to create concurrent, scalable, and maintainable workflows

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Screenshots and Videos

Pricing

$0.000025
Free Version
Free Trial

Pricing

No information available.
Free Version
Free Trial

Pricing

Free
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

Amazon
Founded: 1994
United States
aws.amazon.com/step-functions/

Company Information

The Apache Software Foundation
Founded: 1999
United States
airflow.apache.org

Company Information

Union.ai
Founded: 2020
United States
flyte.org

Alternatives

Alternatives

Alternatives

Ray

Ray

Anyscale
dbt

dbt

dbt Labs
Union Cloud

Union Cloud

Union.ai
OPAQUE

OPAQUE

OPAQUE Systems
Amazon MWAA

Amazon MWAA

Amazon
Vertex AI

Vertex AI

Google
Bonita

Bonita

Bonitasoft

Categories

Categories

Categories

Integrations

AWS Batch
AWS Infrastructure Composer
Acryl Data
Amazon Web Services (AWS)
Ardent
Coursebox AI
Databricks Data Intelligence Platform
Datafold
Datakin
DoubleCloud
Google Cloud Composer
Great Expectations
Horovod
IRI FieldShield
Netdata
Orchestra
Pantomath
Prophecy
emma
rudol

Integrations

AWS Batch
AWS Infrastructure Composer
Acryl Data
Amazon Web Services (AWS)
Ardent
Coursebox AI
Databricks Data Intelligence Platform
Datafold
Datakin
DoubleCloud
Google Cloud Composer
Great Expectations
Horovod
IRI FieldShield
Netdata
Orchestra
Pantomath
Prophecy
emma
rudol

Integrations

AWS Batch
AWS Infrastructure Composer
Acryl Data
Amazon Web Services (AWS)
Ardent
Coursebox AI
Databricks Data Intelligence Platform
Datafold
Datakin
DoubleCloud
Google Cloud Composer
Great Expectations
Horovod
IRI FieldShield
Netdata
Orchestra
Pantomath
Prophecy
emma
rudol
Claim AWS Step Functions and update features and information
Claim AWS Step Functions and update features and information
Claim Apache Airflow and update features and information
Claim Apache Airflow and update features and information
Claim Flyte and update features and information
Claim Flyte and update features and information