AWS Glue

AWS Glue

Amazon
Apache Airflow

Apache Airflow

The Apache Software Foundation
+

Related Products

  • AnalyticsCreator
    46 Ratings
    Visit Website
  • Google Cloud BigQuery
    1,731 Ratings
    Visit Website
  • Semarchy xDM
    63 Ratings
    Visit Website
  • ActiveBatch Workload Automation
    349 Ratings
    Visit Website
  • RunPod
    133 Ratings
    Visit Website
  • Datasite Diligence Virtual Data Room
    458 Ratings
    Visit Website
  • Fraud.net
    56 Ratings
    Visit Website
  • Vertex AI
    713 Ratings
    Visit Website
  • Web APIs by Melissa
    74 Ratings
    Visit Website
  • Google Cloud Platform
    56,309 Ratings
    Visit Website

About

AWS Glue is a serverless data integration service that makes it easy to discover, prepare, and combine data for analytics, machine learning, and application development. AWS Glue provides all the capabilities needed for data integration so that you can start analyzing your data and putting it to use in minutes instead of months. Data integration is the process of preparing and combining data for analytics, machine learning, and application development. It involves multiple tasks, such as discovering and extracting data from various sources; enriching, cleaning, normalizing, and combining data; and loading and organizing data in databases, data warehouses, and data lakes. These tasks are often handled by different types of users that each use different products. AWS Glue runs in a serverless environment. There is no infrastructure to manage, and AWS Glue provisions, configures, and scales the resources required to run your data integration jobs.

About

AWS Step Functions is a serverless function orchestrator that makes it easy to sequence AWS Lambda functions and multiple AWS services into business-critical applications. Through its visual interface, you can create and run a series of checkpointed and event-driven workflows that maintain the application state. The output of one step acts as an input to the next. Each step in your application executes in order, as defined by your business logic. Orchestrating a series of individual serverless applications, managing retries, and debugging failures can be challenging. As your distributed applications become more complex, the complexity of managing them also grows. With its built-in operational controls, Step Functions manages sequencing, error handling, retry logic, and state, removing a significant operational burden from your team. AWS Step Functions lets you build visual workflows that enable fast translation of business requirements into technical requirements.

About

Airflow is a platform created by the community to programmatically author, schedule and monitor workflows. Airflow has a modular architecture and uses a message queue to orchestrate an arbitrary number of workers. Airflow is ready to scale to infinity. Airflow pipelines are defined in Python, allowing for dynamic pipeline generation. This allows for writing code that instantiates pipelines dynamically. Easily define your own operators and extend libraries to fit the level of abstraction that suits your environment. Airflow pipelines are lean and explicit. Parametrization is built into its core using the powerful Jinja templating engine. No more command-line or XML black-magic! Use standard Python features to create your workflows, including date time formats for scheduling and loops to dynamically generate tasks. This allows you to maintain full flexibility when building your workflows.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Anyone looking for a scalable and serverless data integration solution

Audience

Enterprises and businesses in search of a workflow management solution to assemble functions into business-critical applications

Audience

Anyone who wants to to programmatically author, schedule and monitor workflows

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Screenshots and Videos

Pricing

No information available.
Free Version
Free Trial

Pricing

$0.000025
Free Version
Free Trial

Pricing

No information available.
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

Amazon
Founded: 1994
United States
aws.amazon.com/glue

Company Information

Amazon
Founded: 1994
United States
aws.amazon.com/step-functions/

Company Information

The Apache Software Foundation
Founded: 1999
United States
airflow.apache.org

Alternatives

Alternatives

Alternatives

Union Cloud

Union Cloud

Union.ai
Bonita

Bonita

Bonitasoft
Amazon MWAA

Amazon MWAA

Amazon

Categories

Categories

Categories

ETL Features

Data Analysis
Data Filtering
Data Quality Control
Job Scheduling
Match & Merge
Metadata Management
Non-Relational Transformations
Version Control

Integrations

Amazon Aurora
Amazon EKS
Amazon Elastic Container Service (Amazon ECS)
Amazon RDS
Ascend
Azure Marketplace
DQOps
DataHub
FairCom DB
Microsoft Purview
OpenAccess SDK
Prophecy
SDF
Saagie
Soda
Stonebranch
Varada
ZenML
intermix.io
kPow

Integrations

Amazon Aurora
Amazon EKS
Amazon Elastic Container Service (Amazon ECS)
Amazon RDS
Ascend
Azure Marketplace
DQOps
DataHub
FairCom DB
Microsoft Purview
OpenAccess SDK
Prophecy
SDF
Saagie
Soda
Stonebranch
Varada
ZenML
intermix.io
kPow

Integrations

Amazon Aurora
Amazon EKS
Amazon Elastic Container Service (Amazon ECS)
Amazon RDS
Ascend
Azure Marketplace
DQOps
DataHub
FairCom DB
Microsoft Purview
OpenAccess SDK
Prophecy
SDF
Saagie
Soda
Stonebranch
Varada
ZenML
intermix.io
kPow
Claim AWS Glue and update features and information
Claim AWS Glue and update features and information
Claim AWS Step Functions and update features and information
Claim AWS Step Functions and update features and information
Claim Apache Airflow and update features and information
Claim Apache Airflow and update features and information