AWS Glue

AWS Glue

Amazon
Apache Airflow

Apache Airflow

The Apache Software Foundation
+
+
Visit Website

About

AWS Glue is a serverless data integration service that makes it easy to discover, prepare, and combine data for analytics, machine learning, and application development. AWS Glue provides all the capabilities needed for data integration so that you can start analyzing your data and putting it to use in minutes instead of months. Data integration is the process of preparing and combining data for analytics, machine learning, and application development. It involves multiple tasks, such as discovering and extracting data from various sources; enriching, cleaning, normalizing, and combining data; and loading and organizing data in databases, data warehouses, and data lakes. These tasks are often handled by different types of users that each use different products. AWS Glue runs in a serverless environment. There is no infrastructure to manage, and AWS Glue provisions, configures, and scales the resources required to run your data integration jobs.

About

Airflow is a platform created by the community to programmatically author, schedule and monitor workflows. Airflow has a modular architecture and uses a message queue to orchestrate an arbitrary number of workers. Airflow is ready to scale to infinity. Airflow pipelines are defined in Python, allowing for dynamic pipeline generation. This allows for writing code that instantiates pipelines dynamically. Easily define your own operators and extend libraries to fit the level of abstraction that suits your environment. Airflow pipelines are lean and explicit. Parametrization is built into its core using the powerful Jinja templating engine. No more command-line or XML black-magic! Use standard Python features to create your workflows, including date time formats for scheduling and loops to dynamically generate tasks. This allows you to maintain full flexibility when building your workflows.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Anyone looking for a scalable and serverless data integration solution

Audience

Anyone who wants to to programmatically author, schedule and monitor workflows

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

No information available.
Free Version
Free Trial

Pricing

No information available.
Free Version
Free Trial

Reviews/Ratings

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

Amazon
Founded: 1994
United States
aws.amazon.com/glue

Company Information

The Apache Software Foundation
Founded: 1999
United States
airflow.apache.org

Alternatives

Alternatives

AWS Glue

AWS Glue

Amazon
Amazon MWAA

Amazon MWAA

Amazon
ActiveBatch Workload Automation

ActiveBatch Workload Automation

ActiveBatch by Redwood

Categories

Categories

ETL Features

Data Analysis
Data Filtering
Data Quality Control
Job Scheduling
Match & Merge
Metadata Management
Non-Relational Transformations
Version Control

Integrations

Acryl Data
DataBuck
DataHub
Orchestra
SDF
Secoda
Stonebranch
Amazon Redshift
Ascend
FairCom DB
FairCom EDGE
Feroot
IRI Voracity
Kedro
Netdata
New Relic
OpenMetadata
Oxla
Wavo
kPow

Integrations

Acryl Data
DataBuck
DataHub
Orchestra
SDF
Secoda
Stonebranch
Amazon Redshift
Ascend
FairCom DB
FairCom EDGE
Feroot
IRI Voracity
Kedro
Netdata
New Relic
OpenMetadata
Oxla
Wavo
kPow
Claim Apache Airflow and update features and information
Claim Apache Airflow and update features and information