Amazon MWAA

Amazon MWAA

Amazon
Apache Spark

Apache Spark

Apache Software Foundation
+
+

Related Products

  • dbt
    251 Ratings
    Visit Website
  • DataBuck
    6 Ratings
    Visit Website
  • Teradata VantageCloud
    1,107 Ratings
    Visit Website
  • Apryse PDF SDK
    153 Ratings
    Visit Website
  • Parasoft
    143 Ratings
    Visit Website
  • ActiveBatch Workload Automation
    371 Ratings
    Visit Website
  • Apify
    1,291 Ratings
    Visit Website
  • QuantaStor
    6 Ratings
    Visit Website
  • Dynamo Software
    68 Ratings
    Visit Website
  • Gemini Enterprise Agent Platform
    961 Ratings
    Visit Website

About

Amazon Managed Workflows for Apache Airflow (MWAA) is a managed orchestration service for Apache Airflow that makes it easier to set up and operate end-to-end data pipelines in the cloud at scale. Apache Airflow is an open-source tool used to programmatically author, schedule, and monitor sequences of processes and tasks referred to as “workflows.” With Managed Workflows, you can use Airflow and Python to create workflows without having to manage the underlying infrastructure for scalability, availability, and security. Managed Workflows automatically scales its workflow execution capacity to meet your needs, and is integrated with AWS security services to help provide you with fast and secure access to data.

About

Apache Spark™ is a unified analytics engine for large-scale data processing. Apache Spark achieves high performance for both batch and streaming data, using a state-of-the-art DAG scheduler, a query optimizer, and a physical execution engine. Spark offers over 80 high-level operators that make it easy to build parallel apps. And you can use it interactively from the Scala, Python, R, and SQL shells. Spark powers a stack of libraries including SQL and DataFrames, MLlib for machine learning, GraphX, and Spark Streaming. You can combine these libraries seamlessly in the same application. Spark runs on Hadoop, Apache Mesos, Kubernetes, standalone, or in the cloud. It can access diverse data sources. You can run Spark using its standalone cluster mode, on EC2, on Hadoop YARN, on Mesos, or on Kubernetes. Access data in HDFS, Alluxio, Apache Cassandra, Apache HBase, Apache Hive, and hundreds of other data sources.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Organizations searching for a secure, and managed workflow orchestration solution for Apache Airflow

Audience

Organizations that want a unified analytics engine for large-scale data processing

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

$0.49 per hour
Free Version
Free Trial

Pricing

No information available.
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

Amazon
Founded: 1994
United States
aws.amazon.com/managed-workflows-for-apache-airflow/

Company Information

Apache Software Foundation
Founded: 1999
United States
spark.apache.org

Alternatives

Alternatives

dbt

dbt

dbt Labs
Apache Airflow

Apache Airflow

The Apache Software Foundation
AWS Glue

AWS Glue

Amazon
MLlib

MLlib

Apache Software Foundation

Categories

Categories

Streaming Analytics Features

Data Enrichment
Data Wrangling / Data Prep
Multiple Data Source Support
Process Automation
Real-time Analysis / Reporting
Visualization Dashboards

Integrations

Alibaba Log Service
Alluxio
Apache HBase
Apache Hudi
Apache Kylin
Archon Data Store
Astro by Astronomer
BentoML
DataHub
Hue
IBM Analytics Engine
IBM Analytics for Apache Spark
JanusGraph
JupyterLab
Kylo
Lyftrondata
Mage Platform
NVIDIA RAPIDS
Querona
Sifflet

Integrations

Alibaba Log Service
Alluxio
Apache HBase
Apache Hudi
Apache Kylin
Archon Data Store
Astro by Astronomer
BentoML
DataHub
Hue
IBM Analytics Engine
IBM Analytics for Apache Spark
JanusGraph
JupyterLab
Kylo
Lyftrondata
Mage Platform
NVIDIA RAPIDS
Querona
Sifflet
Claim Amazon MWAA and update features and information
Claim Amazon MWAA and update features and information
Claim Apache Spark and update features and information
Claim Apache Spark and update features and information