Apache Airflow

Apache Airflow

The Apache Software Foundation
Hopsworks

Hopsworks

Logical Clocks
+
+

Related Products

  • ActiveBatch Workload Automation
    371 Ratings
    Visit Website
  • dbt
    251 Ratings
    Visit Website
  • JS7 JobScheduler
    1 Rating
    Visit Website
  • JAMS
    265 Ratings
    Visit Website
  • Stonebranch
    182 Ratings
    Visit Website
  • RunMyJobs by Redwood
    425 Ratings
    Visit Website
  • DataBuck
    6 Ratings
    Visit Website
  • Pipeliner CRM
    750 Ratings
    Visit Website
  • Wrike
    7,547 Ratings
    Visit Website
  • Teradata VantageCloud
    1,107 Ratings
    Visit Website

About

Airflow is a platform created by the community to programmatically author, schedule and monitor workflows. Airflow has a modular architecture and uses a message queue to orchestrate an arbitrary number of workers. Airflow is ready to scale to infinity. Airflow pipelines are defined in Python, allowing for dynamic pipeline generation. This allows for writing code that instantiates pipelines dynamically. Easily define your own operators and extend libraries to fit the level of abstraction that suits your environment. Airflow pipelines are lean and explicit. Parametrization is built into its core using the powerful Jinja templating engine. No more command-line or XML black-magic! Use standard Python features to create your workflows, including date time formats for scheduling and loops to dynamically generate tasks. This allows you to maintain full flexibility when building your workflows.

About

Hopsworks is an open-source Enterprise platform for the development and operation of Machine Learning (ML) pipelines at scale, based around the industry’s first Feature Store for ML. You can easily progress from data exploration and model development in Python using Jupyter notebooks and conda to running production quality end-to-end ML pipelines, without having to learn how to manage a Kubernetes cluster. Hopsworks can ingest data from the datasources you use. Whether they are in the cloud, on‑premise, IoT networks, or from your Industry 4.0-solution. Deploy on‑premises on your own hardware or at your preferred cloud provider. Hopsworks will provide the same user experience in the cloud or in the most secure of air‑gapped deployments. Learn how to set up customized alerts in Hopsworks for different events that are triggered as part of the ingestion pipeline.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Anyone who wants to to programmatically author, schedule and monitor workflows

Audience

Data science teams seeking a solution to transform data into features

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

No information available.
Free Version
Free Trial

Pricing

$1 per month
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

The Apache Software Foundation
Founded: 1999
United States
airflow.apache.org

Company Information

Logical Clocks
Founded: 2016
Sweden
www.logicalclocks.com/hopsworks

Alternatives

JAMS

JAMS

JAMS Software

Alternatives

DATAGYM

DATAGYM

eForce21
dbt

dbt

dbt Labs
Amazon MWAA

Amazon MWAA

Amazon
BIRD Analytics

BIRD Analytics

Lightning Insights

Categories

Categories

Artificial Intelligence Features

Chatbot
For eCommerce
For Healthcare
For Sales
Image Recognition
Machine Learning
Multi-Language
Natural Language Processing
Predictive Analytics
Process/Workflow Automation
Rules-Based Automation
Virtual Personal Assistant (VPA)

Big Data Features

Collaboration
Data Blends
Data Cleansing
Data Mining
Data Visualization
Data Warehousing
High Volume Processing
No-Code Sandbox
Predictive Analytics
Templates

Data Analysis Features

Data Discovery
Data Visualization
High Volume Processing
Predictive Analytics
Regression Analysis
Sentiment Analysis
Statistical Modeling
Text Analytics

Data Management Features

Customer Data
Data Analysis
Data Capture
Data Integration
Data Migration
Data Quality Control
Data Security
Information Governance
Master Data Management
Match & Merge

Machine Learning Features

Deep Learning
ML Algorithm Library
Model Training
Natural Language Processing (NLP)
Predictive Modeling
Statistical / Mathematical Tools
Templates
Visualization

Integrations

Acryl Data
Ascend
Chalk
DQOps
DataHub
Determined AI
DoubleCloud
IBM watsonx.data integration
IRI FieldShield
JAMS
MaxPatrol
Microsoft Purview
Netdata
Onehouse
OpenMetadata
Orchestra
Ray
Secoda
Stackable
Tobiko

Integrations

Acryl Data
Ascend
Chalk
DQOps
DataHub
Determined AI
DoubleCloud
IBM watsonx.data integration
IRI FieldShield
JAMS
MaxPatrol
Microsoft Purview
Netdata
Onehouse
OpenMetadata
Orchestra
Ray
Secoda
Stackable
Tobiko
Claim Apache Airflow and update features and information
Claim Apache Airflow and update features and information
Claim Hopsworks and update features and information
Claim Hopsworks and update features and information