Audience

Companies looking for a distributed Workflow Manager solution that helps solve the problem of Hadoop job dependencies

About Azkaban

Azkaban is a distributed Workflow Manager, implemented at LinkedIn to solve the problem of Hadoop job dependencies. We had jobs that needed to run in order, from ETL jobs to data analytics products. After version 3.0, we provide two modes: the stand alone “solo-server” mode and distributed multiple-executor mode. The following describes the differences between the two modes. In solo server mode, the DB is embedded H2 and both web server and executor server run in the same process. This should be useful if one just wants to try things out. It can also be used on small scale use cases. The multiple executor mode is for most serious production environment. Its DB should be backed by MySQL instances with master-slave set up. The web server and executor servers should ideally run in different hosts so that upgrading and maintenance shouldn’t affect users. This multiple host setup brings in robust and scalable aspect to Azkaban.

Other Popular Alternatives & Related Software
Huawei Cloud Resource Formation Service
Huawei Cloud Resource Formation Service
Resource Formation Service (RFS) automates cloud resources provisioning and application deployment based on templates you define. A graphical template designer and a large number of free sample templates enable you to intuitively and easily create custom templates. You only need to describe the final state of resources in a template, which frees you from complex operations. You do not need to install software, prepare an executor, or manage underlying files or data. You can generate an execution template by dragging resources, which reduces the learning curve. Visualized compliance control policies prevent security risks caused by resource changes. Resource deployment rollback, resource status query, and resource operation trace are supported. Compatibility with HCL syntax eliminates an extra learning curve. You can deploy or delete a template in one click without complex manual operations.
Learn more
Kraken CI
Kraken CI
Modern CI/CD, open-source, on-premise system that is highly scalable and focused on testing. Features: - flexible workflow planning using Starlark/Python - distributed building and testing - various executors: bare metal, Docker, LXD - highly scalable to thousands of executors - sophisticated test results analysis - integrated with AWS EC2 and ECS, Azure VM, with autoscaling - supported webhooks from GitHub, GitLab and Gitea - email and Slack notifications
Learn more
Subspace
Subspace
Subspace is a fourth-generation blockchain built for the next wave of crypto creators. Energy-intensive mining and capital-intensive staking are replaced with a new form of disk-based farming. We leverage key academic research to resolve the blockchain trilemma without sacrificing security or decentralization. Archiving the history of the blockchain ecosystem allows for simple, secure, and trustless bridges between networks. Farmers store unique segments of history allowing the blockchain to bloat without sacrificing decentralization. Executors process smart contracts and maintain the blockchain state, keeping farming lightweight and decentralized. Designed from first principles for maximum decentralization, community ownership, and on-chain governance. We are backing up every block across the Polkadot and Kusama Networks as a public good for the benefit of the ecosystem.
Learn more
PragmaDev Process
PragmaDev Process
PragmaDev Process is a simple and powerful tool that aims at helping business process modelers to verify their models. Complex organizations or systems operations are based on processes described in graphical models. The most popular notation is BPMN (Business Process Model and Notation). It describes what the different participants in a process do and how they interact with each other. These processes must be thoroughly discussed before they are applied in a real situation. Any misunderstanding of the process might lead to a catastrophic situation in operation. Based on BPMN standard semantic, the modeler can execute the process step by step. The tool will outline the possible choices at each step of execution. There is no possible human interpretation leading to misunderstanding. PragmaDev Process is a BPMN editor, executor, and verifier. It is the outcome of a 2 years research project with the French Army, Eurocontrol, and Airbus DS.
Learn more

Integrations

See Integrations

Ratings/Reviews

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Company Information

Azkaban
azkaban.github.io

Videos and Screen Captures

Azkaban Screenshot 1
Azkaban Screenshot 1
Other Useful Business Software
Run applications fast and securely in a fully managed environment Icon
Run applications fast and securely in a fully managed environment

Cloud Run is a fully-managed compute platform that lets you run your code in a container directly on top of scalable infrastructure.

Run frontend and backend services, batch jobs, deploy websites and applications, and queue processing workloads without the need to manage infrastructure.
Try for free

Product Details

Platforms Supported
Cloud
Training
Documentation
Support
Online

Azkaban Frequently Asked Questions

Q: What kinds of users and organization types does Azkaban work with?
Q: What languages does Azkaban support in their product?
Q: What kind of support options does Azkaban offer?
Q: What other applications or services does Azkaban integrate with?
Q: What type of training does Azkaban provide?

Azkaban Product Features