Audience

Companies looking for a distributed Workflow Manager solution that helps solve the problem of Hadoop job dependencies

About Azkaban

Azkaban is a distributed Workflow Manager, implemented at LinkedIn to solve the problem of Hadoop job dependencies. We had jobs that needed to run in order, from ETL jobs to data analytics products. After version 3.0, we provide two modes: the stand alone “solo-server” mode and distributed multiple-executor mode. The following describes the differences between the two modes. In solo server mode, the DB is embedded H2 and both web server and executor server run in the same process. This should be useful if one just wants to try things out. It can also be used on small scale use cases. The multiple executor mode is for most serious production environment. Its DB should be backed by MySQL instances with master-slave set up. The web server and executor servers should ideally run in different hosts so that upgrading and maintenance shouldn’t affect users. This multiple host setup brings in robust and scalable aspect to Azkaban.

Other Popular Alternatives & Related Software
PCOV
PCOV
A self-contained CodeCoverage compatible driver for PHP. When PCOV is left unset, PCOV will attempt to find src, lib or, app in the current working directory, in that order; If none are found the current directory will be used, which may waste resources storing coverage information for the test suite. If PCOV contains test code, it's recommended to set the exclude command to avoid wasting resources. To avoid unnecessary allocation of additional arenas for traces and control flow graphs, PCOV should be set according to the memory required by the test suite. To avoid reallocation of tables, PCOV should be set to a number higher than the number of files that will be loaded during testing, inclusive of test files. interoperability with Xdebug is not possible. At an internal level, the executor function is overridden by PCOV, so any extension or SAPI which does the same will be broken. PCOV is zero cost, code runs at full speed.
Learn more
Bupsy
Bupsy
Bupsy is a native macOS application for creating and coordinating teams of AI bots on a Mac. Users assign each bot a role and can trigger work on a schedule, when files change, or when another bot hands off a task. The app shows bot states such as ready, working, awaiting input, complete, asleep, or stuck. It includes routines, scheduled goals, group chats with @mentions, and lead bots that coordinate teammates. Per-bot trust levels can require approval before actions beyond reading, and an audit log records activity. Bupsy uses Claude Code or Codex through the user's own sign-in and subscription, and connects to services such as Gmail, Notion, Linear, and MCP servers through Executor. Conversations are stored on the user's Mac. It is intended for developers and individuals who want to manage recurring AI-assisted tasks locally.
Learn more
Kraken CI
Kraken CI
Modern CI/CD, open-source, on-premise system that is highly scalable and focused on testing. Features: - flexible workflow planning using Starlark/Python - distributed building and testing - various executors: bare metal, Docker, LXD - highly scalable to thousands of executors - sophisticated test results analysis - integrated with AWS EC2 and ECS, Azure VM, with autoscaling - supported webhooks from GitHub, GitLab and Gitea - email and Slack notifications
Learn more
PragmaDev Process
PragmaDev Process
PragmaDev Process is a simple and powerful tool that aims at helping business process modelers to verify their models. Complex organizations or systems operations are based on processes described in graphical models. The most popular notation is BPMN (Business Process Model and Notation). It describes what the different participants in a process do and how they interact with each other. These processes must be thoroughly discussed before they are applied in a real situation. Any misunderstanding of the process might lead to a catastrophic situation in operation. Based on BPMN standard semantic, the modeler can execute the process step by step. The tool will outline the possible choices at each step of execution. There is no possible human interpretation leading to misunderstanding. PragmaDev Process is a BPMN editor, executor, and verifier. It is the outcome of a 2 years research project with the French Army, Eurocontrol, and Airbus DS.
Learn more

Integrations

See Integrations

Ratings/Reviews

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Company Information

Azkaban
azkaban.github.io

Videos and Screen Captures

Azkaban Screenshot 1
Azkaban Screenshot 1
Other Useful Business Software
Host LLMs in Production With On-Demand GPUs Icon
Host LLMs in Production With On-Demand GPUs

NVIDIA L4 GPUs. 5-second cold starts. Scale to zero when idle.

Deploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
Start Free

Product Details

Platforms Supported
Cloud
Training
Documentation
Support
Online

Azkaban Frequently Asked Questions

Q: What kinds of users and organization types does Azkaban work with?
Q: What languages does Azkaban support in their product?
Q: What kind of support options does Azkaban offer?
Q: What other applications or services does Azkaban integrate with?
Q: What type of training does Azkaban provide?

Azkaban Product Features