Search Results for "anything"

...The purpose of Luigi is to address all the plumbing typically associated with long-running batch processes. You want to chain many tasks, automate them, and failures will happen. These tasks can be anything, but are typically long running things like Hadoop jobs, dumping data to/from databases, running machine learning algorithms, or anything else. You can build pretty much any task you want, but Luigi also comes with a toolbox of several common task templates that you use. It includes support for running Python mapreduce jobs in Hadoop, as well as Hive, and Pig, jobs. ...

...It can be used for automated remediation to immediately troubleshoot and fix problems when failures occur; it can be used for continuous deployment; it can create a fast and automated security response and so much more. StackStorm integrates with your existing processes or workflows, so there's no need to change anything. It's currently being used and trusted by a number of big enterprises, including Netflix, Cisco and NASA.