Open Source Python Clustering Software - Page 3

RainforestCluster is an Amazon EC2 python program that manages and load-balances dynamic clusters to allow for maximum workflow flexibility and speed at minimal cost. It enables one to quickly and cheaply create dynamic compute clusters in the cloud, which can then run computational pipelines generically. It is also able to optimize the use of spot instances - idle computers in Amazon's cloud that are available at drastically reduced cost (5x-10x cheaper) - but can be terminated at any moment if capacity drops or the bid price rises. It also provides pre-installed features such as GlusterFS distributed filesystems, ThunderstormDistributor queuing system, RAID 0 /scratch, password-less ssh, and automatic cluster management, for ease of use and maximum processing speed for computational tools. Originally it was developed as a different version for the Wall Lab at Harvard CBMI.

Recall is a framework for building distributed, fault-tolerant, replicated storage servers.

The Portable Highly Available Sensors (PHASE) project aims at creating an example application that demonstrates the usage of Application Interface Specification service interfaces of the Service Availability Forum.

SSS-OSCAR is an integrated release of the SciDAC:Scalable System Software (SSS) suite using the OSCAR cluster installation framework. The SSS project seeks to provide a standard interface for effective management and utilization of terascale systems.

scAMOn Clients: Open Source clients of the Scali ScaMon cluster monitoring server

Scalable Cluster Environment (SCE) is a set of interoperable opensource tools that enable users to build and use Beowulf cluster effectively to solve their problems.

Command line tools designed to setup and manage the Lustre file system on a cluster.

Spilo is a Docker-based HA PostgreSQL cluster built on Patroni and heavily optimized for Kubernetes environments. It includes components for failover, streaming replication, backups, and connection pooling. Spilo is used in production by Zalando and is designed to provide a resilient, self-healing Postgres cluster with minimal manual intervention.

The purpose of this program is to prove that given a finite number of Monkeys and a finite amount of time one monkey will be able to make more money off the stock market than any human being. Checkout our web site for an uncorrupted download.

The Distribulator: Distributed Computing For The Rest Of Us. This is an SSH-based command execution and file transfer utility that includes support for batch, console, and shell integration modes, multiple server enviornments, and full audit logs.

ZFS is a system of automatically replicating file servers closely resembling CODA.

Interactive web monitor for PBS/Torque batch systems, focused on providing queue and detailed job information for users.

The web bases system that allows one user register himself in web interface and run bioinformatic tasks on multiple clusters.

Virtualinux allows the deployment and configuration of clusters of virtual machines. Virtual clusters are fault tolerant and can be copied, duplicated, snapshot, migrated, etc. Storage virtualization provides services for transparent expansion.

XtreemOS project aims at building a Linux-based operating system to support virtual organizations for next generation Grids.

Zeus Grid is a Grid Computing environment usefull to run systems in heterogenous machines at same time. In this first step, it will only compile, run and collect application results and file storage.

The ZSyncer project allows multiple Zopes to easily be manually synchronized by transferring data between them using xml-rpc. This can save a lot of time over the old export / transfer / import dance. See the home page for more information.

General purpose client/server python execution code. This code allows a server to serve a list of python codes to clients for execution. The client then sends the result (literally the value of the variable converted to a string) back to the server.

This tool lets you login with SSH to a group of machines and interact with them as if they were one machine. Each command that you enter is run in parallel on all machines in the group. The output from each machine is printed separately.

ipvsman is a ncurses GUI for the ipvs linux loabalancer. ipvsmand is a multithreaded lifekeeping daemon. This all-in-one solution makes it easy to steer ipvs in realtime with additional robust service lifekeeping.

A very lightweight Python program that executes commands on multiple Linux hosts in a user-designated number of threads via SSH. Intended for management for a large number of Linux/Unix nodes

A web-based monitor for PBS-based clusters (e.g. OpenPBS and Torque). It provides an overview of node usage, running jobs, and active users. It is built on the pbs-python libraries.

Python Integrated Parallel Programming EnviRonment (PIPPER), Python pre-parser that is designed to manage a pipeline, written in Python. It enables automated parallelization of loops. Think of it like OpenMP for Python, but it works in a computer cluster