Open Source Python Clustering Software - Page 3

The aim of the OpenGrid project is to enable personal high-performance grid computations. More specific, issues of configuration, deployment, controlling and monitoring of embarrassingly parallel computations are addressed.

Pluster is a cluster management software developed with python. It is easy to install and maintain. Pluster Provides cluster performance monitoring and remote OS installing. It's future will be an agent-based management system.

PuSSH is Pythonic, Ubiquitous SSH, a Python wrapper/script that runs commands in parallel on clusters/ranges of linux/unix machines via SSH, ideally where SSH is configured to use Kerberos, RSA/DSA keys, or ssh-agent as to avoid password authentication.

PyGFS is a reliable and secure distributed file system that runs completely in userspace. It supports x509 certificate authentication, authorization and encryption mechanisms to provide secure access over insecure networks.

This package provides Python bindings to the OpenPBS C API. All functions of the OpenPBS C library can be accessed in Python through the use of this package. We provide extensive documentation on the usage and lots of examples.

RainforestCluster is an Amazon EC2 python program that manages and load-balances dynamic clusters to allow for maximum workflow flexibility and speed at minimal cost. It enables one to quickly and cheaply create dynamic compute clusters in the cloud, which can then run computational pipelines generically. It is also able to optimize the use of spot instances - idle computers in Amazon's cloud that are available at drastically reduced cost (5x-10x cheaper) - but can be terminated at any moment if capacity drops or the bid price rises. It also provides pre-installed features such as GlusterFS distributed filesystems, ThunderstormDistributor queuing system, RAID 0 /scratch, password-less ssh, and automatic cluster management, for ease of use and maximum processing speed for computational tools. Originally it was developed as a different version for the Wall Lab at Harvard CBMI.

The Portable Highly Available Sensors (PHASE) project aims at creating an example application that demonstrates the usage of Application Interface Specification service interfaces of the Service Availability Forum.

SSS-OSCAR is an integrated release of the SciDAC:Scalable System Software (SSS) suite using the OSCAR cluster installation framework. The SSS project seeks to provide a standard interface for effective management and utilization of terascale systems.

scAMOn Clients: Open Source clients of the Scali ScaMon cluster monitoring server

Command line tools designed to setup and manage the Lustre file system on a cluster.

The purpose of this program is to prove that given a finite number of Monkeys and a finite amount of time one monkey will be able to make more money off the stock market than any human being. Checkout our web site for an uncorrupted download.

The Distribulator: Distributed Computing For The Rest Of Us. This is an SSH-based command execution and file transfer utility that includes support for batch, console, and shell integration modes, multiple server enviornments, and full audit logs.

ZFS is a system of automatically replicating file servers closely resembling CODA.

Interactive web monitor for PBS/Torque batch systems, focused on providing queue and detailed job information for users.

The web bases system that allows one user register himself in web interface and run bioinformatic tasks on multiple clusters.

Virtualinux allows the deployment and configuration of clusters of virtual machines. Virtual clusters are fault tolerant and can be copied, duplicated, snapshot, migrated, etc. Storage virtualization provides services for transparent expansion.

XtreemOS project aims at building a Linux-based operating system to support virtual organizations for next generation Grids.

Zeus Grid is a Grid Computing environment usefull to run systems in heterogenous machines at same time. In this first step, it will only compile, run and collect application results and file storage.

The ZSyncer project allows multiple Zopes to easily be manually synchronized by transferring data between them using xml-rpc. This can save a lot of time over the old export / transfer / import dance. See the home page for more information.

General purpose client/server python execution code. This code allows a server to serve a list of python codes to clients for execution. The client then sends the result (literally the value of the variable converted to a string) back to the server.

This tool lets you login with SSH to a group of machines and interact with them as if they were one machine. Each command that you enter is run in parallel on all machines in the group. The output from each machine is printed separately.

A web-based monitor for PBS-based clusters (e.g. OpenPBS and Torque). It provides an overview of node usage, running jobs, and active users. It is built on the pbs-python libraries.

Python Integrated Parallel Programming EnviRonment (PIPPER), Python pre-parser that is designed to manage a pipeline, written in Python. It enables automated parallelization of loops. Think of it like OpenMP for Python, but it works in a computer cluster