Search Results for "compute cluster"

dispy is a generic and comprehensive, yet easy to use framework for creating and using compute clusters to execute computations in parallel across multiple processors in a single machine (SMP), among many machines in a cluster, grid or cloud. dispy is well suited for data parallel (SIMD) paradigm where a computation (Python function or standalone program) is evaluated with different (large) datasets independently. dispy supports public / private / hybrid cloud computing, fog / edge computing.

This roll provides rpm packages to mount the lustre filesystem on the frontends and compute nodes of a rocks cluster. Please contact me if you need this roll for another kernel and/or lustre version.

ThunderstormDistributor is a queuing system that distributes jobs and computational workload across dynamic clusters in the cloud. It manages the assignment of jobs to maximize CPU and memory usage and prevent oversubscription of compute nodes. It also performs advanced statistics collection on individual compute nodes and jobs to graph the distribution of disk, network, CPU, and memory usage over time, which facilitates the advanced optimization and tuning of computational workflows.

RainforestCluster is an Amazon EC2 python program that manages and load-balances dynamic clusters to allow for maximum workflow flexibility and speed at minimal cost. It enables one to quickly and cheaply create dynamic compute clusters in the cloud, which can then run computational pipelines generically. It is also able to optimize the use of spot instances - idle computers in Amazon's cloud that are available at drastically reduced cost (5x-10x cheaper) - but can be terminated at any moment if capacity drops or the bid price rises. It also provides pre-installed features such as GlusterFS distributed filesystems, ThunderstormDistributor queuing system, RAID 0 /scratch, password-less ssh, and automatic cluster management, for ease of use and maximum processing speed for computational tools. ...

SCR caches checkpoint data in storage on the compute nodes of a Linux cluster to provide a fast, scalable checkpoint / restart capability for MPI codes.

SJM is a tool for managing jobs running on a compute cluster with a job scheduler such as Sun Grid Engine or Platform LSF. Use it to manage dependencies between jobs, monitor job completion status, restart failed jobs without rerunning jobs that finished successfully, and more!

PPIV is a parallel software application used in Particle Image Velocimetry (PIV) analysis. The software will compute the vector field for one image pair or multiple image pairs. PPIV can run on a single desktop machine or in a cluster environment.

A set of documentation and scripts to install, configure, and manage the open-source darwin OS for use in a compute cluster environment.