Search Results for "compute cluster"

aws-parallelcluster-node is the python package installed on the Amazon EC2 instances launched as part of AWS ParallelCluster. AWS ParallelCluster is an AWS-supported Open Source cluster management tool that makes it easy for you to deploy and manage High-Performance Computing (HPC) clusters in the AWS cloud. Built on the Open Source CfnCluster project, AWS ParallelCluster enables you to quickly build an HPC compute environment in AWS. It automatically sets up the required compute resources and a shared filesystem and offers a variety of batch schedulers such as AWS Batch and Slurm. ...

PelicanHPC is an iso-hybrid (CD or USB) image that let's you set up a high performance computing cluster in a few minutes. A Pelican cluster allows you to do parallel computing using MPI. You can run Pelican on a single multiple core machine to use all cores to solve a problem, or you can network multiple computers together to make a cluster. The frontend node (either a real computer or a virtual machine) boots from the image. The compute nodes boot by PXE, using the frontend node as the server. ...

A collection of bash scripts to manage Gentoo System Images (GSIs), compute nodes, file servers and users on a Gentoo-based HPC cluster. GCMT works with PXE boot, dhcp, tftp, qmail, djbdns and tinydns, NIS, NFS, and TORQUE.

dispy is a generic and comprehensive, yet easy to use framework for creating and using compute clusters to execute computations in parallel across multiple processors in a single machine (SMP), among many machines in a cluster, grid or cloud. dispy is well suited for data parallel (SIMD) paradigm where a computation (Python function or standalone program) is evaluated with different (large) datasets independently. dispy supports public / private / hybrid cloud computing, fog / edge computing.

progrep is a command-line tool (Linux) to show live progress report, status & stats of a running simulation or compute job that executes a given number of iterations. It shows % completed, time remaining, time elapsed, number of threads, MPI_Rank(if any), CPU usage & speed (FPS). The FPS measures may be used in benchmarking, e.g. while optimizing HPC algorithms for performance. progrep supports both single-threaded and parallel (multicore/multinode - e.g. OpenMP/MPI) jobs. progrep can...

Manage node sets, node groups and execute commands on cluster nodes in parallel. Provides an event-based Python library to improve administration of large compute clusters or server farms. Command line tools: clush and nodeset included.

This roll provides rpm packages to mount the lustre filesystem on the frontends and compute nodes of a rocks cluster. Please contact me if you need this roll for another kernel and/or lustre version.

ThunderstormDistributor is a queuing system that distributes jobs and computational workload across dynamic clusters in the cloud. It manages the assignment of jobs to maximize CPU and memory usage and prevent oversubscription of compute nodes. It also performs advanced statistics collection on individual compute nodes and jobs to graph the distribution of disk, network, CPU, and memory usage over time, which facilitates the advanced optimization and tuning of computational workflows.

RainforestCluster is an Amazon EC2 python program that manages and load-balances dynamic clusters to allow for maximum workflow flexibility and speed at minimal cost. It enables one to quickly and cheaply create dynamic compute clusters in the cloud, which can then run computational pipelines generically. It is also able to optimize the use of spot instances - idle computers in Amazon's cloud that are available at drastically reduced cost (5x-10x cheaper) - but can be terminated at any moment if capacity drops or the bid price rises. It also provides pre-installed features such as GlusterFS distributed filesystems, ThunderstormDistributor queuing system, RAID 0 /scratch, password-less ssh, and automatic cluster management, for ease of use and maximum processing speed for computational tools. ...

Cbench is intended as a relatively straightforward toolbox of tests, benchmarks, applications, utilities, and framework to hold them together with the goal to facilitate scalable testing, benchmarking, and analysis of a Linux parallel compute cluster.

Tuda-rsync_install is a initrd image containing scripts to partition and rsync a rootfs to compute, or other nodes. A fast, easy and flexible solution not only for HPC systems, although it has been developed for that purpose.

SCR caches checkpoint data in storage on the compute nodes of a Linux cluster to provide a fast, scalable checkpoint / restart capability for MPI codes.

birgHPCC is a major improvement over birgHPC (http://sourceforge.net/projects/birghpc/). While retaining the major functions of the original birgHPC, including automated computing cluster conversion and auto slots detection, the new version (birgHPCC) is capable of creating and configuring a compute unified device architecture (CUDA) computing cluster, hence the extra “C” in the name. In addition to the increase in image size (less than 2 gigabytes) and a new Linux base (previously Debian, now Ubuntu), CUDA-capable bioinformatics software programs, such as NAMD, HOOMD-blue, VMD, GPU-HMMER and GPU-BLAST, are pre-installed in birgHPCC, along with the CUDA driver, libraries and software development kit (SDK). ...

SJM is a tool for managing jobs running on a compute cluster with a job scheduler such as Sun Grid Engine or Platform LSF. Use it to manage dependencies between jobs, monitor job completion status, restart failed jobs without rerunning jobs that finished successfully, and more!

PPIV is a parallel software application used in Particle Image Velocimetry (PIV) analysis. The software will compute the vector field for one image pair or multiple image pairs. PPIV can run on a single desktop machine or in a cluster environment.

Cbench is intended to be a relatively straightforward collection of tests, benchmarks, applications, utilities, and framework to hold them together with the goal to facilitate scalable testing and benchmarking of a Linux parallel compute cluster.