Search Results for "multiple ssh"

Shift is a lightweight framework for high performance local and remote file transfers that provides resiliency across a wide variety of failure scenarios through various techniques. These include end-to-end integrity via cryptographic hashes, throttling of transfers to prevent resource exhaustion, balancing transfers across resources based on load and availability, and parallelization of transfers across multiple source and destination hosts for increased redundancy and performance.

Useful to split up jobs over multiple CPU cores or even multiple computers. Examples: tar -cf - /bigdirectory | splitjob -j 4 gzip > big.tar.gz splitjob "ssh h1 bzip2" "ssh h2 bzip2" < f > f.bz2

RainforestCluster is an Amazon EC2 python program that manages and load-balances dynamic clusters to allow for maximum workflow flexibility and speed at minimal cost. It enables one to quickly and cheaply create dynamic compute clusters in the cloud, which can then run computational pipelines generically. It is also able to optimize the use of spot instances - idle computers in Amazon's cloud that are available at drastically reduced cost (5x-10x cheaper) - but can be terminated at any...

PyDSH is a remote administration tool, consisting of pydsh and pydcp. Pydsh allows you to run a command on multiple hosts in parallel over RSH, SSH or Telnet, OR manage your SSH public keys. The pydcp command allows copying files to/from multiple hosts.

A very lightweight Python program that executes commands on multiple Linux hosts in a user-designated number of threads via SSH. Intended for management for a large number of Linux/Unix nodes

Mrtools (Multi remote tools) are a set of multi-threaded system tools to manage large distributed environments including file distribution collection and concurrent shell script or command execution. MrTools is written in Perl and utilizes ssh and rsync.

central-ssh (cssh) is a Perl program that allows systems administrators to run multiple arbitrary commands on multiple arbitrary hosts from one central host. Straight CLI or config file can be used.