kluster / Wiki / GettingStarted

Tools for GridEngine+NFS administration on EC2

GettingStarted

Getting Started with Kluster

Everything here assumes you are in some kind of Unix-like environment. The current writer is doing the client-side scripting mostly from a Mac laptop, but this should work from any type of UNIX or even cygwin.

You need to have Subversion (svn) installed, so you can download the Kluster scripts to your machine. Once you have it installed, type, from your home directory:

svn co svn://svn.code.sf.net/p/kluster/code/trunk kluster

Then cd kluster. You now need to install Amazon's "EC2 API tools". These are command-line tools with names like ec2-describe-instances (and short-form names like ec2din in this case), that allow you to do the things you could do from Amazon's Web-based EC2 console, from the command line. We provide a script that will install those tools and also set up some necessary paths for you in a file called vars.sh. From the directory kluster, type the command bin/install_ec2_tools.sh. The output should look like the following:

# bin/install-ec2-tools.sh
Linking ec2-api-tools-1.6.7.1 to ec2
Putting the line  export KLUSTER_HOME=/Users/danielpovey/kluster  in ./vars.sh

Then type

. vars.sh

This will source certain variables in vars.sh that will enable you to run the ec2 tools. If it gives you warnings, it will be because Java was not installed or was not found, so you may have to install java. Caution: if you did not know that . vars.sh has the same effect as pasting the contents of vars.sh into the current shell, then stop here. You do not know enough UNIX to administer systems using our tools. You have too much to learn, and we cannot teach you.

OK. By this point you have downloaded the EC2 API tools and the kluster scripts, and you have the basic software prerequisites on the client side. The next stage is getting your security keys set up.

Next: Getting your Amazon Web Services (AWS) keys set up.
Up: Kluster Wiki

Tal Weiss - 2014-09-18

The script name is "bin/install-ec2-tools.sh" not "bin/install_ec2_tools.sh".

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
- Daniel Povey - 2014-09-18
  
  Thanks, will fix this.
  Dan
  
  On Thu, Sep 18, 2014 at 1:59 AM, Tal Weiss majortal@users.sf.net wrote:
  
  The script name is "bin/install-ec2-tools.sh" not
  "bin/install_ec2_tools.sh".
  
  Sent from sourceforge.net because you indicated interest in
  https://sourceforge.net/p/kluster/wiki/GettingStarted/
  
  To unsubscribe from further messages, please visit
  https://sourceforge.net/auth/subscriptions/
  
  alternate
  
  If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
  - Daniel Povey - 2014-09-18
    
    BTW, I have been told that StarCluster now has GPU instances, so that may
    be an easier route.
    Dan
    
    On Thu, Sep 18, 2014 at 2:01 AM, Daniel Povey dpovey@gmail.com wrote:
    
    Thanks, will fix this.
    Dan
    
    On Thu, Sep 18, 2014 at 1:59 AM, Tal Weiss majortal@users.sf.net wrote:
    
    The script name is "bin/install-ec2-tools.sh" not
    "bin/install_ec2_tools.sh".
    
    Sent from sourceforge.net because you indicated interest in
    https://sourceforge.net/p/kluster/wiki/GettingStarted/
    
    To unsubscribe from further messages, please visit
    https://sourceforge.net/auth/subscriptions/
    
    alternate
    
    If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

kluster Wiki

Tools for GridEngine+NFS administration on EC2

GettingStarted

Getting Started with Kluster

Related

Discussion