Recent changes to IB-stateless

IB-stateless modified by Lissa Valletta

Lissa Valletta — Wed, 13 Aug 2014 12:49:15 -0000

--- v3
+++ v4
@@ -1,4 +1,4 @@
-{{:Howto Warning}} 
+[[include ref=Howto_Warning]]

 For additional IB information, see also [Managing_the_Infiniband_Network].

IB-stateless modified by Bruce

Bruce — Mon, 23 Jun 2014 17:55:47 -0000

--- v2
+++ v3
@@ -1,3 +1,5 @@
+{{:Howto Warning}} 
+
 For additional IB information, see also [Managing_the_Infiniband_Network].

 Add IB to a stateless node

IB-stateless modified by Bruce

Bruce — Mon, 23 Jun 2014 17:55:46 -0000

--- v1
+++ v2
@@ -1,3 +1,5 @@
+For additional IB information, see also [Managing_the_Infiniband_Network]. 
+
 Add IB to a stateless node

 Typically we use the OFED stack. You can also try the default drivers that come with the operating system. We downloaded the distribution and extracted into /install/src/ofed1.4.

IB-stateless modified by Bruce

Bruce — Mon, 23 Jun 2014 17:55:45 -0000

Add IB to a stateless node

Typically we use the OFED stack. You can also try the default drivers that come with the operating system. We downloaded the distribution and extracted into /install/src/ofed1.4.

Don't forget to copy the .mlnx or .<something> configuration file into that directory too.

Then we just install the OFED package in the distro:

IMGROOT=/install/netboot/rhels5.3/x86_64/compute-ib/rootimg
yum --installroot=$IMGROOT -y install bind-utils rpm tcl tk glibc-devel.i386 pciutils expat
IBROOT=/install/src/ofed1.4
mount -o bind /proc $IMGROOT/proc
mount -o bind /sys $IMGROOT/sys
mount -o bind $IBROOT $IMGROOT/mnt
chroot $IMGROOT /mnt/mlnxofedinstall --basic --without-ib-bonding
umount $IMGROOT/mnt
umount $IMGROOT/sys
umount $IMGROOT/proc

Then you need to make a script that will bring up the IB interface. You can add something to rc.local to do that:

vim $IMGROOT/etc/rc.local

        ip_ib=`host $HOSTNAME-ib | awk '{ print $4 }'`
        ifconfig ib0 $ip_ib netmask 255.255.0.0

Pack your image and off you go!