Recent changes to Guide

Guide modified by Antonio Barbalace

Antonio Barbalace — Tue, 10 Jun 2014 19:54:10 -0000

--- v10
+++ v11
@@ -84,8 +84,18 @@
     # wget http://sourceforge.net/projects/mpssvt/files/initramfs-3.2.14%2Bmpss3.2.cpio.gz/download
     # cp initramfs-3.2.14+mpss3.2.cpio.gz /usr/share/mpss/boot/

-In order to tell the MPSS that we would like to use this new base CPIO image instead of the previous one we should update the MIC co-processor configuration. Open ***/etc/mpss/mic0.conf*** with your favorite editor and add the following 
+In order to tell the MPSS that we would like to use this new base CPIO image instead of the previous one we should update the MIC co-processor configuration. Open ***/etc/mpss/mic0.conf*** with your favorite editor and identify the following line:

+    Base CPIO /usr/share/mpss/boot/initramfs-knightscorner.cpio.gz
+
+it should be modified in:
+
+    Base CPIO /usr/share/mpss/boot/initramfs-3.2.14+mpss3.2.cpio.gz
+
+at this point we should re-run the script ***mpss_base_cpio.sh*** in order to update the final image loaded on the MIC co-processor.
+
+    # cd ../mpssvt-linux
+    # ./mpss_base_cpio.sh install

 Restarting MPSS

Guide modified by Antonio Barbalace

Antonio Barbalace — Tue, 10 Jun 2014 19:49:25 -0000

--- v9
+++ v10
@@ -73,6 +73,21 @@
 This step should conclude the installation.

+Upgrading the CPIO
+------------------
+
+This step is optional and should be considered only if after restarting the MPSS, during the next step, the MIC is not able to boot (i.e. restarting failure).
+
+Download the latest base image from the repository and copy it in the default images location.
+
+    # cd ..
+    # wget http://sourceforge.net/projects/mpssvt/files/initramfs-3.2.14%2Bmpss3.2.cpio.gz/download
+    # cp initramfs-3.2.14+mpss3.2.cpio.gz /usr/share/mpss/boot/
+
+In order to tell the MPSS that we would like to use this new base CPIO image instead of the previous one we should update the MIC co-processor configuration. Open ***/etc/mpss/mic0.conf*** with your favorite editor and add the following 
+
+
+
 Restarting MPSS
 ---------------

Guide modified by Antonio Barbalace

Antonio Barbalace — Tue, 10 Jun 2014 19:15:27 -0000

--- v8
+++ v9
@@ -35,7 +35,7 @@

     #  make ARCH=k1om CROSS_COMPILE=k1om-mpss-linux- KBUILD_NOPEDANTIC=1 -j 8 bzImage

-To install the kernel image please use the script ***mpss_install_bzImage.sh*** available in the kernel root directory. This script assume a standard MPSS 3.2 installation in order to work (i.e. please modify the script according to your installation).
+To install the kernel image please use the script ***mpss_install_bzImage.sh*** available in the kernel root directory. This script assumes a standard MPSS 3.2 installation in order to work (i.e. please modify the script according to your installation).

     # ./mpss_install_bzImage.sh

@@ -65,13 +65,12 @@

 The above commands provide for installation in the default ***/var/mpss/mic0/*** folder. Please change it accordingly to your setup.

+In order for this changes to take effect please use the script ***mpss_base_cpio.sh*** in the mpssvt-linux directory. Again, this script assumes a standard MPSS 3.2 installation in order to work (i.e. please modify the script according to your installation).

-Upgrading the FS Image
-----------------------
+    # cd ../mpssvt-linux
+    # ./mpss_base_cpio.sh install

-TODO --- the following is to be updated (was there before?!)
-
-    Base CPIO /usr/share/mpss/boot/initramfs-3.2.14+mpss3.2.cpio.gz
+This step should conclude the installation.

 Restarting MPSS

Guide modified by Antonio Barbalace

Antonio Barbalace — Tue, 10 Jun 2014 19:08:32 -0000

--- v7
+++ v8
@@ -55,16 +55,15 @@
 Upgrading the Modules
 ---------------------

-Download the latest modules version from the git repository, and compile them. In this case there is no configuration step, but you should know where your Linux kernel is. We assume the Linux kernel directory is contained in the same folder as the modules directory. (Remember to exit mpssvt-linux directory first.)
+Download the latest Modules version from the git repository, compile and install it. In this case there is no configuration step. The following assumes that the Linux kernel directory is contained in the same folder as the Modules directory. (Remember to exit mpssvt-linux directory first.)

     # cd ..
     # git clone git://git.code.sf.net/p/mpssvt/modules mpssvt-modules
     # cd mpssvt-modules
-    # make MIC_CARD_ARCH=k1om CROSS_COMPILE=k1om-mpss-linux- KDIR=../mpssvt-linux/ DESTDIR=/var/mpss/mic0/ all
+    # make MIC_CARD_ARCH=k1om KDIR=`pwd`/../mpssvt-linux/ all
+    # sudo make MIC_CARD_ARCH=k1om KDIR=`pwd`/../mpssvt-linux/ DESTDIR=/var/mpss/mic0/ modules_install

-
-
-    # sudo make MIC_CARD_ARCH=k1om CROSS_COMPILE=k1om-mpss-linux- KDIR=/home/antoniob/mklinux/ DESTDIR=/var/mpss/mic0/ modules_install
+The above commands provide for installation in the default ***/var/mpss/mic0/*** folder. Please change it accordingly to your setup.

 Upgrading the FS Image

Guide modified by Antonio Barbalace

Antonio Barbalace — Tue, 10 Jun 2014 19:03:17 -0000

--- v6
+++ v7
@@ -7,7 +7,7 @@
 Pre mpss-vt Installation
 ------------------------

-Make sure your MIC co-processor software environment is safe and functional. Furthermore you want that the cross-compilation tools are installed. The cross-compilation tools are the compilers that produce code for the co-processor but that you run on the host, i.e. in this way you can write, develop and compile an application on the host and move that for execution on the MIC. The cross-compiler tools has usually the following prefix: ***k1om-mpss-linux-***. Make sure the cross-compilation tools are exported in the PATH environment variable (the following should work). 
+Make sure your MIC co-processor software environment is safe and functional. Furthermore you want that the cross-compilation tools are installed. The cross-compilation tools are the compilers that produce code for the co-processor but that you run on the host, i.e. in this way you can write, develop and compile an application on the host and move that for execution on the MIC co-processor. The cross-compiler tools has usually the following prefix: ***k1om-mpss-linux-***. Make sure the cross-compilation tools are exported in the PATH environment variable (the following should work). 

     # export PATH=/opt/mpss/3.2/sysroots/x86_64-mpsssdk-linux/usr/bin:/opt/mpss/3.2/sysroots/x86_64-mpsssdk-linux/usr/bin/k1om-mpss-linux:$PATH

@@ -31,7 +31,7 @@
     # make ARCH=k1om oldconfig
     # make ARCH=k1om CROSS_COMPILE=k1om-mpss-linux- KBUILD_NOPEDANTIC=1 bzImage

-As common practice, please add ***-j N*** at the end of the last line in order to speed up the compilation. Example, where the parallelism factor is 8:
+As common practice, please add ***-j N*** at the end of the last line in order to speed up the compilation. Example, where the parallelism factor is 8 (N=8):

     #  make ARCH=k1om CROSS_COMPILE=k1om-mpss-linux- KBUILD_NOPEDANTIC=1 -j 8 bzImage

@@ -51,10 +51,21 @@

 at this point save the file. (The script we run above already copied the bzImage and System.map in /usr/share/mpss/boot/ for us).

+
 Upgrading the Modules
 ---------------------

-TODO
+Download the latest modules version from the git repository, and compile them. In this case there is no configuration step, but you should know where your Linux kernel is. We assume the Linux kernel directory is contained in the same folder as the modules directory. (Remember to exit mpssvt-linux directory first.)
+
+    # cd ..
+    # git clone git://git.code.sf.net/p/mpssvt/modules mpssvt-modules
+    # cd mpssvt-modules
+    # make MIC_CARD_ARCH=k1om CROSS_COMPILE=k1om-mpss-linux- KDIR=../mpssvt-linux/ DESTDIR=/var/mpss/mic0/ all
+
+
+
+    # sudo make MIC_CARD_ARCH=k1om CROSS_COMPILE=k1om-mpss-linux- KDIR=/home/antoniob/mklinux/ DESTDIR=/var/mpss/mic0/ modules_install
+

 Upgrading the FS Image
 ----------------------
@@ -64,8 +75,8 @@
     Base CPIO /usr/share/mpss/boot/initramfs-3.2.14+mpss3.2.cpio.gz

-Restarting the System
----------------------
+Restarting MPSS
+---------------

 We now have to restart the MPSS in order for the changes we made to take effect and exploit the advantages of having a newer Linux version on Xeon Phi.

Guide modified by Antonio Barbalace

Antonio Barbalace — Tue, 10 Jun 2014 02:25:31 -0000

--- v5
+++ v6
@@ -15,7 +15,7 @@
 Stop MPSS
 ---------

-In order to proceed with an upgrade is a good practice to stop the current MPSS software running on your system.
+In order to proceed with an upgrade it's a good practice to stop the current MPSS software running on your system.

     # sudo service mpss stop

@@ -39,10 +39,37 @@

     # ./mpss_install_bzImage.sh

-In order to tell the MPSS that we would like to use this new kernel instead of the previous one we should update the MIC co-processor configuration; hereafter we assume we would like to update ***mic0***. Open ***/etc/mpss/mic0.conf*** with your favorite editor and modify the following line:
+In order to tell the MPSS that we would like to use this new kernel instead of the previous one we should update the MIC co-processor configuration; hereafter we assume we would like to update ***mic0***. Open ***/etc/mpss/mic0.conf*** with your favorite editor and identify the following lines:

-    
+    # MIC OS image
+    OSimage /usr/share/mpss/boot/bzImage-knightscorner /usr/share/mpss/boot/System.map-knightscorner

+they must be modified in:
+
+    # MIC OS image
+    OSimage /usr/share/mpss/boot/bzImage-3.2.14+mpss3.2-knightscorner /usr/share/mpss/boot/System.map-3.2.14+mpss3.2-knightscorner
+
+at this point save the file. (The script we run above already copied the bzImage and System.map in /usr/share/mpss/boot/ for us).
+
+Upgrading the Modules
+---------------------
+
+TODO
+
+Upgrading the FS Image
+----------------------
+
+TODO --- the following is to be updated (was there before?!)
+
+    Base CPIO /usr/share/mpss/boot/initramfs-3.2.14+mpss3.2.cpio.gz
+
+
+Restarting the System
+---------------------
+
+We now have to restart the MPSS in order for the changes we made to take effect and exploit the advantages of having a newer Linux version on Xeon Phi.
+
+    # sudo service mpss start

 Debugging
@@ -74,45 +101,3 @@
 Another tool, called **micrasd**, i.e. a daemon can be used in maintenence mode in order to receive messages from the scif module when loaded. Use the following command:

     # micrasd -maint
-
-File System - Generics
-----------------------
-
-Xeon Phi comes with 4 overlying filesystems:
-
-* Base CPIO (micctrl --base)
-* Common Dir (micctrl --commondir)
-* Mic Dir, coprocessor unique file location (micctrl --micdir)
-* Overlay (micctrl --overlay) [sep]
-
-Intel: "NOTE: Previously, this command included an option to set a corresponding “filelist” associated with the files. The use of this file has been removed."
-
-File System - CPIO
-------------------
-
-The following commands will compile the modules and install them in the MicDirof mic0 (assuming the cwd is the kernel root):
-
-    # make ARCH=k1om CROSS_COMPILE=k1om-mpss-linux- KBUILD_NOPEDANTIC=1 -j modules
-    # sudo make INSTALL_MOD_PATH=/var/mpss/mic0 modules_install
-    # cd /var/mpss/mic0
-    # rm source build
-
-sadly not all needed modules are compiled (seems like we should also compile the outside modules.. argh!!!) we must use our version !!! the last one will install the modules
-
-    # make MIC_CARD_ARCH=k1om CROSS_COMPILE=k1om-mpss-linux- KDIR=/home/antoniob/mklinux/ DESTDIR=/var/mpss/mic0/ all
-    #sudo make MIC_CARD_ARCH=k1om CROSS_COMPILE=k1om-mpss-linux- KDIR=/home/antoniob/mklinux/ DESTDIR=/var/mpss/mic0/ modules_install
-
-Anther example. To compile 2.6.38.8 (located in /root/linux-2.6.38_michael) do change directory in the mpss-modules-3.2_michael (located at /home/antoniob/mpss-modules-3.2_michael) and type
-
-    # sudo make MIC_CARD_ARCH=k1om CROSS_COMPILE=k1om-mpss-linux- KDIR=/root/linux-2.6.38+mpss3.2_michael/ DESTDIR=/var/mpss/mic0/ all
# sudo make MIC_CARD_ARCH=k1om CROSS_COMPILE=k1om-mpss-linux- KDIR=/root/linux-2.6.38+mpss3.2_michael/ DESTDIR=/var/mpss/mic0/ modules_install

-
-File System - Updating the Download Image File

-
-Everytime we are adding or modifying files in Base, CommonDir, MicDir and Overlaysin order to update the file list we should run:
-
- # micctrl --resetconfig
-
-To create the download image Base, CommonDir, MicDir and Overlays are processed in order. The user should modify each directory/file first; i.e. in the case he/she would like to modify the base image he/she should extract, modify and create it again first. To create the ramfs (and e.g. update the CPIO image):
-
- # micctrl --updateramfs [mic card list]

Guide modified by Antonio Barbalace

Antonio Barbalace — Tue, 10 Jun 2014 02:20:08 -0000

--- v4
+++ v5
@@ -39,7 +39,7 @@

     # ./mpss_install_bzImage.sh

-In order to tell the MPSS that we would like to use this new kernel instead of the previous one we should update the MIC co-processor configuration; hereafter we assume we would like to update ***mic0***. Open ***/etc/mpss/mic0.conf*** with your favourite editor and modify the following line:
+In order to tell the MPSS that we would like to use this new kernel instead of the previous one we should update the MIC co-processor configuration; hereafter we assume we would like to update ***mic0***. Open ***/etc/mpss/mic0.conf*** with your favorite editor and modify the following line:

Guide modified by Antonio Barbalace

Antonio Barbalace — Tue, 10 Jun 2014 02:17:18 -0000

--- v3
+++ v4
@@ -2,6 +2,7 @@
 ------------

 The following guide assumes a running CentOS Linux installation on a Intel Xeon machine with a plugged Intel Xeon Phi.
+

 Pre mpss-vt Installation
 ------------------------
@@ -10,12 +11,39 @@

     # export PATH=/opt/mpss/3.2/sysroots/x86_64-mpsssdk-linux/usr/bin:/opt/mpss/3.2/sysroots/x86_64-mpsssdk-linux/usr/bin/k1om-mpss-linux:$PATH

+
+Stop MPSS
+---------
+
+In order to proceed with an upgrade is a good practice to stop the current MPSS software running on your system.
+
+    # sudo service mpss stop
+
+
 Upgrading the Linux Kernel
 --------------------------

-    # cp config-mic-knc-2.6.38 .config
+Download the latest kernel version from the git repository, configure it by using the latest configuration options (in this case please skip the line starting with ***# cp***) or one of the other available ***config-mic-knc-*** in the kernel root directory. Then compile it.
+
+    # git clone git://git.code.sf.net/p/mpssvt/linux mpssvt-linux
+    # cd mpssvt-linux
+    # cp config-mic-knc-3.2.14 .config
     # make ARCH=k1om oldconfig
-    # make ARCH=k1om CROSS_COMPILE=k1om-mpss-linux- KBUILD_NOPEDANTIC=1 -j bzImage
+    # make ARCH=k1om CROSS_COMPILE=k1om-mpss-linux- KBUILD_NOPEDANTIC=1 bzImage
+
+As common practice, please add ***-j N*** at the end of the last line in order to speed up the compilation. Example, where the parallelism factor is 8:
+
+    #  make ARCH=k1om CROSS_COMPILE=k1om-mpss-linux- KBUILD_NOPEDANTIC=1 -j 8 bzImage
+
+To install the kernel image please use the script ***mpss_install_bzImage.sh*** available in the kernel root directory. This script assume a standard MPSS 3.2 installation in order to work (i.e. please modify the script according to your installation).
+
+    # ./mpss_install_bzImage.sh
+
+In order to tell the MPSS that we would like to use this new kernel instead of the previous one we should update the MIC co-processor configuration; hereafter we assume we would like to update ***mic0***. Open ***/etc/mpss/mic0.conf*** with your favourite editor and modify the following line:
+
+    
+
+

 Debugging
 ---------

Guide modified by Antonio Barbalace

Antonio Barbalace — Tue, 10 Jun 2014 02:01:21 -0000

--- v2
+++ v3
@@ -1,29 +1,17 @@
-Prepare the installation
+Requirements
+------------
+
+The following guide assumes a running CentOS Linux installation on a Intel Xeon machine with a plugged Intel Xeon Phi.
+
+Pre mpss-vt Installation
 ------------------------

-Download the source code from http://registrationcenter.intel.com/irc_nas/3778/mpss-src-3.1.2.tar
-
-run the script /opt/mpss/3.1.2/environment-setup-k1om-mpss-linux OR:
+Make sure your MIC co-processor software environment is safe and functional. Furthermore you want that the cross-compilation tools are installed. The cross-compilation tools are the compilers that produce code for the co-processor but that you run on the host, i.e. in this way you can write, develop and compile an application on the host and move that for execution on the MIC. The cross-compiler tools has usually the following prefix: ***k1om-mpss-linux-***. Make sure the cross-compilation tools are exported in the PATH environment variable (the following should work). 

     # export PATH=/opt/mpss/3.2/sysroots/x86_64-mpsssdk-linux/usr/bin:/opt/mpss/3.2/sysroots/x86_64-mpsssdk-linux/usr/bin/k1om-mpss-linux:$PATH

-binutils
---------
-
-Untar the source code, and untar the binutils tar file then run:
-
-    # yum install texinfo bison flex
-
-cd into the binutils directory and run ./configure --target=k1om-mpss-linux-gnu
-
-Then run make and hope for the best..
-
-Xeon Phi original Linux kernel
-------------------------------
-
-extract the linux tar file from mpss distribution
-
-vi config-mic-knc-2.6.38 -- Search for RAMFS and comment out the line with sthampso's home directory
+Upgrading the Linux Kernel
+--------------------------

     # cp config-mic-knc-2.6.38 .config
     # make ARCH=k1om oldconfig

Guide modified by Antonio Barbalace

Antonio Barbalace — Tue, 10 Jun 2014 01:46:11 -0000

--- v1
+++ v2
@@ -4,12 +4,14 @@
 Download the source code from http://registrationcenter.intel.com/irc_nas/3778/mpss-src-3.1.2.tar

 run the script /opt/mpss/3.1.2/environment-setup-k1om-mpss-linux OR:
+
     # export PATH=/opt/mpss/3.2/sysroots/x86_64-mpsssdk-linux/usr/bin:/opt/mpss/3.2/sysroots/x86_64-mpsssdk-linux/usr/bin/k1om-mpss-linux:$PATH

 binutils
 --------

 Untar the source code, and untar the binutils tar file then run:
+
     # yum install texinfo bison flex

 cd into the binutils directory and run ./configure --target=k1om-mpss-linux-gnu
@@ -35,27 +37,33 @@
 [Collecting Debug Data When Running With Intel Xeon Phi Coprocessor](https://software.intel.com/en-us/blogs/2013/06/05/collecting-debug-data-when-running-with-intelr-xeon-phitm-coprocessor)

 A **dmesg** dump of a mic is available throught
+
     # cat /sys/kernel/debug/mic_debug/mic0/log_buf

 If this file entry is not present, debugfs should be mounted (or it is mounted somewhere else). To mount it
+
     # sudo mount -t debugfs none /sys/kernel/debug

 This works by fetching __log_buf and log_buf_len from the loaded System.map, these two parameters can be read from:
+
     # cat /sys/class/mic/mic0/log_buf_addr
     # cat /sys/class/mic/mic0/log_buf_len

 respectively. By echoing a value the parameters can be changed.

 A **console**, hypervisor style type, i.e. HVC, is available. It is not clear why this console do not work until a complete boot (is it compiled as a module or user space program?!). To access the console, use /dev/ttyMIC0, and minicom without initialization (-s allow you to configure it):
+
     # minicom -so

 Another tool, called **micrasd**, i.e. a daemon can be used in maintenence mode in order to receive messages from the scif module when loaded. Use the following command:
+
     # micrasd -maint

 File System - Generics
 ----------------------

 Xeon Phi comes with 4 overlying filesystems:
+
 * Base CPIO (micctrl --base)
 * Common Dir (micctrl --commondir)
 * Mic Dir, coprocessor unique file location (micctrl --micdir)
@@ -67,12 +75,14 @@
 ------------------

 The following commands will compile the modules and install them in the MicDirof mic0 (assuming the cwd is the kernel root):
+
     # make ARCH=k1om CROSS_COMPILE=k1om-mpss-linux- KBUILD_NOPEDANTIC=1 -j modules
     # sudo make INSTALL_MOD_PATH=/var/mpss/mic0 modules_install
     # cd /var/mpss/mic0
     # rm source build

 sadly not all needed modules are compiled (seems like we should also compile the outside modules.. argh!!!) we must use our version !!! the last one will install the modules
+
     # make MIC_CARD_ARCH=k1om CROSS_COMPILE=k1om-mpss-linux- KDIR=/home/antoniob/mklinux/ DESTDIR=/var/mpss/mic0/ all
     #sudo make MIC_CARD_ARCH=k1om CROSS_COMPILE=k1om-mpss-linux- KDIR=/home/antoniob/mklinux/ DESTDIR=/var/mpss/mic0/ modules_install

@@ -84,7 +94,9 @@
 ----------------------------------------------

 Everytime we are adding or modifying files in *Base*, *CommonDir*, *MicDir* and Overlaysin order to update the file list we should run:
+
     # micctrl --resetconfig

 To create the download image *Base*, *CommonDir*, *MicDir* and Overlays are processed in order. The user should modify each directory/file first; i.e. in the case he/she would like to modify the base image he/she should extract, modify and create it again first. To create the ramfs (and e.g. update the CPIO image):
+
     # micctrl --updateramfs [mic card list]