[BProc] cannot insmod in beoboot (was: 2.4.19 .config working with beoboot?)

[<ha...@no...>]

When my slave beoboots, I get this message on first insmod:

 "could not find the kernel version the module was compiled for"

Josh England suggested:

> You may have had version information on modules symbols turned off when
> you compiled/installed those modules and then turned it back on with a
> new build.
> 
> I would wipe out the entire module directory (/lib/modules/<kernel>),
> remake/install the modules and remake/install the bproc modules, then 
> build a new phase2 image.

I did the most complete and paranoid wipe and rebuild and reinstall of
all related things (linux-2.4.19 bproc-3.2.2 cmtools-1.0
beoboot-lanl.1.3-X, see below) but problem persists. I am sure I have matching
kernel and modules in my beoboot images and I can insmod on master
(where I use the same kernel and modules).

It happens both in phase 1 (cannot insert kmonte.o) and in phase 2
(when I use older phase 1 floppy to ever get to phase 2, it fails on
vmadump.o). Reverse engineering (gunzip initrd.img, loop mount) of
phase 1 floppy generated by

  beoboot -1 -k linux-2.4.19/arch/i386/boot/bzImage -f -o /dev/fd0

reveals that kmonte.o is there and looks OK:

 # objdump modules/kmonte.o --section-headers

  modules/kmonte.o:     file format elf32-i386

  Sections:
  Idx Name          Size      VMA       LMA       File off  Algn
    ...
    4 .modinfo      000000e0  00000000  00000000  00000bc0  2**5
                    CONTENTS, ALLOC, LOAD, READONLY, DATA

 # objdump modules/kmonte.o --full-contents --section=.modinfo

  modules/kmonte.o:     file format elf32-i386

  Contents of section .modinfo:
   0000 6b65726e 656c5f76 65727369 6f6e3d32  kernel_version=2
   0010 2e342e31 39007573 696e675f 63686563  .4.19.using_chec
   0020 6b73756d 733d3100 00000000 00000000  ksums=1.........
   0030 00000000 00000000 00000000 00000000  ................
   0040 61757468 6f723d45 72696b20 41726a61  author=Erik Arja
   0050 6e204865 6e647269 6b73203c 68656e64  n Hendriks <hend
   ...

So the problem probably is in libmodutils library which cannot insert
any module while standalone insmod program can?

Any comments are more than welcome.

Regards

Vaclav

------------------------------------

### MY BUILD PROCESS:

# paranoid cleanup:
rm -rf linux-2.4.19 bproc-3.2.2 cmtools-1.0 beoboot-lanl.1.3.1

# uncompress:
tar xjvf linux-2.4.19.tar.bz2
tar xzvf bproc-3.2.2.tar.gz
tar xzvf cmtools-1.0.tar.gz
tar xzvf beoboot-lanl.1.3-luiz-otavio.1.tar.gz
rm /usr/src/linux
ln -s /usr/src/cluster_build/linux-2.4.19 /usr/src/linux

# bproc patch:
cd linux-2.4.19; patch -p1 -s <../bproc-3.2.2/patches/bproc-patch-2.4.19
cd linux-2.4.19/fs/autofs; cp autofs_i.h autofs_i.h.orig;\
  sed -e 's/current->pgrp/sys_getpgrp()/' <autofs_i.h.orig >autofs_i.h

# kernel:
cd linux-2.4.19; make mrproper
cp saved-config-vanilla-4 linux-2.4.19/.config
# force menuconfig to load .config and use it:
cd linux-2.4.19; (echo -e '\033';echo '')|make menuconfig
cd linux-2.4.19; make dep; make clean; make bzImage; make modules;
rm -rf /lib/modules/old-2.4.19
mv /lib/modules/2.4.19 /lib/modules/old-2.4.19
cd linux-2.4.19; make modules_install
depmod -a
cp linux-2.4.19/arch/i386/boot/bzImage /boot/vmlinuz-2.4.19-NEW

# bproc:
cd bproc-3.2.2; make modules; make modules_install;
depmod -a
cd bproc-3.2.2; make install-sys; make install-clients

# cmtools:
cd cmtools-1.0; make; make install; ldconfig

# beoboot:
cd beoboot-lanl.1.3.1; make; make install
depmod -a

# sysfloppy:
mformat a:
syslinux /dev/fd0
mcopy /boot/vmlinuz-2.4.19-NEW a:linux
echo "label linux" >syslinux.cfg
echo "        append root=/dev/hde3" >syslinux.cfg
mcopy syslinux.cfg a:

# netimage:
beoboot -2 -n

# restart-beo:
/etc/rc.d/init.d/beowulf stop
/etc/rc.d/init.d/beowulf start


-----------------------------------------------------------------

These are the simple modifications made to beoboot-lanl.1.3 (discussed
before on this list):

--- beoboot-lanl.1.3/Makefile   Thu Aug 29 17:37:04 2002
+++ beoboot-lanl.1.3-X/Makefile Fri Nov  1 04:02:05 2002
@@ -2,7 +2,7 @@
 # Erik Hendriks <hen...@la...>
 #
 # $Id: Makefile,v 1.36 2002/08/29 15:37:04 packager Exp $
-VERSION:=lanl.1.3
+VERSION:="lanl.1.3"
 export VERSION
 

--- beoboot-lanl.1.3/mkpcitable Tue Jun  4 16:07:50 2002
+++ beoboot-lanl.1.3-X/mkpcitable       Fri Nov  1 04:03:22 2002
@@ -5,9 +5,9 @@
 # $Id: mkpcitable,v 1.4 2002/06/04 14:07:50 packager Exp $
 while (<STDIN>) {
     s/\#.*//;                  # Strip comments
-    split /[\t\n]/;
-    if ($#_ == 3 || $#_ == 5) {
-       ($vendor, $device, $driver) = (hex($_[0]), hex($_[1]), $_[$#_ - 1]);
+    @a = split /[\t\n]/;
+    if ($#a == 3 || $#a == 5) {
+       ($vendor, $device, $driver) = (hex($a[0]), hex($a[1]), $a[$#a - 1]);
        $driver =~ s/\"//g;
        printf("pci 0x%04lx 0x%04lx %s\n", $vendor, $device, $driver)
            unless ($driver =~ m/^unknown/i ||


------------------------------------

My kernel .config can be seen here:

  http://noel.feld.cvut.cz/~hanzl/cluster_build/saved-config-vanilla-4


------------------------------------