[BProc] mounting pvfs2 filesystem on bproc compute node

[Rene S. <rs...@tu...>]

Hi list,

Trying to get pvfs2 working with bproc/clustermatic 5 on an x86_64 cluster
here is the problem/setup.

I have pvfs2 working and installed on the master bproc node.  I can mount
and use the pvfs2 file system just fine on the bproc master node.

To get the pvfs2 file system mounted and working on the master node all I do
is this:

1) >modprobe pvfs2
2) >/usr/local/sbin/pvfs2-client -p /usr/local/sbin/pvfs2-client-core
3) >mount -t pvfs2 tcp://10.0.0.1:3334/pvfs2-fs /scratch-cluster


To get these three thing going on the slave bpoc nodes I did this

1)I added this line on the node_up.conf file and it loads the pvfs2 kernel
modules on all slave nodes just fine.

kmod pvfs2

here is the list of modules on the slave node.

>bpsh 0 lsmod
Module                  Size  Used by
pvfs2                  50376  1
tg3                    84996  0
bproc                 124948  1
vmadump                22568  1 bproc




2)I made the directories and copied the pvfs executables to the slave nodes

node=$1

bpsh $node mkdir /sbin
bpcp /usr/local/sbin/pvfs2-client $node:/sbin/
bpcp /usr/local/sbin/pvfs2-client-core $node:/sbin/
bpsh $node mkdir /scratch-cluster

then I can start the pvfs2-clients deamons

bpsh 0 /usr/local/sbin/pvfs2-client -p /sbin/pvfs2-client-core

So what this does i think is it starts the pvfs2-client deamon on the master node and
then migrates it once migrated the pvfs2-client deamon spawns the local
pvfs2-client-core with resides on the /sbin/ directory on the slave node.

here is what ps on the master node shows.

ps -ef | grep pv
root     12180     1  0 Dec29 ?        00:00:00 /usr/local/sbin/pvfs2-client
-p /usr/local/sbin/pvfs2-client-core
root     17965     1  0 09:45 ?        00:00:00 [pvfs2-client]
root     17966 17965  0 09:45 ?        00:00:00 [pvfs2-client-co]
root     18077 17585  0 10:14 pts/0    00:00:00 grep pv

so the pvfs2-clients appear to be running on the slave.



3)Here is where it fails. I can't mount the pvfs file system.

on the master i get this message

>bpsh 0 mount -t pvfs2 tcp://10.0.0.1:3334/pvfs2-fs /scratch-cluster
>mount: Bad file descriptor

on the slave console I get this

>pvfs2_get_sb: mount request failed with -9



Maybe I need to start both pvfs2-client deamons in the slave node's private
process space and not migrate then as above.  Any one have an idea on how to
do this?

Any clues?

Thank you for any help on this.

Rene