Re: [BProc] InfiBand and Bproc

[Josh E. <jj...@sa...>]

It will be nice when we get things going purely over IB.  In the
meantime we are using an 'exec' module for Bproc originally developed by
LinuxNetworx to run the slew of IB scripts needed for most VAPI stacks.

It's GPL'd, so here is the tarball.  Maybe this would be a good thing to
include in the regular Bproc distro??

-JE

On Fri, 2004-03-12 at 10:35, Matt L. Leininger wrote:
> We are working towards a complete InfiniBand Science Appliance, but it
> will probably be ~6 months before we have something useful for the folks
> running BProc in production mode.  Our current Bproc IB cluster at
> Sandia Livermore runs BProc over the GigE network.  
> 
>   The main issue has been that each InfiniBand company had its our
> proprietary software stack.  Over the last 6 weeks the InfiniBand
> community (mainly industry and DOE national labs) have come together and
> released nearly all the code open source.  We are currently setting up
> an organization to deliver a unified (best of breed) open source
> InfiniBand stack to the Linux community.  This stack will be making its
> way into the Linux kernel (kernel.org), and into the SuSE and Redhat
> distros.  The official announcement for the OS stack and organization
> will be released in about 2 weeks and I'll forward it to the BProc mail
> list.  With a single open source stack we can finally have a
> multi-vendor supported solution for Science Appliance clusters.  As Erik
> mentioned we'll be running BProc via IP over InfiniBand (IPoIB) and
> eliminate the need for a secondary ethernet network.  
> 
> 	- Matt
> 
> 
> On Fri, 2004-03-12 at 08:29, er...@he... wrote:
> > On Thu, Mar 11, 2004 at 09:12:38PM -0800, YhLu wrote:
> > > Erik,
> > > 
> > > Any howto or doc that is talking about using bproc with IB?
> > > 
> > > I saw there is some plug-in option for myerinet ...
> > 
> > I'm not aware of anything like that.  I haven't set it up myself.  The
> > clusters that I've seen using IB at this point were still using
> > ethernet as the management network.  BProc did all its stuff on that
> > network.  There was some stuff whacked in to the BProc setup to get IB
> > drivers loaded.  That was non-trivial since there were a lot of
> > scripts involved.
> > 
> > I have seen BProc run using IP over IB on little bladed thing once but
> > we cheated and had a local linux install on the slave node to get the
> > IB setup.
> > 
> > Some of the Sandia California guys are on this list.  They have a lot
> > more experience with this than I do.  Maybe they can comment or
> > recommend how to go about doing this.  Matt/Josh/Mitch ???
> > 
> > - Erik
> > 
> > 
> > -------------------------------------------------------
> > This SF.Net email is sponsored by: IBM Linux Tutorials
> > Free Linux tutorial presented by Daniel Robbins, President and CEO of
> > GenToo technologies. Learn everything from fundamentals to system
> > administration.http://ads.osdn.com/?ad_id=1470&alloc_id=3638&op=click
> > _______________________________________________
> > BProc-users mailing list
> > BPr...@li...
> > https://lists.sourceforge.net/lists/listinfo/bproc-users