Re: [BProc] InfiBand and Bproc

[Matt L. L. <mll...@hp...>]

We are working towards a complete InfiniBand Science Appliance, but it
will probably be ~6 months before we have something useful for the folks
running BProc in production mode.  Our current Bproc IB cluster at
Sandia Livermore runs BProc over the GigE network.  

  The main issue has been that each InfiniBand company had its our
proprietary software stack.  Over the last 6 weeks the InfiniBand
community (mainly industry and DOE national labs) have come together and
released nearly all the code open source.  We are currently setting up
an organization to deliver a unified (best of breed) open source
InfiniBand stack to the Linux community.  This stack will be making its
way into the Linux kernel (kernel.org), and into the SuSE and Redhat
distros.  The official announcement for the OS stack and organization
will be released in about 2 weeks and I'll forward it to the BProc mail
list.  With a single open source stack we can finally have a
multi-vendor supported solution for Science Appliance clusters.  As Erik
mentioned we'll be running BProc via IP over InfiniBand (IPoIB) and
eliminate the need for a secondary ethernet network.  

	- Matt


On Fri, 2004-03-12 at 08:29, er...@he... wrote:
> On Thu, Mar 11, 2004 at 09:12:38PM -0800, YhLu wrote:
> > Erik,
> > 
> > Any howto or doc that is talking about using bproc with IB?
> > 
> > I saw there is some plug-in option for myerinet ...
> 
> I'm not aware of anything like that.  I haven't set it up myself.  The
> clusters that I've seen using IB at this point were still using
> ethernet as the management network.  BProc did all its stuff on that
> network.  There was some stuff whacked in to the BProc setup to get IB
> drivers loaded.  That was non-trivial since there were a lot of
> scripts involved.
> 
> I have seen BProc run using IP over IB on little bladed thing once but
> we cheated and had a local linux install on the slave node to get the
> IB setup.
> 
> Some of the Sandia California guys are on this list.  They have a lot
> more experience with this than I do.  Maybe they can comment or
> recommend how to go about doing this.  Matt/Josh/Mitch ???
> 
> - Erik
> 
> 
> -------------------------------------------------------
> This SF.Net email is sponsored by: IBM Linux Tutorials
> Free Linux tutorial presented by Daniel Robbins, President and CEO of
> GenToo technologies. Learn everything from fundamentals to system
> administration.http://ads.osdn.com/?ad_id=1470&alloc_id=3638&op=click
> _______________________________________________
> BProc-users mailing list
> BPr...@li...
> https://lists.sourceforge.net/lists/listinfo/bproc-users
-- 
Matt L. Leininger, Ph.D. 
Sandia National Laboratory, Livermore CA
High Performance Computing and Networking
E-mail:  ml...@ca...
World Wide Web: http://aros.ca.sandia.gov/~mlleinin/Matt.html
Office phone: (925) 294-4842
Office fax:   (925) 294-2776 
Mail Stop: 9915