Re: [Myhadoop-users] Hadoop for HPC

[Lockwood, G. <gl...@sd...>]

Hi Ramkumar

myHadoop 0.2a should work for versions of Hadoop as high as 1.1.1 without any modification (we are doing this in production at SDSC).  If you run into any troubles with this, please let us know and we can release an update with the necessary patches and documentation changes pretty quickly.  We have a pile of new features that will be released in the next version of myHadoop (support for Infiniband, SLURM, etc) but I'd be happy to give you any prerelease patches you need to get up and running.

Unfortunately Hadoop 2.0 (and higher) represent a major change in the underlying Hadoop framework, and we are still working on updating myHadoop to be able to configure YARN.  This will be done within the next year, but we don't have much more of a specific timeline right now.

Glenn


--
Glenn K. Lockwood, Ph.D.
User Services Group
San Diego Supercomputer Center