Clustering_with_Hadoop

• The Map-Reduce paradigmhttp://cacm.acm.org/magazines/2010/1/.../fulltext was explored, as it is imminent that the data will quickly become large-scale, using Hadoop[<http://hadoop.apache.org/>] (which is an open-source implementation of Map-Reduce).
• As preliminary investigation kmeans clusteringhttp://nlp.stanford.edu/IR-book/html/.../k-means-1.html available from mahout[<http://mahout.apache.org/>]was employed. The results were similar to the ones we published in the paper, "Knowledge Discovery from Nuclear Reactor Simulation Data".
• Important resources to learn Map-Reduce are:
  • Book Chapter 2 in Mining of Massive Datasets by Anand Rajaraman and Jeffrey David Ullmanhttp://infolab.stanford.edu/~ullman/m.../ch2.pdf.
  • The paper http://cacm.acm.org/magazines/2010/1/.../fulltext] and the wiki article [<http://en.wikipedia.org/wiki/MapReduce>].
  • The tutorial http://hadoop.apache.org/docs/r1.0.4/mapred_tutorial.html...
• Here are the steps