Search Results for "kmeans mapreduce python"

...These tasks can be anything, but are typically long running things like Hadoop jobs, dumping data to/from databases, running machine learning algorithms, or anything else. You can build pretty much any task you want, but Luigi also comes with a toolbox of several common task templates that you use. It includes support for running Python mapreduce jobs in Hadoop, as well as Hive, and Pig, jobs. It also comes with file system abstractions for HDFS, and local files that ensures all file system operations are atomic.

PyTorch implementation of kmeans for utilizing GPU.

A lightweight hyperspectral imaging library that provides developers with spectral algorithms for the Python programming language. New for v0.14.x: a scikit-learn bridge (alpha and partial). The functions and classes are organized by topics: * abundance maps: FCLS, NNLS, UCLS * classification: AbundanceClassification, NormXCorr, KMeans SAM, SID, SVC * detection: ACE, CEM, GLRT, MatchedFilter, OSP * distance: chebychev, NormXCorr, SAM, SID * endmembers extraction: ATGP, FIPPI, NFINDR, PPI * material count: HfcVd, HySime * noise: Savitzky Golay, MNF, whiten * sigproc: bilateral * sklearn: HyperEstimatorCrossVal, HyperSVC and others * spectro: convex hull quotient, features extraction (tetracorder style), USGS06 lib interface * util: load_ENVI_file, load_ENVI_spec_lib, corr, cov and others The library do an extensive use of the numpy numeric library and can achieve good speed. ...

A web-based interface for the Hadoop MapReduce framework that simplifies the process of writing and running MapReduce jobs. Aimed at introducing parallelism concepts in introductory computer science courses.