SkePi

Data parallel and stream parallel skeletons implemented in erlang.

DONE:

• [x] farm stream parallel skeleton
• [x] pipe stream parallel skeleon
• [x] ability to compose stream skeletons
• [x] map data parallel skeleton
• [x] reduce data parallel skeleton (parallel fold version)
• [x] mapreduce data parallel skeletons (smart version, naive version, dictionaries version)
• [x] usage examples
• [x] logging, profiling and benchmarking utilities
• [x] utility functions for purposes such as chunking, file indexing and more

FIXED:

• [x] mapreduce sequential version (used in example/test_mapred_google.erl)

TODO:

• [ ] mapreduce data parallel skeleton (hadoop/buckets version)
• [ ] fault-tolerance
• [ ] documentation
• [ ] better error handling