SkePi

Data parallel and stream parallel skeletons implemented in erlang.

DONE:

• [x] farm stream parallel skeleton
• [x] pipe stream parallel skeleon
• [x] ability to compose stream skeletons
• [x] map data parallel skeleton
• [x] mapreduce data parallel skeletons (naive version, dictionaries version)
• [x] usage examples
• [x] logging, profiling and benchmarking utilities
• [x] utility functions for purposes such as chunking, file indexing and more

TOFIX:

• [ ] mapreduce sequential version (used in example/test_mapred_google.erl)

TODO:

• [ ] reduce data parallel skeleton (parallel fold version)
• [ ] mapreduce data parallel skeletons (smart version)
• [ ] mapreduce data parallel skeleton (hadoop/buckets version)
• [ ] fault-tolerance
• [ ] documentation
• [ ] better error handling