Summingbird
Streaming MapReduce with Scalding and Storm
...It is particularly useful in analytics or metrics systems where you want to update counters or aggregates continuously but also periodically recompute from historical data. Summingbird manages consistency and merging between the real-time and batch paths to avoid double-counting or data loss.