For Software Engineers, DevOps, Data Architects, and IT Leaders
The progression to modern application stacks and microservices architectures has resulted in orders of magnitude more logs, metrics, events, and traces. Like gravity, data attracts more data, making it increasingly difficult to move and process as it accumulates over time. More than ever, there is a need to be able to stream-process, filter, mask, transform, aggregate, analyze, and route that data to various data tier destinations optimized for specific usage.
ngetsuite is a collection of ruby scripts for retrieving binaries from Usenet. It uses nget and yydecode for fetching and decoding, stores the article headers in a MySQL database, and comes with a eruby web interface for remote control.