Search Results for "data processing"

Libcutils provides a self-contained set of fundamental routines which are essential to basically any Unix utility or daemon application written in C. The library provides fundamental data structures such as lists, hash-maps, strings and parsing functions for JSON or the typical dot-file based configuration data. The following list summarizes the currently supported functionality: * length delimited instead of NULL terminated strings * memory management based on reference counting * several list processing functions like iterators and map-reduce * support of [Ideal Hash Tries](http://infoscience.epfl.ch/record/64398/files/idealhashtrees.pdf) for highly efficient hash map data structures * parsers for [JSON](http://json.org) data and the text configuration files found in Unix system * doubly linked circular lists for reliable event queues * support for test and debugging of memory management problems such as memory leaks

This software allows for a user to generate test data. This is useful for testing Hadoop or other data processing clusters.

Tabfmt is a command line utility to format tabular data. It reads lines from one or more files or from standard input, breaks the lines into fields given a set of field delimiters, and prints a table with constant-width columns to standard output.

An implementation of a high performance distributed storage and processing system for large amounts of structured data.