Search Results for "throughput"

...Compression is usually the bottleneck during backup operations but, even with now-ubiquitous multi-core servers, most database backup solutions are still single-process. pgBackRest solves the compression bottleneck with parallel processing. Utilizing multiple cores for compression makes it possible to achieve 1TB/hr raw throughput even on a 1Gb/s link. More cores and a larger pipe lead to even higher throughput. A custom protocol allows pgBackRest to backup, restore, and archive locally or remotely via TLS/SSH with minimal configuration. An interface to query PostgreSQL is also provided via the protocol layer so that remote access to PostgreSQL is never required, which enhances security.

fpsc is a Fast Parallel Stream Compressor. It can use multiple CPUs to compress (gzip or bzip2) a data stream. (from stdin to stdout) It is built to achieve maximum throughput, everything else (especially memory usage) can be sacrified.