Search Results for "throughput"

...Compression is usually the bottleneck during backup operations but, even with now-ubiquitous multi-core servers, most database backup solutions are still single-process. pgBackRest solves the compression bottleneck with parallel processing. Utilizing multiple cores for compression makes it possible to achieve 1TB/hr raw throughput even on a 1Gb/s link. More cores and a larger pipe lead to even higher throughput. A custom protocol allows pgBackRest to backup, restore, and archive locally or remotely via TLS/SSH with minimal configuration. An interface to query PostgreSQL is also provided via the protocol layer so that remote access to PostgreSQL is never required, which enhances security.

fft is a distributed file transfer tool designed to accelerate large file movement by coordinating multiple relay nodes in parallel rather than depending on a single server’s bandwidth ceiling. Its architecture splits a transfer into concurrent “workers” that fetch or push chunks across multiple paths, improving throughput on high-latency or bandwidth-constrained links. The project is implemented in Go and exposes a straightforward command-line interface so operators can stand up senders, receivers, and relays with minimal ceremony. Because it’s oriented around relays, it can better utilize geographically diverse infrastructure and avoid bottlenecks at any one egress point. ...

fpsc is a Fast Parallel Stream Compressor. It can use multiple CPUs to compress (gzip or bzip2) a data stream. (from stdin to stdout) It is built to achieve maximum throughput, everything else (especially memory usage) can be sacrified.