Fastest Integer Compression. ALL functions are available for AMD/Intel, 64-bit ARMv8 NEON Linux+MacOS/M1 & Power9 Altivec. 100% C (C++ headers), as simple as memcpy. OS:Linux amd64, arm64, Power9, MacOs (Amd/intel + Apple M1).

Features

  • Rust Bindings. Access TurboPFor incl. SSE/AVX2/Neon! from Rust
  • Novel TurboPFor (PFor/PForDelta) scheme w./ direct access + SIMD/AVX2. +RLE
  • No other "Integer Compression" compress/decompress faster
  • Fastest and most efficient "SIMD Bit Packing" >20 Billions integers/sec (80Gb/s!)
  • Extremely fast scalar "Bit Packing"
  • Scalar "Variable Byte" faster and more efficient than ANY other implementation
  • Fastest "Elias Fano" implementation w/ or w/o SIMD/AVX2
  • Generate and test (zipfian) skewed distribution (100.000.000 integers, Block size=128/256)

Project Samples

Project Activity

See All Activity >

Categories

Libraries

License

GNU General Public License version 3.0 (GPLv3)

Follow TurboPFor

TurboPFor Web Site

Other Useful Business Software
Host LLMs in Production With On-Demand GPUs Icon
Host LLMs in Production With On-Demand GPUs

NVIDIA L4 GPUs. 5-second cold starts. Scale to zero when idle.

Deploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
Start Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of TurboPFor!

Additional Project Details

Programming Language

C

Related Categories

C Libraries

Registered

2024-05-30