This utility suppresses or reports duplicate rows without the need to sort them first.
It calculates CRC32 hash for every row and saves it in bit matrix. By default it uses 4-byte hash which consumes up to 512MB of RAM. Memory is allocated by 1K chunks as needed.

Project Activity

See All Activity >

License

GNU General Public License version 3.0 (GPLv3)

Follow pguniq

pguniq Web Site

Other Useful Business Software
Save Up to 91% on Cloud Compute With Spot VMs Icon
Save Up to 91% on Cloud Compute With Spot VMs

Automatic sustained-use discounts. One free VM per month. No negotiation needed.

Run batch jobs at 60-91% off with Spot VMs. Long-running workloads get automatic discounts with sustained use.
Start Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of pguniq!

Additional Project Details

Operating Systems

Linux

Programming Language

C

Registered

2021-09-29
Report inappropriate content