Search Results for "duplicates"

lsdup, short for "list duplicates", is a command line tool which can assist in finding and removing files with identical contents. Unlike many file deduplication tools, this has a "comparison mode" which lets you tell lsdup to "only read the files in this directory, do not consider any for duplicates... but, the files in that other directory may have duplicates, so delete (or move) any of those."

A Linux/UNIX command line tool to find duplicate files. The tool supports multiple ways to consider a set of files as duplicates to each other (e.g. content, size, name ... etc.).

Frustrated with multiple records of the same customer which just differ due to a typo or abbreviation or different possible representations of same address? Try Deduper !! Deduper is a simple command line tool to merge duplicates in customer records. It works based on advanced string matching techniques and clustering. This technique is called blocked nearest neighbor clustering and this general technique is further optimized in this tool for the problem of customer merging. Give it a try, we will be happy to hear from you how it helped. See the wiki for more details on usage https://sourceforge.net/p/deduper/wiki/Home/

Duff is a Unix command-line utility for quickly finding duplicates in a given set of files. Duff is written in C and should build and run on most modern Unices.

A small command line tool to process streams of numbers and spit out the running total, bin the results or merge duplicates. Supports arbitrary precision numbers. ocdf is named for the cumulative distribution function in probability.