deduper

Frustrated with multiple records of the same customer
which just differ due to a typo or abbreviation or
different possible representations of same address? Try Deduper !!

Deduper is a simple command line tool to merge duplicates in customer records. It works based on advanced string matching techniques and clustering. This technique is called blocked nearest neighbor clustering and this general technique is further optimized in this tool for the problem of customer merging. Give it a try, we will be happy to hear from you how it helped.

See the wiki for more details on usage
https://sourceforge.net/p/deduper/wiki/Home/