Do you have lots of files? I do, particularly image files.
There are lots of duplicates and I want to extract a unique set from the larger set. That is what dupless does.
Written in Java, using sqlite, it is some simple code that solves the duplicate file problem.
All of the code is contained in the .jar file, both source and binary.
Currently it writes scripts for use on Linux or Windows.
See the Wiki or the README.txt in the .jar file for more information.
Interesting tool!! Other than this, One of the interesting tools that I found recently is DuplicateFilesDeleter.It is tool that can be used to find & remove duplicate files.It is a simple to use,but very effective tool to locate duplicate files in one or more selected search paths.It scans the files and compares them based on Byte for Byte Comparison, which ensures 100% accuracy. You can then choose to delete the selected duplicate or original files. The program is multi-threaded which enhances the performance immensely & performs scans very quickly.Worth trying.