Search Results for "duplicate files"

DataCleaner is a data quality analysis application and a solution platform for DQ solutions. It's core is a strong data profiling engine, which is extensible and thereby adds data cleansing, transformations, enrichment, deduplication, matching and merging. Website: http://datacleaner.github.io

...It's one solution to centrally handling uploads from a number of users, and extensive logging is provided by a Perl+MySQL combination. The key feature of the software is that duplicate files should be detected, and incoming files have an MD5 checksum automatically generated. All upload details, including timestamp, uploaded-by, checksum, filename and location are all stored in a 2-table database. The software should not impact the FTP server software as it is run separately. Coming soon will be a complementary application that will run as a daemon and scan the logging database on a regular basis. ...

JMP3Cat is a MP3 Cataloger that reads MP3 CD’s and inputs the data into a database for sorting and listening. It also prints Jewel Case sleeves and removes duplicate files off the hard drive without the need to locate them on the hard drive.

Provides a linux/unix command line tool to "scrub" comma delimited files. Removing extra spaces, mr. dr. etc. Also removing duplicate records based on a comparison of columns/fields. It's a bash script using awk, cut, join and nl. Using a little perl

a Perl script, with a Gtk GUI, that helps with bibliography maintenance. It can append, delete, check for duplicate keys, search, including regexp search, split files, and output selected records as LaTeX bibitems