Search Results for "duplicate finder md5"

DataCleaner is a data quality analysis application and a solution platform for DQ solutions. It's core is a strong data profiling engine, which is extensible and thereby adds data cleansing, transformations, enrichment, deduplication, matching and merging. Website: http://datacleaner.github.io

...It's one solution to centrally handling uploads from a number of users, and extensive logging is provided by a Perl+MySQL combination. The key feature of the software is that duplicate files should be detected, and incoming files have an MD5 checksum automatically generated. All upload details, including timestamp, uploaded-by, checksum, filename and location are all stored in a 2-table database. The software should not impact the FTP server software as it is run separately. Coming soon will be a complementary application that will run as a daemon and scan the logging database on a regular basis. ...