Search Results for "duplicate"

with_advisory_lock is a Ruby gem that provides a simple and thread-safe way to use PostgreSQL advisory locks within Ruby applications. It allows developers to wrap critical code sections with database-level locks to prevent race conditions across concurrent processes or threads. It’s especially useful in distributed systems, background job processing, or scheduled tasks where application-level mutexes aren't sufficient.

...A single scalable deployment of all your AI models and APIs which is automatically kept up-to-date as new data is processed immediately. No need to introduce an additional database and duplicate your data to use vector search and build on top of it. SuperDuperDB enables vector search in your existing database. Integrate and combine models from Sklearn, PyTorch, HuggingFace with AI APIs such as OpenAI to build even the most complex AI applications and workflows. Train models on your data in your datastore simply by querying without additional ingestion and pre-processing.

...Dumps stored routines (functions and procedures). Dumps events, does extended-insert and/or complete-insert, supports virtual columns from MySQL 5.7, does insert-ignore, like a REPLACE but ignoring errors if a duplicate key exists, modifying data from database on-the-fly when dumping, using hooks. Can save directly to google cloud storage over a compressed stream wrapper (GZIPSTREAM).

Record matching software

DataCleaner is a data quality analysis application and a solution platform for DQ solutions. It's core is a strong data profiling engine, which is extensible and thereby adds data cleansing, transformations, enrichment, deduplication, matching and merging. Website: http://datacleaner.github.io

A database editor, suitable as front-end for all your relational databases. Connects to Oracle, DB2, MySQL and many other databases. Used to easily query, update and administer your database, create reports and synchronize data.

...It's one solution to centrally handling uploads from a number of users, and extensive logging is provided by a Perl+MySQL combination. The key feature of the software is that duplicate files should be detected, and incoming files have an MD5 checksum automatically generated. All upload details, including timestamp, uploaded-by, checksum, filename and location are all stored in a 2-table database. The software should not impact the FTP server software as it is run separately. Coming soon will be a complementary application that will run as a daemon and scan the logging database on a regular basis. ...

A high-performance implementation of bloom filters, a lightweight duplicate detection algorithm.

JMP3Cat is a MP3 Cataloger that reads MP3 CD’s and inputs the data into a database for sorting and listening. It also prints Jewel Case sleeves and removes duplicate files off the hard drive without the need to locate them on the hard drive.

...Purpose is a web-based music cataloging, voting and playing system. Tuna extends tunez with a new web interface, exhaustive mp3 information, id3 info correction, duplicate filtering and separate moods and genres.