Search Results for "duplicate files"

Percona Toolkit is a collection of battle-tested command-line tools for MySQL and MariaDB that help diagnose performance, verify integrity, and perform online maintenance safely. Utilities such as pt-query-digest analyze slow logs and packet captures to surface hotspots and regressions, while pt-online-schema-change applies ALTERs with minimal blocking by copying and swapping tables. Consistency tools like pt-table-checksum and pt-table-sync detect and reconcile replication drift across...

Meta Package Manager wraps all package managers with a unifying CLI, and provides the MPM CLI, a wrapper around all package managers. MPM is like yt-dlp, but for package managers instead of videos. MPM solves XKCD #1654 - Universal Install Script. List installed packages. List duplicate installed packages. Search for packages. Install a package, remove a package, and list outdated packages. Sync local package infos. Upgrade all outdated packages. Backup list of installed packages to TOML file. Restore/install list of packages from TOML files. Pin-point commands to a subset of package managers (include/exclude selectors). ...

Copyright © 2014 Neil Butterworth. If you have any dealings at all with data and databases, then you almost certainly will have to deal with comma-separated values (CSV) data. Unfortunately, the CSV files you are given, or are required to produce, never seem to be in quite the right format for your particular business application. And because of the structure of CSV records, using standard text processing tools like sed, awk and perl is not as simple as it might...

The Specify Attachment Parser is a Java based command line tool that compares a file system directory to attachments in Specify and identifies the files not present in Specify. The tool will optionally copy the identified files to a target directory. The tool also accepts a regular expression to match or exclude files from source directory. We wrote the parser becasuse we had a directory with 3k+ images, of which an unknown number were attached in Specify. Using the Specify attachment import wizard was not an option, as it will re-import and duplicate the images already present in Specify. ...

lsdup, short for "list duplicates", is a command line tool which can assist in finding and removing files with identical contents. Unlike many file deduplication tools, this has a "comparison mode" which lets you tell lsdup to "only read the files in this directory, do not consider any for duplicates... but, the files in that other directory may have duplicates, so delete (or move) any of those." lsdup also has normal deduplication, where, if given a single directory, it will sort the...

A Linux/UNIX command line tool to find duplicate files. The tool supports multiple ways to consider a set of files as duplicates to each other (e.g. content, size, name ... etc.).

Duff is a Unix command-line utility for quickly finding duplicates in a given set of files. Duff is written in C and should build and run on most modern Unices.

Provides a linux/unix command line tool to "scrub" comma delimited files. Removing extra spaces, mr. dr. etc. Also removing duplicate records based on a comparison of columns/fields. It's a bash script using awk, cut, join and nl. Using a little perl

Synclair is a tool for diff'ing and synchronizing directories. It also includes a utility to find duplicate files (by name, or md5 hash). It is a command line tool, written in Java.