Showing 8 open source projects for "file duplicate"

View related business solutions
  • Train ML Models With SQL You Already Know Icon
    Train ML Models With SQL You Already Know

    BigQuery turns your data warehouse into an AI platform. No new languages required.

    Build and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
    Try Free
  • $300 in Free Credit Across 150+ Cloud Services Icon
    $300 in Free Credit Across 150+ Cloud Services

    VMs, containers, AI, databases, storage | build anything. No commitment to start.

    Start your project in minutes. After credits run out, 20+ products include free monthly usage. Only pay when you're ready to scale with Google Cloud.
    Start Building Free
  • 1
    Meta Package Manager

    Meta Package Manager

    Wraps all package managers with a unifying CLI

    Meta Package Manager wraps all package managers with a unifying CLI, and provides the MPM CLI, a wrapper around all package managers. MPM is like yt-dlp, but for package managers instead of videos. MPM solves XKCD #1654 - Universal Install Script. List installed packages. List duplicate installed packages. Search for packages. Install a package, remove a package, and list outdated packages. Sync local package infos. Upgrade all outdated packages. Backup list of installed packages to TOML file. Restore/install list of packages from TOML files. Pin-point commands to a subset of package managers (include/exclude selectors). ...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 2
    CSVfix

    CSVfix

    Command-line tool specifically designed to deal with CSV data

    Copyright © 2014 Neil Butterworth. If you have any dealings at all with data and databases, then you almost certainly will have to deal with comma-separated values (CSV) data. Unfortunately, the CSV files you are given, or are required to produce, never seem to be in quite the right format for your particular business application. And because of the structure of CSV records, using standard text processing tools like sed, awk and perl is not as simple as it might...
    Downloads: 2 This Week
    Last Update:
    See Project
  • 3

    Specify Attachment Parser

    Compare file system dir to Specify attachments

    ...Using the Specify attachment import wizard was not an option, as it will re-import and duplicate the images already present in Specify. The Specify Attachment Parser allowed us to rapidly identify the 466 images missing from Specify, copy them to a target directory, and use the Specify attachment import wizard to attach them.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 4

    lsdup

    List files with duplicate contents

    lsdup, short for "list duplicates", is a command line tool which can assist in finding and removing files with identical contents. Unlike many file deduplication tools, this has a "comparison mode" which lets you tell lsdup to "only read the files in this directory, do not consider any for duplicates... but, the files in that other directory may have duplicates, so delete (or move) any of those." lsdup also has normal deduplication, where, if given a single directory, it will sort the...
    Downloads: 0 This Week
    Last Update:
    See Project
  • Catch Bugs Before Your Customers Do Icon
    Catch Bugs Before Your Customers Do

    Real-time error alerts, performance insights, and anomaly detection across your full stack. Free 30-day trial.

    Move from alert to fix before users notice. AppSignal monitors errors, performance bottlenecks, host health, and uptime—all from one dashboard. Instant notifications on deployments, anomaly triggers for memory spikes or error surges, and seamless log management. Works out of the box with Rails, Django, Express, Phoenix, Next.js, and dozens more. Starts at $23/month with no hidden fees.
    Try AppSignal Free
  • 5
    A Linux/UNIX command line tool to find duplicate files. The tool supports multiple ways to consider a set of files as duplicates to each other (e.g. content, size, name ... etc.).
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6

    duff

    Command-line tool for finding duplicate files

    Duff is a Unix command-line utility for quickly finding duplicates in a given set of files. Duff is written in C and should build and run on most modern Unices.
    Leader badge
    Downloads: 68 This Week
    Last Update:
    See Project
  • 7
    Provides a linux/unix command line tool to "scrub" comma delimited files. Removing extra spaces, mr. dr. etc. Also removing duplicate records based on a comparison of columns/fields. It's a bash script using awk, cut, join and nl. Using a little perl
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8
    Synclair is a tool for diff'ing and synchronizing directories. It also includes a utility to find duplicate files (by name, or md5 hash). It is a command line tool, written in Java.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Previous
  • You're on page 1
  • Next
MongoDB Logo MongoDB