Showing 10 open source projects for "duplicate"

View related business solutions
  • Gemini 3 and 200+ AI Models on One Platform Icon
    Gemini 3 and 200+ AI Models on One Platform

    Access Google's best plus Claude, Llama, and Gemma. Fine-tune and deploy from one console.

    Build generative AI apps with Vertex AI Studio. Switch between models without switching platforms.
    Start Free
  • Cut Cloud Costs with Google Compute Engine Icon
    Cut Cloud Costs with Google Compute Engine

    Save up to 91% with Spot VMs and get automatic sustained-use discounts. One free VM per month, plus $300 in credits.

    Save on compute costs with Compute Engine. Reduce your batch jobs and workload bill 60-91% with Spot VMs. Compute Engine's committed use offers customers up to 70% savings through sustained use discounts. Plus, you get one free e2-micro VM monthly and $300 credit to start.
    Try Compute Engine
  • 1
    Percona Toolkit

    Percona Toolkit

    A collection of advanced open source command-line tools

    ...Utilities such as pt-query-digest analyze slow logs and packet captures to surface hotspots and regressions, while pt-online-schema-change applies ALTERs with minimal blocking by copying and swapping tables. Consistency tools like pt-table-checksum and pt-table-sync detect and reconcile replication drift across replicas or shards. Other helpers find duplicate indexes, unused keys, skewed data distributions, and configuration issues that quietly erode performance. Each tool favors guardrails: dry runs, throttling, and resumable operations reduce the risk of harming production workloads. Operators and DBAs rely on the toolkit to bring observability and predictability to busy database fleets without hand-rolled scripts.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 2
    Syncpack

    Syncpack

    Consistent dependency versions in large JavaScript Monorepos

    Syncpack is a command-line tool for managing and synchronizing dependency versions across JavaScript monorepos. It ensures consistency in package versions within a project, preventing conflicts caused by mismatched dependencies.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 3
    Meta Package Manager

    Meta Package Manager

    Wraps all package managers with a unifying CLI

    Meta Package Manager wraps all package managers with a unifying CLI, and provides the MPM CLI, a wrapper around all package managers. MPM is like yt-dlp, but for package managers instead of videos. MPM solves XKCD #1654 - Universal Install Script. List installed packages. List duplicate installed packages. Search for packages. Install a package, remove a package, and list outdated packages. Sync local package infos. Upgrade all outdated packages. Backup list of installed packages to TOML file. Restore/install list of packages from TOML files. Pin-point commands to a subset of package managers (include/exclude selectors). ...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 4
    CSVfix

    CSVfix

    Command-line tool specifically designed to deal with CSV data

    Copyright © 2014 Neil Butterworth. If you have any dealings at all with data and databases, then you almost certainly will have to deal with comma-separated values (CSV) data. Unfortunately, the CSV files you are given, or are required to produce, never seem to be in quite the right format for your particular business application. And because of the structure of CSV records, using standard text processing tools like sed, awk and perl is not as simple as it might...
    Downloads: 2 This Week
    Last Update:
    See Project
  • Enterprise-grade ITSM, for every business Icon
    Enterprise-grade ITSM, for every business

    Give your IT, operations, and business teams the ability to deliver exceptional services—without the complexity.

    Freshservice is an intuitive, AI-powered platform that helps IT, operations, and business teams deliver exceptional service without the usual complexity. Automate repetitive tasks, resolve issues faster, and provide seamless support across the organization. From managing incidents and assets to driving smarter decisions, Freshservice makes it easy to stay efficient and scale with confidence.
    Try it Free
  • 5

    lsdup

    List files with duplicate contents

    lsdup, short for "list duplicates", is a command line tool which can assist in finding and removing files with identical contents. Unlike many file deduplication tools, this has a "comparison mode" which lets you tell lsdup to "only read the files in this directory, do not consider any for duplicates... but, the files in that other directory may have duplicates, so delete (or move) any of those." lsdup also has normal deduplication, where, if given a single directory, it will sort the...
    Downloads: 2 This Week
    Last Update:
    See Project
  • 6
    A Linux/UNIX command line tool to find duplicate files. The tool supports multiple ways to consider a set of files as duplicates to each other (e.g. content, size, name ... etc.).
    Downloads: 0 This Week
    Last Update:
    See Project
  • 7

    duff

    Command-line tool for finding duplicate files

    Duff is a Unix command-line utility for quickly finding duplicates in a given set of files. Duff is written in C and should build and run on most modern Unices.
    Leader badge
    Downloads: 68 This Week
    Last Update:
    See Project
  • 8
    A linux command line tool for detecting duplicate images, where one may have been resized, watermarked, and/or had some colour correction etc. performed on it.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    Provides a linux/unix command line tool to "scrub" comma delimited files. Removing extra spaces, mr. dr. etc. Also removing duplicate records based on a comparison of columns/fields. It's a bash script using awk, cut, join and nl. Using a little perl
    Downloads: 0 This Week
    Last Update:
    See Project
  • Try Google Cloud Risk-Free With $300 in Credit Icon
    Try Google Cloud Risk-Free With $300 in Credit

    No hidden charges. No surprise bills. Cancel anytime.

    Use your credit across every product. Compute, storage, AI, analytics. When it runs out, 20+ products stay free. You only pay when you choose to.
    Start Free
  • 10
    Synclair is a tool for diff'ing and synchronizing directories. It also includes a utility to find duplicate files (by name, or md5 hash). It is a command line tool, written in Java.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Previous
  • You're on page 1
  • Next
MongoDB Logo MongoDB