Showing 329 open source projects for "duplicate"

View related business solutions
  • Build Agents and Models on One Platform Icon
    Build Agents and Models on One Platform

    Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

    Gemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
    Start Free
  • Custom VMs From 1 to 96 vCPUs With 99.95% Uptime Icon
    Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

    General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

    Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
    Start Free
  • 1
    SurveyJS

    SurveyJS

    JavaScript Survey and Form Library

    SurveyJS Form Library is distributed as npm packages and as scripts and style sheets that you can reference on your page. You can use it in any React, Angular, Vue, Knockout, or jQuery application. React, Angular, Knockout, and Vue3 are supported natively. To communicate with the server, the libraries use JSON objects that represent form schemas (content and layout of a form) and form results (answers). You have the option to build dynamic JSON-driven forms using our free full-featured...
    Downloads: 2 This Week
    Last Update:
    See Project
  • 2
    Text Line Duplicate Remover

    Text Line Duplicate Remover

    Remove duplicate lines from your text

    This standalone offline web browser tool helps you remove duplicate lines from your text, with additional text processing options. Simply open it in your browser by double-clicking the html file. It also includes the source code too. I made this when I was working with long lists of entries and needed something to automatically clean them up. As a bonus you can also change the Sentence Case of the text, make it lowercase, UPPERCASE or Sentence case.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 3

    RemoveDuplicateLinesFromTxt

    Remove Duplicate lines From Files in TXT

    This program remove duplicate lines in txt files.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 4
    SortMyShit

    SortMyShit

    A tool designed to help you organize and manage your files

    SortMyShit is an open-source Python project designed to help you organize and manage your files effortlessly. It provides customizable sorting rules to keep your directories clean and structured.
    Downloads: 5 This Week
    Last Update:
    See Project
  • Go from Code to Production URL in Seconds Icon
    Go from Code to Production URL in Seconds

    Cloud Run deploys apps in any language instantly. Scales to zero. Pay only when code runs.

    Skip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
    Start Free
  • 5
    Swiss File Knife

    Swiss File Knife

    One hundred command line tools in a small and portable binary.

    Create zip files, extract zip files, replace text in files, search in files using expressions, stream text editor, instant command line ftp and http server, send folder via network, copy folder excluding sub folders and files, find duplicate files, run a command on all files of a folder, split and join large files, make md5 checksum lists of files, remove tab characters, convert CR/LF, list newest or biggest files of a folder, compare folders, treesize, show first or last lines of a file, find filenames fast using index files, rename many files using expressions, copy part of a file, change times of a file, set file time from filename, print colored text to terminal, convert csv to tab separated, download files from web, send http or udp requests, print tcp or udp traffic, create hexdump of files, join many text files into one, list nested .zip .tar .tar.gz .tar.bz2 archive contents. ...
    Leader badge
    Downloads: 1,215 This Week
    Last Update:
    See Project
  • 6

    ParDRe

    Parallel tool to remove duplicate DNA reads

    ParDRe is a parallel tool to remove duplicate reads. Duplicate reads can be seen as identical or nearly identical sequences with some mismatches. This tool will let the users to avoid the analysis of not necessary reads, reducing the time of subsequent procedures with the dataset (e.g., assemblies, mappings, etc.). The tool is implemented with MPI in order to exploit the parallel capabilities of multicore clusters.
    Downloads: 5 This Week
    Last Update:
    See Project
  • 7
    MangoDisk

    MangoDisk

    Open-source disk cleaner for Windows, macOS and Linux

    MangoDisk is a free, open-source disk cleaner for Windows, macOS and Linux. Find caches, large files, exact duplicates and app leftovers without digging through hidden folders. Explore disk usage with nested treemaps or a sunburst chart to see which folders take up the most space. Privacy Cleanup lets you review supported browser, app and system activity by time range. Clearing cookies can sign you out of websites. Also included: app uninstall, startup management, system optimization,...
    Downloads: 63 This Week
    Last Update:
    See Project
  • 8
    PeaZip

    PeaZip

    Free Zip software and Rar extractor

    ...Create: 7Z, ARC, Brotl, BZip, GZip, PEA, TAR, WIM, XZ, ZPAQ, ZIP, Zstandard files and more Open and extract 200+ file types: ACE, CAB, DEB, ISO, RAR, ZIPX and more Features of PeaZip includes extract, create and convert multiple archives at once, create self-extracting archives (sfx), split files, strong encryption with two factor authentication, encrypted password manager, secure deletion, find duplicate files, calculate hashes, export task definition as command line script.
    Leader badge
    Downloads: 2,981 This Week
    Last Update:
    See Project
  • 9

    littleutils

    Various small and useful command-line utilities

    The littleutils include duplicate file finders (repeats, repeats.pl, repeats.py), image optimizers (opt-jpg, opt-png, opt-gif, recomp-jpg), file rename tools (lowercase, uppercase, pren), archive recompressors (to-gzip, to-bzip2, to-bzip3, to-7zip, to-lzma, to-lzip, to-xz), a tempfile utility (tempname), file property tools (filedate, filemode, filenode, fileown, filesize, and lrealpath), and others.
    Downloads: 1 This Week
    Last Update:
    See Project
  • MongoDB Atlas runs apps anywhere Icon
    MongoDB Atlas runs apps anywhere

    Deploy in 115+ regions with the modern database for every enterprise.

    MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
    Start Free
  • 10
    Second Brain

    Second Brain

    Self-hosted AI memory layer. Works with Claude, ChatGPT, Cursor.

    ...One-click deploy provisions everything in your own Cloudflare account. Your data never touches a third party after setup. Features semantic search via vector embeddings, time decay reranking, duplicate detection, and an append tool for updating existing memories without creating conflicts. MIT licensed. Open source.
    Downloads: 5 This Week
    Last Update:
    See Project
  • 11
    Photo Agent

    Photo Agent

    Duplicate Photo Finder and Cleaner for Linux

    The program is very easy to use. Simply point to the path and click scan. Mark any unwanted photos and click "Send to Fake Trash." Then, switch to the Fake Trash tab, make sure you've selected the correct files, and select and delete them all (they can no longer be recovered). If you want to return any, simply mark them and recover them (Restore Selected). If the directory you're pointing to is very large or complex, the program may freeze for a moment when you press the scan button. This is...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12
    The Timeline Project

    The Timeline Project

    Cross-platform app for displaying and navigating events on a timeline.

    The Timeline Project aims to create a free, cross-platform application for displaying and navigating events on a timeline.
    Leader badge
    Downloads: 82 This Week
    Last Update:
    See Project
  • 13
    XnView MP
    ...With its easy-to-use explorer-like interface, XnView MP allow you to quickly view your images and photos, but also to make image management. You have features like batch rename, batch converter, duplicate image finder, image compare, but you can also create contact sheets, slideshow. XnConvert is a fast and powerful batch image converter, you can convert, resize, watermark, add text, enhance, filter in batch mode. XnResize is a fast and powerful batch image resizer, you can convert, resize in batch mode. You have the Online Convert to batch resize and convert your files from your web browser.
    Downloads: 141 This Week
    Last Update:
    See Project
  • 14

    logwitch

    a simple log file scanner for linux written in shell and lua

    ...You configure it to watch for lines in log files that interest you in by creating a simple text file in its config directory. It emails a daily report to you and timestamps logs so that you do not receive duplicate information. logwitch is GPL3 licensed
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15

    libpolycall-v1

    Libpolycall - The World irst Polyglot System

    ...Python talks to Python. Node.js whispers to JavaScript. Java shouts in its own dialect. Meanwhile, developers waste countless hours building bridges between languages, creating duplicate APIs, and maintaining separate implementations for what should be unified solutions. **This ends now.** ## The Program-First Revolution LibPolyCall represents a fundamental shift from "binding-first" to "program-first" architecture. While others build language-specific solutions, we've created something unprecedented: **a single protocol that makes language barriers obsolete**.
    Downloads: 7 This Week
    Last Update:
    See Project
  • 16
    DupRem

    DupRem

    Simple application to remove duplicate and empty lines on text files.

    DupRem is a simple easy-to-use cross-platform application to remove duplicate and empty lines from any text file. It is also possible to keep or ignore case sensitive. Works also from command-line interface, e.g. "java -jar duprem.jar -r input_file.txt >output_file.txt", to create output file, or "java -jar duprem.jar -r input_file.txt >>output_file.txt", to create or append to output file. DupRem is portable, does not need installation and is developed in Java, so needs the Java Virtual Machine (version 6 or higher) that, in the case, is very easy to download and install.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    Bootleg Sound Processor

    Bootleg Sound Processor

    Software for processing audio files.

    Software for processing audio files. The files "Batch Processor.py" and "Duplicate remover.py" are meant to be used with the output of Bootleg Text Slicer (https://github.com/Northstrix/bootleg-text-slicer) placed into the "Unprocessed" folder, while "Single file processor.py" can be used with standalone files from arbitrary locations. GitHub repository: https://github.com/Northstrix/bootleg-sound-processor Made using Google AI Studio (https://aistudio.google.com/) and Perplexity (https://www.perplexity.ai/)
    Downloads: 0 This Week
    Last Update:
    See Project
  • 18
    SIMILAR

    SIMILAR

    Compares Folders for Same Name and/or Size Files

    I developed this application because I was not happy with existing ones. The program analyzes two folders to determine whether they are identical or different by identifying files with the same name and/or size. The resulting list can be saved as a text file. Files with matching names and/or sizes can be deleted, but only those in the second directory will be removed. You can control which files are deleted through the textbox, as only the files displayed there will be deleted. Vary name...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 19
    favbox

    favbox

    Local-first bookmarks manager. No ads, no tracking, no clutter.

    FavBox is a local-first experimental browser extension that enhances and simplifies bookmark management without cloud storage or third-party services. It extends your browser's native bookmarking features.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20
    HomeBank

    HomeBank

    Free, easy, personal accounting for everyone

    «HomeBank» is the software you have always wanted to manage your personal accounts. It brings you many features to analyze your finances in a detailed way instantly and dynamically with powerfull report tools based on filtering and graphical charts.
    Downloads: 10 This Week
    Last Update:
    See Project
  • 21
    QuickWheel

    QuickWheel

    It lowers friction of daily browsing by allowing quick actions.

    ...Hold middle-click or press Alt + Q, flick toward an action, and release. Features: • Radial navigation wheel with 8 browser actions • Mouse gesture controls • Middle-click activation • Alt + Q keyboard shortcut • Duplicate and reopen tabs • Mute and unmute tabs • Focus browser search • Jump to the top of a page • Translate pages • Copy links • Copy Markdown links • Native middle-click autoscroll preserved • Runs locally with no analytics or external tracking • Lightweight and designed to stay out of the way QuickWheel is designed for faster browser navigation and repetitive browser workflows, especially for power users who frequently manage tabs, navigate webpages, and perform the same actions repeatedly. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 22
    ai-budget-assistant

    ai-budget-assistant

    Budget app with AI chat, voice input, and family purchase voting.

    ...For shared family accounts, members can propose purchases and vote to approve or reject them before money is spent. An activity feed shows recent transactions across all account members. Bank statement import supports Wise CSV and several Polish banks. A duplicate detection layer prevents double-counting across sources. The mobile app works offline. Local SQLite storage syncs to a PostgreSQL backend when connectivity is rest
    Downloads: 0 This Week
    Last Update:
    See Project
  • 23
    ImageMerge

    ImageMerge

    A GUI tool to merge images/videos from multiple folders.

    A GUI tool to merge images/videos from multiple folders, remove duplicates with SHA-256, and rename files into a clean sequential format.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 24
    ...Example: DW_A4423.wav becomes 2025-12-15 14.42 01 Dictation.wav. Components of that filename: date and 24-hour time when the recording was made; 01 indicates that it is the first recording created in that minute (eliminating duplicate filenames if more than one recording was created in that clock minute). For more information, see https://raywoodcockslatest.wordpress.com/2026/03/21/vn-960pc-capture/
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25

    local_search

    Load filenames to a local database for an easy search

    Load filenames to a local database for an easy search. This program is made with my Swedish Compiler. That is focusing on a simple Gui and support many different databases (PostgreSQL, MariaDB, SqLite, Odbc). It’s working under Linux (Wine).
    Downloads: 0 This Week
    Last Update:
    See Project