Showing 329 open source projects for "duplicate"

View related business solutions
  • Ship Agents Faster Icon
    Ship Agents Faster

    Transform your applications and workflows into powerful agentic systems at global scale.

    Gemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
    Start Free
  • Custom VMs From 1 to 96 vCPUs With 99.95% Uptime Icon
    Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

    General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

    Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
    Start Free
  • 1
    dupeGuru

    dupeGuru

    Find duplicate files

    dupeGuru is a cross-platform GUI application written in Python (with Qt/Cocoa UI) that quickly detects duplicate files on your computer using flexible scanning modes—including filename fuzzy matching, content comparison, and specialized Music/Picture modes. On some linux systems pyrcc5 is not put on the path when installing python3-pyqt5, this will cause some issues with the resource files (and icons). These systems should have a respective pyqt5-dev-tools package, which should also be installed. ...
    Downloads: 238 This Week
    Last Update:
    See Project
  • 2
    grab-site

    grab-site

    Web crawler for archiving and backing up sites into WARC archives

    ...Users can dynamically apply ignore patterns during an active crawl, allowing them to skip problematic or unnecessary URLs that could slow down or block the archiving process. grab-site also provides predefined ignore sets for common site structures such as forums and other complex web platforms. Additional mechanisms like duplicate page detection help avoid re-crawling identical content.
    Downloads: 4 This Week
    Last Update:
    See Project
  • 3
    Ultimate Creator

    Ultimate Creator

    Advanced map editor

    It is an advanced object, vehicle, actor editor (full list below), which can work right in the game! Editing: Objects, Vehicles, Actors, Pickups, Checkpoints, Map icons, Gangzones, 3D texts. How to use: 1. To begin, you must have an RCon rights (optional). 2. Once you get them, type /edit command. 3. Now you are in flymode: use the keys W, A, S, D to move, and move the mouse to look around. 4. You can open the main menu by pressing the Enter key. 5. Next, select items depending on...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 4
    Cinematic Introduction In Powerpoint

    Cinematic Introduction In Powerpoint

    A Powerpoint Template for a Cinematic Introduction

    Please download the above zip file, extract it, and modify the .pptx file according to your requirements. Points not covered in the below video: 1. Duplicate animations with the animation painter. In PowerPoint, you can copy animations from one object to another by using the Animation Painter. Animation Painter applies animation effects and characteristics uniformly to other objects with one click. For this, watch: https://www.youtube.com/watch?v=N5LreRCpg2Y
    Downloads: 1 This Week
    Last Update:
    See Project
  • Build Data Resilience - Take the Assessment Today Icon
    Build Data Resilience - Take the Assessment Today

    Can you recover when it matters most? Take this quick assessment to identify gaps and build greater recovery confidence.

    Is your recovery strategy as strong as you think? Take this quick self-assessment to check your recovery readiness and gain tailored insights. In only 2 minutes, you'll learn where you fall on the recovery readiness scale.
    Take the Assessment
  • 5
    Joforce CRM

    Joforce CRM

    Open Source CRM gets better with Joforce.

    ...Features like Kanban view for deals and other modules, PDF Maker to design invoices, sales orders, etc., will help your sales reps to increase their productivity. Beyond acting as a CRM, Joforce has some extended functionalities such as Integration with Google, Zapier integration, Address Lookup, Duplicate Check, Module designer, and Masquerade User are worth giving a try.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6
    videohash

    videohash

    The Python package for near duplicate video detection

    Videohash is a Python library for detecting near-duplicate videos (Perceptual Video Hashing). Any video input can be used to generate a 64-bit equivalent hash value with this package. The video-hash-values for identical or near-duplicate videos are the same or similar, implying that if the video is resized (upscaled/downscaled), transcoded, watermark added/removed, stabilized, color changed, frame rate changed, changed aspect ratio, slightly cropped, black-bars added or removed, the hash-value should remain unchanged or not vary substantially. ...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 7
    Similarity

    Similarity

    Text similarity calculation Toolkit for Java

    ...It includes approaches such as edit distance, cosine similarity, Euclidean distance, Jaccard similarity, Jaro distance, Jaro-Winkler distance, Manhattan distance, SimHash with Hamming distance, and Sørensen-Dice coefficient. It also supports Java dependency integration through Maven or Gradle workflows. It is useful for Chinese NLP projects, search features, duplicate detection, recommendation systems, and text analysis experiments.
    Downloads: 5 This Week
    Last Update:
    See Project
  • 8

    Delete Duplicate Folder Levels

    A spreadsheet to collapse redundant folders

    This project offers an Excel spreadsheet, available for download through the Files tab (above). This spreadsheet helps the user to identify and remove duplicate directory levels. For instance, it can reduce "D:\Folder Layer\Folder Layer\Folder Layer\Another Layer\Another Layer\Filename.doc" to "D:\Folder Layer\Another Layer\Filename.doc" Duplicate folder layers can form due to normal file renaming processes, and also when restoring from archive (e.g., ZIP, RAR) files that contain folder layers. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9

    Free Weighbridge Software

    Imagic Solution Easy to Use Windows Based Weighbridge Software

    Imagic Solution Provide Easy to Use Windows Based Weighbridge Software, its Support Win10/Win11/Win7, 32 and 64 Bit both OS. Facility to Create Multi User with Various Authorisation, it will Provide Secure Weighment with Various Facility Like CCTV Image Capture, RFID Reader Integration, Boom Barrier Integration, Traffic Light, PA Sound System, LED display etc... This Software Provide a secure and Fraud-Free-Operation of All Kind Of Weighbridge, its Design to Suitable for all Kind of...
    Leader badge
    Downloads: 86 This Week
    Last Update:
    See Project
  • Go from Code to Production URL in Seconds Icon
    Go from Code to Production URL in Seconds

    Cloud Run deploys apps in any language instantly. Scales to zero. Pay only when code runs.

    Skip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
    Start Free
  • 10
    czkawka

    czkawka

    Fast cleaner of duplicates, similar images, empty folders ...

    Czkawka allows to find and delete: - Duplicate Files - Empty folders and files - Similar Images - Biggest files - Similar videos - Temporary files - Invalid symbolic links - Broken Files - Similar music files
    Leader badge
    Downloads: 39 This Week
    Last Update:
    See Project
  • 11
    ChoiceMaker
    Record matching software
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12

    link-dups

    Generate hard links for duplicate files

    Searches for files that are duplicates of each other and creates a script that will cause hard links to replace files that are duplicated so saving disk space. Download executable and type 'link-dups -h' for command line help.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13
    Graphile Starter

    Graphile Starter

    Opinionated SaaS quick-start with pre-built user account

    Opinionated SaaS quick-start with a pre-built user account and organization system for full-stack application development in React, Node.js, GraphQL and PostgreSQL. Powered by PostGraphile, TypeScript, Apollo Client, Graphile Worker, Graphile Migrate, GraphQL Code Generator, Ant Design and Next.js. This project can serve as a basis for your own project. We've added many features that most projects require, but you're free to remove them or replace them with whatever you need. We use Next.js...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14

    wadmerge

    Merges WAD files for Doom engine games.

    Merges .WAD files from Doom engine games, such as Doom, Doom2, Hexen and Heretic. Takes any number of input wads, and produces a sorted single output .WAD file. Runs on Linux and Windows, does not duplicate wad entries and allows space saving with an optional 'deduplication' method, where different entries which have the same data, only have the data stored once.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 15

    pguniq

    Pretty Good Unique - report or omit repeated lines without sorting

    This utility suppresses or reports duplicate rows without the need to sort them first. It calculates CRC32 hash for every row and saves it in bit matrix. By default it uses 4-byte hash which consumes up to 512MB of RAM. Memory is allocated by 1K chunks as needed.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    Manba

    Manba

    HTTP API Gateway

    ...Shuffle error will occur when compiling. Traffic Control (on Server or API). Circuit Breaker (on Server or API). Load balance, service discovery, plugin. Routing (Divert Traffic, Duplicate Traffic). API Aggregation. API Argument Check, API Access Control (White and Black List), API Default Return Value, API Customized Return Value, API Result Cache, JWT Authorization, API Metric Imports Prometheus. API Retry After Failure, backend server health Check, Open Management of API (GRPC, Restful). Websocket support and online data migration support. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    MinPOS

    MinPOS

    Stability POS software, Free soft develop from Openbravo POS

    ... - Bug: Can not print the receipt of the company name has special symbol (%^&...). - Bug: Can not print the close cash report if the category Name has the special symbol (%^&...). - Bug: Duplicate ticket ID. - Bug: The receipt still prints when the database has not been saved. - Bug: "Inventory Diary" Report
    Downloads: 18 This Week
    Last Update:
    See Project
  • 18
    Binance Triangle Arbitrage

    Binance Triangle Arbitrage

    Detect in-market cryptocurrency arbitrage

    ...This includes trading fees specified via EXECUTION.FEE config. All configuration is managed inside the /config directory. To setup your configuration for the first time, duplicate the config.json.example file and remove the ".example" extension. This process must be done before deploying the app for the first time and redone after each major version update where the configuration has changed.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19

    Free VCF file to CSV or Excel converter

    Excel VBA Script to convert VCF file with multiple entries to CSV file

    This is an Excel based VBA script used to import bulk .VCF files that contain more than 1 Vcard and then convert them to a comma separated .CSV file or Excel xls file that can then be imported into Outlook, Google, or any other application that supports import of contacts using CSV files. This has been written to support VCF 2.0, 2.1, 3.0 and 4.0 formatted files including those with printable encoding (MIME) and has been tested with bulk VCF files from Backupify, Google Contacts (Gmail...
    Downloads: 43 This Week
    Last Update:
    See Project
  • 20

    Grabber of Pictures

    Quick search and download pictures from Google Images

    Grabber of Pictures is a cross platform desktop application that offers efficient automation of searching and downloading pictures from "Google Pictures". Versions of the application for Windows, Linux, MacOS are available. https://www.grabber.pictures Features Duplicate all Google search settings (size, aspect ratio, type or color of image, etc.) Cross platform application (Windows, Linux and MacOS) User friendly and multilingual interface Search for an unlimited number of pictures Search for a custom number of pictures Custom selecting images for download Batch image search by several keywords and phrases separated by commas Downloading pictures in several streams Save/reset your image search configuration Drag and drop image from preview to any destination (folder, video editor, etc.) ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21

    hk-dup-finder

    hadi kiamarsi duplicate file finder

    hk-dup-finder is a free tool for find duplicate file in your computers . this software is written by Hadi Kiamarsi.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 22
    Mono Icons

    Mono Icons

    Simple, consistent open-source icon set

    The Mono icon font is a simple, consistent open-source icon set designed to be used in a wide variety of digital products. You can download the whole set of SVG icons or selected items. Designers can make a Figma duplicate or click the copy SVG button to copy and paste icons in design files. A simple, consistent open-source icon set designed to be used in a wide variety of digital products.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 23
    sfk

    sfk

    Swiss File Knife - A Command Line Tools Collection

    SFK combines many functions in a single, portable executable that belongs onto every USB stick. Search and convert text files, instant simple FTP/HTTP server, find duplicate files, compare folders, treesize, run own commands on all files of a folder - it's all within a single tool.
    Downloads: 3 This Week
    Last Update:
    See Project
  • 24
    Mega Project List

    Mega Project List

    List of practical projects that anyone can solve in any prog language

    ...Each entry is described in plain language, often with optional “added complexity” suggestions. The repo encourages contributions: you can add new projects, or strip duplicate items, and you can choose any language to implement.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    CC-Net

    CC-Net

    Tools to download and cleanup Common Crawl data

    cc_net provides tools to download, segment, clean, and filter Common Crawl to build large-scale text corpora, including monolingual datasets and the multilingual CC-100 collection introduced in the associated paper. It includes pipelines to fetch snapshots, extract text, de-duplicate, identify language, and apply quality filtering based on heuristics and language models. The outputs are intended for pretraining language models and for creating standardized corpora that can be reproduced or updated with new crawls. The repository documents practical concerns like HTTP failures, snapshot differences, and stats JSONs, reflecting community use across many languages. ...
    Downloads: 0 This Week
    Last Update:
    See Project