Search Results for "find duplicate"
Sort By:
Showing 37 open source projects for "find duplicate"
View related business solutions-
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
1
Czkawka
Multi functional app to find duplicates, empty folders, similar images
Czkawka (Polish for “hiccup”) is a lightning‑fast, multi‑purpose file cleaning tool written in Rust. It helps users declutter storage by finding duplicate files, similar images or audio, empty folders, and unusually large files through CPU‑efficient multithreading. Available with both GUI (GTK‑based) and CLI versions for flexible usage. -
2
FDUPES
FDUPES is a program for identifying or deleting duplicate files
FDUPES is a lightweight command-line utility that helps users find and optionally delete duplicate files within specified directories by comparing file contents, which can be extremely useful for cleaning up storage clutter or organizing large collections of files. It works by scanning directories and subdirectories, identifying sets of files with identical content through size and hash comparisons, and then listing them together so users can examine duplicates. -
3
Percona Toolkit
A collection of advanced open source command-line tools
...Utilities such as pt-query-digest analyze slow logs and packet captures to surface hotspots and regressions, while pt-online-schema-change applies ALTERs with minimal blocking by copying and swapping tables. Consistency tools like pt-table-checksum and pt-table-sync detect and reconcile replication drift across replicas or shards. Other helpers find duplicate indexes, unused keys, skewed data distributions, and configuration issues that quietly erode performance. Each tool favors guardrails: dry runs, throttling, and resumable operations reduce the risk of harming production workloads. Operators and DBAs rely on the toolkit to bring observability and predictability to busy database fleets without hand-rolled scripts. -
4
RemoveDuplicate
A software that can helps you remove duplicate files
RemoveDuplicate is a Windows application designed to help users find and remove duplicate files within folders. It uses MD5 hashing to identify identical files and provides a user-friendly interface to manage and delete duplicates while keeping one copy of each file. -
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
5
LittleLink
A lightweight DIY alternative to services like Linktree
The DIY self-hosted LinkTree alternative. LittleLink has more than 60 branded button styles you can easily use, with more being added by our community all the time. LittleLink has more than 60 branded button styles you can use (with even more being added by our community). You'll also find a light and dark theme ready to go. Not a fan of the default colors? Update skeleton-light.css or skeleton-dark.css to the HEX values of your choosing. You can also set your CSS to skeleton-auto.css, which... -
6
Swiss File Knife
One hundred command line tools in a small and portable binary.
Create zip files, extract zip files, replace text in files, search in files using expressions, stream text editor, instant command line ftp and http server, send folder via network, copy folder excluding sub folders and files, find duplicate files, run a command on all files of a folder, split and join large files, make md5 checksum lists of files, remove tab characters, convert CR/LF, list newest or biggest files of a folder, compare folders, treesize, show first or last lines of a file, find filenames fast using index files, rename many files using expressions, copy part of a file, change times of a file, set file time from filename, print colored text to terminal, convert csv to tab separated, download files from web, send http or udp requests, print tcp or udp traffic, create hexdump of files, join many text files into one, list nested .zip .tar .tar.gz .tar.bz2 archive contents. ... -
7
PeaZip
Free Zip software and Rar extractor
...Create: 7Z, ARC, Brotl, BZip, GZip, PEA, TAR, WIM, XZ, ZPAQ, ZIP, Zstandard files and more Open and extract 200+ file types: ACE, CAB, DEB, ISO, RAR, ZIPX and more Features of PeaZip includes extract, create and convert multiple archives at once, create self-extracting archives (sfx), split files, strong encryption with two factor authentication, encrypted password manager, secure deletion, find duplicate files, calculate hashes, export task definition as command line script. -
8
TextureAtlas Toolbox
A powerful, free and open-source tool for TextureAtlases/Spritesheets
TextureAtlas Toolbox is an all-in-one solution for working with texture atlases and sprite sheets. Extract sprites into organized frame collections and GIF/WebP/APNG animations, generate optimized atlases from individual frames, or convert between 15+ atlas formats. Perfect for game developers, modders, and anyone creating showcases of game sprites. Formerly known as TextureAtlas to GIFs and Frames Licensed under AGPL-3.0 Third-party licenses: See... -
9
Useful Scripts
Useful scripts for making developer's everyday life easier
...The scripts of this warehouse (such as related scripts) are deployed and used in the online production environment of JavaAlibaba and other companies (such as Portable Cloud). It is used to quickly troubleshoot performance problems, automatically find out how many threads are consumed in the running process, and print out their thread stacks to determine the method calls that cause performance problems. Find out duplicate classes in jar files and class directories. Used to troubleshoot Javaclass conflicts. -
99.99% Uptime for MySQL and PostgreSQL DatabasesCloud SQL Enterprise Plus delivers near-zero downtime with 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server.
-
10
dupeGuru
Find duplicate files
dupeGuru is a cross-platform GUI application written in Python (with Qt/Cocoa UI) that quickly detects duplicate files on your computer using flexible scanning modes—including filename fuzzy matching, content comparison, and specialized Music/Picture modes. On some linux systems pyrcc5 is not put on the path when installing python3-pyqt5, this will cause some issues with the resource files (and icons). These systems should have a respective pyqt5-dev-tools package, which should also be... -
11
czkawka
Fast cleaner of duplicates, similar images, empty folders ...
Czkawka allows to find and delete: - Duplicate Files - Empty folders and files - Similar Images - Biggest files - Similar videos - Temporary files - Invalid symbolic links - Broken Files - Similar music files -
12
hk-dup-finder
hadi kiamarsi duplicate file finder
hk-dup-finder is a free tool for find duplicate file in your computers . this software is written by Hadi Kiamarsi. -
13
sfk
Swiss File Knife - A Command Line Tools Collection
SFK combines many functions in a single, portable executable that belongs onto every USB stick. Search and convert text files, instant simple FTP/HTTP server, find duplicate files, compare folders, treesize, run own commands on all files of a folder - it's all within a single tool. -
14
DataCleaner
Data quality analysis, profiling, cleansing, duplicate detection +more
DataCleaner is a data quality analysis application and a solution platform for DQ solutions. It's core is a strong data profiling engine, which is extensible and thereby adds data cleansing, transformations, enrichment, deduplication, matching and merging. Website: http://datacleaner.github.io -
15
With this song management application you are able to keep an eye on your UltraStar collection. Quickly find songs with missing covers, backgrounds or videos.
-
16
Uniq Copy
Java Desktop application which helps de-duplicate files during copy.
UniqCopy scans a source folder to get a list of all the files and then guesses duplicated files based on file name and file size. Using this information, it copies all files to the target folder, maintaining the relative structure of the files within the target folder. Files considered to have been duplicated in the source folder are copied only once to one of the matching locations in the target folder, and the other locations are skipped. A summary of these "skipped duplicates" is... -
17
OJson
Optimised JSON (Javascript Object Notation)
Optimise JSON by removing duplicate strings and arrays containing repeated object keys. Here you will find binary downloads and discussion (https://sourceforge.net/p/ojson/discussion/) . The actual development and issue tracking can be found here: https://bitbucket.org/cryanfuse/ojson -
18
DupStat
Duplicate/unique file analyzer with at-a-glance statistics.
This tool helps find duplicate files and folders across two selected directories. It can answer questions like, "What files are on my thumb drive that are not on my PC", and can help synchronize different backup copies of a folder structure. It helps you merge backups without accidentally deleting unique files. DupStat compares files across two selected directories (and their subdirectories). -
19
Music Merge Manager
Identify duplicate songs based on track metadata (ID3, etc)
Given two trees of audio files, examine the metadata for each file to try and determine the differences in the content of the trees. This helps find duplicate songs (or non-duplicated songs) even if the music is stored in different formats. Toggles let you determine how specific the matching criteria must be: Track number and song name? Artist, album, and track length? All of the above? Ultimately this program will let you delete duplicates from either the left or right trees, or copy non-duplicated files from one tree to the other. ... -
20
Filekit
File Processing Tools - string search and DOS command execution
Filekit is a set of file processing GUI tools that can be put into an USB flash, so that no installation is required. Aim of the project is to include many file processing tools such as file searching tool, batch rename file, find duplicate files, split and join files and so on ... Release 0.1.0 consist of the multi-threaded file search tool that allow you to select multiple folders and files, then search those files that contains particular strings using regular expression. Release 2.0 includes the DOS command execution function, so that you can apply DOS command to a list of selected folders and files. ... -
21
CloneManager
Allow to find duplicate files
Two goals : Allow to find duplicated files on computer / find files which haven't been backed up yet -
22
DuplicateFinder
Find duplicated files on your computer.
A small application to find duplicates on your computer, the application has a simple interface that is easy to understand, all you need to do is select the hard drive or folder and click start and the application will find the duplicates for you. Like this program? Support the developer's newest project on KickStarter: https://www.kickstarter.com/projects/1451017695/korduene-visual-programming-ide -
23
Simple Directory Toolbox
Portable collections of directory tools (Unhide etc)
...I plan to create some tools, but because it's still alpha, there are still few finished. Still, you can use it. 1. Unhidder Finds hidden/Superhidden files/folders and restore it to normal state 2. Duplicate file finder Find duplicated files, and easily removes it 3. Space analyzer Analyze folder, list which file/folder takes how much size in disk Here is the virustotal result https://www.virustotal.com/en/file/a5b742d657293c0563364e28545548afd45501e5ed9a72e69875177e757ace1e/analysis/1391693986 -
24
ourfilesystem
Peer-to-peer file-sharing system.
...Someone else may mark another file as a re-encoded duplicate, or simply add more search terms. You can search information people have shared about their files and download a file from them if you do not already have it. Files are shared within groups. Anyone can create a group and only allow whom they wish to join. Public and private messages are also supported. -
25
Duplicate File Fixer 1.00g
Find Duplicate Files and Manage Them
This software finds duplicate files across all directory levels inside a given folder.