Open Source Linux Duplicate File Finders
Sort By:
Duplicate File Finders for Linux
View 3 business solutionsBrowse free open source Duplicate File Finders and projects for Linux below. Use the toggles on the left to filter open source Duplicate File Finders by OS, license, language, programming language, and project status.
-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
1
dupeGuru
Find duplicate files
dupeGuru is a cross-platform GUI application written in Python (with Qt/Cocoa UI) that quickly detects duplicate files on your computer using flexible scanning modes—including filename fuzzy matching, content comparison, and specialized Music/Picture modes. On some linux systems pyrcc5 is not put on the path when installing python3-pyqt5, this will cause some issues with the resource files (and icons). These systems should have a respective pyqt5-dev-tools package, which should also be installed. The presence of pyrcc5 can be checked with which pyrcc5. Debian based systems need the extra package, and Arch does not. Scanning by filename or content with fuzzy matching to catch similar filenames. -
2
Swiss File Knife
One hundred command line tools in a small and portable binary.
Create zip files, extract zip files, replace text in files, search in files using expressions, stream text editor, instant command line ftp and http server, send folder via network, copy folder excluding sub folders and files, find duplicate files, run a command on all files of a folder, split and join large files, make md5 checksum lists of files, remove tab characters, convert CR/LF, list newest or biggest files of a folder, compare folders, treesize, show first or last lines of a file, find filenames fast using index files, rename many files using expressions, copy part of a file, change times of a file, set file time from filename, print colored text to terminal, convert csv to tab separated, download files from web, send http or udp requests, print tcp or udp traffic, create hexdump of files, join many text files into one, list nested .zip .tar .tar.gz .tar.bz2 archive contents. Fully portable, for USB stick, without installation. For Windows, Linux and Mac OS/X. -
3
FDUPES
FDUPES is a program for identifying or deleting duplicate files
FDUPES is a lightweight command-line utility that helps users find and optionally delete duplicate files within specified directories by comparing file contents, which can be extremely useful for cleaning up storage clutter or organizing large collections of files. It works by scanning directories and subdirectories, identifying sets of files with identical content through size and hash comparisons, and then listing them together so users can examine duplicates. Once duplicates are identified, the tool offers interactive deletion options where users can choose which copy to keep and which to remove, or apply flags to automate deletion while preserving a single instance. Because it operates directly on file content rather than just filenames, fdupes can accurately detect true copies and guide cleaning operations in data cleanup or migration tasks. It’s a simple, efficient, and widely used utility on Unix-like systems, appreciated by administrators, developers, and power users. -
4
Duplicate Files Finder is a cross-platform application for finding and removing duplicate files by deleting, creating hardlinks or creating symbolic links. A special algorithm minimizes the amount of data read from disk, so the program is very fast.
-
Veeam Data Platform v13.1 - Get Your Free TrialTry Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
5
MediaFileDuplicateFinder
MediaFileDuplicateFinder finds duplicated video, image, & audio files
Media File Duplicate Finder finds duplicated video and image files based on similarity. Finds duplicates which have different resolution, frame rate, watermark, and video file tags. It's a cross-platform program that supports Windows, Linux and Mac-OS. Please use below link to report bugs, feature-request, or questions. https://github.com/David-Maisonave/MediaFileDuplicateFinder/issues/new/choose For more information, visit the following Wiki page: https://github.com/David-Maisonave/MediaFileDuplicateFinder/wiki -
6
GDuplicateFinder
GDuplicateFinder - A FREE Groovy way to find file duplicates!
Unlike other duplicate finders such as Easy Duplicate File Finder, Auslogics Duplicate File Finder, MindGems Fast Duplicate File Finder, Duplicate Cleaner, DupFiles and others, GDuplicateFinder is a FREE cross-platform application, with the ability to search among not just local files, but files on the network, such as a Windows or a Linux share using VFS library. Taking advantage of Groovy facilities and GPars power to process in parallel, GDuplicateFinder will help you get rid of those duplicates you always wanted to dispose in an easy and friendly way. Looking for translators to translate the app! If you'd like to help me, please create a GitHub Issue here (https://github.com/guicamest/GDuplicate-Finder/issues) mentioning the language so that I get notified. Thanks in advance <3 If you want to help me continue improving this app, donate some money through paypal! https://www.paypal.com/cgi-bin/webscr?cmd=_s-xclick&hosted_button_id=fezuqqg9t6j6y -
7
Duplicate Agent
Duplicate Files Finder and Cleaner
This program was created to detect and delete unnecessary files on your computer that you've unknowingly created, copied, or backed up in some way. You can find the release notes on my Github address: https://github.com/shampuan/Duplicate-Agent/issues -
8
SIMILAR
Compares Folders for Same Name and/or Size Files
I developed this application because I was not happy with existing ones. The program analyzes two folders to determine whether they are identical or different by identifying files with the same name and/or size. The resulting list can be saved as a text file. Files with matching names and/or sizes can be deleted, but only those in the second directory will be removed. You can control which files are deleted through the textbox, as only the files displayed there will be deleted. Vary name similarity allows for the identification of files with similar names not exactly the same. Increasing the number of Vary name similarity and Word Size textboxes make the search more restricted. -
9
dupliFinder
Find duplicate files on your system
dupliFinder is a app that searches your computer for duplicate files by compairing the MD5 sum of each file. You then have the option of deleting any duplicate files found. Great for collections of MP3s, images etc.. Runs on Windows & Linux with Java 1.5 -
Train ML Models With SQL You Already KnowBuild and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
-
10
SortMyShit
A tool designed to help you organize and manage your files
SortMyShit is an open-source Python project designed to help you organize and manage your files effortlessly. It provides customizable sorting rules to keep your directories clean and structured. -
11
littleutils
Various small and useful command-line utilities
The littleutils include duplicate file finders (repeats, repeats.pl, repeats.py), image optimizers (opt-jpg, opt-png, opt-gif, recomp-jpg), file rename tools (lowercase, uppercase, pren), archive recompressors (to-gzip, to-bzip2, to-bzip3, to-7zip, to-lzma, to-lzip, to-xz), a tempfile utility (tempname), file property tools (filedate, filemode, filenode, fileown, filesize, and lrealpath), and others. See the README file for more details. -
12
Filekit
File Processing Tools - string search and DOS command execution
Filekit is a set of file processing GUI tools that can be put into an USB flash, so that no installation is required. Aim of the project is to include many file processing tools such as file searching tool, batch rename file, find duplicate files, split and join files and so on ... Release 0.1.0 consist of the multi-threaded file search tool that allow you to select multiple folders and files, then search those files that contains particular strings using regular expression. Release 2.0 includes the DOS command execution function, so that you can apply DOS command to a list of selected folders and files. You can batch rename files using this feature. This release add an option to select files from the result panel and let you do iteration processing. Other features will be provided in future. -
13
Command line duplicate file finder for Linux machines, which finds the duplicate files by its content, name & directories by its name. Easy usage and efficient too.
-
14
DupStat
Duplicate/unique file analyzer with at-a-glance statistics.
This tool helps find duplicate files and folders across two selected directories. It can answer questions like, "What files are on my thumb drive that are not on my PC", and can help synchronize different backup copies of a folder structure. It helps you merge backups without accidentally deleting unique files. DupStat compares files across two selected directories (and their subdirectories). It shows duplication statistics across the selected directories to help you see where entire directories are duplicated. Version 0.5 has several new features, including Action menu with copy/move/delete capability, drag-and-drop capability to specify search directories on either side, file counts in the file pane, tooltips for most UI controls and options, directory swap and copy buttons, cleaned up UI options, Several updates and refinements are also included; see the change history section of the Readme file. -
15
Simple Directory Toolbox
Portable collections of directory tools (Unhide etc)
Hi, simple directory tools is another portable software i made. I made this to help people whom work with directory/files using longer method (cmd, etc). I plan to create some tools, but because it's still alpha, there are still few finished. Still, you can use it. 1. Unhidder Finds hidden/Superhidden files/folders and restore it to normal state 2. Duplicate file finder Find duplicated files, and easily removes it 3. Space analyzer Analyze folder, list which file/folder takes how much size in disk Here is the virustotal result https://www.virustotal.com/en/file/a5b742d657293c0563364e28545548afd45501e5ed9a72e69875177e757ace1e/analysis/1391693986 -
16
Text Line Duplicate Remover
Remove duplicate lines from your text
This standalone offline web browser tool helps you remove duplicate lines from your text, with additional text processing options. Simply open it in your browser by double-clicking the html file. It also includes the source code too. I made this when I was working with long lists of entries and needed something to automatically clean them up. As a bonus you can also change the Sentence Case of the text, make it lowercase, UPPERCASE or Sentence case. -
17
fdf
FDF: Find Duplicate Files
Searches a drive (possibly with additional mounted drives) for duplicate files, outputs a potential script for deleting them after editing. -
18
Fast Duplicate File Finder
Superfast, lightweight, simple duplicate file finder
A simple, super-fast, lightweight duplicate file finder written in java. System requirement: Java 1.6+ 20 KB of disk space (lol :D) -
19
CloneManager
Allow to find duplicate files
Two goals : Allow to find duplicated files on computer / find files which haven't been backed up yet -
20
Duplicate File Finder
Find duplicates of a specified file
When you've been using your computer for quite a long time, often you end up duplicating your files and you don't even know about them. Duplicate File Finder is a Linux/Unix utility than scans your hard drive for finding duplicates of a given file. -
21
Duplicate File Fixer 1.00g
Find Duplicate Files and Manage Them
This software finds duplicate files across all directory levels inside a given folder. -
22
-
23
HashCatalog is a program that can find duplicate files in one or more folders, or between 2 lists of one or more folders. HashCatalog can also create an xml database file containing a listing of files with hashes.
-
24
JustOneFile help you to find duplicate files and managed them. It's a Free and Open Source software under GNU GPL licence.
-
25
MediaCMN provides tools to create a consistent music library. In detail these tools, index all audio files of certain directories, find duplicate files, tag the files using musicbrainz and organize the audio files in a filesystem.
