Search Results for "duplicate"
Sort By:
Showing 44 open source projects for "duplicate"
View related business solutions-
Gemini 3 and 200+ AI Models on One PlatformBuild generative AI apps with Vertex AI Studio. Switch between models without switching platforms.
-
Catch Bugs Before Your Customers DoMove from alert to fix before users notice. AppSignal monitors errors, performance bottlenecks, host health, and uptime—all from one dashboard. Instant notifications on deployments, anomaly triggers for memory spikes or error surges, and seamless log management. Works out of the box with Rails, Django, Express, Phoenix, Next.js, and dozens more. Starts at $23/month with no hidden fees.
-
1
duf
Disk usage and free utility, a better 'df' alternative
...You can simply start duf without any command-line arguments. If you supply arguments, duf will only list specific devices & mount points. If you want to list everything (including pseudo, duplicate, inaccessible file systems), you can. You can show and hide specific tables. You can also show and hide specific filesystems. List inode information instead of block usage. If duf doesn't detect your terminal's colors correctly, you can set a theme. Users of oh-my-zsh should be aware that it already defines an alias called duf, which you will have to remove in order to use duf. -
2
littleutils
Various small and useful command-line utilities
The littleutils include duplicate file finders (repeats, repeats.pl, repeats.py), image optimizers (opt-jpg, opt-png, opt-gif, recomp-jpg), file rename tools (lowercase, uppercase, pren), archive recompressors (to-gzip, to-bzip2, to-bzip3, to-7zip, to-lzma, to-lzip, to-xz), a tempfile utility (tempname), file property tools (filedate, filemode, filenode, fileown, filesize, and lrealpath), and others. -
3
Swiss File Knife
One hundred command line tools in a small and portable binary.
Create zip files, extract zip files, replace text in files, search in files using expressions, stream text editor, instant command line ftp and http server, send folder via network, copy folder excluding sub folders and files, find duplicate files, run a command on all files of a folder, split and join large files, make md5 checksum lists of files, remove tab characters, convert CR/LF, list newest or biggest files of a folder, compare folders, treesize, show first or last lines of a file, find filenames fast using index files, rename many files using expressions, copy part of a file, change times of a file, set file time from filename, print colored text to terminal, convert csv to tab separated, download files from web, send http or udp requests, print tcp or udp traffic, create hexdump of files, join many text files into one, list nested .zip .tar .tar.gz .tar.bz2 archive contents. ... -
4
PeaZip
Free Zip software and Rar extractor
...Create: 7Z, ARC, Brotl, BZip, GZip, PEA, TAR, WIM, XZ, ZPAQ, ZIP, Zstandard files and more Open and extract 200+ file types: ACE, CAB, DEB, ISO, RAR, ZIPX and more Features of PeaZip includes extract, create and convert multiple archives at once, create self-extracting archives (sfx), split files, strong encryption with two factor authentication, encrypted password manager, secure deletion, find duplicate files, calculate hashes, export task definition as command line script. -
Host LLMs in Production With On-Demand GPUsDeploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
-
5
Blazefox
Blazefox: Fast, safe file deduplication and management tool for Linux
Blazefox is a powerful and efficient file deduplication and management tool designed for both everyday users and system administrators. It scans directories recursively, identifies duplicate files using advanced content hashing, and provides safe options to remove, move, or rename duplicates. Blazefox supports flexible filtering with regex/glob patterns, interactive and dry-run modes, and advanced conflict resolution strategies, ensuring no data is lost accidentally. Its undo and redo functionality allows users to safely reverse operations, giving complete control over file management tasks. ... -
6
File-Studio
A tool that automates complex file operations.
File studio is a tool that assists in handling complex file operations such as bulk renaming, organizing folders and more. -
7
garysfm
An advanced file manager with qss themes and iso and folder previews
garysfm which stands for Gary's File Manager is a file manager with some advanced features. Those features include bulk renaming and folder image previews. I has rather advanced search functions, tab browsing with persistence between launches. It remembers your folder sorting and view options in icon view. It also remembers your active tabs between sessions. It has progress dialog while doing large operations like copying large files, and folders with many files. python version works on... -
8
CDC File Transfer
Tools for synching and streaming files from Windows to Linux
...Unlike fixed-size blocks, content-defined chunks are cut at data-dependent boundaries, which means shifts and insertions don’t invalidate the rest of the file’s delta map. The tool maintains chunk fingerprints and a manifest so it can de-duplicate across versions and even across different files that share regions of content. This approach makes it well suited for large logs, VM images, and binary assets where small edits would otherwise force full re-uploads. The implementation focuses on being robust over unreliable networks with resumable transfers and integrity checks that verify every chunk. ... -
9
link-dups
Generate hard links for duplicate files
Searches for files that are duplicates of each other and creates a script that will cause hard links to replace files that are duplicated so saving disk space. Download executable and type 'link-dups -h' for command line help. -
Cut Cloud Costs with Google Compute EngineSave on compute costs with Compute Engine. Reduce your batch jobs and workload bill 60-91% with Spot VMs. Compute Engine's committed use offers customers up to 70% savings through sustained use discounts. Plus, you get one free e2-micro VM monthly and $300 credit to start.
-
10
SortPhotos
SortPhotos is a Python script that organizes photos and videos
...SortPhotos includes options for copying versus moving files, recursive searches, silent or test modes, and customizable start times for when a “day” begins. It also prevents duplicate files by comparing content, with an option to keep duplicates if needed. With support for automation through launch agents or cron jobs, SortPhotos is well-suited for photographers, archivists, and anyone looking to streamline large personal or professional media collections. -
11
fdf
FDF: Find Duplicate Files
Searches a drive (possibly with additional mounted drives) for duplicate files, outputs a potential script for deleting them after editing. -
12
h3d
Heavy Duty Directory Deduplicator
A tool to detect duplicate or similar directories on locally accessible drives. The tool is currently linux-specific, but can be extended easily to run anywhere Java runs. -
13
Uniqueoid
Simple & adorable program to eliminate copies of files.
Uniqueoid program is designed for searching and deleting copies of files. Uniqueoid analyses target files and folders and offer to save one of the duplicates and eliminate the else. Search results can be saved and loaded. You may clean disk bit by bit. Uniqueoid takes care of files that become unique even after the end of the search. Unique files can’t be deleted accidently. Also Uniqueoid can automatically choose or ignore files by directory or path prefix. All this features in combine... -
14
EZreclaim
Reclaim space taken by duplicate files
Reclaim space taken by duplicate files. With the option of Deleting or replacing duplicate files with hard links. CAUTION : MAKE SURE YOU HAVE A BACKUP OF YOUR DATA BEFORE RUNNING THIS PROGRAM. NEVER RUN AGAINST SYSTEM FILES OR FOLDERS AS YOUR SYSTEM MAY BE PERMANENTLY DAMAGED. -
15
Filekit
File Processing Tools - string search and DOS command execution
Filekit is a set of file processing GUI tools that can be put into an USB flash, so that no installation is required. Aim of the project is to include many file processing tools such as file searching tool, batch rename file, find duplicate files, split and join files and so on ... Release 0.1.0 consist of the multi-threaded file search tool that allow you to select multiple folders and files, then search those files that contains particular strings using regular expression. Release 2.0 includes the DOS command execution function, so that you can apply DOS command to a list of selected folders and files. ... -
16
dlFindDuplicates
Find duplicate files in directories.
dlFindDuplicates finds duplicate files in selected directories, based on filelength and MD5 hashes. Duplicate files then can be selected via a lua-based scripting interface. Selected duplicates can be deleted, converted to a hardlink or moved away. dlFindDuplicates explores multithreading in order to be fast. -
17
Fast Duplicate File Finder
Superfast, lightweight, simple duplicate file finder
A simple, super-fast, lightweight duplicate file finder written in java. System requirement: Java 1.6+ 20 KB of disk space (lol :D) -
18
hardlinkpl finds duplicate files and hardlinks them, especially but not only on Cyrus mail spools. The memory footprint is bearable low, making it possible to search huge file systems of several hundred gigabytes. Inspired by hardlinkpy.
-
19
DupLichaSe
A Fast Duplicate File Detector with graph based semi-automatic cleaner
DupLichaSe is a very fast Duplicate File Detector that uses inductive heuristics to detect duplicate files very fast; based on content! DupLichaSe stands out from EVERY other Duplicate file detection Software because of it's graph based semi-automatic selection system. ... after finding 100s of duplicate files, do you have to go through some manual and possibly laborious process of deleting the duplicates? -
20
dupehasher
Shell script for managing duplicate image files in a directory.
dupehasher scans the given directory for files that are identical except by filename. dupeshasher will generate a report plaintext file named 'dupelist.txt' in the working directory (which contains, per line, tab-delimited names of files whose contents are identical). Depending upon the arguments supplied by the user upon invoking dupeshasher, it will also delete all duplicates, keeping either the oldest or newest of all sets of duplicates. Additionally it can batch-rename all... -
21
This Java software is useful to set id3v1 and id3v2 tags on mp3 files, possibly in a massive way. It helps you managing a song database, searching for duplicate songs. It has a rename file utility, not only for mp3 files. It has an utility panel to create playlists, re-organize files in folders with the name format you prefer, an utility to optimize the CD disk space. This program was written in 2002, so I don't remember much about it ... but I used it a lot, as much as my close friends. ...
-
22
Duplicate Files Finder is a cross-platform application for finding and removing duplicate files by deleting, creating hardlinks or creating symbolic links. A special algorithm minimizes the amount of data read from disk, so the program is very fast.
-
23
Zipbox
a java zip utility
a java util to zip/unzip files and folders Supported files for extraction: 7z, Zip, Tar, Rar, Lzma, Iso, GZip, Cpio, BZIP2, Z, Arj, Lzh, Cab, Chm, Nsis, DEB, RPM, UDF, WIM Supported compression format: Zip Minimum Requirements: - needs Java 1.7 or above CHECK OUT AND SUPPORT MY LATEST ANDROID PROJECTS IN HERE: https://play.google.com/store/apps/developer?id=Deepak+PK -
24
qlsdup
GUI based lightweight duplicate file finder / remover.
Simple GUI based lightweight duplicate file finder and remover. Configurable file search and preview (via external tools) option for file data. No command-line interface available! This is basically a reimplementation of dupfinder as: it doesn't compile on my computer, the executable won't work either, the projects seems dead and I didn't wanna work through the original code. -
25
Dupless - a duplicate file solution
extract unique file sets from sets with duplicates
...There are lots of duplicates and I want to extract a unique set from the larger set. That is what dupless does. Written in Java, using sqlite, it is some simple code that solves the duplicate file problem. All of the code is contained in the .jar file, both source and binary. Currently it writes scripts for use on Linux or Windows. See the Wiki or the README.txt in the .jar file for more information.
