Search Results for "duplicate"
Sort By:
Showing 73 open source projects for "duplicate"
View related business solutions-
Build AI Apps with Gemini 3 on Vertex AIVertex AI gives developers access to Gemini 3—Google’s most advanced reasoning and coding model—plus 200+ foundation models including Claude, Llama, and Gemma. Build generative AI apps with Vertex AI Studio, customize with fine-tuning, and deploy to production with enterprise-grade MLOps. New customers get $300 in free credits.
-
Managed MySQL, PostgreSQL, and SQL Databases on Google CloudCloud SQL is a fully managed relational database for MySQL, PostgreSQL, and SQL Server. We handle patching, backups, replication, encryption, and failover—so you can focus on your app. Migrate from on-prem or other clouds with free Database Migration Service. IDC found customers achieved 246% ROI. New customers get $300 in credits plus a 30-day free trial.
-
1
duf
Disk usage and free utility, a better 'df' alternative
...You can simply start duf without any command-line arguments. If you supply arguments, duf will only list specific devices & mount points. If you want to list everything (including pseudo, duplicate, inaccessible file systems), you can. You can show and hide specific tables. You can also show and hide specific filesystems. List inode information instead of block usage. If duf doesn't detect your terminal's colors correctly, you can set a theme. Users of oh-my-zsh should be aware that it already defines an alias called duf, which you will have to remove in order to use duf. -
2
littleutils
Various small and useful command-line utilities
The littleutils include duplicate file finders (repeats, repeats.pl, repeats.py), image optimizers (opt-jpg, opt-png, opt-gif, recomp-jpg), file rename tools (lowercase, uppercase, pren), archive recompressors (to-gzip, to-bzip2, to-bzip3, to-7zip, to-lzma, to-lzip, to-xz), a tempfile utility (tempname), file property tools (filedate, filemode, filenode, fileown, filesize, and lrealpath), and others. -
3
Swiss File Knife
One hundred command line tools in a small and portable binary.
Create zip files, extract zip files, replace text in files, search in files using expressions, stream text editor, instant command line ftp and http server, send folder via network, copy folder excluding sub folders and files, find duplicate files, run a command on all files of a folder, split and join large files, make md5 checksum lists of files, remove tab characters, convert CR/LF, list newest or biggest files of a folder, compare folders, treesize, show first or last lines of a file, find filenames fast using index files, rename many files using expressions, copy part of a file, change times of a file, set file time from filename, print colored text to terminal, convert csv to tab separated, download files from web, send http or udp requests, print tcp or udp traffic, create hexdump of files, join many text files into one, list nested .zip .tar .tar.gz .tar.bz2 archive contents. ... -
4
PeaZip
Free Zip software and Rar extractor
...Create: 7Z, ARC, Brotl, BZip, GZip, PEA, TAR, WIM, XZ, ZPAQ, ZIP, Zstandard files and more Open and extract 200+ file types: ACE, CAB, DEB, ISO, RAR, ZIPX and more Features of PeaZip includes extract, create and convert multiple archives at once, create self-extracting archives (sfx), split files, strong encryption with two factor authentication, encrypted password manager, secure deletion, find duplicate files, calculate hashes, export task definition as command line script. -
AI-generated apps that pass security reviewRetool lets you generate dashboards, admin panels, and workflows directly on your data. Type something like “Build me a revenue dashboard on my Stripe data” and get a working app with security, permissions, and compliance built in from day one. Whether on our cloud or self-hosted, create the internal software your team needs without compromising enterprise standards or control.
-
5
WinDirStat: Windows Directory Statistics
A disk usage statistics viewer and cleanup tool for Windows
WinDirStat (Windows Directory Statistics) is a disk usage statistics viewer and cleanup tool for Windows. On start up, WinDirStat reads the whole directory tree once and then presents it in three useful views. The official download location and collaboration platform for WinDirStat has moved to GitHub: https://github.com/windirstat/windirstat Downloads and source code provided on SourceForge may not always be up to date. They are primarily used for disaster recovery purposes. -
6
DiskBoss
File management, file sync, and data wiping tool
DiskBoss is an automated, rule-based data management and analysis solution designed to give users complete control over their storage environments. It enables advanced disk space analysis, file classification, duplicate detection, and secure cleanup operations — all within a fast and customizable interface. The software supports high-speed file synchronization and secure data migration, ensuring reliability and data integrity across systems. Users can create automated policies to perform real-time disk monitoring, scheduled cleanups, and bulk file operations with minimal manual effort. ... -
7
File-Studio
A tool that automates complex file operations.
File studio is a tool that assists in handling complex file operations such as bulk renaming, organizing folders and more. -
8
Blazefox
Blazefox: Fast, safe file deduplication and management tool for Linux
Blazefox is a powerful and efficient file deduplication and management tool designed for both everyday users and system administrators. It scans directories recursively, identifies duplicate files using advanced content hashing, and provides safe options to remove, move, or rename duplicates. Blazefox supports flexible filtering with regex/glob patterns, interactive and dry-run modes, and advanced conflict resolution strategies, ensuring no data is lost accidentally. Its undo and redo functionality allows users to safely reverse operations, giving complete control over file management tasks. ... -
9
FSTDFC
File Search To Date Folder Copy
Version 0.7 - 31st October 2024 Added option to specify multiple file wildcards for search criteria, separate multiple by space to use Font size changes to make the form easier to use Version 0.6 - 5th September 2024 Increased maximum file count from 100K to 1000K Any file with EXIF data showing the date will be used for the output folder naming, all other files will use the "LastWriteTime" as the parameter. Added counter showing the number of files still to be copied to the... -
Build on Google Cloud with $300 in Free CreditStart your next project with $300 in free Google Cloud credit. Spin up VMs, run containers, query exabytes in BigQuery, or build AI apps with Vertex AI and Gemini. Once your credits are used, keep building with 20+ products with free monthly usage, including Compute Engine, Cloud Storage, GKE, and Cloud Run functions. Sign up to start building right away.
-
10
garysfm
An advanced file manager with qss themes and iso and folder previews
garysfm which stands for Gary's File Manager is a file manager with some advanced features. Those features include bulk renaming and folder image previews. I has rather advanced search functions, tab browsing with persistence between launches. It remembers your folder sorting and view options in icon view. It also remembers your active tabs between sessions. It has progress dialog while doing large operations like copying large files, and folders with many files. python version works on... -
11
DuplicadosEraser2
Search, find and manage duplicate files and folders with this program
It compares files and folders, even inside compressed archives. When done, you can send the duplicate files or folders to the recycle bin, another folder or erase them, or save the list to work later. -
12
CDC File Transfer
Tools for synching and streaming files from Windows to Linux
...Unlike fixed-size blocks, content-defined chunks are cut at data-dependent boundaries, which means shifts and insertions don’t invalidate the rest of the file’s delta map. The tool maintains chunk fingerprints and a manifest so it can de-duplicate across versions and even across different files that share regions of content. This approach makes it well suited for large logs, VM images, and binary assets where small edits would otherwise force full re-uploads. The implementation focuses on being robust over unreliable networks with resumable transfers and integrity checks that verify every chunk. ... -
13
FolderDup
Fastest folder copier
Windows copier is very slow for folders, especially with lots of files. This freeware is the fastest you can find! -
14
Abdal Duplicate Remover
Remove duplicate content and more features
Remove duplicate content and more features for txt file -
15
DuplicatedFile
Find out duplicate files
Discovers duplicate files within a folder or disk and saves the list of discovered files to a file. -
16
link-dups
Generate hard links for duplicate files
Searches for files that are duplicates of each other and creates a script that will cause hard links to replace files that are duplicated so saving disk space. Download executable and type 'link-dups -h' for command line help. -
17
SortPhotos
SortPhotos is a Python script that organizes photos and videos
...SortPhotos includes options for copying versus moving files, recursive searches, silent or test modes, and customizable start times for when a “day” begins. It also prevents duplicate files by comparing content, with an option to keep duplicates if needed. With support for automation through launch agents or cron jobs, SortPhotos is well-suited for photographers, archivists, and anyone looking to streamline large personal or professional media collections. -
18
generic-auto-updater
A robust, user-friendly, clean and efficient Auto-Updater
After finishing a stable beta version of the "Auto-Updater" to be used by a specific company, I decided to duplicate the repository and making a few tweaks in the copy to turn it public (and generic) in order for it to be used by anyone. And thus, the first version of the "Generic Auto-Updater" was born! - A robust, user-friendly, clean and efficient Auto-Updater for anyone who wishes to maintain their client's users always updated based on some server directory. -
19
NoDoubles
Finds and removes duplicates (hard links)
NoDouble is a duplicate correction tool. It scans your drives for duplicate file. Unlike most tools, it replaces duplicates with hard links. A duplicate file is file with the same content, the same size, but not necessarily the same name or extension. When two duplicates or more are found, at least one of them is replaced with a hard link that points to the same data in the first file. -
20
MULTITAS
File management software for 64 bits windows 7/8/10 os
This program provides these features: 1) Remove duplicate files 2) Move a file from one folder to another. Download the only setup.exe file to windows os laptop then install this program. -
21
fdf
FDF: Find Duplicate Files
Searches a drive (possibly with additional mounted drives) for duplicate files, outputs a potential script for deleting them after editing. -
22
h3d
Heavy Duty Directory Deduplicator
A tool to detect duplicate or similar directories on locally accessible drives. The tool is currently linux-specific, but can be extended easily to run anywhere Java runs. -
23
PeaZIP-mod
It's a fork of Free Zip software and Rar extractor by Giorgio Tani.
...Create: 7Z, ARC, BZip/GZip, PEA, TAR, WIM, XZ, ZPAQ, ZIP files and more Open and extract 180+ file types: ACE, CAB, DEB, ISO, RAR, ZIPX and more Features of PeaZip includes extract, create and convert multiple archives at once, create self-extracting archives (sfx), split files, strong encryption with two factor authentication, encrypted password manager, secure deletion, find duplicate files, calculate hashes, export task definition as command line script. Only source code distribution of my improvements by using of Subversion. -
24
Uniqueoid
Simple & adorable program to eliminate copies of files.
Uniqueoid program is designed for searching and deleting copies of files. Uniqueoid analyses target files and folders and offer to save one of the duplicates and eliminate the else. Search results can be saved and loaded. You may clean disk bit by bit. Uniqueoid takes care of files that become unique even after the end of the search. Unique files can’t be deleted accidently. Also Uniqueoid can automatically choose or ignore files by directory or path prefix. All this features in combine... -
25
DuplicateFileCheck
Duplicate file check / failed .jpg detect, optional unique file copy
I recovered a hard disk which left me with a bunch of files (mostly .jpg files), some of which were duplicate. All the files were stored in a single directory, I needed a method to quickly identify duplicate files and confirm if the .jpg files could be opened. The DuplicateFileCheck application was created to simplify this process. You can select to either search the top-level directory or all sub directories (default action). All the files are enumerated with an md5 hash created, after this process each file is checked to determine if it is a duplicate. ...
