Search Results for "duplicate files"
Sort By:
Showing 39 open source projects for "duplicate files"
View related business solutions-
Demo Series - Small Business Backup By VeeamWatch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
1
SortPhotos
SortPhotos is a Python script that organizes photos and videos
...SortPhotos includes options for copying versus moving files, recursive searches, silent or test modes, and customizable start times for when a “day” begins. It also prevents duplicate files by comparing content, with an option to keep duplicates if needed. With support for automation through launch agents or cron jobs, SortPhotos is well-suited for photographers, archivists, and anyone looking to streamline large personal or professional media collections. -
2
SortMyShit
A tool designed to help you organize and manage your files
SortMyShit is an open-source Python project designed to help you organize and manage your files effortlessly. It provides customizable sorting rules to keep your directories clean and structured. -
3
Swiss File Knife
One hundred command line tools in a small and portable binary.
Create zip files, extract zip files, replace text in files, search in files using expressions, stream text editor, instant command line ftp and http server, send folder via network, copy folder excluding sub folders and files, find duplicate files, run a command on all files of a folder, split and join large files, make md5 checksum lists of files, remove tab characters, convert CR/LF, list newest or biggest files of a folder, compare folders, treesize, show first or last lines of a file, find filenames fast using index files, rename many files using expressions, copy part of a file, change times of a file, set file time from filename, print colored text to terminal, convert csv to tab separated, download files from web, send http or udp requests, print tcp or udp traffic, create hexdump of files, join many text files into one, list nested .zip .tar .tar.gz .tar.bz2 archive contents. ... -
4
PeaZip
Free Zip software and Rar extractor
...The application provides an unified, natively portable, cross-platform file manager and archive manager GUI for many Open Source technologies like 7-Zip, FreeArc, PAQ, UPX. Create: 7Z, ARC, Brotl, BZip, GZip, PEA, TAR, WIM, XZ, ZPAQ, ZIP, Zstandard files and more Open and extract 200+ file types: ACE, CAB, DEB, ISO, RAR, ZIPX and more Features of PeaZip includes extract, create and convert multiple archives at once, create self-extracting archives (sfx), split files, strong encryption with two factor authentication, encrypted password manager, secure deletion, find duplicate files, calculate hashes, export task definition as command line script. -
99.99% Uptime for MySQL and PostgreSQL DatabasesCloud SQL Enterprise Plus delivers near-zero downtime with 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server.
-
5
BoolFiles
A modern file manager that supports multiple tabs.
BoolFiles is an open-source, cross-platform file manager, adopting MVVM architecture and a Fluent design style. It supports Windows, Linux, macOS desktops. Features: [File Management] Navigate directories and open files with default apps. Create folders, rename, copy, cut, paste. Deleted files go to Recycle Bin with restore/permanent delete options. [Multi-tab Browsing] Open/close tabs, close other/right tabs, duplicate current tab. Tabs show directory icons and names for quick switching. [Navigation] Breadcrumb address bar for direct path jumps. ... -
6
File-Studio
A tool that automates complex file operations.
File studio is a tool that assists in handling complex file operations such as bulk renaming, organizing folders and more. -
7
Blazefox
Blazefox: Fast, safe file deduplication and management tool for Linux
Blazefox is a powerful and efficient file deduplication and management tool designed for both everyday users and system administrators. It scans directories recursively, identifies duplicate files using advanced content hashing, and provides safe options to remove, move, or rename duplicates. Blazefox supports flexible filtering with regex/glob patterns, interactive and dry-run modes, and advanced conflict resolution strategies, ensuring no data is lost accidentally. Its undo and redo functionality allows users to safely reverse operations, giving complete control over file management tasks. ... -
8
garysfm
An advanced file manager with qss themes and iso and folder previews
garysfm which stands for Gary's File Manager is a file manager with some advanced features. Those features include bulk renaming and folder image previews. I has rather advanced search functions, tab browsing with persistence between launches. It remembers your folder sorting and view options in icon view. It also remembers your active tabs between sessions. It has progress dialog while doing large operations like copying large files, and folders with many files. python version works on... -
9
CDC File Transfer
Tools for synching and streaming files from Windows to Linux
cdc-file-transfer is a bandwidth-efficient file transfer and sync tool that uses content-defined chunking to detect and transmit only the parts of files that actually changed. Unlike fixed-size blocks, content-defined chunks are cut at data-dependent boundaries, which means shifts and insertions don’t invalidate the rest of the file’s delta map. The tool maintains chunk fingerprints and a manifest so it can de-duplicate across versions and even across different files that share regions of content. ... -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
link-dups
Generate hard links for duplicate files
Searches for files that are duplicates of each other and creates a script that will cause hard links to replace files that are duplicated so saving disk space. Download executable and type 'link-dups -h' for command line help. -
11
fdf
FDF: Find Duplicate Files
Searches a drive (possibly with additional mounted drives) for duplicate files, outputs a potential script for deleting them after editing. -
12
Uniqueoid
Simple & adorable program to eliminate copies of files.
Uniqueoid program is designed for searching and deleting copies of files. Uniqueoid analyses target files and folders and offer to save one of the duplicates and eliminate the else. Search results can be saved and loaded. You may clean disk bit by bit. Uniqueoid takes care of files that become unique even after the end of the search. Unique files can’t be deleted accidently. Also Uniqueoid can automatically choose or ignore files by directory or path prefix. All this features in combine... -
13
EZreclaim
Reclaim space taken by duplicate files
Reclaim space taken by duplicate files. With the option of Deleting or replacing duplicate files with hard links. CAUTION : MAKE SURE YOU HAVE A BACKUP OF YOUR DATA BEFORE RUNNING THIS PROGRAM. NEVER RUN AGAINST SYSTEM FILES OR FOLDERS AS YOUR SYSTEM MAY BE PERMANENTLY DAMAGED. -
14
Filekit
File Processing Tools - string search and DOS command execution
Filekit is a set of file processing GUI tools that can be put into an USB flash, so that no installation is required. Aim of the project is to include many file processing tools such as file searching tool, batch rename file, find duplicate files, split and join files and so on ... Release 0.1.0 consist of the multi-threaded file search tool that allow you to select multiple folders and files, then search those files that contains particular strings using regular expression. Release 2.0 includes the DOS command execution function, so that you can apply DOS command to a list of selected folders and files. ... -
15
dlFindDuplicates
Find duplicate files in directories.
dlFindDuplicates finds duplicate files in selected directories, based on filelength and MD5 hashes. Duplicate files then can be selected via a lua-based scripting interface. Selected duplicates can be deleted, converted to a hardlink or moved away. dlFindDuplicates explores multithreading in order to be fast. -
16
hardlinkpl finds duplicate files and hardlinks them, especially but not only on Cyrus mail spools. The memory footprint is bearable low, making it possible to search huge file systems of several hundred gigabytes. Inspired by hardlinkpy.
-
17
DupLichaSe
A Fast Duplicate File Detector with graph based semi-automatic cleaner
DupLichaSe is a very fast Duplicate File Detector that uses inductive heuristics to detect duplicate files very fast; based on content! DupLichaSe stands out from EVERY other Duplicate file detection Software because of it's graph based semi-automatic selection system. ... after finding 100s of duplicate files, do you have to go through some manual and possibly laborious process of deleting the duplicates? -
18
Duplicate Files Finder is a cross-platform application for finding and removing duplicate files by deleting, creating hardlinks or creating symbolic links. A special algorithm minimizes the amount of data read from disk, so the program is very fast.
-
19
dupehasher
Shell script for managing duplicate image files in a directory.
dupehasher scans the given directory for files that are identical except by filename. dupeshasher will generate a report plaintext file named 'dupelist.txt' in the working directory (which contains, per line, tab-delimited names of files whose contents are identical). Depending upon the arguments supplied by the user upon invoking dupeshasher, it will also delete all duplicates, keeping either the oldest or newest of all sets of duplicates. Additionally it can batch-rename all... -
20
This Java software is useful to set id3v1 and id3v2 tags on mp3 files, possibly in a massive way. It helps you managing a song database, searching for duplicate songs. It has a rename file utility, not only for mp3 files. It has an utility panel to create playlists, re-organize files in folders with the name format you prefer, an utility to optimize the CD disk space. This program was written in 2002, so I don't remember much about it ... but I used it a lot, as much as my close friends. ...
-
21
Zipbox
a java zip utility
a java util to zip/unzip files and folders Supported files for extraction: 7z, Zip, Tar, Rar, Lzma, Iso, GZip, Cpio, BZIP2, Z, Arj, Lzh, Cab, Chm, Nsis, DEB, RPM, UDF, WIM Supported compression format: Zip Minimum Requirements: - needs Java 1.7 or above CHECK OUT AND SUPPORT MY LATEST ANDROID PROJECTS IN HERE: https://play.google.com/store/apps/developer?id=Deepak+PK -
22
qlsdup
GUI based lightweight duplicate file finder / remover.
...So Look'n'Feel should be somewhat the same, though some changes have been made. Algorithm is simple and suitable for large file sets with few differences: basic set of duplicate candidates is determined by file size, then candidates are compared byte-wise. So for files which don't start to differ by growing at the tail it reduces read operations greatly compared to hash-based comparision (i.e. test case: 40GB of files, 16GB RAM, many differences: initial compare (uncached by OS) around 300sec, subsequent compare (relevant file parts cached by OS) ca. 2sec) Note: this program is not related to lsdup -
23
Dupless - a duplicate file solution
extract unique file sets from sets with duplicates
Do you have lots of files? I do, particularly image files. There are lots of duplicates and I want to extract a unique set from the larger set. That is what dupless does. Written in Java, using sqlite, it is some simple code that solves the duplicate file problem. All of the code is contained in the .jar file, both source and binary. Currently it writes scripts for use on Linux or Windows. -
24
A Linux/UNIX command line tool to find duplicate files. The tool supports multiple ways to consider a set of files as duplicates to each other (e.g. content, size, name ... etc.).
-
25
sameseek
Simple fast and lightweight identical/duplicate files searching tool
Simple fast and lightweight identical/duplicate files searching tool with graphical interface (GTK+ 3).
