Search Results for "duplicate file"
Sort By:
Showing 38 open source projects for "duplicate file"
View related business solutions-
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
1
SortPhotos
SortPhotos is a Python script that organizes photos and videos
...It can sort files by year, month, day, or any custom format using EXIF and other metadata tags, making it easy to transform messy collections into neatly arranged photo libraries. The tool works with both images and videos, automatically renames files if desired, and can filter which metadata groups or tags to prioritize when determining file dates. SortPhotos includes options for copying versus moving files, recursive searches, silent or test modes, and customizable start times for when a “day” begins. It also prevents duplicate files by comparing content, with an option to keep duplicates if needed. With support for automation through launch agents or cron jobs, SortPhotos is well-suited for photographers, archivists, and anyone looking to streamline large personal or professional media collections. -
2
Swiss File Knife
One hundred command line tools in a small and portable binary.
Create zip files, extract zip files, replace text in files, search in files using expressions, stream text editor, instant command line ftp and http server, send folder via network, copy folder excluding sub folders and files, find duplicate files, run a command on all files of a folder, split and join large files, make md5 checksum lists of files, remove tab characters, convert CR/LF, list newest or biggest files of a folder, compare folders, treesize, show first or last lines of a file, find filenames fast using index files, rename many files using expressions, copy part of a file, change times of a file, set file time from filename, print colored text to terminal, convert csv to tab separated, download files from web, send http or udp requests, print tcp or udp traffic, create hexdump of files, join many text files into one, list nested .zip .tar .tar.gz .tar.bz2 archive contents. ... -
3
File-Studio
A tool that automates complex file operations.
File studio is a tool that assists in handling complex file operations such as bulk renaming, organizing folders and more. -
4
duf
Disk usage and free utility, a better 'df' alternative
...You can simply start duf without any command-line arguments. If you supply arguments, duf will only list specific devices & mount points. If you want to list everything (including pseudo, duplicate, inaccessible file systems), you can. You can show and hide specific tables. You can also show and hide specific filesystems. List inode information instead of block usage. If duf doesn't detect your terminal's colors correctly, you can set a theme. Users of oh-my-zsh should be aware that it already defines an alias called duf, which you will have to remove in order to use duf. -
Build Securely on AWS with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
5
littleutils
Various small and useful command-line utilities
The littleutils include duplicate file finders (repeats, repeats.pl, repeats.py), image optimizers (opt-jpg, opt-png, opt-gif, recomp-jpg), file rename tools (lowercase, uppercase, pren), archive recompressors (to-gzip, to-bzip2, to-bzip3, to-7zip, to-lzma, to-lzip, to-xz), a tempfile utility (tempname), file property tools (filedate, filemode, filenode, fileown, filesize, and lrealpath), and others. -
6
PeaZip
Free Zip software and Rar extractor
PeaZip is a free archiver tool. The application provides an unified, natively portable, cross-platform file manager and archive manager GUI for many Open Source technologies like 7-Zip, FreeArc, PAQ, UPX. Create: 7Z, ARC, Brotl, BZip, GZip, PEA, TAR, WIM, XZ, ZPAQ, ZIP, Zstandard files and more Open and extract 200+ file types: ACE, CAB, DEB, ISO, RAR, ZIPX and more Features of PeaZip includes extract, create and convert multiple archives at once, create self-extracting archives (sfx), split files, strong encryption with two factor authentication, encrypted password manager, secure deletion, find duplicate files, calculate hashes, export task definition as command line script. -
7
Blazefox
Blazefox: Fast, safe file deduplication and management tool for Linux
Blazefox is a powerful and efficient file deduplication and management tool designed for both everyday users and system administrators. It scans directories recursively, identifies duplicate files using advanced content hashing, and provides safe options to remove, move, or rename duplicates. Blazefox supports flexible filtering with regex/glob patterns, interactive and dry-run modes, and advanced conflict resolution strategies, ensuring no data is lost accidentally. -
8
garysfm
An advanced file manager with qss themes and iso and folder previews
garysfm which stands for Gary's File Manager is a file manager with some advanced features. Those features include bulk renaming and folder image previews. I has rather advanced search functions, tab browsing with persistence between launches. It remembers your folder sorting and view options in icon view. It also remembers your active tabs between sessions. It has progress dialog while doing large operations like copying large files, and folders with many files. python version works on... -
9
CDC File Transfer
Tools for synching and streaming files from Windows to Linux
cdc-file-transfer is a bandwidth-efficient file transfer and sync tool that uses content-defined chunking to detect and transmit only the parts of files that actually changed. Unlike fixed-size blocks, content-defined chunks are cut at data-dependent boundaries, which means shifts and insertions don’t invalidate the rest of the file’s delta map. -
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
10
fdf
FDF: Find Duplicate Files
Searches a drive (possibly with additional mounted drives) for duplicate files, outputs a potential script for deleting them after editing. -
11
h3d
Heavy Duty Directory Deduplicator
A tool to detect duplicate or similar directories on locally accessible drives. The tool is currently linux-specific, but can be extended easily to run anywhere Java runs. -
12
Uniqueoid
Simple & adorable program to eliminate copies of files.
Uniqueoid program is designed for searching and deleting copies of files. Uniqueoid analyses target files and folders and offer to save one of the duplicates and eliminate the else. Search results can be saved and loaded. You may clean disk bit by bit. Uniqueoid takes care of files that become unique even after the end of the search. Unique files can’t be deleted accidently. Also Uniqueoid can automatically choose or ignore files by directory or path prefix. All this features in combine... -
13
EZreclaim
Reclaim space taken by duplicate files
Reclaim space taken by duplicate files. With the option of Deleting or replacing duplicate files with hard links. CAUTION : MAKE SURE YOU HAVE A BACKUP OF YOUR DATA BEFORE RUNNING THIS PROGRAM. NEVER RUN AGAINST SYSTEM FILES OR FOLDERS AS YOUR SYSTEM MAY BE PERMANENTLY DAMAGED. -
14
Filekit
File Processing Tools - string search and DOS command execution
Filekit is a set of file processing GUI tools that can be put into an USB flash, so that no installation is required. Aim of the project is to include many file processing tools such as file searching tool, batch rename file, find duplicate files, split and join files and so on ... Release 0.1.0 consist of the multi-threaded file search tool that allow you to select multiple folders and files, then search those files that contains particular strings using regular expression. ... -
15
Fast Duplicate File Finder
Superfast, lightweight, simple duplicate file finder
A simple, super-fast, lightweight duplicate file finder written in java. System requirement: Java 1.6+ 20 KB of disk space (lol :D) -
16
dlFindDuplicates
Find duplicate files in directories.
dlFindDuplicates finds duplicate files in selected directories, based on filelength and MD5 hashes. Duplicate files then can be selected via a lua-based scripting interface. Selected duplicates can be deleted, converted to a hardlink or moved away. dlFindDuplicates explores multithreading in order to be fast. -
17
hardlinkpl finds duplicate files and hardlinks them, especially but not only on Cyrus mail spools. The memory footprint is bearable low, making it possible to search huge file systems of several hundred gigabytes. Inspired by hardlinkpy.
-
18
DupLichaSe
A Fast Duplicate File Detector with graph based semi-automatic cleaner
DupLichaSe is a very fast Duplicate File Detector that uses inductive heuristics to detect duplicate files very fast; based on content! DupLichaSe stands out from EVERY other Duplicate file detection Software because of it's graph based semi-automatic selection system. ... after finding 100s of duplicate files, do you have to go through some manual and possibly laborious process of deleting the duplicates? -
19
dupehasher
Shell script for managing duplicate image files in a directory.
dupehasher scans the given directory for files that are identical except by filename. dupeshasher will generate a report plaintext file named 'dupelist.txt' in the working directory (which contains, per line, tab-delimited names of files whose contents are identical). Depending upon the arguments supplied by the user upon invoking dupeshasher, it will also delete all duplicates, keeping either the oldest or newest of all sets of duplicates. Additionally it can batch-rename all... -
20
This Java software is useful to set id3v1 and id3v2 tags on mp3 files, possibly in a massive way. It helps you managing a song database, searching for duplicate songs. It has a rename file utility, not only for mp3 files. It has an utility panel to create playlists, re-organize files in folders with the name format you prefer, an utility to optimize the CD disk space. This program was written in 2002, so I don't remember much about it ... but I used it a lot, as much as my close friends. ...
-
21
Duplicate Files Finder is a cross-platform application for finding and removing duplicate files by deleting, creating hardlinks or creating symbolic links. A special algorithm minimizes the amount of data read from disk, so the program is very fast.
-
22
Dupless - a duplicate file solution
extract unique file sets from sets with duplicates
...There are lots of duplicates and I want to extract a unique set from the larger set. That is what dupless does. Written in Java, using sqlite, it is some simple code that solves the duplicate file problem. All of the code is contained in the .jar file, both source and binary. Currently it writes scripts for use on Linux or Windows. See the Wiki or the README.txt in the .jar file for more information. -
23
Zipbox
a java zip utility
a java util to zip/unzip files and folders Supported files for extraction: 7z, Zip, Tar, Rar, Lzma, Iso, GZip, Cpio, BZIP2, Z, Arj, Lzh, Cab, Chm, Nsis, DEB, RPM, UDF, WIM Supported compression format: Zip Minimum Requirements: - needs Java 1.7 or above CHECK OUT AND SUPPORT MY LATEST ANDROID PROJECTS IN HERE: https://play.google.com/store/apps/developer?id=Deepak+PK -
24
qlsdup
GUI based lightweight duplicate file finder / remover.
Simple GUI based lightweight duplicate file finder and remover. Configurable file search and preview (via external tools) option for file data. No command-line interface available! This is basically a reimplementation of dupfinder as: it doesn't compile on my computer, the executable won't work either, the projects seems dead and I didn't wanna work through the original code. -
25
A Linux/UNIX command line tool to find duplicate files. The tool supports multiple ways to consider a set of files as duplicates to each other (e.g. content, size, name ... etc.).