Search Results for "duplicate files"
Sort By:
Showing 196 open source projects for "duplicate files"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
Full-stack observability with actually useful AI | Grafana CloudBuilt on open standards like Prometheus and OpenTelemetry, Grafana Cloud includes Kubernetes Monitoring, Application Observability, Incident Response, plus the AI-powered Grafana Assistant. Get started with our generous free tier today.
-
1
Czkawka
Multi functional app to find duplicates, empty folders, similar images
Czkawka (Polish for “hiccup”) is a lightning‑fast, multi‑purpose file cleaning tool written in Rust. It helps users declutter storage by finding duplicate files, similar images or audio, empty folders, and unusually large files through CPU‑efficient multithreading. Available with both GUI (GTK‑based) and CLI versions for flexible usage. -
2
FDUPES
FDUPES is a program for identifying or deleting duplicate files
FDUPES is a lightweight command-line utility that helps users find and optionally delete duplicate files within specified directories by comparing file contents, which can be extremely useful for cleaning up storage clutter or organizing large collections of files. It works by scanning directories and subdirectories, identifying sets of files with identical content through size and hash comparisons, and then listing them together so users can examine duplicates. ... -
3
SortPhotos
SortPhotos is a Python script that organizes photos and videos
...SortPhotos includes options for copying versus moving files, recursive searches, silent or test modes, and customizable start times for when a “day” begins. It also prevents duplicate files by comparing content, with an option to keep duplicates if needed. With support for automation through launch agents or cron jobs, SortPhotos is well-suited for photographers, archivists, and anyone looking to streamline large personal or professional media collections. -
4
diskover-community
Open source file indexing & storage analytics powered by Elasticsearch
...Diskover also helps identify outdated or unused files, duplicate data, and inefficient storage usage that can waste resources or increase operational costs. A Python-based indexing engine performs the scanning and indexing tasks. -
Application Monitoring That Won't Slow Your App DownFull APM with errors, performance, logs, and uptime monitoring. 99.999% uptime SLA on the platform itself.
-
5
duplicate-file-cleaner
Windows GUI application for scan and clean the duplicate files
This is a GUI application for Windows platform, which can scan all files under the specified directory and use SHA256 signature to ensure the consistency of file content. It also supports deleting or transferring duplicate files with the same SHA256 signature. No installation is required, just run it directly after decompression. It does not rely on the network and supports offline operation. -
6
supabase-py
Python Client for Supabase. Query Postgres from Flask, Django
Python Client for Supabase. Query Postgres from Flask, Django, FastAPI. Python user authentication, security policies, edge functions, file storage, and realtime data streaming. Good first issue. -
7
Percona Toolkit
A collection of advanced open source command-line tools
Percona Toolkit is a collection of battle-tested command-line tools for MySQL and MariaDB that help diagnose performance, verify integrity, and perform online maintenance safely. Utilities such as pt-query-digest analyze slow logs and packet captures to surface hotspots and regressions, while pt-online-schema-change applies ALTERs with minimal blocking by copying and swapping tables. Consistency tools like pt-table-checksum and pt-table-sync detect and reconcile replication drift across... -
8
Video-subtitle-extractor
A GUI tool for extracting hard-coded subtitle (hardsub) from videos
Video hard subtitle extraction, generate srt file. There is no need to apply for a third-party API, and text recognition can be implemented locally. A deep learning-based video subtitle extraction framework, including subtitle region detection and subtitle content extraction. A GUI tool for extracting hard-coded subtitles (hardsub) from videos and generating srt files. Use local OCR recognition, no need to set up and call any API, and do not need to access online OCR services such as Baidu... -
9
RemoveDuplicate
A software that can helps you remove duplicate files
RemoveDuplicate is a Windows application designed to help users find and remove duplicate files within folders. It uses MD5 hashing to identify identical files and provides a user-friendly interface to manage and delete duplicates while keeping one copy of each file. -
Go From AI Idea to AI App FastAccess Gemini 3 and 200+ models. Build chatbots, agents, or custom models with built-in monitoring and scaling.
-
10
Calibre-Web Automated
Calibre-Web but Automated and with tons of New Features
Calibre-Web-Automated (CWA) is an all-in-one, self-hosted solution for managing an ebook library that combines the modern, lightweight web UI style of Calibre-Web with the deeper tooling and conversion capabilities associated with Calibre. The goal is to reduce the common “two-service” setup where users run Calibre-Web for browsing and Calibre separately for conversions, metadata fixes, and automation, by packaging those workflows together in a single system. CWA keeps the familiar strengths... -
11
File Nesting Config for VS Code
Config of File Nesting for VS Code
...Because the snippet is generated via a script (update.mjs), it is maintained for many languages, frameworks, and file types. The benefit is much cleaner project file trees, reduced noise, easier navigation, and less time wasted hunting through duplicate or generated files. -
12
tumblr-crawler
Python crawler to download photos and videos from Tumblr blogs
tumblr-crawler is an open source Python-based utility designed to download media content from Tumblr blogs. It provides a script that automatically retrieves photos and videos from specified Tumblr sites and saves them locally for offline access. Users can specify one or multiple blogs to crawl by editing a configuration file or by passing parameters through the command line. Once executed, the script fetches media from the Tumblr API and stores the downloaded files in folders named after... -
13
trackerslist
Updated list of public BitTorrent trackers
trackerslist is a repository that provides continuously updated lists of public BitTorrent trackers, designed to improve torrent download performance and peer discovery. The project is maintained by an automated system that regularly checks tracker availability, removes duplicates, and ranks them based on reliability and latency. It offers multiple formats of tracker lists, including HTTP, HTTPS, WebSocket, and IP-based versions, making it compatible with a wide range of BitTorrent clients.... -
14
RemoveDuplicateLinesFromTxt
Remove Duplicate lines From Files in TXT
This program remove duplicate lines in txt files. -
15
Meta Package Manager
Wraps all package managers with a unifying CLI
Meta Package Manager wraps all package managers with a unifying CLI, and provides the MPM CLI, a wrapper around all package managers. MPM is like yt-dlp, but for package managers instead of videos. MPM solves XKCD #1654 - Universal Install Script. List installed packages. List duplicate installed packages. Search for packages. Install a package, remove a package, and list outdated packages. Sync local package infos. Upgrade all outdated packages. Backup list of installed packages to TOML file. Restore/install list of packages from TOML files. Pin-point commands to a subset of package managers (include/exclude selectors). ... -
16
Open Asset Import Library
The open-asset-importer-library repository
The Open Asset Import Library (short name: Assimp) is a portable Open-Source library to import various well-known 3D model formats in a uniform manner. The most recent version also knows how to export 3d files and is therefore suitable as a general-purpose 3D model converter. See the feature-list. open3mod is a Windows-based model viewer. It loads all file formats that Assimp supports and is perfectly suited to quickly inspect 3d assets. Assimp aims to provide a full asset conversion... -
17
parcel/css
A CSS parser, transformer, and minifier written in Rust
A CSS parser, transformer, and minifier written in Rust. Parsing and minifying large files are completed in milliseconds, often with significantly smaller output than other tools. Many other CSS parsers treat property values as an untyped series of tokens. This means that each transformer that wants to do something with these values must interpret them itself, leading to duplicate work and inconsistencies. @parcel/css parses all values using the grammar from the CSS specification and exposes a specific value type for each property. ... -
18
Useful Scripts
Useful scripts for making developer's everyday life easier
...It is used to quickly troubleshoot performance problems, automatically find out how many threads are consumed in the running process, and print out their thread stacks to determine the method calls that cause performance problems. Find out duplicate classes in jar files and class directories. Used to troubleshoot Javaclass conflicts. -
19
Swiss File Knife
One hundred command line tools in a small and portable binary.
Create zip files, extract zip files, replace text in files, search in files using expressions, stream text editor, instant command line ftp and http server, send folder via network, copy folder excluding sub folders and files, find duplicate files, run a command on all files of a folder, split and join large files, make md5 checksum lists of files, remove tab characters, convert CR/LF, list newest or biggest files of a folder, compare folders, treesize, show first or last lines of a file, find filenames fast using index files, rename many files using expressions, copy part of a file, change times of a file, set file time from filename, print colored text to terminal, convert csv to tab separated, download files from web, send http or udp requests, print tcp or udp traffic, create hexdump of files, join many text files into one, list nested .zip .tar .tar.gz .tar.bz2 archive contents. ... -
20
GameLauncher
Frontend emulator launcher displaying box art image of associated ROMs
A free front-end emulator displaying associated game box art image for each game. GameLauncher can be controlled using standard Xbox controller. ROM associated image files can be downloaded using following link: http://axter.com/GameLauncher/Images.zip -
21
PeaZip
Free Zip software and Rar extractor
...The application provides an unified, natively portable, cross-platform file manager and archive manager GUI for many Open Source technologies like 7-Zip, FreeArc, PAQ, UPX. Create: 7Z, ARC, Brotl, BZip, GZip, PEA, TAR, WIM, XZ, ZPAQ, ZIP, Zstandard files and more Open and extract 200+ file types: ACE, CAB, DEB, ISO, RAR, ZIPX and more Features of PeaZip includes extract, create and convert multiple archives at once, create self-extracting archives (sfx), split files, strong encryption with two factor authentication, encrypted password manager, secure deletion, find duplicate files, calculate hashes, export task definition as command line script. -
22
gopkg
Example for the go pkg's function
gopkg is a large community-driven repository of examples for Go’s standard library packages, created to fill the gap left by the relatively sparse official examples. The project organizes content so that each package has its own directory and each function within that package gets its own Markdown file with code examples. The idea is that developers can quickly look up “how do I actually use this function?” without digging through source code or scattered blog posts. The maintainer provides... -
23
WizTree
WizTree quickly analyzes disk space, showing large files and folders.
WizTree is an ultra-fast and intuitive disk space analyzer that helps you instantly see what’s taking up space on your hard drives. Using advanced technology, it reads the Master File Table (MFT) directly on NTFS drives, making it dramatically faster than traditional scanners. The program displays your files and folders in a clear, visual tree-map view, showing their relative sizes so you can quickly locate and delete large or unnecessary items. -
24
SIMILAR
Compares Folders for Same Name and/or Size Files
I developed this application because I was not happy with existing ones. The program analyzes two folders to determine whether they are identical or different by identifying files with the same name and/or size. The resulting list can be saved as a text file. Files with matching names and/or sizes can be deleted, but only those in the second directory will be removed. You can control which files are deleted through the textbox, as only the files displayed there will be deleted. Vary name... -
25
Bootleg Sound Processor
Software for processing audio files.
Software for processing audio files. The files "Batch Processor.py" and "Duplicate remover.py" are meant to be used with the output of Bootleg Text Slicer (https://github.com/Northstrix/bootleg-text-slicer) placed into the "Unprocessed" folder, while "Single file processor.py" can be used with standalone files from arbitrary locations. GitHub repository: https://github.com/Northstrix/bootleg-sound-processor Made using Google AI Studio (https://aistudio.google.com/) and Perplexity (https://www.perplexity.ai/)
