Search Results for "duplicate files"
Sort By:
Showing 27 open source projects for "duplicate files"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
1
SortPhotos
SortPhotos is a Python script that organizes photos and videos
...SortPhotos includes options for copying versus moving files, recursive searches, silent or test modes, and customizable start times for when a “day” begins. It also prevents duplicate files by comparing content, with an option to keep duplicates if needed. With support for automation through launch agents or cron jobs, SortPhotos is well-suited for photographers, archivists, and anyone looking to streamline large personal or professional media collections. -
2
claude-real-video
Let Claude (or any LLM) actually watch a video
claude-real-video is a local video processing tool that prepares videos for analysis by Claude or other LLMs. It accepts public video URLs or local files and extracts the visual and audio evidence an AI model needs. Instead of sampling at a fixed interval, it detects scene changes and removes near-duplicate frames to reduce unnecessary token usage. It can transcribe audio, generate a clean output folder, and create a local viewer with the video, keyframe grid, and transcript. The tool can also be installed as a Claude Code skill so an agent can process videos more directly. ... -
3
supabase-py
Python Client for Supabase. Query Postgres from Flask, Django
Python Client for Supabase. Query Postgres from Flask, Django, FastAPI. Python user authentication, security policies, edge functions, file storage, and realtime data streaming. Good first issue. -
4
diskover-community
Open source file indexing & storage analytics powered by Elasticsearch
...Diskover also helps identify outdated or unused files, duplicate data, and inefficient storage usage that can waste resources or increase operational costs. A Python-based indexing engine performs the scanning and indexing tasks. -
Save Up to 91% on Cloud Compute With Spot VMsRun batch jobs at 60-91% off with Spot VMs. Long-running workloads get automatic discounts with sustained use.
-
5
Video-subtitle-extractor
A GUI tool for extracting hard-coded subtitle (hardsub) from videos
Video hard subtitle extraction, generate srt file. There is no need to apply for a third-party API, and text recognition can be implemented locally. A deep learning-based video subtitle extraction framework, including subtitle region detection and subtitle content extraction. A GUI tool for extracting hard-coded subtitles (hardsub) from videos and generating srt files. Use local OCR recognition, no need to set up and call any API, and do not need to access online OCR services such as Baidu... -
6
DocuBrowse
This does for Documents what repo-browser does for repos
...It also includes PII detection, multiple document directories, tag filtering, duplicate cleanup, and packaged installers for Linux, Windows, and macOS. -
7
Meta Package Manager
Wraps all package managers with a unifying CLI
Meta Package Manager wraps all package managers with a unifying CLI, and provides the MPM CLI, a wrapper around all package managers. MPM is like yt-dlp, but for package managers instead of videos. MPM solves XKCD #1654 - Universal Install Script. List installed packages. List duplicate installed packages. Search for packages. Install a package, remove a package, and list outdated packages. Sync local package infos. Upgrade all outdated packages. Backup list of installed packages to TOML file. Restore/install list of packages from TOML files. Pin-point commands to a subset of package managers (include/exclude selectors). ... -
8
tumblr-crawler
Python crawler to download photos and videos from Tumblr blogs
tumblr-crawler is an open source Python-based utility designed to download media content from Tumblr blogs. It provides a script that automatically retrieves photos and videos from specified Tumblr sites and saves them locally for offline access. Users can specify one or multiple blogs to crawl by editing a configuration file or by passing parameters through the command line. Once executed, the script fetches media from the Tumblr API and stores the downloaded files in folders named after... -
9
SortMyShit
A tool designed to help you organize and manage your files
SortMyShit is an open-source Python project designed to help you organize and manage your files effortlessly. It provides customizable sorting rules to keep your directories clean and structured. -
Cut Data Warehouse Costs by 54%BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
-
10
ImageMerge
ImageMerge combines media, removes duplicates, and renames in order.
...Whether you are cleaning up messy media collections, combining downloads, or organizing your personal library, ImageMerge streamlines the workflow with an intuitive navigation sidebar, step-by-step guidance, and three dedicated operation modes: Merge folders, Add to library, and Tidy a folder. Key features include advanced duplicate detection (checking file size, extension, and content hashing), flexible file handling options (copy, move, or copy-and-delete), and a safe temporary workspace staging system that ensures your files are processed reliably without risk of interruption. Built for speed, safety, and ease of use, ImageMerge gives you complete control over your media organization with a clean interface and robust backend. -
11
garysfm
An advanced file manager with qss themes and iso and folder previews
garysfm which stands for Gary's File Manager is a file manager with some advanced features. Those features include bulk renaming and folder image previews. I has rather advanced search functions, tab browsing with persistence between launches. It remembers your folder sorting and view options in icon view. It also remembers your active tabs between sessions. It has progress dialog while doing large operations like copying large files, and folders with many files. python version works on... -
12
TextureAtlas Toolbox
A powerful, free and open-source tool for TextureAtlases/Spritesheets
TextureAtlas Toolbox is an all-in-one solution for working with texture atlases and sprite sheets. Extract sprites into organized frame collections and GIF/WebP/APNG animations, generate optimized atlases from individual frames, or convert between 15+ atlas formats. Perfect for game developers, modders, and anyone creating showcases of game sprites. Formerly known as TextureAtlas to GIFs and Frames Licensed under AGPL-3.0 Third-party licenses: See... -
13
Introducing a lightweight duplicate file remover tool for Windows. With this software, you can efficiently identify duplicate files, determine the amount of storage occupied by these files, and seamlessly remove them. Free up valuable disk space by eliminating redundant copies and optimizing your storage usage. Some Antivers may show false virus alert ignore it , this tool delete files so i think thats why they think this is virus.
-
14
dupeGuru
Find duplicate files
dupeGuru is a cross-platform GUI application written in Python (with Qt/Cocoa UI) that quickly detects duplicate files on your computer using flexible scanning modes—including filename fuzzy matching, content comparison, and specialized Music/Picture modes. On some linux systems pyrcc5 is not put on the path when installing python3-pyqt5, this will cause some issues with the resource files (and icons). These systems should have a respective pyqt5-dev-tools package, which should also be installed. ... -
15
grab-site
Web crawler for archiving and backing up sites into WARC archives
...Additional mechanisms like duplicate page detection help avoid re-crawling identical content. -
16
MULTITAS
File management software for 64 bits windows 7/8/10 os
This program provides these features: 1) Remove duplicate files 2) Move a file from one folder to another. Download the only setup.exe file to windows os laptop then install this program. -
17
ProfileTool is a Windows 7 command line utility, for various operations on Windows 7 profiles. Its main purpose is to duplicate a profile as "default profile". It can also copy, delete, check size and delete temporary files on all profiles.
-
18
IL Music Library Deduplicator
Easily find and remove duplicates from a music collection
If you want to easily find and remove audio duplicate from a music collection IL Music Library Deduplicator is for you. It can distinguish between similar songs offering you a list with best matches highlighted in green. Audio files with lower similarity are listed as well in case there are duplicates with lower bitrate. These are highlighted in yellow and red. You can select them by color if you wish to delete them or you can add them to a list with excluded files in case you wish to keep duplicates or not to be scanned next time. ... -
19
Music Merge Manager
Identify duplicate songs based on track metadata (ID3, etc)
Given two trees of audio files, examine the metadata for each file to try and determine the differences in the content of the trees. This helps find duplicate songs (or non-duplicated songs) even if the music is stored in different formats. Toggles let you determine how specific the matching criteria must be: Track number and song name? Artist, album, and track length? -
20
PyPedal is a Python module that provides tools for the manipulation of pedigrees, simple visualization of pedigrees, and the calculation of measures of genetic diversity from pedigrees.
-
21
JustOneFile help you to find duplicate files and managed them. It's a Free and Open Source software under GNU GPL licence.
-
22
-
23
A command line tool that allows you to (live) analyze netfilter (iptables) log files. It provides a nice output and has features like displaying hostnames, duplicate detection... More info (+ screenshots) can be found in the pdf inside the tarball.
-
24
FileUniq identifies duplicate files, and optionally removes them or replaces them with hard or soft links. It is designed to work well with heavily hard-linked cp -al / rsync backups. For more information please see http://fileuniq.sourceforge.net
-
25
Cozy is a backup solution for Linux. It aims to be similar to Apple's Time Machine, with the difference that Cozy recognizes duplicate files and incremental backups are realized through binary diffs to save space.
