Search Results for "duplicates" - Page 4
Sort By:
Showing 147 open source projects for "duplicates"
View related business solutions-
Demo Series - Small Business Backup By VeeamWatch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
-
Paessler - Monitor Your Whole Network in MinutesWaiting weeks for a monitoring rollout isn't an option when infrastructure doesn't stop running. PRTG's auto-discovery scans your network and suggests from over 200 pre-configured sensor types, so you're watching servers, applications and devices within minutes, not after a multi-week deployment. Enterprise-strength monitoring, without the enterprise complexity. Start your free trial today.
-
1
Torrent Search Engine
A fast cross-platform TorrentSearch client
Torrent Search Engine: TorrentSearch is a framework and script language for searching Bit Torrent websites and search engines for torrents. -
2
toastr
Simple javascript toast notifications
...The methods fadeIn/fadeOut, slideDown/slideUp, and show/hide are built into jQuery. Rather than having identical toasts stack, set the preventDuplicates property to true. Duplicates are matched to the previous toast based on their message content. Control how toastr interacts with users by setting timeouts appropriately. Visually indicate how long before a toast expires. -
3
EZreclaim
Reclaim space taken by duplicate files
Reclaim space taken by duplicate files. With the option of Deleting or replacing duplicate files with hard links. CAUTION : MAKE SURE YOU HAVE A BACKUP OF YOUR DATA BEFORE RUNNING THIS PROGRAM. NEVER RUN AGAINST SYSTEM FILES OR FOLDERS AS YOUR SYSTEM MAY BE PERMANENTLY DAMAGED. -
4
Apache Kafka
Mirror of Apache Kafka
...The commit/offset model and retention policies support patterns from real-time processing to event sourcing and audit trails. Exactly-once processing semantics, idempotent producers, and transactions help prevent duplicates across complex dataflows. Kafka Streams and Kafka Connect extend the core: Streams provides a library for stateful stream processing within applications, while Connect standardizes integration with external systems. With horizontal scalability, strong ordering guarantees within partitions, and mature tooling, Kafka serves as the backbone for event-driven architectures across analytics, microservices, and data integration. -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
5
CIMS
Crosslinking induced mutation site analysis
This package includes the scripts to detect statistically reproducible crosslinking induced mutation sites (CIMS) and cross linking induced truncation sites (CITS) from HITS-CLIP data. References: Moore, M.*, Zhang, C.*, Gantman, E.C., Mele, A., Darnell, J.C., Darnell, R.B. 2014. Mapping Argonaute and conventional RNA-binding protein interactions with RNA at single-nucleotide resolution using HITS-CLIP and CIMS analysis. Nat Protocols, 9:263-293. Zhang,C.†, Darnell, R.B.† 2011.... -
6
MethylExtract
High-Quality methylation maps and SNV calling from BS-Seq experiments
MethylExtract is a user friendly tool to generate i) high quality, whole genome methylation maps and ii) to detect sequence variation within the same sample preparation. The program is implemented into a single script and takes into account all major error sources: sequencing errors, bisulfite failure, clonal reads and single nucleotide variants. MethylExtract detects variation (SNVs – Single Nucleotide Variation) in a similar way than VarScan, a very sensitive method extensively used in... -
7
Music Merge Manager
Identify duplicate songs based on track metadata (ID3, etc)
...Toggles let you determine how specific the matching criteria must be: Track number and song name? Artist, album, and track length? All of the above? Ultimately this program will let you delete duplicates from either the left or right trees, or copy non-duplicated files from one tree to the other. However until the matching code gets a lot more reliable the only action allowed is to export the list of files suspected to be duplicated in both trees. (Prerequisite: uses the `Mutagen' library to process ID3 data and `wx' for the UI.) ... -
8
MusicPlayer
Music player - endlessly plays your music
This music player is supposed to be simple and all centered around an infinite intelligent queue (some other players call this PartyShuffle or DJ mode). You can manually add songs to it - but if you don't or the queue gets too short, it will automatically intelligently fill it with further songs. The intelligent queue decision currently is based on: * song ratings * context-based choices, e.g. related songs more likely Other features of this player: * open source, simplified BSD... -
9
dlFindDuplicates
Find duplicate files in directories.
dlFindDuplicates finds duplicate files in selected directories, based on filelength and MD5 hashes. Duplicate files then can be selected via a lua-based scripting interface. Selected duplicates can be deleted, converted to a hardlink or moved away. dlFindDuplicates explores multithreading in order to be fast. -
Cut Data Warehouse Costs by 54%BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
-
10
dupehasher
Shell script for managing duplicate image files in a directory.
...dupeshasher will generate a report plaintext file named 'dupelist.txt' in the working directory (which contains, per line, tab-delimited names of files whose contents are identical). Depending upon the arguments supplied by the user upon invoking dupeshasher, it will also delete all duplicates, keeping either the oldest or newest of all sets of duplicates. Additionally it can batch-rename all remaining (post-deletion) files in a chronologically-sequential manner; or according to the md5sum or sha256 sum of every file. File extensions (.jpg for example) are preserved, and there is a user option to ensure that the extension is correct (for example, a .jpg file is indeed a jpeg and not, for example, a png). ... -
11
DupLichaSe
A Fast Duplicate File Detector with graph based semi-automatic cleaner
...DupLichaSe stands out from EVERY other Duplicate file detection Software because of it's graph based semi-automatic selection system. ... after finding 100s of duplicate files, do you have to go through some manual and possibly laborious process of deleting the duplicates? ...or is there a way for the Software to learn and do most of it for you in a SAFE and RECOVERABLE MANNER? YES!! There is!! ...This Software will ALSO help you and delete duplicate files, after you must have taken action on a a FEW important files(i.e large files that are duplicates). ++Thanks to its trivial Graph based suggestion System -
12
Similar Image Search
Reverse image search your photos. Find duplicates. Find similars
Similar Image Search is a desktop reverse image search app. Think Google's "search by image" but with your own photos on your computer. SiS can search for similar images in the library and return a list of matches. I can also compare ones outside the library to ones within. It's designed for photographers to sift through a memory card dump, searching for photos in batches for ease of sorting. Requires: Java 7 -
13
DuplicateFinder
Find duplicated files on your computer.
A small application to find duplicates on your computer, the application has a simple interface that is easy to understand, all you need to do is select the hard drive or folder and click start and the application will find the duplicates for you. Like this program? Support the developer's newest project on KickStarter: https://www.kickstarter.com/projects/1451017695/korduene-visual-programming-ide -
14
Hierarchical cluster engine HCE
Hierarchical Cluster Engine project
The main idea of this project – to implement the solution that can be used to: construct custom network mesh or distributed network cluster structure with several relations types between nodes, formalize the data flow processing goes from upper node level central source point to down nodes and backward, formalize the management requests handling from multiple source points, support native reducing of multiple nodes results (aggregation, duplicates elimination, sorting and so on), internally support powerful full-text search engine and data storage, provide transactions-less and transactional requests processing, support flexible run-time changes of cluster infrastructure, have many languages bindings for client-side integration APIs in one product build on C++ language... ... -
15
lsdup
List files with duplicate contents
lsdup, short for "list duplicates", is a command line tool which can assist in finding and removing files with identical contents. Unlike many file deduplication tools, this has a "comparison mode" which lets you tell lsdup to "only read the files in this directory, do not consider any for duplicates... but, the files in that other directory may have duplicates, so delete (or move) any of those." -
16
Dupless - a duplicate file solution
extract unique file sets from sets with duplicates
Do you have lots of files? I do, particularly image files. There are lots of duplicates and I want to extract a unique set from the larger set. That is what dupless does. Written in Java, using sqlite, it is some simple code that solves the duplicate file problem. All of the code is contained in the .jar file, both source and binary. Currently it writes scripts for use on Linux or Windows. See the Wiki or the README.txt in the .jar file for more information. -
17
A Linux/UNIX command line tool to find duplicate files. The tool supports multiple ways to consider a set of files as duplicates to each other (e.g. content, size, name ... etc.).
-
18
GDuplicateFinder
GDuplicateFinder - A FREE Groovy way to find file duplicates!
Unlike other duplicate finders such as Easy Duplicate File Finder, Auslogics Duplicate File Finder, MindGems Fast Duplicate File Finder, Duplicate Cleaner, DupFiles and others, GDuplicateFinder is a FREE cross-platform application, with the ability to search among not just local files, but files on the network, such as a Windows or a Linux share using VFS library. Taking advantage of Groovy facilities and GPars power to process in parallel, GDuplicateFinder will help you get rid of those duplicates you always wanted to dispose in an easy and friendly way. Looking for translators to translate the app! If you'd like to help me, please create a GitHub Issue here (https://github.com/guicamest/GDuplicate-Finder/issues) mentioning the language so that I get notified. Thanks in advance <3 If you want to help me continue improving this app, donate some money through paypal! ... -
19
duplicate
Remove duplicate files using binary compression
Utility that checks all files for given directory and removed the duplicates by binary compression comparison. -
20
Duplicate File Finder
Find duplicates of a specified file
When you've been using your computer for quite a long time, often you end up duplicating your files and you don't even know about them. Duplicate File Finder is a Linux/Unix utility than scans your hard drive for finding duplicates of a given file. -
21
Toolsverse ETL Framework
Open source Extract Transform Load engine written in Java
ETL Framework is a standalone Extract Transform Load engine written in Java. It includes executables for all major platforms and can be easily integrated into other applications. Key Features: * embeddable, open source and free * fast and scalable * uses target database features to do transformations and loads * manual and automatic data mapping * data streaming * bulk data loads * data quality features using SQL, JavaScript? and regex * data transformations Requirements *... -
22
duplicatesNuker
Checks for duplicated files
Checks on filesize (optional also on the SHA1) of files. It give out a sorted list. In this list files to delete can selected and also files can opened with an doubleclick (easier to verify if a file is an dupicate or not) -
23
deduper
A simple tool to merge duplicates in customer records
Frustrated with multiple records of the same customer which just differ due to a typo or abbreviation or different possible representations of same address? Try Deduper !! Deduper is a simple command line tool to merge duplicates in customer records. It works based on advanced string matching techniques and clustering. This technique is called blocked nearest neighbor clustering and this general technique is further optimized in this tool for the problem of customer merging. Give it a try, we will be happy to hear from you how it helped. See the wiki for more details on usage https://sourceforge.net/p/deduper/wiki/Home/ -
24
SmartDupe
Replaces file Duplicates by Hard Links
SmartDupe is bash script which replaces file Duplicates in a given path by Hard links to free space on your Hard Drive. -
25
Pokémon Team Randomizer
Pokémon Team Randomizer for Stadium Battles
...When constructing a new team, you can generate Pokémon from any combination of Gen I, Gen II, Gen III, Gen IV, and Gen V, and may allow or disallow legendaries and duplicates.
