Search Results for "remove duplicate"
Sort By:
Showing 41 open source projects for "remove duplicate"
View related business solutions-
Our Free Plans just got better! | Auth0 by OktaYou asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your secuirty. Auth0 now, thank yourself later.
-
Save hundreds of developer hours with components built for SaaS applications.Whether you want full self-service analytics or simpler multi-tenant security, Qrvey’s embeddable components and scalable data management remove the guess work.
-
1
Grabber
Very customizable imageboard/booru downloader with powerful filenaming
Very customizable imageboard/booru browser and mass downloader, with powerful file naming features. Thanks to its powerful naming features, you just have to set your filename and save the directory using all the tokens available, and the program will generate a filename using the image's information. With this, you can store and manage your pictures in advanced directory structures, and save images with custom filenames. Imageboard/booru downloader which can download thousands of images from... -
2
vConsole
A lightweight, extendable front-end developer tool for mobile web page
... development. You can destroy an vConsole instance object and remove vConsole panel from document. You can also add a new plugin to vConsole. Duplicate plugin will be ignored. Create an vConsole plugin object, bind plugin events to this object, and add this object to vConsole. While installing and running a plugin, vConsole will trigger some events to allow a plugin customizing it's functions. -
3
Meta Package Manager
Wraps all package managers with a unifying CLI
Meta Package Manager wraps all package managers with a unifying CLI, and provides the MPM CLI, a wrapper around all package managers. MPM is like yt-dlp, but for package managers instead of videos. MPM solves XKCD #1654 - Universal Install Script. List installed packages. List duplicate installed packages. Search for packages. Install a package, remove a package, and list outdated packages. Sync local package infos. Upgrade all outdated packages. Backup list of installed packages to TOML file... -
4
Delete Duplicate Folder Levels
A spreadsheet to collapse redundant folders
This project offers an Excel spreadsheet, available for download through the Files tab (above). This spreadsheet helps the user to identify and remove duplicate directory levels. For instance, it can reduce "D:\Folder Layer\Folder Layer\Folder Layer\Another Layer\Another Layer\Filename.doc" to "D:\Folder Layer\Another Layer\Filename.doc" Duplicate folder layers can form due to normal file renaming processes, and also when restoring from archive (e.g., ZIP, RAR) files that contain folder... -
Bright Data - All in One Platform for Proxies and Web ScrapingBright Data offers the highest quality proxies with automated session management, IP rotation, and advanced web unlocking technology. Enjoy reliable, fast performance with easy integration, a user-friendly dashboard, and enterprise-grade scaling. Powered by ethically-sourced residential IPs for seamless web scraping.
-
5
Swiss File Knife
One hundred command line tools in a small and portable binary.
Create zip files, extract zip files, replace text in files, search in files using expressions, stream text editor, instant command line ftp and http server, send folder via network, copy folder excluding sub folders and files, find duplicate files, run a command on all files of a folder, split and join large files, make md5 checksum lists of files, remove tab characters, convert CR/LF, list newest or biggest files of a folder, compare folders, treesize, show first or last lines of a file, find... -
6
RemoveDuplicateLinesFromTxt
Remove Duplicate lines From Files in TXT
This program remove duplicate lines in txt files. -
7
duf
Disk usage and free utility, a better 'df' alternative
..., duplicate, inaccessible file systems), you can. You can show and hide specific tables. You can also show and hide specific filesystems. List inode information instead of block usage. If duf doesn't detect your terminal's colors correctly, you can set a theme. Users of oh-my-zsh should be aware that it already defines an alias called duf, which you will have to remove in order to use duf. -
8
Graphile Starter
Opinionated SaaS quick-start with pre-built user account
Opinionated SaaS quick-start with a pre-built user account and organization system for full-stack application development in React, Node.js, GraphQL and PostgreSQL. Powered by PostGraphile, TypeScript, Apollo Client, Graphile Worker, Graphile Migrate, GraphQL Code Generator, Ant Design and Next.js. This project can serve as a basis for your own project. We've added many features that most projects require, but you're free to remove them or replace them with whatever you need. We use Next.js... -
9
Binance Triangle Arbitrage
Detect in-market cryptocurrency arbitrage
.... All configuration is managed inside the /config directory. To setup your configuration for the first time, duplicate the config.json.example file and remove the ".example" extension. This process must be done before deploying the app for the first time and redone after each major version update where the configuration has changed. -
Red Hat Enterprise Linux on Microsoft AzureRed Hat Enterprise Linux (RHEL) on Microsoft Azure provides a secure, reliable, and flexible foundation for your cloud infrastructure. Red Hat Enterprise Linux on Microsoft Azure is ideal for enterprises seeking to enhance their cloud environment with seamless integration, consistent performance, and comprehensive support.
-
10
MinPOS
Stability POS software, Free soft develop from Openbravo POS
... default language from Vietnam to English. - Update receipt template for 58mm printer. - Remove Text and URL settings in the Configuration screen. - Bug: Can not print the receipt of the company name has special symbol (%^&...). - Bug: Can not print the close cash report if the category Name has the special symbol (%^&...). - Bug: Duplicate ticket ID. - Bug: The receipt still prints when the database has not been saved. - Bug: "Inventory Diary" Report -
11
Duplicate Image Remover
Windows application to remove duplicate images
This application will scan a directory & all sub directories for duplicate image. It will build a list of such images which have same name, size & resolution. It will copy all unique image to selected destination folder. -
12
CSVfix
Command-line tool specifically designed to deal with CSV data
Copyright © 2014 Neil Butterworth. If you have any dealings at all with data and databases, then you almost certainly will have to deal with comma-separated values (CSV) data. Unfortunately, the CSV files you are given, or are required to produce, never seem to be in quite the right format for your particular business application. And because of the structure of CSV records, using standard text processing tools like sed, awk and perl is not as simple as it might... -
13
MarDRe
MapReduce-based tool to remove duplicate DNA reads
MarDRe is a de novo MapReduce-based parallel tool to remove duplicate and near-duplicate DNA reads through the clustering of single-end and paired-end sequences from FASTQ/FASTA datasets. This tool allows bioinformatics to avoid the analysis of not necessary reads, reducing the time of subsequent procedures with the dataset. MarDRe is the Big Data counterpart of ParDRe (link above), which employs HPC technologies (i.e., hybrid MPI/multithreading) to reduce runtime on multicore systems... -
14
360-FAAR Firewall Analysis Audit Repair
360-FAAR Analyze FW1 Cisco Netscreen Policy Offline Using Config/Logs
... CIDR and text filters to split rulebases / policies into target sections and identify connectivity for further analysis. 360-FAAR supports, policy to log association, object translation, rulebase reordering and simplification, rule moves and duplicate matching automatically. Allowing you to move rules to where you need them. Build new rulebases from scratch with a single 'any' rule and log files, with the 'res' and 'name' options. Switch into DROPS mode to analyse drop log entries. -
15
ParDRe
Parallel tool to remove duplicate DNA reads
ParDRe is a parallel tool to remove duplicate reads. Duplicate reads can be seen as identical or nearly identical sequences with some mismatches. This tool will let the users to avoid the analysis of not necessary reads, reducing the time of subsequent procedures with the dataset (e.g., assemblies, mappings, etc.). The tool is implemented with MPI in order to exploit the parallel capabilities of multicore clusters. It is faster than multithreaded counterparts (end of 2015) for the same... -
16
Speed up Mac Software
Speed up Mac - Remove Unwanted & duplicate files improve your Mac X EI
Speed Up Mac is a free utility to remove unwanted, duplicate and unnecessary files / Applications and improve your Mac Operating system performance. Software completely uninstalls your unwanted application through simple ‘drag and drop’ method. With this application you also show the preview of all audio, video, images, application and any other data removing process start. Software Compatible with all Mac X EI operating systems like: 10.6, 10.7, 10.8.109.10.10 and 10.11 also. -
17
Relay Fullstack
Modern Relay Starter Kit - Integrated with Relay, GraphQL, Express
..., Autoprefix, Precss, Nodemon, etc. Designed with simplicity in mind, which allows you to easily customize to suit your needs. Relay Fullstack is integrated with Yeoman that allows you to choose technologies that suit your needs, the options are including database, flow, and etc. In order to deploy a project, it is a good practice to minify all JavaScript files, stop spawning the GraphiQL server, pull off some duplicate dependencies, and remove all unnecessary scripts. -
18
Uniq Copy
Java Desktop application which helps de-duplicate files during copy.
UniqCopy scans a source folder to get a list of all the files and then guesses duplicated files based on file name and file size. Using this information, it copies all files to the target folder, maintaining the relative structure of the files within the target folder. Files considered to have been duplicated in the source folder are copied only once to one of the matching locations in the target folder, and the other locations are skipped. A summary of these "skipped duplicates" is... -
19
to extract emails from text sources and removes duplicate emails and removes unwanted words from emails
-
20
ParDRR-MPI
Parallel Duplicate Read Remover with MPI
ParDRR-MPI is a parallel tool to remove duplicate reads. Duplicate reads can be seen as identical or nearly identical sequences with some mismatches. This tool will let the users to avoid the analysis of not necessary reads, reducing the time of subsequent procedures with the dataset (e.g., assemblies, mappings, etc.). The tool is implemented with MPI in order to exploit the parallel capabilities of multicore clusters. It is faster than multithreaded counterparts (end of 2015) for the same... -
21
Duplicate files util
Search and delete duplicate files.
Search and remove duplicate files with panel file Manager. Utility searches for clones as a review in the list will be presented all clones branches or compare two branches, and selectively for comparison with the branch of the directory with options for rapid detection of directory clones when comparing branches or in the same branch. Search and clone detection is carried out by name, size, date, content, tags for MP3, limited by size and date, template. Checked control the amount... -
22
Filekit
File Processing Tools - string search and DOS command execution
Filekit is a set of file processing GUI tools that can be put into an USB flash, so that no installation is required. Aim of the project is to include many file processing tools such as file searching tool, batch rename file, find duplicate files, split and join files and so on ... Release 0.1.0 consist of the multi-threaded file search tool that allow you to select multiple folders and files, then search those files that contains particular strings using regular expression. Release 2.0... -
23
duplicate
Remove duplicate files using binary compression
Utility that checks all files for given directory and removed the duplicates by binary compression comparison. -
24
Analyzing poor data takes CPU time and interpreting the results from poor data takes people time, so it's always important to make a pre-processing. Let me call my script as “Sequence_cleaner” and the big idea is to remove duplicate sequences, remove too short sequences ( the user defines the minimum length) and remove sequences which have too many unknown nucleotides (N) ( the user defines the % of N is allows ) and in the end the user can choose if he/she wants to have a file as output...
-
25
intBasHistory
Manage (.Bash_history)
Script(Gui) to add commands to the history of Bash shell (.Bash_history). Allows to add (without being executed) commands for later use both user mode how to Root mode. Cleans or sorts and removes duplicate lines from bash history