Search Results for "duplicate lines"
Sort By:
Showing 23 open source projects for "duplicate lines"
View related business solutions-
Build Securely on AWS with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
Go From AI Idea to AI App FastAccess Gemini 3 and 200+ models. Build chatbots, agents, or custom models with built-in monitoring and scaling.
-
1
RemoveDuplicateLinesFromTxt
Remove Duplicate lines From Files in TXT
This program remove duplicate lines in txt files. -
2
Text Line Duplicate Remover
Remove duplicate lines from your text
This standalone offline web browser tool helps you remove duplicate lines from your text, with additional text processing options. Simply open it in your browser by double-clicking the html file. It also includes the source code too. I made this when I was working with long lists of entries and needed something to automatically clean them up. As a bonus you can also change the Sentence Case of the text, make it lowercase, UPPERCASE or Sentence case. -
3
Video-subtitle-extractor
A GUI tool for extracting hard-coded subtitle (hardsub) from videos
Video hard subtitle extraction, generate srt file. There is no need to apply for a third-party API, and text recognition can be implemented locally. A deep learning-based video subtitle extraction framework, including subtitle region detection and subtitle content extraction. A GUI tool for extracting hard-coded subtitles (hardsub) from videos and generating srt files. Use local OCR recognition, no need to set up and call any API, and do not need to access online OCR services such as Baidu... -
4
Swiss File Knife
One hundred command line tools in a small and portable binary.
Create zip files, extract zip files, replace text in files, search in files using expressions, stream text editor, instant command line ftp and http server, send folder via network, copy folder excluding sub folders and files, find duplicate files, run a command on all files of a folder, split and join large files, make md5 checksum lists of files, remove tab characters, convert CR/LF, list newest or biggest files of a folder, compare folders, treesize, show first or last lines of a file, find filenames fast using index files, rename many files using expressions, copy part of a file, change times of a file, set file time from filename, print colored text to terminal, convert csv to tab separated, download files from web, send http or udp requests, print tcp or udp traffic, create hexdump of files, join many text files into one, list nested .zip .tar .tar.gz .tar.bz2 archive contents. ... -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
5
logwitch
a simple log file scanner for linux written in shell and lua
logwitch checks single or rotated log files, either plain text or gzipped. It can work with log4j and gnu/linux system logs. You configure it to watch for lines in log files that interest you in by creating a simple text file in its config directory. It emails a daily report to you and timestamps logs so that you do not receive duplicate information. logwitch is GPL3 licensed -
6
DupRem
Simple application to remove duplicate and empty lines on text files.
DupRem is a simple easy-to-use cross-platform application to remove duplicate and empty lines from any text file. It is also possible to keep or ignore case sensitive. Works also from command-line interface, e.g. "java -jar duprem.jar -r input_file.txt >output_file.txt", to create output file, or "java -jar duprem.jar -r input_file.txt >>output_file.txt", to create or append to output file. DupRem is portable, does not need installation and is developed in Java, so needs the Java Virtual Machine (version 6 or higher) that, in the case, is very easy to download and install. -
7
CVTRPGFREE
Convert fixed-format RPG code to free-form RPGILE code
This IBM i (aka iSeries, AS400) command provides for code modernisation by converting fixed-format RPG and RPGLE source code into fully free-form RPGLE source in a non-destructive manner. Converts: * H-Specs * F-Specs * D-Specs * C-Specs * P-Specs (Subprocedures) * Key Lists * Parameter Lists **PLEASE REPORT ANY ISSUES YOU FIND** NOTE: Requires V7R2M0 or higher. Some Background: This started out as a 'quick and dirty' program for my own needs, but it got a little out of... -
8
Blaiz Tools
Tools for working with Gossamer codebase and app source code
Tools for packing files, converting images, manipulating text, checking code and working with the Gossamer codebase and app source code. -
9
Remove Duplicate Lines
Remove duplicate lines in text file
A handy tool with graphical interface that remove/delete duplicate lines in a text file. GitHub source: https://github.com/ahmed-fathy/remove-duplicates/ -
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
10
CleanRL
High-quality single file implementation of Deep Reinforcement Learning
...The implementation is clean and simple, yet we can scale it to run thousands of experiments using AWS Batch. CleanRL is not a modular library and therefore it is not meant to be imported. At the cost of duplicate code, we make all implementation details of a DRL algorithm variant easy to understand, so CleanRL comes with its own pros and cons. You should consider using CleanRL if you want to 1) understand all implementation details of an algorithm's variant or 2) prototype advanced features that other modular DRL libraries do not support (CleanRL has minimal lines of code so it gives you great debugging experience and you don't have to do a lot of subclassing like sometimes in modular DRL libraries). -
11
Abdal Duplicate Remover
Remove duplicate content and more features
Remove duplicate content and more features for txt file -
12
Sucky Clipboard
A clipboard tool with a history function.
A useful tool when having to copy and paste several strings from one application to another. Imagine testing a payment gateway with set card number, name, and address details and having to switch between applications repeatedly to copy and paste each detail one-by-one. Instead, Sucky Clipboard allows you to copy each of the detail lines from one application, stores them on its clipboard interface, and then paste each line in turn into the destination fields. -
13
pguniq
Pretty Good Unique - report or omit repeated lines without sorting
This utility suppresses or reports duplicate rows without the need to sort them first. It calculates CRC32 hash for every row and saves it in bit matrix. By default it uses 4-byte hash which consumes up to 512MB of RAM. Memory is allocated by 1K chunks as needed. -
14
XL-Tools
XL-Tools provides a bunch of functions for list of strings.
XL-Tools provides a bunch of functions for list of strings, grouped in five categories: Lists, Sorting, Conversion, Time, Utils. More details and screenshots on http://le-tools.com. -
15
TextMechanic offline
Simple, single task, browser based, text manipulation tools.
This is a small utility to manipulate text , its functions are: -Remove Duplicate Lines - Remove/delete all duplicate lines within your text/list. -Remove Empty Lines - Remove/delete all empty lines within your text/list. -Remove Lines Containing... - Remove lines containing or not containing your specified search text. -Find and Replace Text - Find and replace text matching your search criteria. -
16
intBasHistory
Manage (.Bash_history)
Script(Gui) to add commands to the history of Bash shell (.Bash_history). Allows to add (without being executed) commands for later use both user mode how to Root mode. Cleans or sorts and removes duplicate lines from bash history -
17
Crunch is a wordlist generator where you can specify a standard character set or a character set you specify. crunch can generate all possible combinations and permutations.
-
18
Simple Java Database
Simple Database written in Java
A simple database with commands similar to those of SQL. It is to be run from the command line. (java -jar DatabaseJAR.jar) The application allows users to create tables, add data to the tables, view data from tables using various filters, back-up and restore the database, read commands from a text file, perform various set operations (such as union and intersection) on tables, and define indices on tables to allow faster manipulation. (To simplify the binary tree structure, the define... -
19
This is a simple Python script which allows you to remove duplicate lines from a text file. This application was designed specifically for creating word-list dictionaries and ensuring no duplicates exist. Use files with one entry per line.
-
20
-
21
-
22
Send unique lines to standard out. Remove duplicate lines from anywhere within a text file. Usage example : uniquelines command_history > commmand_history.unique
-
23
same is a tool to find duplicate lines in multiple text files. Very useful to find and fix copy-and-paste programming. It has been designed to be simple, portable, and fast.
- Previous
- You're on page 1
- Next
