Search Results for "duplicate text"
Sort By:
Showing 62 open source projects for "duplicate text"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
1
Text Line Duplicate Remover
Remove duplicate lines from your text
This standalone offline web browser tool helps you remove duplicate lines from your text, with additional text processing options. Simply open it in your browser by double-clicking the html file. It also includes the source code too. I made this when I was working with long lists of entries and needed something to automatically clean them up. As a bonus you can also change the Sentence Case of the text, make it lowercase, UPPERCASE or Sentence case. -
2
Video-subtitle-extractor
A GUI tool for extracting hard-coded subtitle (hardsub) from videos
Video hard subtitle extraction, generate srt file. There is no need to apply for a third-party API, and text recognition can be implemented locally. A deep learning-based video subtitle extraction framework, including subtitle region detection and subtitle content extraction. A GUI tool for extracting hard-coded subtitles (hardsub) from videos and generating srt files. Use local OCR recognition, no need to set up and call any API, and do not need to access online OCR services such as Baidu... -
3
GladiaFlow
A desktop app for real-time voice dictation
GladiaFlow is an open-source desktop app for turning spoken language into text in virtually any text field. It captures microphone audio through a global hotkey and streams it to Gladia’s Live Transcription API. Partial and final results arrive in real time, then the app cleans punctuation, capitalization, and duplicate text before pasting the transcript into the active application. Users can choose push-to-talk or toggle activation and configure languages, code switching, vocabulary, and pronunciations. ... -
4
JSON Lint
JSON Lint for PHP
...Its lint method returns detailed parsing errors without decoding the input, while parse produces PHP values and throws exceptions when the document is invalid. Error messages include the relevant line, nearby text, a position marker, and the tokens expected by the parser. Optional flags can reject duplicate object keys, preserve them under generated names, or collect repeated values into arrays. The parser can also return associative arrays and accept JavaScript-style inline or block comments. UTF-8 validation detects malformed byte sequences and reports the first invalid position. ... -
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
5
DocuBrowse
This does for Documents what repo-browser does for repos
...It also includes PII detection, multiple document directories, tag filtering, duplicate cleanup, and packaged installers for Linux, Windows, and macOS. -
6
kg-gen
Knowledge Graph Generation from Any Text
kg-gen is an open-source framework developed by the STAIR Lab that automatically generates knowledge graphs from unstructured text using large language models. The system is designed to transform plain text sources such as documents, articles, or conversation transcripts into structured graphs composed of entities and relationships. Instead of relying on traditional rule-based extraction techniques, KG-Gen uses language models to identify entities and their relationships, producing... -
7
SurveyJS
JavaScript Survey and Form Library
SurveyJS Form Library is distributed as npm packages and as scripts and style sheets that you can reference on your page. You can use it in any React, Angular, Vue, Knockout, or jQuery application. React, Angular, Knockout, and Vue3 are supported natively. To communicate with the server, the libraries use JSON objects that represent form schemas (content and layout of a form) and form results (answers). You have the option to build dynamic JSON-driven forms using our free full-featured... -
8
Swiss File Knife
One hundred command line tools in a small and portable binary.
Create zip files, extract zip files, replace text in files, search in files using expressions, stream text editor, instant command line ftp and http server, send folder via network, copy folder excluding sub folders and files, find duplicate files, run a command on all files of a folder, split and join large files, make md5 checksum lists of files, remove tab characters, convert CR/LF, list newest or biggest files of a folder, compare folders, treesize, show first or last lines of a file, find filenames fast using index files, rename many files using expressions, copy part of a file, change times of a file, set file time from filename, print colored text to terminal, convert csv to tab separated, download files from web, send http or udp requests, print tcp or udp traffic, create hexdump of files, join many text files into one, list nested .zip .tar .tar.gz .tar.bz2 archive contents. ... -
9
DupRem
Simple application to remove duplicate and empty lines on text files.
DupRem is a simple easy-to-use cross-platform application to remove duplicate and empty lines from any text file. It is also possible to keep or ignore case sensitive. Works also from command-line interface, e.g. "java -jar duprem.jar -r input_file.txt >output_file.txt", to create output file, or "java -jar duprem.jar -r input_file.txt >>output_file.txt", to create or append to output file. DupRem is portable, does not need installation and is developed in Java, so needs the Java Virtual Machine (version 6 or higher) that, in the case, is very easy to download and install. -
Demo Series - Small Business Backup By VeeamWatch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
-
10
logwitch
a simple log file scanner for linux written in shell and lua
logwitch checks single or rotated log files, either plain text or gzipped. It can work with log4j and gnu/linux system logs. You configure it to watch for lines in log files that interest you in by creating a simple text file in its config directory. It emails a daily report to you and timestamps logs so that you do not receive duplicate information. logwitch is GPL3 licensed -
11
Bootleg Sound Processor
Software for processing audio files.
Software for processing audio files. The files "Batch Processor.py" and "Duplicate remover.py" are meant to be used with the output of Bootleg Text Slicer (https://github.com/Northstrix/bootleg-text-slicer) placed into the "Unprocessed" folder, while "Single file processor.py" can be used with standalone files from arbitrary locations. GitHub repository: https://github.com/Northstrix/bootleg-sound-processor Made using Google AI Studio (https://aistudio.google.com/) and Perplexity (https://www.perplexity.ai/) -
12
SIMILAR
Compares Folders for Same Name and/or Size Files
I developed this application because I was not happy with existing ones. The program analyzes two folders to determine whether they are identical or different by identifying files with the same name and/or size. The resulting list can be saved as a text file. Files with matching names and/or sizes can be deleted, but only those in the second directory will be removed. You can control which files are deleted through the textbox, as only the files displayed there will be deleted. Vary name... -
13
pathopener
Quick and Easy Folder Access
...Features Quick Path Access: Store and quickly open your most-used folders and directories Global Hotkey: Press Ctrl + F4 from anywhere to show the application System Tray Integration: Runs minimized in system tray for quick access Auto-start Option: Configure to start automatically with Windows Persistent Storage: Automatically saves your folder paths for future sessions Duplicate Prevention: Automatically detects and handles duplicate paths Path Validation: Verifies paths exist before saving Simple Interface: Clean, easy-to-use interface with one-click folder opening Read the ReadMe text -
14
DiskGeek
Free disk space analyser for Windows — no ads, no bloat
DiskGeek scans your drives and shows exactly what's eating your space, with a sortable list view and a treemap view. It finds exact duplicates (SHA-256) and near-duplicate / visually similar images using perceptual hashing, with full-text search across scan results and batch rename. Snapshot comparison shows what changed between scans over time, and scheduled, unattended scans can run from the command line for ongoing monitoring. Includes NTFS permission auditing plus CSV/HTML export. No installer bloat, no bundled offers, no telemetry, no Pro tier or upsells — 100% free. ... -
15
...With its easy-to-use explorer-like interface, XnView MP allow you to quickly view your images and photos, but also to make image management. You have features like batch rename, batch converter, duplicate image finder, image compare, but you can also create contact sheets, slideshow. XnConvert is a fast and powerful batch image converter, you can convert, resize, watermark, add text, enhance, filter in batch mode. XnResize is a fast and powerful batch image resizer, you can convert, resize in batch mode. You have the Online Convert to batch resize and convert your files from your web browser.
-
16
Blaiz Tools
Tools for working with Gossamer codebase and app source code
Tools for packing files, converting images, manipulating text, checking code and working with the Gossamer codebase and app source code. -
17
Sprint PDF Editor (Smarter PDF Solution)
Edit, Convert, Extract , Export, Secure and PDF Imposition.
Sprint PDF Editor® The Productive, Modern, Innovative, Clean & Colourful GUI. Faster, Smarter & Seamless workflows, with 50+ functions. Sprint PDF Editor & Reader, Complete PDF Solution, Supercharge Your Workflows With Imposition, Extract, Compress, Watermark, Protect & Secure, Split & Merge, Crop Pages, Printing, Stamp & more. Your Privacy, Our Priority Protect Your Data with Complete Confidence. Our software is designed to keep your information 100% secure. Unlike cloud-based... -
18
Kindle Mate(KMate)
Kindle clippings and Kindle Vocabulary Builder manager
KMate is the ultimate reading companion for Kindle users — and the all-new, cross-platform successor to Kindle Mate, the classic Kindle notes manager trusted by readers worldwide for over a decade. It is the only Kindle assistant that unifies cross-device import, cloud sync, vocabulary & dictionary management, flexible export, reading analytics, and AI-powered definitions — all in one app. ******************************************************************************* KMate: Windows: ... -
19
FSTDFC
File Search To Date Folder Copy
Version 0.7 - 31st October 2024 Added option to specify multiple file wildcards for search criteria, separate multiple by space to use Font size changes to make the form easier to use Version 0.6 - 5th September 2024 Increased maximum file count from 100K to 1000K Any file with EXIF data showing the date will be used for the output folder naming, all other files will use the "LastWriteTime" as the parameter. Added counter showing the number of files still to be copied to the... -
20
WebEmailsExtractor
WebEmailsExtractor - get emails and phones from websites to list
WebEmailsExtractor is a powerful desktop application designed for marketers, sales teams, recruiters, and researchers who need to build targeted contact lists quickly and effectively. Simply input your starting URLs, and let our intelligent crawler do the rest. Unlimited Crawl Depth + Unlimited Concurrent URLs + Keyword Filter + A lot more in Pro Version. -
21
garysfm
An advanced file manager with qss themes and iso and folder previews
garysfm which stands for Gary's File Manager is a file manager with some advanced features. Those features include bulk renaming and folder image previews. I has rather advanced search functions, tab browsing with persistence between launches. It remembers your folder sorting and view options in icon view. It also remembers your active tabs between sessions. It has progress dialog while doing large operations like copying large files, and folders with many files. python version works on... -
22
Virtualdub Batch Video DeShake v26.0204
Batch to compress [and deshake] all videos [or images] in folder
Installation: Execute "DeShakInst.BAT" VirtualDub2 44282; AviSynth+ 3.7.5 updated to C:\DVD DESHAK.BAT updated to C:\UT and added to PATH Usage: DESHAK task[s] [parameters] Tasks: tp1: deshake pass1 LOG generation for 2nd pass tp2: deshake pass2 and compress video and audio to MP3 tcomp: compress (no deshake) twav: extract WAV and/or uses external WAV audio Parameters (more in help): vEXT: video extension (ie: vmov), default: vAVI qN: h264... -
23
text-dedup
All-in-one text de-duplication
text-dedup is a Python library that enables efficient deduplication of large text corpora by using MinHash and other probabilistic techniques to detect near-duplicate content. This is especially useful for NLP tasks where duplicated training data can skew model performance. text-dedup scales to billions of documents and offers tools for chunking, hashing, and comparing text efficiently with low memory usage. -
24
Remove Duplicate Lines
Remove duplicate lines in text file
A handy tool with graphical interface that remove/delete duplicate lines in a text file. GitHub source: https://github.com/ahmed-fathy/remove-duplicates/ -
25
Super-PDF-Editor-Lite
World's most comprehensive, powerful, process-based PDF editor
World's most comprehensive, powerful, process-based and lighting fast PDF reader, editor and batch processor. Includes features like Create PDF from Images, HTML, Text files. Create a processing log file. Extract Page, Split Page, Rotate Page, Merge Page, Duplicate page, Move Page, Printing, and Compress Page. Improve image enhancement before OCR operation for better OCR performance. pdf Imposition, etc. Super PDF Editor is best for bulk pdf processing, especially for the printing industry. Easy pdf imposition, booklet, n ups pages, and more. ...
