Search Results for "large files"
Sort By:
Showing 818 open source projects for "large files"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
1
files-to-prompt
Concatenate a directory full of files into a single prompt
files-to-prompt is a Python command-line tool that takes one or more files or entire directories and concatenates their contents into a single, LLM-friendly prompt. It walks the directory tree, outputting each file preceded by its relative path and a separator, so a model can understand which content came from where. The tool is aimed at workflows where you want to ask an LLM questions about a whole codebase, documentation set, or notes folder without manually copying files together. It... -
2
Git Large File Storage
Git extension for versioning large files
An open source Git extension for versioning large files. Git Large File Storage (LFS) replaces large files such as audio samples, videos, datasets, and graphics with text pointers inside Git, while storing the file contents on a remote server like GitHub.com or GitHub Enterprise. Download and install the Git command line extension. Once downloaded and installed, set up Git LFS for your user account. -
3
changed-files
Github action to retrieve all (added, copied, modified, deleted, etc.
Github action to retrieve all (added, copied, modified, deleted, renamed, type changed, unmerged, unknown) files and directories. Effortlessly track all changed files and directories relative to a target branch, preceding commit or the last remote commit returning relative paths from the project root using this GitHub action. This action solely identifies files that have undergone changes within the context of events such as pull_request, push, and more. However, it doesn't detect pending... -
4
Czkawka
Multi functional app to find duplicates, empty folders, similar images
Czkawka (Polish for “hiccup”) is a lightning‑fast, multi‑purpose file cleaning tool written in Rust. It helps users declutter storage by finding duplicate files, similar images or audio, empty folders, and unusually large files through CPU‑efficient multithreading. Available with both GUI (GTK‑based) and CLI versions for flexible usage. -
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
5
ZipStream PHP
PHP ZIP Streaming Library
ZipStream-PHP is a library that allows you to dynamically create ZIP files on the fly without storing files on the server beforehand. It’s designed for streaming large ZIP archives directly to the browser or client, making it suitable for memory-efficient downloads. -
6
MCA Selector
A tool to select chunks from Minecraft worlds for deletion or export
An external tool to export or delete selected chunks and regions from a world save of Minecraft Java Edition. -
7
MarkItDown
Python tool for converting files and office documents to Markdown
MarkItDown is a lightweight Python utility developed by Microsoft for converting various files and office documents to Markdown format. It is particularly useful for preparing documents for use with large language models and related text analysis pipelines. -
8
EasyTier
A simple, decentralized mesh VPN with WireGuard support
EasyTier is a user-friendly file management tool for creating and managing tiered storage solutions, allowing users to offload rarely used files to alternative storage while keeping the system clean and efficient. Built for Windows, it helps users analyze disk usage, identify large or unused files, and move them to other volumes or cloud drives with minimal effort. Its intuitive interface and automation capabilities make it suitable for both personal and small business use, particularly when managing limited SSD space. -
9
LosslessCut
The swiss army knife of lossless video/audio editing
LosslessCut aims to be the ultimate cross platform FFmpeg GUI for extremely fast and lossless operations on video, audio, subtitle and other related media files. The main feature is lossless trimming and cutting of video and audio files, which is great for saving space by rough-cutting your large video files taken from a video camera, GoPro, drone, etc. It lets you quickly extract the good parts from your videos and discard many gigabytes of data without doing a slow re-encode and thereby losing quality. ... -
Stop vibe-debugging.AppSignal's MCP server hands Claude, Cursor, or Zed your real errors, traces, and the deploy that shipped them. AI writes the fix; you review the diff.
-
10
DuckDB
DuckDB is an in-process SQL OLAP Database Management System
...DuckDB supports arbitrary and nested correlated subqueries, window functions, collations, complex types (arrays, structs), and more. For more information on the goals of DuckDB, please refer to the Why DuckDB page on our website. Processing and storing tabular datasets, e.g. from CSV or Parquet files. Interactive data analysis, e.g. Joining & aggregate multiple large tables. Concurrent large changes, to multiple large tables, e.g. appending rows, adding/removing/updating columns. Large result set transfer to client. For development, DuckDB requires CMake, Python3 and a C++11 compliant compiler. Run make in the root directory to compile the sources. ... -
11
Zip.js
JavaScript library to zip and unzip files
Zip.js is a JavaScript library for creating, reading, and editing ZIP files directly in the browser or in Node.js environments, supporting various compression methods and encryption. -
12
repo2txt
Web-based tool converts GitHub repository contents
repo2txt is an open-source developer tool that converts the contents of a code repository into a single structured text file that can be easily consumed by large language models. The tool is designed to address the challenge of analyzing entire codebases with AI assistants, where code is normally distributed across many files and directories. By collecting repository contents and formatting them into a single text document, repo2txt allows developers to feed complete projects into AI systems for analysis, documentation, or code explanation tasks. ... -
13
AudioBookConverter
Improved AudioBookConverter based on freeipodsoftware release
...It includes intelligent artwork handling, automatically sourcing and merging cover images from files or directories. The application uses parallel encoding to improve performance, making it efficient for large audiobook collections. It also supports advanced chapter management, including importing and editing chapter structures. Overall, it simplifies audiobook creation while maintaining high-quality output and metadata integrity. -
14
MarkPDFDown
A high-quality PDF to Markdown tool based on large language model
MarkPDFdown is an open-source document processing tool designed to convert PDF files into structured Markdown output that can be easily used for documentation, content pipelines, and AI processing workflows. The project focuses on extracting text, formatting, and structural information from complex PDF documents and transforming that information into clean Markdown that preserves the original hierarchy of headings, paragraphs, tables, and lists. By producing Markdown rather than raw text,... -
15
Gemini MCP Tool
MCP server that enables AI assistants to interact with Google Gemini
Gemini MCP Tool is a lightweight MCP server that enables AI assistants to interface directly with the Google Gemini CLI, effectively extending the capabilities of one AI system by leveraging another. Its primary purpose is to allow tools like Claude or other MCP-compatible agents to offload complex or large-scale analysis tasks to Gemini, particularly when working with large files or codebases. The system takes advantage of Gemini’s large context window, enabling deeper analysis of extensive datasets that might otherwise exceed the limits of other models. It supports workflows where users can reference files or directories using simple syntax, allowing the AI to process entire projects or documents in a single request. ... -
16
WeChatMsg
Project aimed at extracting, exporting, and analyzing chat records
WeChatMsg repository hosts an open-source project aimed at extracting, exporting, and analyzing chat records from the WeChat messaging platform. It provides tools that read local WeChat database files and allow users to convert chat data into readable formats such as HTML, Word, and CSV, making it possible to inspect conversations outside the mobile app environment. Beyond simple export, the project includes mechanisms for analyzing chat histories and generating annual reports or visual... -
17
imagefap-dl
ImageFap gallery downloader
imagefap-dl is a command-line downloader designed to automate the retrieval of galleries and media from ImageFap, focusing on efficiency, reliability, and structured output. The tool enables users to download entire galleries or specific content collections by parsing URLs and systematically fetching associated media files. It is optimized for batch downloading scenarios, allowing users to archive large sets of images with minimal manual intervention. The program typically includes configurable options for output directories, naming conventions, and filtering, ensuring that downloaded content is organized in a consistent and user-defined structure. ... -
18
FSearch
A fast file search utility for Unix-like systems based on GTK3
...Designed with GTK and written in C, it integrates nicely with desktop environments like GNOME, XFCE, and Cinnamon while still being lightweight and resource-efficient. Developers and power users appreciate FSearch for dramatically reducing the time it takes to find files compared to traditional search tools, especially on large partitions. -
19
Meli-Action
Download files from direct links, YouTube, Telegram, Google Play
Meli-Action is a GitHub Actions-based downloading and web archiving project designed for heavily restricted internet environments. It uses GitHub-hosted workflow runners to fetch content from direct links, YouTube, Telegram, Google Play, SoundCloud, and web pages. Downloaded files are committed into the user’s repository so they can be retrieved later through normal GitHub access. The project includes workflows for different content sources, plus a Python script that can render and save web pages as MHTML archives using a headless browser. It also handles large direct-download files by splitting them into smaller chunks that fit repository limits. ... -
20
BentoPDF
A Privacy First PDF Toolkit
...It offers functionality to merge, split, compress, rotate, and convert PDFs through an easy-to-deploy container or local installation, making it ideal for individuals and teams that handle large volumes of PDF files regularly. Because it runs entirely on your own system or server, BentoPDF helps ensure that sensitive documents never leave your environment — a critical consideration for privacy-conscious users or organizations with strict data policies. Its design aims to balance robust feature coverage with a simple setup process, typically involving a Docker image so you can start using the toolkit with minimal configuration. ... -
21
Vince's CSV Parser
A modern C++ library for reading, writing, and analyzing CSV
...Inspired by Python's csv module, I wanted a library with simple, intuitive syntax. Furthermore, I wanted support for special use cases such as calculating statistics on very large files. With the deluge of large datasets available, a performant CSV parser is a necessity. By using overlapped threads, memory-mapped IO, and efficient data structures, this parser can quickly tackle large CSV files. Furthermore, this parser has a minimal memory footprint and can handle larger-than-RAM files. -
22
Detect It Easy
Program for determining types of files for Windows, Linux and MacOS
Detect It Easy (DiE) is a tool for determining the type and internal features of binary and other file formats. It is widely used by malware analysts, digital forensics investigators, reverse engineers, and security researchers to quickly inspect unknown files and infer their type, architecture, compiler/packer used, and internal structure. DiE supports a large variety of file formats — from common executables (Windows PE, Linux ELF, macOS Mach-O) to archives, mobile packages (APK, IPA), legacy binaries, compressed or packed files, and more — making it a versatile first step in analysis or triage workflows. ... -
23
AltSendme
Send files and folders anywhere in the world without storing in cloud
Alt-Sendme is a free, open-source peer-to-peer file transfer tool that allows users to send files and folders directly between devices without relying on cloud storage or intermediary accounts. Built with modern networking principles, it provides a secure, end-to-end encrypted connection that prioritizes privacy, so personal data is not stored on third-party servers during transfer. Users can share files of any size and format easily, which makes Alt-Sendme a flexible alternative to services... -
24
Matroska Server Mk2
The streaming solution to end all streaming problems
Matroska Server Mk2 is a media streaming server designed to serve MKV video files over a network with minimal configuration. It enables on-demand streaming of video content, making it suitable for personal media servers or lightweight distribution systems. The project focuses on efficient file serving and compatibility with common media players. It supports handling large video files while maintaining smooth playback performance. -
25
Luck Perms
A permissions plugin for Minecraft servers
...The plugin provides a flexible system for creating user groups, assigning permissions, and defining roles that determine access to commands, features, and gameplay mechanics. Designed for performance and scalability, LuckPerms can handle large multiplayer servers and complex permission hierarchies while maintaining fast response times. Administrators can configure permissions using command-line tools, configuration files, or a web-based editor that simplifies management of large permission systems. The plugin also supports multiple storage backends such as local files, SQL databases, and other data systems, allowing server networks to synchronize permissions across multiple servers.
