Search Results for "large files"
Sort By:
Showing 1112 open source projects for "large files"
View related business solutions-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
1
files-to-prompt
Concatenate a directory full of files into a single prompt
files-to-prompt is a Python command-line tool that takes one or more files or entire directories and concatenates their contents into a single, LLM-friendly prompt. It walks the directory tree, outputting each file preceded by its relative path and a separator, so a model can understand which content came from where. The tool is aimed at workflows where you want to ask an LLM questions about a whole codebase, documentation set, or notes folder without manually copying files together. It... -
2
changed-files
Github action to retrieve all (added, copied, modified, deleted, etc.
Github action to retrieve all (added, copied, modified, deleted, renamed, type changed, unmerged, unknown) files and directories. Effortlessly track all changed files and directories relative to a target branch, preceding commit or the last remote commit returning relative paths from the project root using this GitHub action. This action solely identifies files that have undergone changes within the context of events such as pull_request, push, and more. However, it doesn't detect pending... -
3
Git Large File Storage
Git extension for versioning large files
An open source Git extension for versioning large files. Git Large File Storage (LFS) replaces large files such as audio samples, videos, datasets, and graphics with text pointers inside Git, while storing the file contents on a remote server like GitHub.com or GitHub Enterprise. Download and install the Git command line extension. Once downloaded and installed, set up Git LFS for your user account. -
4
Planning with Files
Claude Code skill implementing Manus-style persistent planning
Planning With Files is a Claude Code skill — essentially a plugin for AI agent workflows — that adapts the “Manus-style” persistent markdown planning methodology into developer workflows, enabling structured project planning, progress tracking, and knowledge storage using plain text files. Inspired by high-profile agent workflows and context engineering patterns, it uses persistent markdown files (like task_plan.md, progress.md, and findings.md) as the “working memory” for AI agents, overcoming the limitations of ephemeral memory and large context windows that often lead to drift or information loss. ... -
Veeam Data Platform v13.1Try Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
5
Czkawka
Multi functional app to find duplicates, empty folders, similar images
Czkawka (Polish for “hiccup”) is a lightning‑fast, multi‑purpose file cleaning tool written in Rust. It helps users declutter storage by finding duplicate files, similar images or audio, empty folders, and unusually large files through CPU‑efficient multithreading. Available with both GUI (GTK‑based) and CLI versions for flexible usage. -
6
ZipStream PHP
PHP ZIP Streaming Library
ZipStream-PHP is a library that allows you to dynamically create ZIP files on the fly without storing files on the server beforehand. It’s designed for streaming large ZIP archives directly to the browser or client, making it suitable for memory-efficient downloads. -
7
EasyTier
A simple, decentralized mesh VPN with WireGuard support
EasyTier is a user-friendly file management tool for creating and managing tiered storage solutions, allowing users to offload rarely used files to alternative storage while keeping the system clean and efficient. Built for Windows, it helps users analyze disk usage, identify large or unused files, and move them to other volumes or cloud drives with minimal effort. Its intuitive interface and automation capabilities make it suitable for both personal and small business use, particularly when managing limited SSD space. -
8
MarkItDown
Python tool for converting files and office documents to Markdown
MarkItDown is a lightweight Python utility developed by Microsoft for converting various files and office documents to Markdown format. It is particularly useful for preparing documents for use with large language models and related text analysis pipelines. -
9
MCA Selector
A tool to select chunks from Minecraft worlds for deletion or export
An external tool to export or delete selected chunks and regions from a world save of Minecraft Java Edition. -
Cut Data Warehouse Costs by 54%BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
-
10
smart_open
Utils for streaming large files (S3, HDFS, gzip, bz2...)
smart_open is a Python library for streaming very large files from local or remote storage through a familiar file-like interface. It acts as an extended replacement for Python's built-in open function. Supported backends include Amazon S3, Google Cloud Storage, Azure Blob Storage, HDFS, WebHDFS, HTTP, HTTPS, SFTP, and local filesystems. Data can be read or written without first downloading an entire remote object to disk. -
11
Send files to TV
Easily transfer files to your Smart TV from Android or Windows
SFTTV is a simple application to connect your Smart Tv android, your android mobile device and your personal computer. It allows you to quickly and easily share movies, tv show or ANY files between these devices through your local network. No Internet required. SFTTV is designed to be simple. The application discover automagically other devices on the local network with SFTTV installed. Transfer large files in record time SFTTV is faster than Bluetooth. SFTTV is the fastest and most private way to send files to your TV Cross platform SFTTV runs also on Windows, macOS, and Linux. ... -
12
Gemini MCP Tool
MCP server that enables AI assistants to interact with Google Gemini
Gemini MCP Tool is a lightweight MCP server that enables AI assistants to interface directly with the Google Gemini CLI, effectively extending the capabilities of one AI system by leveraging another. Its primary purpose is to allow tools like Claude or other MCP-compatible agents to offload complex or large-scale analysis tasks to Gemini, particularly when working with large files or codebases. The system takes advantage of Gemini’s large context window, enabling deeper analysis of extensive datasets that might otherwise exceed the limits of other models. It supports workflows where users can reference files or directories using simple syntax, allowing the AI to process entire projects or documents in a single request. ... -
13
yek
Serialize repositories into LLM-ready context w/ smart prioritization
Yek is a Rust-based CLI tool designed to serialize text-based files from a repository or directory into a single structured output for large language model use. It scans projects using .gitignore rules to exclude irrelevant files and automatically filters out binary or oversized content. Yek prioritizes files based on Git history, placing more important content later in the output to align with how language models process context. -
14
Headroom
Compress tool outputs, logs, files, and RAG chunks
Headroom is a context optimization layer for LLM applications that compresses information before it reaches the model. It sits between an application and an LLM provider, intercepting requests and forwarding a shorter optimized prompt. The project is designed to reduce token usage while preserving the answer quality needed for agent workflows. It can compress tool outputs, logs, RAG chunks, files, and conversation history. Headroom can be used as a transparent proxy, a Python function, a... -
15
LosslessCut
The swiss army knife of lossless video/audio editing
LosslessCut aims to be the ultimate cross platform FFmpeg GUI for extremely fast and lossless operations on video, audio, subtitle and other related media files. The main feature is lossless trimming and cutting of video and audio files, which is great for saving space by rough-cutting your large video files taken from a video camera, GoPro, drone, etc. It lets you quickly extract the good parts from your videos and discard many gigabytes of data without doing a slow re-encode and thereby losing quality. ... -
16
QSV
Blazing-fast Data-Wrangling toolkit
qsv is a fast, command-line CSV data toolkit written in Rust that extends the capabilities of xsv. It’s designed to make working with CSV files at scale easy and efficient, offering over 40 powerful subcommands for tasks like querying, sampling, splitting, deduplicating, and more. qsv is ideal for data engineers, analysts, and developers who need high-performance CSV manipulation on the command line. -
17
Mole
🐹 Deep clean and optimize your Mac.
...It aims to consolidate the functionality of multiple popular Mac utilities—cleaners, uninstallers, disk analyzers, and system tuners—into a single open-source binary. From the command line, you can scan and remove large caches, logs, temporary files, browser remnants, and other junk that quietly accumulates over time. Mole’s smart uninstall mode walks the filesystem to remove not just an application bundle, but also associated caches, preferences, launch agents, logs, and other leftovers in more than twenty locations. It also includes optimization routines that rebuild caches, reset network services, trim swap files, and refresh indexes to keep the system feeling responsive. ... -
18
Vince's CSV Parser
A modern C++ library for reading, writing, and analyzing CSV
...Inspired by Python's csv module, I wanted a library with simple, intuitive syntax. Furthermore, I wanted support for special use cases such as calculating statistics on very large files. With the deluge of large datasets available, a performant CSV parser is a necessity. By using overlapped threads, memory-mapped IO, and efficient data structures, this parser can quickly tackle large CSV files. Furthermore, this parser has a minimal memory footprint and can handle larger-than-RAM files. -
19
Rainmeter
Desktop customization tool for Windows
Rainmeter is a powerful and extensible desktop customization platform for Windows that lets users display customizable skins and widgets on their desktop to show information such as system statistics, time, weather, application shortcuts, and more. With a modular architecture, Rainmeter allows users and creators to build or install “skins” using simple INI configuration files combined with Lua scripting and graphics to display text, images, meters, and interactive controls. It runs with minimal system overhead and stays resident in the Windows notification area, updating widgets in real time based on system performance, network conditions, or custom triggers. Rainmeter’s open-source codebase and large community ecosystem mean that thousands of user-created skins are available for download, enabling anything from minimalistic time displays to elaborate animated dashboards. -
20
AudioBookConverter
Improved AudioBookConverter based on freeipodsoftware release
...It includes intelligent artwork handling, automatically sourcing and merging cover images from files or directories. The application uses parallel encoding to improve performance, making it efficient for large audiobook collections. It also supports advanced chapter management, including importing and editing chapter structures. Overall, it simplifies audiobook creation while maintaining high-quality output and metadata integrity. -
21
repo2txt
Web-based tool converts GitHub repository contents
repo2txt is an open-source developer tool that converts the contents of a code repository into a single structured text file that can be easily consumed by large language models. The tool is designed to address the challenge of analyzing entire codebases with AI assistants, where code is normally distributed across many files and directories. By collecting repository contents and formatting them into a single text document, repo2txt allows developers to feed complete projects into AI systems for analysis, documentation, or code explanation tasks. ... -
22
MarkPDFDown
A high-quality PDF to Markdown tool based on large language model
MarkPDFdown is an open-source document processing tool designed to convert PDF files into structured Markdown output that can be easily used for documentation, content pipelines, and AI processing workflows. The project focuses on extracting text, formatting, and structural information from complex PDF documents and transforming that information into clean Markdown that preserves the original hierarchy of headings, paragraphs, tables, and lists. By producing Markdown rather than raw text,... -
23
FSearch
A fast file search utility for Unix-like systems based on GTK3
...Designed with GTK and written in C, it integrates nicely with desktop environments like GNOME, XFCE, and Cinnamon while still being lightweight and resource-efficient. Developers and power users appreciate FSearch for dramatically reducing the time it takes to find files compared to traditional search tools, especially on large partitions. -
24
Zip.js
JavaScript library to zip and unzip files
Zip.js is a JavaScript library for creating, reading, and editing ZIP files directly in the browser or in Node.js environments, supporting various compression methods and encryption. -
25
JMComic APK
Forbidden Comics Paradise APK
JMComic APK is an open-source repository that distributes and manages Android installation packages for a comic reading application associated with the JMComic ecosystem, which aggregates and delivers large collections of digital comics. The project acts as a hub for downloading updated APK releases, allowing users to install or update the application outside of traditional app stores. It is closely tied to a broader ecosystem that includes APIs, crawlers, and tools for browsing, searching,...
