Search Results for "large files"
Sort By:
Showing 60 open source projects for "large files"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
1
ZipStream PHP
PHP ZIP Streaming Library
ZipStream-PHP is a library that allows you to dynamically create ZIP files on the fly without storing files on the server beforehand. It’s designed for streaming large ZIP archives directly to the browser or client, making it suitable for memory-efficient downloads. -
2
Zip.js
JavaScript library to zip and unzip files
Zip.js is a JavaScript library for creating, reading, and editing ZIP files directly in the browser or in Node.js environments, supporting various compression methods and encryption. -
3
Stash
An organizer for your videos, written in Go
...Galleries are collections of images. Galleries can be automatically created from zip files and folders containing image files. Preview and view all of your scenes and galleries from your web browser on your PC, tablet or phone. Stash directly streams videos to your web browser. Stash supports streaming of a large variety of formats and codecs to most web browsers. -
4
dategrep
Print lines matching a time range
dategrep is a command-line utility designed to extract lines from log files that fall within a specified time range. It efficiently processes large log files by performing a binary search to locate the relevant entries, making it a valuable tool for system administrators and developers analyzing time-specific events. -
$300 Free Credits for Your Google Cloud ProjectsLaunch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
-
5
NYC Taxi Data
Import public NYC taxi and for-hire vehicle (Uber, Lyft)
The nyc-taxi-data repository is a rich dataset and exploratory project around New York City taxi trip records. It collects and preprocesses large-scale trip datasets (fares, pickup/dropoff, timestamps, locations, passenger counts) to enable data analysis, modeling, and visualization efforts. The project includes scripts and notebooks for cleaning and filtering the raw data, memory-efficient processing for large CSV/Parquet files, and aggregation workflows (e.g. trips per hour, heatmaps of pickups/dropoffs). ... -
6
Gaufrette
PHP library that provides a filesystem abstraction layer
Gaufrette is a PHP library designed to abstract filesystem operations, providing a consistent interface to interact with various storage backends. It allows developers to work with files stored locally, on cloud platforms, or via network protocols, without changing the code. Gaufrette supports plugins for caching, metadata management, and file transformation, making it a flexible choice for file management in web applications. -
7
Expat
Fast streaming XML parser written in C99 with >90% test coverage
Welcome to Expat, a stream-oriented XML parser library written in C. Expat excels with files too large to fit RAM, and where performance and flexibility are crucial. There are a number of applications, libraries, and hardware using Expat, as well as bindings and 3rd-party wrappers. Expat is packaged everywhere. This is Expat, a C99 library for parsing XML 1.0 Fourth Edition, started by James Clark in 1997. Expat is a stream-oriented XML parser. -
8
File Nesting Config for VS Code
Config of File Nesting for VS Code
This project provides a curated configuration snippet for the file-nesting feature of Visual Studio Code, authored by Anthony Fu (antfu). The goal is to help developers organize large code-bases by collapsing “secondary” or generated files (for example build artifacts, tests, config variants) under their primary files in the Explorer tree. It supports VS Code version 1.67 and above by enabling the built-in "explorer.fileNesting" setting. It is somewhat opinionated, offering a broad list of patterns (for example hiding .env.*, *.freezed.dart, etc) and it also includes an optional VS Code extension to automatically update the nesting config from the repo. ... -
9
PRDownloader
A file downloader library for Android with pause and resume support
A file downloader library for Android with pause and resume support. PRDownloader can be used to download any type of files like image, video, pdf, apk and etc. This file downloader library supports pause and resume while downloading a file. Supports large file download. This downloader library has a simple interface to make download request. We can check if the status of downloading with the given download Id. PRDownloader gives callbacks for everything like onProgress, onCancel, onStart, onError and etc while downloading a file. ... -
99.99% Uptime for MySQL and PostgreSQL DatabasesCloud SQL Enterprise Plus delivers near-zero downtime with 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server.
-
10
PcapPlusPlus
Multiplatform C++ library for parsing and crafting of network packets
A multi-platform C++ library for capturing, parsing, and crafting of network packets. It is designed to be efficient, powerful, and easy to use. PcapPlusPlus enables capturing and sending network packets through easy-to-use C++ wrappers for the most popular packet processing engines such as libpcap, WinPcap, NPcap, DPDK and PF_RING. PcapPlusPlus enables decoding and forging capabilities for a large variety of network protocols. PcapPlusPlus is designed to be efficient and lightweight. It... -
11
Polybar Themes
A huge collection of polybar themes
Polybar Themes is a large collection of Polybar themes for Linux desktops. It provides many styles, colors, and visual variants for users who want polished status bars without building every configuration from scratch. The project includes simple and bitmap theme families, along with fonts, wallpapers, scripts, and installation tooling. It is designed for customizable desktop environments and window managers, especially setups that use Polybar with tools like Rofi, pywal, and NetworkManager... -
12
php-file-iterator
FilterIterator implementation that filters files
php-file-iterator is a small library that walks directory trees and yields files matching include/exclude rules, commonly used to discover test files. It supports filtering by suffixes or prefixes (for example, “Test.php”) to keep selection deterministic. Exclusion lists help you skip vendor directories, VCS folders, or generated artifacts that would otherwise slow down tools. The iterator interface means results are streamed rather than loaded at once, which keeps memory usage modest on large codebases. ... -
13
EasyExcel
Lightweight Java library developed by Alibaba for reading and writing
EasyExcel is a Java library focused on reading and writing Excel files with very low memory usage, making it suitable for large datasets that overwhelm traditional APIs. It uses streaming/event-driven parsing to avoid loading entire workbooks into memory, and it maps rows to Java objects via simple annotations. Writers support multiple sheets, custom styles, merged cells, and template-based filling so production reports remain maintainable. -
14
minizip-ng
Fork of the zip manipulation library found in the zlib distribution
minizip-ng is a zip manipulation library written in C that is supported on Windows, macOS, and Linux. Minizip was originally developed by Gilles Vollant in 1998. It was first included in the zlib distribution as an additional code contribution starting in zlib 1.1.2. Since that time, it has been continually improved upon and contributed to by many people. The original project can still be found in the zlib distribution that is maintained by Mark Adler. The motivation behind this repository... -
15
TensorStore
Library for reading and writing large multi-dimensional arrays
...Transactional semantics allow atomic updates and consistent snapshots, which is essential for large, shared datasets used by ML and scientific workflows. The library is engineered for scalability—background caching, chunk sharding, and retryable operations keep throughput high even over unreliable networks. With language bindings, it fits into Python-heavy analysis pipelines while retaining a fast C++ core. -
16
sharp
High performance Node.js image processing module
The typical use case for this high speed Node.js module is to convert large images in common formats to smaller, web-friendly JPEG, PNG, AVIF and WebP images of varying dimensions. Resizing an image is typically 4x-5x faster than using the quickest ImageMagick and GraphicsMagick settings due to its use of libvips. Colour spaces, embedded ICC profiles and alpha transparency channels are all handled correctly. Lanczos resampling ensures quality is not sacrificed for speed. As well as image... -
17
OmniTools
Self-hosted collection of powerful web-based tools for everyday tasks
OmniTools is a self-hosted web application that bundles a large collection of everyday utilities into a single clean interface you can run on your own infrastructure. It’s designed to replace the random assortment of “free online tools” people use for quick tasks, while avoiding ads, tracking, and the need to upload sensitive files to unknown servers. A key design choice is that file processing happens entirely on the client side, meaning your data stays in your browser instead of being sent to the backend. ... -
18
Plog
Portable, simple and extensible C++ logging library
Portable, simple and extensible C++ logging library. Plog is a C++ logging library that is designed to be as simple, small and flexible as possible. It is created as an alternative to existing large libraries and provides some unique features as CSV log format and wide string support. -
19
GH Archive
GH Archive is a project to record the public GitHub timeline
...Researchers can download specific hours, days, or longer periods with ordinary HTTP tools and process the events in their own systems. The dataset is also published through Google BigQuery for large-scale SQL-style exploration without downloading every archive. Its structure supports trend analysis, visualizations, machine learning, and open-source ecosystem research. The repository contains the crawler, supporting scripts, and website code, while the actual event files are hosted separately. -
20
insta
A snapshot testing library for rust
...It lets developers compare complex values against stored reference outputs instead of writing fragile manual assertions. Snapshot tests are useful when outputs are large, structured, or expected to change during development. The project includes macros for generating snapshots, reviewing changes, and storing inline snapshots inside source files. A companion cargo tool helps manage the review workflow, while a VS Code extension improves snapshot file editing and inspection. Insta is especially useful for command output, serializers, parsers, compilers, debug values, and tests where human review matters. -
21
Ollama-Laravel Package
Ollama-Laravel is a Laravel package providing seamless integration
Ollama-Laravel Package is a PHP package designed to integrate local large language models into Laravel applications through a clean and idiomatic interface. It abstracts the Ollama API into a developer-friendly facade, allowing Laravel developers to interact with models using familiar patterns such as service containers, configuration files, and fluent method chaining. The package supports a wide range of AI capabilities including text generation, chat-based interactions, embeddings, and multimodal vision analysis, making it suitable for both simple features and complex AI-driven systems. ... -
22
Glob
glob functionality for node.js
Glob is a widely used JavaScript library that implements file path pattern matching using glob syntax, enabling developers to efficiently locate files and directories that match wildcard expressions. It provides functionality similar to Unix shell globbing but is designed to work consistently across platforms within Node.js environments. The library supports complex patterns such as recursive directory matching, brace expansion, and character ranges, making it suitable for build tools, CLIs, and automation scripts. node-glob is optimized for performance and reliability when traversing large file trees, and it exposes both asynchronous and synchronous APIs. ... -
23
Down
Streaming downloads using Net::HTTP, http.rb or HTTPX
Down is a small, reliable Ruby library for downloading files that favors correctness, streaming, and clear error handling. It follows redirects safely, supports timeouts and retries, and streams responses to disk to keep memory usage low—ideal for large downloads or server environments. The API returns file-like objects (often Tempfile) with helpful metadata such as original filename and content type, which plays nicely with file-attachment libraries and background jobs. ... -
24
libvips
A fast image processing library with low memory needs
libvips is a demand-driven, horizontally threaded image processing library. Compared to similar libraries, libvips runs quickly and uses little memory. libvips is licensed under the LGPL 2.1+. It has around 300 operations covering arithmetic, histograms, convolution, morphological operations, frequency filtering, colour, resampling, statistics and others. It supports a large range of numeric types, from 8-bit int to 128-bit complex. Images can have any number of bands. It supports a good... -
25
My Python Eggs
Python Examples
...Many of the programs are designed to reduce manual workload by automating tasks such as renaming files, scanning directories, or checking system information. The repository also includes examples of more advanced concepts like multithreading, API interaction, and GUI development, providing a gradual learning curve for beginners.
