Search Results for "large files"
Sort By:
77 projects for "large files" with 2 filters applied:
-
$300 Free Credits for Your Google Cloud ProjectsLaunch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
1
ZipStream PHP
PHP ZIP Streaming Library
ZipStream-PHP is a library that allows you to dynamically create ZIP files on the fly without storing files on the server beforehand. It’s designed for streaming large ZIP archives directly to the browser or client, making it suitable for memory-efficient downloads. -
2
Zip.js
JavaScript library to zip and unzip files
Zip.js is a JavaScript library for creating, reading, and editing ZIP files directly in the browser or in Node.js environments, supporting various compression methods and encryption. -
3
dategrep
Print lines matching a time range
dategrep is a command-line utility designed to extract lines from log files that fall within a specified time range. It efficiently processes large log files by performing a binary search to locate the relevant entries, making it a valuable tool for system administrators and developers analyzing time-specific events. -
4
NYC Taxi Data
Import public NYC taxi and for-hire vehicle (Uber, Lyft)
The nyc-taxi-data repository is a rich dataset and exploratory project around New York City taxi trip records. It collects and preprocesses large-scale trip datasets (fares, pickup/dropoff, timestamps, locations, passenger counts) to enable data analysis, modeling, and visualization efforts. The project includes scripts and notebooks for cleaning and filtering the raw data, memory-efficient processing for large CSV/Parquet files, and aggregation workflows (e.g. trips per hour, heatmaps of pickups/dropoffs). ... -
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
5
xlswriter
PHP Extension for creating and reader XLSX files
PHPExcel has been unable to work properly for memory reasons at 40,000 and 100000 points, but it can be resolved by modifying the ini configuration, but the time may take longer to complete the work. xlswriter is a PHP C Extension that can be used to write text, numbers, formulas and hyperlinks to multiple worksheets in an Excel 2007+ XLSX file. -
6
Gaufrette
PHP library that provides a filesystem abstraction layer
Gaufrette is a PHP library designed to abstract filesystem operations, providing a consistent interface to interact with various storage backends. It allows developers to work with files stored locally, on cloud platforms, or via network protocols, without changing the code. Gaufrette supports plugins for caching, metadata management, and file transformation, making it a flexible choice for file management in web applications. -
7
Expat
Fast streaming XML parser written in C99 with >90% test coverage
Welcome to Expat, a stream-oriented XML parser library written in C. Expat excels with files too large to fit RAM, and where performance and flexibility are crucial. There are a number of applications, libraries, and hardware using Expat, as well as bindings and 3rd-party wrappers. Expat is packaged everywhere. This is Expat, a C99 library for parsing XML 1.0 Fourth Edition, started by James Clark in 1997. Expat is a stream-oriented XML parser. -
8
File Nesting Config for VS Code
Config of File Nesting for VS Code
This project provides a curated configuration snippet for the file-nesting feature of Visual Studio Code, authored by Anthony Fu (antfu). The goal is to help developers organize large code-bases by collapsing “secondary” or generated files (for example build artifacts, tests, config variants) under their primary files in the Explorer tree. It supports VS Code version 1.67 and above by enabling the built-in "explorer.fileNesting" setting. It is somewhat opinionated, offering a broad list of patterns (for example hiding .env.*, *.freezed.dart, etc) and it also includes an optional VS Code extension to automatically update the nesting config from the repo. ... -
9
PRDownloader
A file downloader library for Android with pause and resume support
A file downloader library for Android with pause and resume support. PRDownloader can be used to download any type of files like image, video, pdf, apk and etc. This file downloader library supports pause and resume while downloading a file. Supports large file download. This downloader library has a simple interface to make download request. We can check if the status of downloading with the given download Id. PRDownloader gives callbacks for everything like onProgress, onCancel, onStart, onError and etc while downloading a file. ... -
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
10
PcapPlusPlus
Multiplatform C++ library for parsing and crafting of network packets
A multi-platform C++ library for capturing, parsing, and crafting of network packets. It is designed to be efficient, powerful, and easy to use. PcapPlusPlus enables capturing and sending network packets through easy-to-use C++ wrappers for the most popular packet processing engines such as libpcap, WinPcap, NPcap, DPDK and PF_RING. PcapPlusPlus enables decoding and forging capabilities for a large variety of network protocols. PcapPlusPlus is designed to be efficient and lightweight. It... -
11
Polybar Themes
A huge collection of polybar themes
Polybar Themes is a large collection of Polybar themes for Linux desktops. It provides many styles, colors, and visual variants for users who want polished status bars without building every configuration from scratch. The project includes simple and bitmap theme families, along with fonts, wallpapers, scripts, and installation tooling. It is designed for customizable desktop environments and window managers, especially setups that use Polybar with tools like Rofi, pywal, and NetworkManager... -
12
Advanced Copy
A patch for GNU Core Utilities cp, mv to add progress bars
...It’s particularly helpful in scripting or large-scale file management tasks because it combines safety with speed, balancing automation with intentional checks. -
13
php-file-iterator
FilterIterator implementation that filters files
php-file-iterator is a small library that walks directory trees and yields files matching include/exclude rules, commonly used to discover test files. It supports filtering by suffixes or prefixes (for example, “Test.php”) to keep selection deterministic. Exclusion lists help you skip vendor directories, VCS folders, or generated artifacts that would otherwise slow down tools. The iterator interface means results are streamed rather than loaded at once, which keeps memory usage modest on large codebases. ... -
14
codemaxxed
CLI tool purpose-built to generate the maximum possible lines of code
codemaxxed is a deliberately experimental and satirical project that generates massive amounts of code automatically to explore and critique the idea of measuring productivity through lines of code. The repository continuously grows through automated workflows that generate new files and commits at regular intervals, resulting in extremely large codebases with minimal functional value. It is built using the companion tool “codemaxxing,” which allows users to control parameters such as the number of lines generated, the level of randomness, and the speed of generation. The project intentionally produces nonsensical or low-quality code, including exaggerated naming patterns and redundant structures, to highlight the absurdity of equating quantity with quality in software engineering. ... -
15
EasyExcel
Lightweight Java library developed by Alibaba for reading and writing
EasyExcel is a Java library focused on reading and writing Excel files with very low memory usage, making it suitable for large datasets that overwhelm traditional APIs. It uses streaming/event-driven parsing to avoid loading entire workbooks into memory, and it maps rows to Java objects via simple annotations. Writers support multiple sheets, custom styles, merged cells, and template-based filling so production reports remain maintainable. -
16
log4rs
A highly configurable logging framework for Rust
...If you are using the file rotation in your configuration there is a known substantial performance issue so listen up! By default the gzip feature is enabled and when rolling files it will zip log archives automatically. This is a problem when the log archives are large as the zip happens in the main thread and will halt the process while the zip is completed. Be advised that the gzip feature will be removed from default features as of 1.0. -
17
TensorStore
Library for reading and writing large multi-dimensional arrays
...Transactional semantics allow atomic updates and consistent snapshots, which is essential for large, shared datasets used by ML and scientific workflows. The library is engineered for scalability—background caching, chunk sharding, and retryable operations keep throughput high even over unreliable networks. With language bindings, it fits into Python-heavy analysis pipelines while retaining a fast C++ core. -
18
Ruff Visual Studio Code
A Visual Studio Code extension with support for the Ruff linter
Ruff Visual Studio Code is an official Visual Studio Code extension that integrates the Ruff Python linter and formatter directly into the development environment, enabling developers to maintain high code quality with minimal configuration. It provides real-time linting and formatting feedback as developers write code, helping catch errors, enforce style guidelines, and automatically fix issues where possible. The extension is built on top of Ruff’s high-performance Rust-based engine, which... -
19
minizip-ng
Fork of the zip manipulation library found in the zlib distribution
minizip-ng is a zip manipulation library written in C that is supported on Windows, macOS, and Linux. Minizip was originally developed by Gilles Vollant in 1998. It was first included in the zlib distribution as an additional code contribution starting in zlib 1.1.2. Since that time, it has been continually improved upon and contributed to by many people. The original project can still be found in the zlib distribution that is maintained by Mark Adler. The motivation behind this repository... -
20
Kaggle CLI
The official CLI to interact with Kaggle
Kaggle CLI is Kaggle’s official command-line interface for interacting with the Kaggle platform from a terminal. It lets users authenticate, search resources, download files, submit competition entries, manage datasets, work with models, run notebooks, and read discussion content without relying only on the web interface. The tool is useful for data scientists who want to automate Kaggle workflows inside scripts, CI jobs, notebooks, or reproducible local environments. It supports both traditional API-token authentication and an OAuth login flow, which makes it more flexible for different usage patterns. kaggle-cli is especially practical when working with large datasets or repeated competition submissions that would be slow to handle manually. ... -
21
Plog
Portable, simple and extensible C++ logging library
Portable, simple and extensible C++ logging library. Plog is a C++ logging library that is designed to be as simple, small and flexible as possible. It is created as an alternative to existing large libraries and provides some unique features as CSV log format and wide string support. -
22
OmniTools
Self-hosted collection of powerful web-based tools for everyday tasks
OmniTools is a self-hosted web application that bundles a large collection of everyday utilities into a single clean interface you can run on your own infrastructure. It’s designed to replace the random assortment of “free online tools” people use for quick tasks, while avoiding ads, tracking, and the need to upload sensitive files to unknown servers. A key design choice is that file processing happens entirely on the client side, meaning your data stays in your browser instead of being sent to the backend. ... -
23
mgrep
A calm, CLI-native way to semantically grep everything, like code
This project is a modern, semantic search tool that brings the simplicity of traditional command-line grep to the world of natural language and multimodal content, enabling users to search across codebases, documents, PDFs, and even images using meaning-aware queries. Built with a focus on calm CLI experiences, it lets you index and query your local files with semantic understanding, delivering results that are relevant to your intent rather than simple pattern matches, which is especially powerful in large or diverse projects. It also includes features such as background indexing to keep your search index up to date without interrupting your workflow and web search integration to expand the scope of queries beyond local files. -
24
Fabric
Fabric is an open-source framework for augmenting humans using AI
Fabric is a command-line framework that turns a curated library of prompt “patterns” into reusable, automatable workflows for large language models. Instead of repeatedly crafting ad-hoc prompts, you pick a pattern (for research, summarization, brainstorming, code review, and more) and feed it inputs or files. The tool standardizes execution with configuration files and environment variables, enabling reproducible runs across different models and providers. Patterns can be customized with variables, chained into pipelines, and applied to entire directories, which helps scale editorial or analytical tasks. ... -
25
GH Archive
GH Archive is a project to record the public GitHub timeline
...Researchers can download specific hours, days, or longer periods with ordinary HTTP tools and process the events in their own systems. The dataset is also published through Google BigQuery for large-scale SQL-style exploration without downloading every archive. Its structure supports trend analysis, visualizations, machine learning, and open-source ecosystem research. The repository contains the crawler, supporting scripts, and website code, while the actual event files are hosted separately.
