Search Results for "zero copy"
Sort By:
Showing 100 open source projects for "zero copy"
View related business solutions-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
1
netsniff-ng
A Swiss army knife for your daily Linux network plumbing
netsniff-ng is a free Linux networking toolkit, a Swiss army knife for your daily Linux network plumbing if you will. Its gain of performance is reached by zero-copy mechanisms, so that on packet reception and transmission the kernel does not need to copy packets from kernel space to user space and vice versa. Our toolkit can be used for network development and analysis, debugging, auditing, or network reconnaissance. -
2
zpdf
Zero-copy PDF text extraction library written in Zig
zpdf is a high-performance PDF text extraction library written in Zig that focuses on speed, low overhead, and modern parsing techniques. It leans heavily on memory-mapped file reading and zero-copy patterns where possible, so it can scan large PDFs without repeatedly copying data around in memory. The library supports streaming extraction using efficient arena allocation, making it well suited for workloads that need to process big documents quickly or in batches. It implements multiple PDF decompression filters and handles common font encoding pathways, which are essential for turning raw PDF content streams into readable text. ... -
3
iperf3
iperf3: A TCP, UDP, and SCTP network bandwidth measurement tool
...The tool reports throughput, bitrate, packet loss, and other measurement details for each test. iperf3 was redesigned from the original iperf with a smaller codebase, a cleaner architecture, and library functionality that can be used by other programs. It includes features such as zero-copy mode, optional JSON output, protocol tuning, buffer tuning, and timing controls. Overall, it is a trusted utility for network engineers, research networks, developers, and administrators who need reliable active bandwidth testing. -
4
Lance
Modern columnar data format for ML and LLMs implemented in Rust
Lance is a columnar data format that is easy and fast to version, query and train on. It’s designed to be used with images, videos, 3D point clouds, audio and of course tabular data. It supports any POSIX file systems, and cloud storage like AWS S3 and Google Cloud Storage. -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
5
react-native-fast-tflite
High-performance TensorFlow Lite library for React Native
react-native-fast-tflite is a high-performance TensorFlow Lite library for React Native applications. It is built with Nitro Modules and uses the low-level C and C++ TensorFlow Lite core API for direct memory access. The library supports zero-copy ArrayBuffers, which helps reduce overhead when passing model inputs and outputs through React Native. It can load and swap TensorFlow Lite models at runtime, making it useful for apps that run multiple machine learning tasks. The project supports GPU-accelerated delegates such as CoreML, Metal, and OpenGL. It is especially useful for mobile computer vision, on-device inference, and VisionCamera-based workflows that need fast local model execution. -
6
quick-xml
Rust high performance xml reader and writer
High-performance xml pull reader/writer. The reader is almost zero-copy (use of Cow whenever possible) It is easy on memory allocation (the API provides a way to reuse buffers) It supports various encoding (with encoding feature), namespaces resolution, and special characters. Syntax is inspired by xml-rs. When using the serialize feature, quick-xml can be used with serde's Serialize/Deserialize traits. -
7
Neon Database
Neon: Serverless Postgres. We separated storage and compute
The database you love, on a serverless platform designed to help you build reliable and scalable applications faster. Focus on building applications with time and money-saving features like instant provisioning, autoscaling according to load, and scale to zero. Instantly branch your data and schema to access isolated DB copies for development, CI/CD, and schema migrations with copy-on-write storage. Integrate it into your language or framework within minutes and unlock a simpler developer workflow. -
8
Cactus
Low-latency AI inference engine optimized for mobile devices
...It provides a full-stack architecture composed of an inference engine, a computation graph system, and highly optimized hardware kernels tailored for ARM-based processors. Cactus emphasizes efficient memory usage through techniques such as zero-copy computation graphs and quantized model formats, allowing large models to run within the constraints of mobile hardware. It supports a wide range of AI tasks including text generation, speech-to-text, vision processing, and retrieval-augmented workflows through a unified API interface. A notable feature of Cactus is its hybrid execution model, which can dynamically route tasks between on-device processing and cloud services when additional compute is required. -
9
Angstrom
Parser combinators built for speed and memory efficiency
Angstrom is a parser-combinator library in OCaml designed for high-performance applications. It provides monadic and applicative interfaces for composing parsers and supports incremental input processing. -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
Logos
Create ridiculously fast Lexers
Logos is a lexer generator for Rust, designed to create fast and efficient lexers with minimal code. It leverages Rust's procedural macros to define token patterns, streamlining the process of lexical analysis. -
11
Chumsky
Write expressive, high-performance parsers with ease.
Chumsky is a parser library for Rust that focuses on expressiveness and performance. It provides developers with tools to write high-performance parsers using combinators, suitable for a wide range of parsing tasks. -
12
Daft
Distributed DataFrame for Python designed for the cloud
Daft is a framework for ETL, analytics and ML/AI at scale. Its familiar Python Dataframe API is built to outperform Spark in performance and ease of use. Daft plugs directly into your ML/AI stack through efficient zero-copy integrations with essential Python libraries such as Pytorch and Ray. It also allows requesting GPUs as a resource for running models. Daft runs locally with a lightweight multithreaded backend. When your local machine is no longer sufficient, it scales seamlessly to run out-of-core on a distributed cluster. Underneath its Python API, Daft is built in blazing fast Rust code. ... -
13
Litecoin Core integration
Litecoin source tree
Litecoin is a peer-to-peer Internet currency that enables instant, near-zero cost payments to anyone in the world. Litecoin is an open-source, global payment network that is fully decentralized without any central authorities. Mathematics secures the network and empowers individuals to control their own finances. Litecoin features faster transaction confirmation times and improved storage efficiency than the leading math-based currency. -
14
Fury
A blazing fast multi-language serialization framework
Fury is a blazing-fast multi-language serialization framework powered by jit(just-in-time compilation) and zero-copy, providing up to 170x performance and ultimate ease of use. Based on efficient JIT, struct deserialization can get 170x speed up compared to other serialization frameworks. In serialization scenarios, Fury can achieve a 100x speed up compared to traditional serialization frameworks. If you use Java clusters on a large scale, this will save a lot of computing resources. -
15
Datasets
Hub of ready-to-use datasets for ML models
...Load a dataset in a single line of code, and use our powerful data processing methods to quickly get your dataset ready for training in a deep learning model. Backed by the Apache Arrow format, process large datasets with zero-copy reads without any memory constraints for optimal speed and efficiency. We also feature a deep integration with the Hugging Face Hub, allowing you to easily load and share a dataset with the wider NLP community. There are currently over 2658 datasets, and more than 34 metrics available. Datasets naturally frees the user from RAM memory limitation, all datasets are memory-mapped using an efficient zero-serialization cost backend (Apache Arrow). ... -
16
Realm Swift
Realm is a mobile database: a replacement for Core Data & SQLite
Realm is a fast, scalable alternative to SQLite with mobile to cloud data sync that makes building real-time, reactive mobile apps easy. Build data-rich apps without draining device resources with Realm's lazy loading and zero-copy architecture. The object-oriented data model lets developers work directly with native objects – no ORMs or DAOs are needed. Real-time mobile to cloud data sync makes it easy to build interactive features that keep data up-to-date across multiple devices, users, and the backend. Accelerate time-to-market with easy to learn, language-native APIs that simplify data access. ... -
17
ArduinoJson
JSON library for Arduino and embedded C++. Simple and efficient
ArduinoJson is a C++ JSON library for Arduino and IoT (Internet Of Things). ArduinoJson has a simple and intuitive syntax to handle objects and arrays. ArduinoJson supports both JSON serialization and deserialization. ArduinoJson uses a fixed memory allocation, allowing to work on devices with very little RAM. ArduinoJson can filter large inputs to keep only fields that are relevant to your application, thereby saving a lot of memory. ArduinoJson can parse directly from an input Stream or... -
18
ncnn
High-performance neural network inference framework for mobile
ncnn is a high-performance neural network inference computing framework designed specifically for mobile platforms. It brings artificial intelligence right at your fingertips with no third-party dependencies, and speeds faster than all other known open source frameworks for mobile phone cpu. ncnn allows developers to easily deploy deep learning algorithm models to the mobile platform and create intelligent APPs. It is cross-platform and supports most commonly used CNN networks, including... -
19
Vortex
The LLVM of columnar file formats
Vortex is a high-performance toolkit designed for working with compressed Apache Arrow arrays, providing functionality for in-memory, on-disk, and over-the-wire data handling. It aims to be an advanced successor to Apache Parquet, offering dramatically faster random access reads and scans, while maintaining similar compression ratios. Vortex's modular design allows for extensibility, enabling developers to implement custom encodings for efficient data management, particularly for large-scale... -
20
libevent
Event notification library
The libevent API provides a mechanism to execute a callback function when a specific event occurs on a file descriptor or after a timeout has been reached. Furthermore, libevent also support callbacks due to signals or regular timeouts. libevent is meant to replace the event loop found in event driven network servers. An application just needs to call event_dispatch() and then add or remove events dynamically without having to change the event loop. The internal event mechanism is completely... -
21
Trellis
WordPress LEMP stack with PHP 8.1, Composer, WP-CLI
Trellis uses Vagrant to automatically create a self-contained virtual machine. Stop cluttering up your host machine with software like MAMP and use the same software you would in production. You’ll get a complete WordPress server running all the software you need to be configured according to the best practices. All of this is powered by Ansible for configuration management. You don’t have to use brittle and confusing Bash scripts or worry about commands you found to copy and paste. Trellis... -
22
LiteRT
LiteRT, successor to TensorFlow Lite
LiteRT is Google's next-generation on-device machine learning framework and the successor to TensorFlow Lite, designed for high-performance AI and generative AI deployment across edge devices. It provides efficient model conversion, optimization, and runtime execution while leveraging hardware acceleration from CPUs, GPUs, and NPUs. LiteRT supports a wide range of platforms, including Android, iOS, Linux, macOS, Windows, web environments, and IoT devices. The framework simplifies on-device... -
23
Minima
Minima is a one-size-fits-all Jekyll theme for writers
...It's what you get when you run jekyll new. Minima has been scaffolded by the jekyll new-theme command and therefore has all the necessary files and directories to have a new Jekyll site up and running with zero-configuration. From Minima v3 onwards, the base layout is named base.html instead of default.html to avoid confusing new users into assuming that name holds a special status. Users migrating from older versions with customized _layouts/default.html are advised to rename their copy to _layouts/base.html. Migrating users with additional customized layouts may either update front matter references to the former default.html layout or create a new default.html layout referencing the current base.html, whichever route is the easiest. -
24
realm dotnet
Realm is a mobile database: a replacement for SQLite & ORMs
Realm is a fast, scalable alternative to SQLite with mobile to cloud data sync that makes building real-time, reactive mobile apps easy. Build data-rich apps without draining device resources with Realm's lazy loading and zero-copy architecture. The object-oriented data model lets developers work directly with native objects – no ORMs or DAOs are needed. Real-time mobile to cloud data sync makes it easy to build interactive features that keep data up-to-date across multiple devices, users, and the backend. Accelerate time-to-market with easy to learn, language-native APIs that simplify data access. ... -
25
UnQLite
An Embedded NoSQL, Transactional Database Engine
UnQLite is an in-process software library that implements a self-contained, serverless, zero-configuration, transactional NoSQL database engine. UnQLite is a document store database similar to MongoDB, Redis, CouchDB, etc. as well as a standard Key/Value store similar to BerkeleyDB, LevelDB, etc. UnQLite is an embedded NoSQL (Key/Value store and Document-store) database engine. Unlike most other NoSQL databases, UnQLite does not have a separate server process.
