Search Results for "throughput" - Page 3
Sort By:
Showing 432 open source projects for "throughput"
View related business solutions-
Gemini 3 and 200+ AI Models on One PlatformBuild, govern, and optimize agents and models with Gemini Enterprise Agent Platform.
-
$300 in Free Credit Towards Top Cloud ServicesStart your project in minutes. After credits run out, 20+ products include free monthly usage. Only pay when you're ready to scale.
-
1
Vector
A high-performance observability data pipeline
Vector is a Rust‑based, high‑performance observability data pipeline tool (agent + aggregator) designed to collect, transform, and route logs and metrics at scale. Created by Datadog, it aims to be the only tool needed from ingestion to vendor output, providing cost-efficient, safe, and flexible telemetry processing. -
2
Monoio
Rust async runtime based on io-uring
...Because tasks do not need to be Send or Sync and can make use of thread-local data safely, Monoio simplifies certain concurrency paradigms while delivering performance benefits for workloads like high-throughput network servers, proxies, or real-time services. The runtime includes abstractions for async sockets, readers/writers, TCP/UDP networking, and compatibility layers (macros, crates) to ease adoption. -
3
Webman
Probably the fastest PHP web framework in the world
...It leverages PHP’s multi-process architecture to handle asynchronous HTTP requests efficiently, making it suitable for real-time applications, APIs, and microservices. Unlike traditional synchronous frameworks, Webman achieves low latency and high throughput by using asynchronous I/O, significantly improving performance in scenarios requiring concurrent connections. -
4
ProgressMeter.jl
Progress meter for long-running computations
ProgressMeter.jl is a lightweight Julia package that provides customizable progress bars for long-running loops and computations. It allows developers to track the progress of tasks with real-time visual feedback in the terminal, making it easier to monitor performance, debug slow operations, or report computational progress in user-facing applications. -
Secure File Transfer for Windows with Cerberus by RedwoodCerberus supports unlimited users and connections on a single IP, with built-in encryption, 2FA, and a browser-based web client — all deployable in under 15 minutes with a 25-day free trial.
-
5
PolarDB for PostgreSQL
A cloud-native database based on PostgreSQL developed by Alibaba Cloud
PolarDB for PostgreSQL is Alibaba Cloud's cloud-native, distributed version of PostgreSQL designed for high availability, scalability, and performance. It enhances standard PostgreSQL with features like shared storage, compute-storage separation, and parallel processing. PolarDB supports cloud-native workloads, offering enterprise-grade capabilities while maintaining PostgreSQL compatibility. -
6
OrioleDB
Building a modern cloud-native storage engine
...Designed as a table access method (TAM) extension, it introduces features like MVCC improvements, compression, and efficient concurrency handling. OrioleDB seeks to future-proof PostgreSQL by enabling cloud-native, high-throughput workloads without altering the core PostgreSQL behavior. -
7
Torrra
A Python tool that lets you search and download torrents
...Users can add, pause, prioritize, and remove torrents dynamically, while the client intelligently manages piece selection, peer discovery, and bandwidth allocation to optimize download throughput. Torrra also includes hooks for event monitoring and status reporting, enabling third-party tools to visualize torrent progress or integrate with home automation dashboards. -
8
kallisto
Near-optimal RNA-Seq quantification
kallisto is a program for near-optimal quantification of transcript abundances from RNA-Seq data, or more generally of target sequences using high-throughput sequencing reads. It is based on the idea of using pseudoalignment to quickly determine reads and targets’ compatibility, with no need for alignment. According to benchmarks done on a Mac desktop computer, kallisto can quantify 30 million human bulk RNA-seq reads in less than 3 minutes with just the read sequences and a transcriptome index, that in itself can take more than 10 minutes to build. ... -
9
Lemonade
Lemonade helps users run local LLMs with the highest performance
...The repository highlights easy onboarding with downloads, docs, and a Discord for support, suggesting an active user community. Messaging centers on squeezing maximum throughput/latency from modern accelerators without users having to hand-tune kernels or flags. Releases further reinforce the “server” framing, pointing developers toward a service that can be integrated into apps and tools. -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
10
Cortex
A horizontally scalable, multi-tenant, long term Prometheus
...Cortex gives you a global view of Prometheus time series data that includes data in long-term storage, greatly expanding the usefulness of PromQL for analytical purposes. Cortex runs across multiple machines in a cluster, exceeding the throughput and storage of a single machine. This enables you to send the metrics from multiple Prometheus servers to a single Cortex cluster. -
11
AIClient-2-API
Simulates Gemini CLI, Antigravity, Qwen Code, and Kiro client
...It enables developers to connect various AI tools and clients, such as Gemini CLI, Qwen Code, or other proprietary interfaces, into a unified backend without needing to rewrite integrations. The system is designed to support high-throughput usage, handling large volumes of requests while maintaining compatibility across different AI ecosystems. It also provides access to alternative models, including built-in support for certain Claude-based functionalities, expanding flexibility for developers working with multiple providers. By abstracting away client-specific differences, it simplifies AI application development and reduces integration overhead. -
12
Pingora
A library for building fast, reliable and evolvable network services
Pingora is a Rust-based high-performance HTTP proxy and networking framework developed by Cloudflare to eventually replace NGINX. Designed for extreme reliability and memory-safe concurrency, it handles over 40 million requests per second in production and reduces CPU/memory usage significantly compared to traditional web servers. -
13
Fuel Core
Rust full node implementation of the Fuel v2 protocol
Fuel-Core is the Rust-based implementation of a full FUEL blockchain node—supporting chain execution, mempool, consensus, GraphQL API, and state management. It powers the Fuel Layer 1 network and enables developers to run local or production nodes with high throughput and low latency. -
14
SPQR
Stateless Postgres Query Router
SPQR is a sharding proxy for PostgreSQL that enables horizontal scalability by distributing queries across multiple PostgreSQL instances. Designed for large-scale, multi-tenant architectures, SPQR routes, rewrites, and manages SQL queries to ensure they are executed efficiently across shards. It provides a PostgreSQL-compatible interface so applications can scale transparently without code changes. -
15
Text Generation Inference
Large Language Model Text Generation Inference
Text Generation Inference is a high-performance inference server for text generation models, optimized for Hugging Face's Transformers. It is designed to serve large language models efficiently with optimizations for performance and scalability. -
16
AWS SDK for Java 2.0
The official AWS SDK for Java - Version 2
...Each AWS service ships as its own small artifact, so applications include only what they use, cutting footprint and cold-start time. The SDK provides both synchronous clients and a high-performance asynchronous stack built on event-driven HTTP, enabling reactive pipelines and high-throughput services. Models are immutable and builders are pervasive, leading to safer code and clearer intent. Credential providers, region resolution, retries, and paginators are redesigned with extensibility in mind, and integrations are available for common observability and HTTP client choices. For teams starting new Java projects on AWS, v2 is the default choice due to its modularity, improved ergonomics, and better runtime characteristics. -
17
agentgateway
Next Generation Agentic Proxy for AI Agents and MCP servers
...The project supports interoperable protocols designed for this ecosystem, including Agent2Agent (A2A) and Model Context Protocol (MCP), which helps standardize how tools and agents interoperate. It is designed for performance and scale, implemented in Rust and engineered to handle large throughput and multi-tenant deployments. Operationally, it emphasizes safety and control with an RBAC system tuned for MCP/A2A use cases, plus the ability to update configuration dynamically via xDS without downtime. -
18
Tencent-Hunyuan-Large
Open-source large language model family from Tencent Hunyuan
Tencent-Hunyuan-Large is the flagship open-source large language model family from Tencent Hunyuan, offering both pre-trained and instruct (fine-tuned) variants. It is designed with long-context capabilities, quantization support, and high performance on benchmarks across general reasoning, mathematics, language understanding, and Chinese / multilingual tasks. It aims to provide competitive capability with efficient deployment and inference. FP8 quantization support to reduce memory usage... -
19
DFlash
Block Diffusion for Ultra-Fast Speculative Decoding
DFlash is an open-source framework for ultra-fast speculative decoding using a lightweight block diffusion model to draft text in parallel with a target large language model, dramatically improving inference speed without sacrificing generation quality. It acts as a “drafter” that proposes likely continuations which the main model then verifies, enabling significant throughput gains compared to traditional autoregressive decoding methods that generate token by token. This approach has been shown to deliver lossless acceleration on models like Qwen3-8B by combining block diffusion techniques with efficient batching, making it ideal for applications where latency and cost matter. The project includes support for multiple draft models, example integration code, and scripts to benchmark performance, and it is structured to work with popular model serving stacks like SGLang and the Hugging Face Transformers ecosystem. -
20
ToaruOS
Hobby operating system, bootloader, kernel, drivers, C library
ToaruOS is a "complete" operating system for x86-64 PCs and experimental support for ARMv8. While many independent, hobby, and research OSes aim to experiment with new designs, ToaruOS is intended as an educational resource, providing a representative microcosm of functionality found in major desktop operating systems. The OS includes a kernel, bootloader, dynamic shared object linker, C standard library, its own composited windowing system, a dynamic bytecode-compiled programming language,... -
21
Decred
Decred daemon in Go (golang)
dcrd is the full-node implementation of Decred, a hybrid proof-of-work/proof-of-stake cryptocurrency focused on decentralized governance, long-term sustainability, and robust network security. Written in Go, dcrd provides all the core consensus, networking, and validation logic necessary for Decred nodes to participate in the network. It plays a critical role in enforcing consensus rules, managing peer connections, and enabling advanced features like on-chain voting and self-funding via a... -
22
MagicAPI AI Gateway
Built for demanding AI workflows
The world's fastest AI Gateway proxy, written in Rust and optimized for maximum performance. This high-performance API gateway routes requests to various AI providers (OpenAI, GROQ) with streaming support, making it perfect for developers who need reliable and blazing-fast AI API access. -
23
HyperExpress
High performance Node.js webserver with a simple-to-use API
HyperExpress aims to be a simple yet performant HTTP & Websocket Server. Combined with the power of uWebsockets.js, a Node.js binding of uSockets written in C++, HyperExpress allows developers to unlock higher throughput for their web applications with their existing hardware. This can allow many web applications to become much more performant on optimized data serving endpoints without having to scale hardware. High-performance Node.js webserver with a simple-to-use API powered by uWebsockets.js under the hood. -
24
fluentbit
Fast and Lightweight Logs and Metrics processor for Linux, BSD, OSX
Fluent Bit is a super-fast, lightweight, and highly scalable logging and metrics processor and forwarder. It is the preferred choice for cloud and containerized environments. A robust, lightweight, and portable architecture for high throughput with low CPU and memory usage from any data source to any destination. Proven across distributed cloud and container environments. Highly available with I/O handlers to store data for disaster recovery. Granular management of data parsing and routing. Filtering and enrichment to optimize security and minimize cost. The lightweight, asynchronous design optimizes resource usage: CPU, memory, disk I/O, network. ... -
25
Async MySQL Connector .NET and .NET Core
Async MySQL Connector for .NET and .NET Core
...This library implements true asynchronous I/O for database operations, without blocking (or using Task.Run to run synchronous methods on a background thread). This greatly improves the throughput of a web server that performs database operations. This library outperforms MySQL Connector/NET (MySql.Data) on benchmarks. This library is MIT-licensed and may be freely distributed with commercial software. Commercial software that uses Connector/NET may have to purchase a commercial license from Oracle. Fixes dozens of open bugs in Oracle’s Connector/NET; passes all ADO.NET Specification Tests. ...
