Search Results for "throughput"
Sort By:
Showing 77 open source projects for "throughput"
View related business solutions-
Full-stack observability with actually useful AI | Grafana CloudBuilt on open standards like Prometheus and OpenTelemetry, Grafana Cloud includes Kubernetes Monitoring, Application Observability, Incident Response, plus the AI-powered Grafana Assistant. Get started with our generous free tier today.
-
Stop Cyber Threats with VM-Series Next-Gen Firewall on AzureGain integrated visibility across all traffic in a single pass. Deploy Palo Alto Networks VM-Series to determine application identity and content while automating security policy updates via rich APIs.
-
1
HikariCP
A solid, high-performance, JDBC connection pool at last
HikariCP is a high-performance JDBC connection pooling library designed to offer minimal overhead and maximum throughput. It aims for simplicity and stability, concentrating on fast connection acquisition and minimal latency under load. Its internals manage a pool of connections aggressively but smartly, with options such as leak detection, timeout thresholds, and adaptive connection retirement. Because it avoids heavy internal locking, it scales well in high-concurrency environments, making it a popular choice in microservices and high-throughput web backends. ... -
2
Napkin Math
Techniques and numbers for estimating system's performance
...It collects practical numbers, benchmark-style measurements, and mental models that help engineers make fast back-of-the-envelope calculations. The project is useful for questions like how much memory throughput matters, how long storage operations may take, what network latency to expect, or how expensive logging could become at high request volume. It treats these values as rounded numbers for reasoning rather than exact performance guarantees. The repository is especially useful for system design interviews, architecture planning, capacity estimation, and infrastructure cost discussions. ... -
3
Gatling
Modern Load Testing as Code
...Gatling supports HTTP out of the box as well as WebSocket, Server-Sent Events, and JMS, so you can exercise modern, real-time systems end to end. Rich HTML reports visualize percentiles, response time distributions, errors, and throughput, making bottlenecks and regressions easy to spot. With injection profiles (ramp, constant, spikes) and pass/fail gates, you can automate performance thresholds in CI and promote builds with confidence. -
4
Broadway
Concurrent and multi-stage data ingestion and data processing
Broadway is a data processing library for Elixir designed to handle high-throughput, concurrent workloads with ease. It provides an abstraction for defining pipelines that consume data from sources like RabbitMQ, Kafka, Amazon SQS, or custom producers. Each pipeline is fault-tolerant and backpressure-aware, ensuring stable throughput even under load. The library integrates seamlessly with GenStage and OTP supervision trees, making it highly resilient in production. -
Gemini 3 and 200+ AI Models on One PlatformBuild, govern, and optimize agents and models with Gemini Enterprise Agent Platform.
-
5
DeepEP
DeepEP: an efficient expert-parallel communication library
DeepEP is a communication library designed specifically to support Mixture-of-Experts (MoE) and expert parallelism (EP) deployments. Its core role is to implement high-throughput, low-latency all-to-all GPU communication kernels, which handle the dispatching of tokens to different experts (or shards) and then combining expert outputs back into the main data flow. Because MoE architectures require routing inputs to different experts, communication overhead can become a bottleneck — DeepEP addresses that by providing optimized GPU kernels and efficient dispatch/combining logic. ... -
6
CoreNet
CoreNet: A library for training deep neural networks
...CoreNet provides abstractions for data, tensor, and pipeline parallelism, allowing models to scale without code duplication or heavy manual configuration. Its distributed runtime manages synchronization, load balancing, and mixed-precision computation to maximize throughput while minimizing communication bottlenecks. CoreNet integrates tightly with Apple’s proprietary ML stack and hardware, serving as the foundation for research in computer vision, language models, and multimodal systems within Apple AI. The framework includes monitoring tools, fault tolerance mechanisms, and efficient checkpointing for massive training runs. -
7
FlashMLA
FlashMLA: Efficient Multi-head Latent Attention Kernels
FlashMLA is a high-performance decoding kernel library designed especially for Multi-Head Latent Attention (MLA) workloads, targeting NVIDIA Hopper GPU architectures. It provides optimized kernels for MLA decoding, including support for variable-length sequences, helping reduce latency and increase throughput in model inference systems using that attention style. The library supports both BF16 and FP16 data types, and includes a paged KV cache implementation with a block size of 64 to efficiently manage memory during decoding. On very compute-bound settings, it can reach up to ~660 TFLOPS on H800 SXM5 hardware, while in memory-bound configurations it can push memory throughput to ~3000 GB/s. ... -
8
Zeebe
Distributed Workflow Engine for Microservices Orchestration
Automate processes at scale with unprecedented performance and resilience. Zeebe is the workflow and decision engine that powers Camunda Platform 8. Zeebe’s cloud-native design provides the performance, resilience, and security enterprises need to future-proof their process orchestration efforts. Zeebe distributes data across all brokers in a cluster with storage directly on the server filesystem. If one broker goes down, another can replace it with no data loss. This pre-configured... -
9
Node RDKafka
Node.js bindings for librdkafka
A high-performance Node.js client for Apache Kafka, built on top of librdkafka, providing bindings for efficient Kafka message processing. -
Secure File Transfer for Windows with Cerberus by RedwoodCerberus supports unlimited users and connections on a single IP, with built-in encryption, 2FA, and a browser-based web client — all deployable in under 15 minutes with a 25-day free trial.
-
10
Webman
Probably the fastest PHP web framework in the world
...It leverages PHP’s multi-process architecture to handle asynchronous HTTP requests efficiently, making it suitable for real-time applications, APIs, and microservices. Unlike traditional synchronous frameworks, Webman achieves low latency and high throughput by using asynchronous I/O, significantly improving performance in scenarios requiring concurrent connections. -
11
async-std
Async version of the Rust standard library
async-std makes async programming foundations easy and approachable. Built-in Rust for speed and safety. -
12
ProgressMeter.jl
Progress meter for long-running computations
ProgressMeter.jl is a lightweight Julia package that provides customizable progress bars for long-running loops and computations. It allows developers to track the progress of tasks with real-time visual feedback in the terminal, making it easier to monitor performance, debug slow operations, or report computational progress in user-facing applications. -
13
AIClient-2-API
Simulates Gemini CLI, Antigravity, Qwen Code, and Kiro client
...It enables developers to connect various AI tools and clients, such as Gemini CLI, Qwen Code, or other proprietary interfaces, into a unified backend without needing to rewrite integrations. The system is designed to support high-throughput usage, handling large volumes of requests while maintaining compatibility across different AI ecosystems. It also provides access to alternative models, including built-in support for certain Claude-based functionalities, expanding flexibility for developers working with multiple providers. By abstracting away client-specific differences, it simplifies AI application development and reduces integration overhead. -
14
MagicAPI AI Gateway
Built for demanding AI workflows
The world's fastest AI Gateway proxy, written in Rust and optimized for maximum performance. This high-performance API gateway routes requests to various AI providers (OpenAI, GROQ) with streaming support, making it perfect for developers who need reliable and blazing-fast AI API access. -
15
Async MySQL Connector .NET and .NET Core
Async MySQL Connector for .NET and .NET Core
...This library implements true asynchronous I/O for database operations, without blocking (or using Task.Run to run synchronous methods on a background thread). This greatly improves the throughput of a web server that performs database operations. This library outperforms MySQL Connector/NET (MySql.Data) on benchmarks. This library is MIT-licensed and may be freely distributed with commercial software. Commercial software that uses Connector/NET may have to purchase a commercial license from Oracle. Fixes dozens of open bugs in Oracle’s Connector/NET; passes all ADO.NET Specification Tests. ... -
16
frugally-deep
A lightweight header-only library for using Keras (TensorFlow) models
...Utterly ignores even the most powerful GPU in your system and uses only one CPU core per prediction. Quite fast on one CPU core, and you can run multiple predictions in parallel, thus utilizing as many CPUs as you like to improve the overall prediction throughput of your application/pipeline. -
17
workerpool
Offload tasks to a pool of workers on node.js and in the browser
...It supports task queuing, dynamic worker scaling, timeouts, transferable objects, and proxy-based APIs for interacting with worker functions as if they were local calls. workerpool is designed to improve application responsiveness and throughput in workloads involving heavy computation, data processing, or asynchronous execution. The library works across multiple environments, supporting Web Workers in browsers and Worker Threads or child processes in Node.js. Its architecture emphasizes ease of integration, scalability, and efficient concurrency management for modern JavaScript applications. -
18
bitnet.cpp
Official inference framework for 1-bit LLMs
...BitNet is built to scale across architectures, with configurable kernels and tiling strategies that adapt to different hardware, and it supports large models with impressive throughput even on modest resources. -
19
SyncKit
Local-first collaboration SDK for React, Vue, and Svelte
...Synckit’s synchronization engine efficiently handles differential syncing — transferring only changed blocks rather than entire files — which reduces bandwidth usage and accelerates sync throughput. -
20
Wireit
Wireit upgrades your npm/pnpm/yarn scripts to make them smarter
...It persists caches between runs and across CI so identical steps don’t redo expensive tasks like bundling or type-checking. The system also serializes or parallelizes scripts based on dependencies to avoid race conditions while maximizing throughput. Because it integrates at the script layer, it works with any underlying tool—TypeScript, Rollup, Jest, or bespoke commands—while remaining transparent to developers. -
21
Scalatra
Tiny Scala high-performance, async web framework
Scalatra is a lightweight, high-performance micro web framework written in Scala, inspired by the Ruby framework Sinatra. Its goal is to provide a minimal but expressive foundation for building web applications or REST APIs in Scala without the verbosity or steep learning curve of larger frameworks. It supports asynchronous request handling, routing, filters, content negotiation, and easy integration with templating, JSON libraries, and other web middleware. Being unopinionated, it lets... -
22
Laravel Horizon
Dashboard and code-driven configuration for Laravel queues
Horizon provides a beautiful dashboard and code-driven configuration for your Laravel-powered Redis queues. Horizon allows you to easily monitor key metrics of your queue system such as job throughput, runtime, and job failures. All of your worker configuration is stored in a single, simple configuration file, allowing your configuration to stay in source control where your entire team can collaborate. When using Horizon, all of your queue worker configuration is stored in a single, simple configuration file. By defining your application's worker configuration in a version-controlled file, you may easily scale or modify your application's queue workers when deploying your application. -
23
Simple Binary Encoding (SBE)
Simple Binary Encoding (SBE) - High Performance Message Codec
...For the latest version information and changes see the Change Log with downloads at Maven Central. The Java and C++ SBE implementations work very efficiently with the Aeron messaging system for low-latency and high-throughput communications. The Java SBE implementation has a dependency on Agrona for its buffer implementations. -
24
dperf
DPDK based 100Gbps network performance and load testing software
dperf is a DPDK based 100Gbps network performance and load testing software. Based on DPDK, dperf can generate huge traffic with a single x86 server: tens of millions of HTTP CPS，hundreds of Gbps throughput and billions of concurrent connections. Provides detailed statistics and identify every packet loss. Support multiple scenarios. Load testing and stability testing for Layer 4 Load Balancer and other Layer 4 gateways. Network performance testing for servers on cloud. Performance test of network package processing capability for NIC and CPU. ... -
25
Ristretto
A high performance memory-bound Go cache
Ristretto is a fast, concurrent cache library built with a focus on performance and correctness. It all started with needing a memory-bound, concurrent Go cache in Dgraph. We looked around for a solution, but we couldn’t find a great one. We then tried using a sharded map, with shard eviction to release memory, which caused us memory issues. We then repurposed Groupcache’s LRU, using mutex locks for thread safety. After having it around for a year, we noticed that the cache suffered from...
