Search Results for "throughput"
Sort By:
Showing 83 open source projects for "throughput"
View related business solutions-
Fully Managed MySQL, PostgreSQL, and SQL ServerCloud SQL handles your database ops end to end, so you can focus on your app.
-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
1
HikariCP
A solid, high-performance, JDBC connection pool at last
HikariCP is a high-performance JDBC connection pooling library designed to offer minimal overhead and maximum throughput. It aims for simplicity and stability, concentrating on fast connection acquisition and minimal latency under load. Its internals manage a pool of connections aggressively but smartly, with options such as leak detection, timeout thresholds, and adaptive connection retirement. Because it avoids heavy internal locking, it scales well in high-concurrency environments, making it a popular choice in microservices and high-throughput web backends. ... -
2
Napkin Math
Techniques and numbers for estimating system's performance
...It collects practical numbers, benchmark-style measurements, and mental models that help engineers make fast back-of-the-envelope calculations. The project is useful for questions like how much memory throughput matters, how long storage operations may take, what network latency to expect, or how expensive logging could become at high request volume. It treats these values as rounded numbers for reasoning rather than exact performance guarantees. The repository is especially useful for system design interviews, architecture planning, capacity estimation, and infrastructure cost discussions. ... -
3
TensorRT
C++ library for high performance inference on NVIDIA GPUs
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference. It includes a deep learning inference optimizer and runtime that delivers low latency and high throughput for deep learning inference applications. TensorRT-based applications perform up to 40X faster than CPU-only platforms during inference. With TensorRT, you can optimize neural network models trained in all major frameworks, calibrate for lower precision with high accuracy, and deploy to hyperscale data centers, embedded, or automotive product platforms. ... -
4
Gatling
Modern Load Testing as Code
...Gatling supports HTTP out of the box as well as WebSocket, Server-Sent Events, and JMS, so you can exercise modern, real-time systems end to end. Rich HTML reports visualize percentiles, response time distributions, errors, and throughput, making bottlenecks and regressions easy to spot. With injection profiles (ramp, constant, spikes) and pass/fail gates, you can automate performance thresholds in CI and promote builds with confidence. -
Build Securely on AWS with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
5
Broadway
Concurrent and multi-stage data ingestion and data processing
Broadway is a data processing library for Elixir designed to handle high-throughput, concurrent workloads with ease. It provides an abstraction for defining pipelines that consume data from sources like RabbitMQ, Kafka, Amazon SQS, or custom producers. Each pipeline is fault-tolerant and backpressure-aware, ensuring stable throughput even under load. The library integrates seamlessly with GenStage and OTP supervision trees, making it highly resilient in production. -
6
CoreNet
CoreNet: A library for training deep neural networks
...CoreNet provides abstractions for data, tensor, and pipeline parallelism, allowing models to scale without code duplication or heavy manual configuration. Its distributed runtime manages synchronization, load balancing, and mixed-precision computation to maximize throughput while minimizing communication bottlenecks. CoreNet integrates tightly with Apple’s proprietary ML stack and hardware, serving as the foundation for research in computer vision, language models, and multimodal systems within Apple AI. The framework includes monitoring tools, fault tolerance mechanisms, and efficient checkpointing for massive training runs. -
7
DeepEP
DeepEP: an efficient expert-parallel communication library
DeepEP is a communication library designed specifically to support Mixture-of-Experts (MoE) and expert parallelism (EP) deployments. Its core role is to implement high-throughput, low-latency all-to-all GPU communication kernels, which handle the dispatching of tokens to different experts (or shards) and then combining expert outputs back into the main data flow. Because MoE architectures require routing inputs to different experts, communication overhead can become a bottleneck — DeepEP addresses that by providing optimized GPU kernels and efficient dispatch/combining logic. ... -
8
FlashMLA
FlashMLA: Efficient Multi-head Latent Attention Kernels
FlashMLA is a high-performance decoding kernel library designed especially for Multi-Head Latent Attention (MLA) workloads, targeting NVIDIA Hopper GPU architectures. It provides optimized kernels for MLA decoding, including support for variable-length sequences, helping reduce latency and increase throughput in model inference systems using that attention style. The library supports both BF16 and FP16 data types, and includes a paged KV cache implementation with a block size of 64 to efficiently manage memory during decoding. On very compute-bound settings, it can reach up to ~660 TFLOPS on H800 SXM5 hardware, while in memory-bound configurations it can push memory throughput to ~3000 GB/s. ... -
9
Zeebe
Distributed Workflow Engine for Microservices Orchestration
Automate processes at scale with unprecedented performance and resilience. Zeebe is the workflow and decision engine that powers Camunda Platform 8. Zeebe’s cloud-native design provides the performance, resilience, and security enterprises need to future-proof their process orchestration efforts. Zeebe distributes data across all brokers in a cluster with storage directly on the server filesystem. If one broker goes down, another can replace it with no data loss. This pre-configured... -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
RabbitMQ Server
Core server and tier 1 (built-in) plugins
...Supports multiple messaging protocols, message queuing, delivery acknowledgement, flexible routing to queues, multiple exchange type. Deploy as clusters for high availability and throughput; federate across multiple availability zones and regions. HTTP-API, command line tool, and UI for managing and monitoring RabbitMQ. -
11
Node RDKafka
Node.js bindings for librdkafka
A high-performance Node.js client for Apache Kafka, built on top of librdkafka, providing bindings for efficient Kafka message processing. -
12
async-std
Async version of the Rust standard library
async-std makes async programming foundations easy and approachable. Built-in Rust for speed and safety. -
13
Webman
Probably the fastest PHP web framework in the world
...It leverages PHP’s multi-process architecture to handle asynchronous HTTP requests efficiently, making it suitable for real-time applications, APIs, and microservices. Unlike traditional synchronous frameworks, Webman achieves low latency and high throughput by using asynchronous I/O, significantly improving performance in scenarios requiring concurrent connections. -
14
ProgressMeter.jl
Progress meter for long-running computations
ProgressMeter.jl is a lightweight Julia package that provides customizable progress bars for long-running loops and computations. It allows developers to track the progress of tasks with real-time visual feedback in the terminal, making it easier to monitor performance, debug slow operations, or report computational progress in user-facing applications. -
15
AIClient-2-API
Simulates Gemini CLI, Antigravity, Qwen Code, and Kiro client
...It enables developers to connect various AI tools and clients, such as Gemini CLI, Qwen Code, or other proprietary interfaces, into a unified backend without needing to rewrite integrations. The system is designed to support high-throughput usage, handling large volumes of requests while maintaining compatibility across different AI ecosystems. It also provides access to alternative models, including built-in support for certain Claude-based functionalities, expanding flexibility for developers working with multiple providers. By abstracting away client-specific differences, it simplifies AI application development and reduces integration overhead. -
16
ToaruOS
Hobby operating system, bootloader, kernel, drivers, C library
ToaruOS is a "complete" operating system for x86-64 PCs and experimental support for ARMv8. While many independent, hobby, and research OSes aim to experiment with new designs, ToaruOS is intended as an educational resource, providing a representative microcosm of functionality found in major desktop operating systems. The OS includes a kernel, bootloader, dynamic shared object linker, C standard library, its own composited windowing system, a dynamic bytecode-compiled programming language,... -
17
MagicAPI AI Gateway
Built for demanding AI workflows
The world's fastest AI Gateway proxy, written in Rust and optimized for maximum performance. This high-performance API gateway routes requests to various AI providers (OpenAI, GROQ) with streaming support, making it perfect for developers who need reliable and blazing-fast AI API access. -
18
Async MySQL Connector .NET and .NET Core
Async MySQL Connector for .NET and .NET Core
...This library implements true asynchronous I/O for database operations, without blocking (or using Task.Run to run synchronous methods on a background thread). This greatly improves the throughput of a web server that performs database operations. This library outperforms MySQL Connector/NET (MySql.Data) on benchmarks. This library is MIT-licensed and may be freely distributed with commercial software. Commercial software that uses Connector/NET may have to purchase a commercial license from Oracle. Fixes dozens of open bugs in Oracle’s Connector/NET; passes all ADO.NET Specification Tests. ... -
19
frugally-deep
A lightweight header-only library for using Keras (TensorFlow) models
...Utterly ignores even the most powerful GPU in your system and uses only one CPU core per prediction. Quite fast on one CPU core, and you can run multiple predictions in parallel, thus utilizing as many CPUs as you like to improve the overall prediction throughput of your application/pipeline. -
20
workerpool
Offload tasks to a pool of workers on node.js and in the browser
...It supports task queuing, dynamic worker scaling, timeouts, transferable objects, and proxy-based APIs for interacting with worker functions as if they were local calls. workerpool is designed to improve application responsiveness and throughput in workloads involving heavy computation, data processing, or asynchronous execution. The library works across multiple environments, supporting Web Workers in browsers and Worker Threads or child processes in Node.js. Its architecture emphasizes ease of integration, scalability, and efficient concurrency management for modern JavaScript applications. -
21
bitnet.cpp
Official inference framework for 1-bit LLMs
...BitNet is built to scale across architectures, with configurable kernels and tiling strategies that adapt to different hardware, and it supports large models with impressive throughput even on modest resources. -
22
SyncKit
Local-first collaboration SDK for React, Vue, and Svelte
...Synckit’s synchronization engine efficiently handles differential syncing — transferring only changed blocks rather than entire files — which reduces bandwidth usage and accelerates sync throughput. -
23
Wireit
Wireit upgrades your npm/pnpm/yarn scripts to make them smarter
...It persists caches between runs and across CI so identical steps don’t redo expensive tasks like bundling or type-checking. The system also serializes or parallelizes scripts based on dependencies to avoid race conditions while maximizing throughput. Because it integrates at the script layer, it works with any underlying tool—TypeScript, Rollup, Jest, or bespoke commands—while remaining transparent to developers. -
24
Scalatra
Tiny Scala high-performance, async web framework
Scalatra is a lightweight, high-performance micro web framework written in Scala, inspired by the Ruby framework Sinatra. Its goal is to provide a minimal but expressive foundation for building web applications or REST APIs in Scala without the verbosity or steep learning curve of larger frameworks. It supports asynchronous request handling, routing, filters, content negotiation, and easy integration with templating, JSON libraries, and other web middleware. Being unopinionated, it lets... -
25
Laravel Horizon
Dashboard and code-driven configuration for Laravel queues
Horizon provides a beautiful dashboard and code-driven configuration for your Laravel-powered Redis queues. Horizon allows you to easily monitor key metrics of your queue system such as job throughput, runtime, and job failures. All of your worker configuration is stored in a single, simple configuration file, allowing your configuration to stay in source control where your entire team can collaborate. When using Horizon, all of your queue worker configuration is stored in a single, simple configuration file. By defining your application's worker configuration in a version-controlled file, you may easily scale or modify your application's queue workers when deploying your application.
