Search Results for "latency"
Sort By:
30 projects for "latency" with 2 filters applied:
-
Gemini 3 and 200+ AI Models on One PlatformBuild generative AI apps with Vertex AI. Switch between models without switching platforms.
-
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
1
Oboe
Oboe is a C++ library that makes it easy to build high-performance
oboe is a C++ library for building high-performance audio apps on Android, providing a unified, low-latency API over AAudio and OpenSL ES. It abstracts device and API-version differences so developers can focus on audio processing instead of platform quirks. The library emphasizes minimal latency and glitch-free playback/recording via tuned buffer strategies and callback-driven I/O. It supports features like floating-point audio, channel configuration, sample-rate negotiation, and stream sharing to match device capabilities. ... -
2
libSQL
libSQL is a fork of SQLite that is both Open Source
libSQL is an open-source, community-driven fork of SQLite maintained by Turso. It aims to modernize SQLite by optimizing for performance and availability, targeting distributed and low-latency applications. SQLite has solidified its place in modern technology stacks, embedded in nearly any computing device you can think of. Its open source nature and public domain availability make it a popular choice for modification to meet specific use cases. libSQL will always be able to ingest and write the SQLite file format. We would love to add extensions like encryption, and CRC that require the file to be changed. ... -
3
edgetunnel
edgetunnel 2.0 VLESS/Trojan
...It provides a streamlined way to host proxy endpoints without managing a full server stack, instead leveraging the edge network of Cloudflare for distribution and potential performance. Because it runs at the edge, latency can be minimized and deployment complexity simplified; users supply configuration variables (host, port, UUID, path) and the script handles mapping to technical protocols and subscription formatting. -
4
libdatachannel
C/C++ WebRTC network library featuring Data Channels, Media Transport
libdatachannel is a C++ library that implements WebRTC DataChannels and ICE transports, enabling peer-to-peer communication without relying on media components. It is ideal for developers who want efficient, low-latency P2P communication for data transmission in IoT, multiplayer games, decentralized apps, or custom signaling architectures. Built for performance and minimalism, it allows fine-grained control over STUN, TURN, DTLS, and SCTP layers, with a clean and modern C++ interface. -
8 Monitoring Tools in One APM. Install in 5 Minutes.AppSignal works out of the box for Ruby, Elixir, Node.js, Python, and more. 30-day free trial, no credit card required.
-
5
DeepEP
DeepEP: an efficient expert-parallel communication library
DeepEP is a communication library designed specifically to support Mixture-of-Experts (MoE) and expert parallelism (EP) deployments. Its core role is to implement high-throughput, low-latency all-to-all GPU communication kernels, which handle the dispatching of tokens to different experts (or shards) and then combining expert outputs back into the main data flow. Because MoE architectures require routing inputs to different experts, communication overhead can become a bottleneck — DeepEP addresses that by providing optimized GPU kernels and efficient dispatch/combining logic. ... -
6
CoreNet
CoreNet: A library for training deep neural networks
CoreNet is Apple’s internal deep learning framework for distributed neural network training, designed for high scalability, low-latency communication, and strong hardware efficiency. It focuses on enabling large-scale model training across clusters of GPUs and accelerators by optimizing data flow and parallelism strategies. CoreNet provides abstractions for data, tensor, and pipeline parallelism, allowing models to scale without code duplication or heavy manual configuration. -
7
Lettuce
Advanced Java Redis client for thread-safe sync, async, etc.
...Lettuce is a fully non-blocking Redis client built with netty providing Reactive, Asynchronous and Synchronous Data Access. Lettuce provides asynchronous API with RedisFuture (CompletionStage) and Reactive types Flux [N] and Mono [0|1]. Low-latency communication, backpressure-enabled network engine for NIO TCP, epoll TCP and Unix Domain Sockets. Reactive Streaming is fully supported. Lettuce comes with an API that gets you started quickly. Its simple yet powerful programming model allows you for trivial use-cases as well as for chained asynchronous flows. Redis Standalone, Master/Slave, Redis Sentinel and Redis Cluster. ... -
8
Quake3e
Improved Quake III Arena engine
Quake3e is a modernized fork of id Software’s Quake III Arena engine, tailored for mod developers and competitive players. It includes numerous technical improvements while preserving the core gameplay and mod compatibility of the original. Focused on performance, security, and extended modding capabilities, it has become a popular base for competitive tournaments and engine forks. With its updated rendering path and support for high refresh rates, Quake3e offers a slick and responsive... -
9
Zsh for Humans
A turnkey configuration for Zsh
...Instead of requiring you to pick and wire together many plugins and themes yourself, it bundles a curated set of Zsh plugins and settings into a coherent, production-ready configuration. The project handles prompt customization, completions, key bindings, history management, and Git integration for you, all tuned for responsiveness and low latency. It is designed to feel like a finished product rather than a DIY starter kit, so new users can get a high-quality shell experience with a single install command. At the same time, it provides escape hatches and configuration points so advanced users can layer their own aliases, functions, and styles on top of the base setup. The maintainer notes that the project now has limited support and few new features planned, but the existing feature set is already extensive and stable for everyday use. -
Forever Free Full-Stack Observability | Grafana CloudBuilt on open standards like Prometheus and OpenTelemetry, Grafana Cloud includes Kubernetes Monitoring, Application Observability, Incident Response, plus the AI-powered Grafana Assistant. Get started with our generous free tier today.
-
10
RSocket
Java implementation of RSocket
...RSocket is intended to be consumed via one of the various implementation libraries which implement the RSocket Protocol. By default to make RSocket easier to use it copies the incoming Payload. Copying the payload comes at cost to performance and latency. If you want to use zero copy you must disable this. To disable copying you must include a payloadDecoder argument in your RSocketFactory. This will let you manage the Payload without copying the data from the underlying transport. You must free the Payload when you are done with them or you will get a memory leak. Used correctly this will reduce latency and increase performance. -
11
asyncpg
A fast PostgreSQL Database Client Library for Python/asyncio
asyncpg is a high-performance PostgreSQL client library designed for Python's asyncio framework. It offers a clean and efficient implementation of the PostgreSQL server binary protocol, enabling developers to execute database operations asynchronously. This approach allows for scalable and responsive applications that can handle numerous concurrent database connections. -
12
Rocket.jl
Functional reactive programming extensions library for Julia
Rocket.jl is a Julia package for reactive programming using Observables, to make it easier to work with asynchronous data. Rocket.jl has been designed with a focus on performance and modularity. -
13
SFBAudioEngine
A powerhouse of audio functionality for macOS, iOS, and tvOS
SFBAudioEngine is an advanced audio engine designed for macOS and iOS, focusing on high-quality playback, precise audio control, and support for a wide range of audio formats. Built for modern Apple platforms, it provides developers with a robust tool for integrating sophisticated audio functionalities into their applications. It emphasizes extensibility, performance, and clean API design. -
14
Agrona
High Performance data structures and utility methods for Java
Agrona provides a library of data structures and utility methods that are a common need when building high-performance applications in Java. Many of these utilities are used in the Aeron efficient reliable UDP unicast, multicast, and IPC message transport and provides high-performance buffer implementations to support the Simple Binary Encoding Message Codec. -
15
SOFAJRaft
A production-grade java implementation of RAFT consensus algorithm
SOFAJRaft is a production-level, high-performance Java implementation based on the RAFT consistency algorithm that supports MULTI-RAFT-GROUP for high-load, low-latency scenarios. With SOFAJRaft you can focus on your business area. SOFAJRaft handles all RAFT-related technical challenges. SOFAJRaft is very user-friendly, which provides several examples, making it easy to understand and use. -
16
ChartGPU
Beautiful, open source, WebGPU-based charting library
...By leveraging WebGPU — the next-generation graphics API for the web — ChartGPU offloads rendering work to the GPU, allowing for fast panning, zooming, and real-time updates with minimal latency. This makes the library particularly valuable for data-intensive dashboards, scientific visualizations, and financial charting where performance bottlenecks of traditional canvas or SVG approaches become apparent. It includes support for common chart types like line, bar, scatter, and candlestick plots, and its architecture is designed to scale with both visual complexity and data volume. -
17
Chronicle Queue
Micro second messaging that stores everything to disk
Micro second messaging that stores everything to disk. With millions of users worldwide, Chronicle Queue is a leading choice for organizations of all sizes seeking a low-latency, high-performance messaging framework. The Chronicle Queue Enterprise version eliminates compatibility issues and allows for the seamless integration and sharing of data between Java, Rust, Python, and C++ libraries. Chronicle Queue is available as a fully native Java, Rust or C++ library, and also supports a Python API. All versions are fully binary compatible. -
18
FlashMLA
FlashMLA: Efficient Multi-head Latent Attention Kernels
FlashMLA is a high-performance decoding kernel library designed especially for Multi-Head Latent Attention (MLA) workloads, targeting NVIDIA Hopper GPU architectures. It provides optimized kernels for MLA decoding, including support for variable-length sequences, helping reduce latency and increase throughput in model inference systems using that attention style. The library supports both BF16 and FP16 data types, and includes a paged KV cache implementation with a block size of 64 to efficiently manage memory during decoding. On very compute-bound settings, it can reach up to ~660 TFLOPS on H800 SXM5 hardware, while in memory-bound configurations it can push memory throughput to ~3000 GB/s. ... -
19
Size Limit
Calculate the real cost to run your JS app or lib
Size Limit is a JavaScript performance budget tool that measures the real cost of your JavaScript bundle and prevents regressions by enforcing limits in CI. It calculates not just raw bundle size, but also download and execution time under configurable network conditions, giving a more realistic sense of what users experience. The tool is modular: it offers a CLI and multiple plugins (file, webpack, time) plus presets tailored to different use cases, from big single-page apps to small npm... -
20
CppServer
Fast and low latency asynchronous socket server & client C++ library
Ultra-fast and low latency asynchronous socket server & client C++ library with support TCP, SSL, UDP, HTTP, HTTPS, WebSocket protocols, and 10K connections problem solution. Cross platform (Linux, MacOS, Windows) Asynchronous communication. Supported CPU scalability designs: IO service per thread, thread pool. Supported transport protocols: TCP, SSL, UDP, UDP multicast. -
21
Index Advisor
PostgreSQL Index Advisor
...It passively monitors query patterns and recommends indexes to improve performance without requiring deep database expertise. This tool helps developers and DBAs reduce query latency and improve efficiency in production environments. -
22
Scalable-Software-Architecture
Collection of tech talks, papers and web links on Distributed Systems
Scalable-Software-Architecture gathers tech talks, academic papers, blog posts and web links related to building scalable software architecture, distributed systems, system design, and production-scale considerations. The aim is to help readers study how large systems operate: how to scale them, how to handle latency, failure, load, concurrency, and how to structure software for maintainability at scale. Because many interview and real-world engineering problems revolve around system design now, this collection serves as both prep material and a reference bank for engineers evolving beyond code to architecture. It promotes reading original source material (papers and talks) rather than merely summary blog posts, thereby helping practitioners deepen their mental models. ... -
23
CDN Up and Running
CDN Up and Running - Building a CDN from Scratch to Learn about CDN
...The project uses technologies such as Nginx, Lua, Docker, Prometheus, and Grafana to simulate realistic CDN environments and monitoring systems. It also explores performance considerations, including latency simulation, load balancing, and scalability. By integrating observability tools, it enables users to analyze system behavior and performance metrics. -
24
TengineKit
TengineKit - Free, Fast, Easy, Real-Time Face Detection
Free, Fast, Easy, Real-Time Face Detection & Face Landmarks & Face Attributes & Hand Detection & Hand Landmarks & Body Detection & Body Landmarks & Iris Landmarks & Yolov5 SDK On Mobile. TengineKit is an easy-to-integrate AI algorithm SDK. At present, it can run on various mobile phones at very low latency. We will continue to update this project for better results and better performance! -
25
NATS HTTP Round Tripper
This is a Golang http.RoundTripper that uses NATS as a transport
...It exposes an API compatible with the common “RoundTripper” abstraction, enabling developers to route request/response traffic through NATS subjects rather than traditional HTTP connections. This pattern lets services running in distributed environments take advantage of NATS’ low latency and flexible topology while retaining familiar client semantics. It can be an effective bridge for teams migrating from synchronous REST calls to a message-driven fabric without rewriting every call site. Because the transport is swappable, it promotes clean separation between business logic and the underlying network. The result is an incremental pathway to evented architectures with the ergonomics of conventional request/response programming.
