Search Results for "latency" - Page 6
Sort By:
Showing 661 open source projects for "latency"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
Veeam Data Platform v13.1 - Get Your Free TrialTry Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
1
Fun Audio Chat
Large Audio Language Model built for natural interactions
...The system supports dynamic audio input and output, meaning it can handle different voices, tones, and conversational contexts without forcing users into typed interactions. With real-time streaming, it minimizes latency and delivers responses quickly, making it suitable for applications where responsiveness matters, such as interactive demos, accessibility tools, and conversational games. -
2
PocketMocker
In-page HTTP controller for frontend development
...Running inside the browser, it provides a floating control panel that automatically captures outgoing requests and allows developers to override responses, simulate errors or latency, or test edge cases on the fly. This makes building, debugging, and verifying user interfaces significantly faster because developers can instantly see how their UI reacts to different API conditions without switching contexts. Pocket-Mocker also supports team collaboration through configuration plugins and shared rule sets. Its UI and manual are designed to be intuitive, so even those new to API mocking can quickly catch up. ... -
3
StreamSpeech
StreamSpeech is a seamless model for offline speech recognition
StreamSpeech is an “all-in-one” speech model designed to perform offline and simultaneous speech recognition, speech translation, and speech synthesis within a single unified architecture. Developed as part of an ACL 2024 paper, it targets streaming and low-latency scenarios where intermediate results and final translations or synthetic speech must be produced continuously as audio is being received. The model supports eight tasks: offline ASR, speech-to-text translation, speech-to-speech translation, and TTS, as well as their streaming or simultaneous counterparts, all handled by the same underlying system. ... -
4
s2n-quic
An implementation of the IETF QUIC protocol
...Extensive testing (unit, fuzz, interop) ensures protocol compliance and interoperability with other implementations. Because it is open-source under Apache 2.0, organizations can integrate it into services where low latency, multiple streams, or mobility (connection migration) matter. -
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
5
ZeusDB Vector Database
Blazing-fast vector DB with similarity search and metadata filtering
...It combines high-performance approximate nearest neighbor indexes with clean APIs and metadata filtering so applications can retrieve semantically relevant items at low latency. The storage layer is designed for durability and growth, supporting sharding, replication, and background compaction while keeping query tails predictable. Developers get multiple ingestion paths—batch, streaming, and upsert—making it easy to keep embeddings synchronized as content changes. Hybrid search is a core design goal, allowing you to mix vector, keyword, and filter queries in a single request for practical relevance. ... -
6
FastVLM
This repository contains the official implementation of FastVLM
...The repository documents model variants, showcases head-to-head numbers against known baselines, and explains how the encoder integrates with common LLM backbones. Apple’s research brief frames FastVLM as targeting real-time or latency-sensitive scenarios, where lowering visual token pressure is critical to interactive UX. In short, it’s a practical recipe to make VLMs fast without exotic token-selection heuristics. -
7
DeepEP
DeepEP: an efficient expert-parallel communication library
DeepEP is a communication library designed specifically to support Mixture-of-Experts (MoE) and expert parallelism (EP) deployments. Its core role is to implement high-throughput, low-latency all-to-all GPU communication kernels, which handle the dispatching of tokens to different experts (or shards) and then combining expert outputs back into the main data flow. Because MoE architectures require routing inputs to different experts, communication overhead can become a bottleneck — DeepEP addresses that by providing optimized GPU kernels and efficient dispatch/combining logic. ... -
8
Infinity
Low-latency REST API for serving text-embeddings
Infinity is a high-throughput, low-latency REST API for serving vector embeddings, supporting all sentence-transformer models and frameworks. Infinity is developed under MIT License. Infinity powers inference behind Gradient.ai and other Embedding API providers. -
9
Apache Phoenix
Mirror of Apache Phoenix
Apache Phoenix is a SQL skin over HBase delivered as a client-embedded JDBC driver targeting low latency queries over HBase data. Apache Phoenix enables OLTP and operational analytics in Hadoop for low latency applications by combining the best of both worlds. The power of standard SQL and JDBC APIs with full ACID transaction capabilities and the flexibility of late-bound, schema-on-read capabilities from the NoSQL world by leveraging HBase as its backing store. -
Train ML Models With SQL You Already KnowBuild and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
-
10
Riemann
A network event stream processing system, in Clojure
Riemann aggregates events from your servers and applications with a powerful stream processing language. Send an email for every exception in your app. Track the latency distribution of your web app. See the top processes on any host, by memory and CPU. Combine statistics from every Riak node in your cluster and forward to Graphite. Track user activity from second to second. Riemann streams are just functions which accept an event. Events are just structs with some common fields like :host and :service You can use dozens of built-in streams for filtering, altering, and combining events, or write your own. ... -
11
Quake3e
Improved Quake III Arena engine
Quake3e is a modernized fork of id Software’s Quake III Arena engine, tailored for mod developers and competitive players. It includes numerous technical improvements while preserving the core gameplay and mod compatibility of the original. Focused on performance, security, and extended modding capabilities, it has become a popular base for competitive tournaments and engine forks. With its updated rendering path and support for high refresh rates, Quake3e offers a slick and responsive... -
12
Deskhop
Fast Desktop Switching Device
DeskHop is an open-source hardware/software KVM device that seamlessly switches keyboard/mouse between two computers by dragging the cursor or via hotkeys. It’s plug‑and‑play, requiring no drivers, and provides galvanic isolation for secure multi-OS setups. -
13
Olric
Distributed, in-memory key/value store and cache
A lightweight, distributed in-memory data store designed for key-value caching and ephemeral storage. -
14
PikiwiDB
Pika is a Redis-Compatible database
A high-performance, distributed key-value database inspired by Redis but designed for large-scale cloud-native environments. -
15
CockroachDB
The open source, cloud-native SQL database
...It delivers resilient, consistent, distributed SQL at your scale thanks in large part to its unique self-organizing and self-healing architecture. It is able to scale horizontally, survive all kinds of failures with minimal latency disruption and zero manual intervention, and supports strongly-consistent ACID transactions. All this while providing a familiar SQL API. -
16
SoftEther VPN
Cross-platform multi-protocol VPN software
An open-source free cross-platform multi-protocol VPN program, as an academic project from University of Tsukuba, under the Apache License 2.0. The API Suite allows you to easily develop your original SoftEther VPN Server management application to control the VPN Server (e.g. creating users, adding Virtual Hubs, disconnecting a specified VPN sessions) from JavaScript, TypeScript, C# or other languages. SoftEther VPN ("SoftEther" means "Software Ethernet") is one of the world's most powerful... -
17
Switchyard
Switchyard lets LLM applications route traffic across models
...Routing strategies include random splits, LLM classification, signal-driven stage routing, escalation, and custom algorithms. Prometheus metrics track requests, errors, latency, tokens, and routing overhead. Developers can run it as a standalone server, launch coding agents through it, or embed its routing logic in Rust applications. The project is currently pre-alpha and explicitly marked experimental rather than production-ready. -
18
Lunary
The production toolkit for LLMs. Observability, prompt management
Lunary helps developers of LLM Chatbots develop and improve them. -
19
HikariCP
A solid, high-performance, JDBC connection pool at last
HikariCP is a high-performance JDBC connection pooling library designed to offer minimal overhead and maximum throughput. It aims for simplicity and stability, concentrating on fast connection acquisition and minimal latency under load. Its internals manage a pool of connections aggressively but smartly, with options such as leak detection, timeout thresholds, and adaptive connection retirement. Because it avoids heavy internal locking, it scales well in high-concurrency environments, making it a popular choice in microservices and high-throughput web backends. ... -
20
WireGuard Linux
Linux kernel implementation of the WireGuard VPN protocol
...The repository serves as a mirror of the official development tree and contains the kernel-side code that enables native WireGuard support on Linux systems. By operating inside the kernel rather than user space, the project achieves very low latency and high throughput, making it suitable for servers, embedded systems, and enterprise networking environments. WireGuard itself is designed to be a modern, streamlined VPN that uses state-of-the-art cryptography while remaining simpler and leaner than legacy solutions such as IPsec or OpenVPN. The Linux implementation integrates tightly with standard networking tools and interfaces, allowing administrators to manage tunnels using familiar workflows. -
21
LingBot-World
Advancing Open-source World Models
...LingBot-World supports long-term temporal consistency, maintaining coherent scenes and interactions over minute-level horizons. With real-time interactivity and sub-second latency at 16 FPS, it is well-suited for interactive applications and rapid experimentation. The project is fully open-access, releasing both code and models to help bridge the gap between closed and open world-model systems. LingBot-World empowers researchers and developers in areas such as content creation, gaming, robotics, and embodied AI learning. -
22
Memobase
Fast backend for long-term AI user memory via structured profiles
...The system focuses on three principal performance metrics: high search performance, reduced large language model (LLM) costs through batch processing techniques, and low latency with minimal SQL operations. Memobase supports integration with existing LLM workflows via APIs and SDKs (including Python, Node, and Go), making it easy to adopt within diverse application stacks. -
23
Internet Pi
Raspberry Pi config for all things Internet
...The typical use case is: plug the Pi into your home network, install Pi-hole for DNS-level ad-blocking and privacy, and deploy Prometheus + Grafana to monitor internet connection quality, ping latency, speed tests, and uptime trends. The intention is both practical (reduce ads, manage DNS) and observational (track your internet link over time, identify drops, latency spikes, or service degradation). The project supports additional modules like monitoring smart plugs (e.g., Shelly), monitoring air quality (via AirGradient sensors), or monitoring Starlink statistics. ... -
24
Universal Tool Calling Protocol (UTCP)
Official python implementation of UTCP. UTCP is an open standard
...It leverages a modular, plugin-based architecture built around Pydantic models and separates the core functionality into a lightweight client and extensible protocol plugins, enabling secure, scalable, and low-latency direct tool calls. A pluggable architecture allows developers to easily add new communication protocols, tool storage mechanisms, and search strategies without modifying the core library. -
25
RSocket
Java implementation of RSocket
...RSocket is intended to be consumed via one of the various implementation libraries which implement the RSocket Protocol. By default to make RSocket easier to use it copies the incoming Payload. Copying the payload comes at cost to performance and latency. If you want to use zero copy you must disable this. To disable copying you must include a payloadDecoder argument in your RSocketFactory. This will let you manage the Payload without copying the data from the underlying transport. You must free the Payload when you are done with them or you will get a memory leak. Used correctly this will reduce latency and increase performance.
