Search Results for "latency" - Page 2
Sort By:
Showing 661 open source projects for "latency"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
1
ScaleLLM
A high-performance inference system for large language models
ScaleLLM is a high-performance inference system tailored for Large Language Models (LLMs), specifically designed for production environments. It focuses on optimizing inference processes to handle large-scale deployments efficiently, ensuring low latency and high throughput. ScaleLLM supports various LLM architectures and integrates with existing infrastructures, providing a scalable solution for deploying LLMs in real-world applications. -
2
Oboe
Oboe is a C++ library that makes it easy to build high-performance
oboe is a C++ library for building high-performance audio apps on Android, providing a unified, low-latency API over AAudio and OpenSL ES. It abstracts device and API-version differences so developers can focus on audio processing instead of platform quirks. The library emphasizes minimal latency and glitch-free playback/recording via tuned buffer strategies and callback-driven I/O. It supports features like floating-point audio, channel configuration, sample-rate negotiation, and stream sharing to match device capabilities. ... -
3
N64: Recompiled
Tool to statically recompile N64 games into native executables
...Instead of relying on traditional emulation, which interprets instructions at runtime, N64Recomp focuses on static recompilation, converting MIPS-based N64 binaries into readable and buildable source code. This approach allows developers to run classic games with improved performance, lower latency, and better integration with modern hardware and operating systems. The framework provides tools for analyzing ROMs, reconstructing program logic, and generating code that preserves the original game’s behavior while enabling modifications and enhancements. It also supports cross-platform compilation, making it possible to run recompiled games on Windows, Linux, and other environments without specialized emulators. -
4
trackerslist
Updated list of public BitTorrent trackers
trackerslist is a repository that provides continuously updated lists of public BitTorrent trackers, designed to improve torrent download performance and peer discovery. The project is maintained by an automated system that regularly checks tracker availability, removes duplicates, and ranks them based on reliability and latency. It offers multiple formats of tracker lists, including HTTP, HTTPS, WebSocket, and IP-based versions, making it compatible with a wide range of BitTorrent clients. The lists can be integrated into torrent files or magnet links to enhance connectivity and download speeds. Additionally, the project includes specialized lists for alternative networks such as I2P and Yggdrasil, expanding its usability in privacy-focused environments. ... -
Demo Series - Small Business Backup By VeeamWatch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
-
5
AsmJit
Low-latency machine code generation
...It is commonly used in applications such as emulators, compilers, and high-performance computing systems where runtime optimization is essential. asmjit emphasizes low latency and efficiency, ensuring that generated code executes quickly without significant overhead. Its modular design allows developers to integrate it into various systems with minimal friction. Overall, asmjit bridges the gap between high-level programming and low-level execution by enabling efficient runtime code generation. -
6
GuitarPedal
Linus learns analog circuits
GuitarPedal is an experimental repository exploring a digital guitar-effects signal chain implemented with lean, low-level code. The project demonstrates how to read audio input, process it through simple transformations, and write the result out in real time with minimal latency. It emphasizes straightforward, inspectable DSP so developers can follow the math and tweak parameters without a giant framework in the way. The codebase favors portability and simplicity, focusing on a handful of canonical effects rather than a sprawling plugin architecture. It doubles as a teaching aid for musicians who code, showing how buffers, sampling rates, and numerical stability affect tone. ... -
7
PgAgroal
High-performance connection pool for PostgreSQL
pgagroal is a high-performance PostgreSQL connection pooler written in C, designed for minimal latency and efficient resource usage. It provides features like secure authentication, hot reloading, and support for multiple databases, making it suitable for low-latency applications and microservice architectures. pgagroal is optimized for fast startup, low overhead, and easy integration. -
8
PeerDB
Fast, Simple and a cost effective tool to replicate data from Postgres
PeerDB is an open-source platform for real-time replication and transformation of data from PostgreSQL to analytical warehouses like BigQuery and Snowflake. It supports Change Data Capture (CDC) and provides seamless syncing and transformation logic with low latency. PeerDB is ideal for teams building real-time data pipelines without relying on expensive proprietary solutions. -
9
Bitalosdb
Bitalosdb is a high-performance KV storage engine
BitalosDB is a distributed, high-performance key-value database designed for cloud-native applications. It is optimized for scalability, supporting large workloads while maintaining low latency and high availability. -
One Monitoring Tool for IT, OT and Cloud | Free TrialModern infrastructure spans data centers, cloud platforms and factory floors, and every blind spot between them is a risk. PRTG supports SNMP, WMI, SSH and other standard protocols to monitor IT, OT and hybrid environments through one customizable dashboard. Build the views your team needs, from network health to application performance, without switching tools. Try PRTG free for 30 days now.
-
10
Ultravox
Fast multimodal LLM for real-time voice interaction and AI apps
...Internally, it leverages pretrained language models and speech encoders, with a multimodal adapter that integrates both modalities for inference and training. Ultravox is optimized for low latency, achieving fast response times suitable for interactive voice agents and real-time applications. It supports use cases such as conversational AI agents, speech-to-speech translation, and analysis of spoken audio content. Ultravox also includes tooling and configuration systems for training, evaluation, and dataset integration. -
11
Aeron
Efficient UDP unicast, UDP multicast, and IPC message transport
...Aeron Cluster provides support for fault-tolerant services as replicated state machines based on the Raft consensus algorithm. Performance is the key focus. A design goal for Aeron is to be the highest throughput with the lowest and most predictable latency of any messaging system. Aeron integrates with Simple Binary Encoding (SBE) for the best possible message encoding and decoding performance. Many of the data structures used in the creation of Aeron have been factored out to the Agrona project. -
12
Garnet
Garnet is a remote cache-store from Microsoft Research
Garnet is a remote cache‑store developed by Microsoft Research. It delivers high throughput and low‑latency performance, supports scalability via clustering (sharding, replication, key migration, checkpointing, failover, transactions), and seamlessly integrates with existing Redis clients. Garnet offers much better throughput and scalability with many client connections and small batches, relative to comparable open-source cache-stores, leading to cost savings for large apps and services. ... -
13
Canal
MySQL binlog
...It enables real-time data synchronization and change data capture (CDC) between MySQL and other systems such as Elasticsearch, Kafka, or HBase. Canal is widely used for data integration, replication, and monitoring across distributed systems, offering high performance and low-latency log parsing. -
14
Lantern Database
PostgreSQL vector database extension for building AI applications
Lantern is a real-time data transformation engine that enables data engineers to build, run, and monitor streaming data pipelines with SQL. It’s designed to process events in motion, offering low-latency stream transformations, aggregations, and enrichment in a declarative way. Lantern is especially suited for modern data infrastructure and analytics platforms. -
15
optillm
Optimizing inference proxy for LLMs
...It serves as an OpenAI API-compatible proxy, allowing for seamless integration into existing workflows while optimizing inference processes. OptiLLM aims to reduce latency and resource consumption during LLM inference. -
16
VictoriaMetrics
VictoriaMetrics: fast, cost-effective monitoring solution
VictoriaMetrics is a fast, cost-effective and scalable monitoring solution and time series database. VictoriaMetrics is available in binary releases, Docker images, Snap packages and source code. Just download the latest version of VictoriaMetrics. VictoriaMetrics is developed at a fast pace, so it is recommended periodically checking the CHANGELOG and performing regular upgrades. It can be used as long-term storage for Prometheus. See these docs for details. It can be used as a drop-in... -
17
hls4ml
Machine learning on FPGAs using HLS
hls4ml is an open-source framework that enables machine learning models to be implemented directly on hardware such as FPGAs and ASICs using high-level synthesis techniques. The system converts trained neural network models from common machine learning frameworks into hardware description code suitable for ultra-low-latency inference. This approach allows machine learning algorithms to run directly on specialized hardware, making them suitable for applications that require extremely fast response times and minimal power consumption. The framework was originally developed for high-energy physics experiments where real-time decision systems must process large volumes of data with strict latency constraints. ... -
18
Portkey AI Gateway
A blazing fast AI Gateway with integrated guardrails
...It’s lightweight and optimized for low latency with a small footprint. -
19
Seamless Communication
Foundational Models for State-of-the-Art Speech and Text Translation
...The research prototype includes components for visual grounding (understanding when a user references something in view), gesture recognition and synthesis, and turn-taking mechanisms that mirror human conversational timing. Because latency and synchronization are critical, the codebase invests in asynchronous scheduling, overlap of perception and reasoning, and fast fallback responses. -
20
PackageCompiler
Compile your Julia Package
...All subsequent calls within that same session use this fast compiled function, but if you restart Julia you lose all the compiled work. PackageCompiler allows you to do this work upfront — further ahead of time — and store the results for a lower latency startup. You can save loaded packages and compiled functions into a file (called a sysimage) that you pass to Julia upon startup. Typically the goal is to reduce latency on your machine; for example, you could load the packages and compile the functions used in common plotting workflows using that saved image by default. In general, sysimages are not relocatable to other machines; they'll only work on the machine they were created on. -
21
Blinkenlights
Tiniest x86-64-linux emulator
The Blinkenlights project is a high-performance terminal emulator designed to provide a fast and responsive command-line experience. It focuses on delivering low-latency interactions and efficient rendering, making it suitable for developers who rely heavily on terminal workflows. The project is built with performance optimization in mind, leveraging modern techniques to minimize overhead. It supports standard terminal features while also introducing enhancements that improve usability and responsiveness. ... -
22
Scrypted
Scrypted is a high performance video integration and automation
Scrypted is a high-performance home video integration platform and NVR with smart detection capabilities. It is designed to connect and manage camera systems while providing low-latency streaming to platforms such as HomeKit, Google Home, and Alexa. The project supports many camera types and focuses on reliable video integration rather than simple device control alone. Its plugin-based architecture allows additional camera providers, integrations, and automation behavior to be developed around the core platform. ... -
23
LOL HTML
Low output latency streaming HTML parser/rewriter with CSS API
Low Output Latency streaming HTML rewriter/parser with CSS-selector based API. It is designed to modify HTML on the fly with minimal buffering. It can quickly handle very large documents, and operate in environments with limited memory resources. The crate serves as a back-end for the HTML rewriting functionality of Cloudflare Workers, but can be used as a standalone library with a convenient API for a wide variety of HTML rewriting/analysis tasks. -
24
cloudflare-speed-cli
CLI for internet speed test via cloudflare
cloudflare-speed-cli is a Rust-based command-line internet speed testing tool that interfaces with Cloudflare’s public speed test endpoints, letting users measure download and upload throughput, latency, and more from a terminal. It presents results in an interactive text-user-interface (TUI) that charts real-time metrics as tests run, making it easy to visually inspect performance trends without leaving the console. The tool also stores historical test results and can export measured data as structured JSON for scripting, logging, or integration with automation tools. ... -
25
MOSS-TTS-Nano
MOSS-TTS-Nano is an open-source multilingual tiny speech generation
...The model operates efficiently on CPU-only systems, enabling deployment without specialized hardware. It supports multilingual voice cloning and produces high-fidelity audio with low latency. The system uses an autoregressive audio tokenization pipeline to generate natural-sounding speech. It is suitable for local applications, web services, and embedded systems. Overall, it brings advanced speech synthesis capabilities to lightweight and accessible environments.
