Search Results for "latency"
Sort By:
Showing 707 open source projects for "latency"
View related business solutions-
Go From AI Idea to AI App FastAccess Gemini 3 and 200+ models. Build chatbots, agents, or custom models with built-in monitoring and scaling.
-
Forever Free Full-Stack Observability | Grafana CloudBuilt on open standards like Prometheus and OpenTelemetry, Grafana Cloud includes Kubernetes Monitoring, Application Observability, Incident Response, plus the AI-powered Grafana Assistant. Get started with our generous free tier today.
-
1
Ant Media Server
Adaptive, ultra low latency streaming
Real-time streaming engine delivers content with sub-0.5secs latency. Ant Media Server supports WebRTC, CMAF, HLS, RTMP, RTSP, SRT, Zixi and more for your needs. Ant Media Server is a real-time streaming engine software that provides adaptive, ultra low latency streaming by using WebRTC technology with ~0.5 seconds latency. Ant Media Server is auto-scalable and can run on-premise or on-cloud. Increase interaction and experience real-time video streaming. -
2
Sunshine
Self-hosted game stream host for Moonlight
Sunshine is an open-source self‑hosted cloud gaming server that implements NVIDIA’s GameStream protocol. Compatible with Moonlight clients across platforms, it supports low‑latency streaming via software or hardware encoding (AMD/Intel/NVIDIA) and offers a browser‑based control UI for pairing. -
3
SmokePing
The Active Monitoring System
SmokePing is a latency monitoring tool that measures, visualizes, and alerts on network latency using configurable probes such as ping, fping, or HTTP checks. Developed by Tobi Oetiker, it provides detailed, historical graphs of network performance, making it ideal for diagnosing intermittent issues or verifying SLAs. It uses RRDtool for data storage and graphing. -
4
Mumble
Mumble is an open-source, low-latency, high quality voice chat
Mumble is an open-source, low-latency, high-quality voice chat software. There are two modules in Mumble; the client (mumble) and the server (murmur). The client works on Windows, Linux, FreeBSD, OpenBSD, and macOS, while the server should work on anything Qt can be installed on. Low-latency and high-quality voice-chat program written on top of Qt and Opus. Administrators appreciate Mumble for being able to self-host and have control over data security and privacy. -
Fully Managed MySQL, PostgreSQL, and SQL ServerCloud SQL handles your database ops end to end, so you can focus on your app.
-
5
DeepSpeed MII
MII makes low-latency and high-throughput inference possible
...While open-sourcing has democratized access to AI capabilities, their application is still restricted by two critical factors: inference latency and cost. DeepSpeed-MII is a new open-source python library from DeepSpeed, aimed towards making low-latency, low-cost inference of powerful models not only feasible but also easily accessible. MII offers access to the highly optimized implementation of thousands of widely used DL models. MII-supported models achieve significantly lower latency and cost compared to their original implementation. -
6
hidusbf
USB Mice Overclocking Software (for Windows)
Hidusbf is a low-level Windows driver and utility designed to modify the polling rate of USB input devices such as mice and controllers, effectively enabling higher responsiveness through overclocking or reducing latency through downclocking. It works by installing a filter driver that intercepts USB communication and adjusts the rate at which the device reports input data to the system. This can result in significantly higher polling rates, such as increasing from the default 125 Hz to much higher frequencies, depending on hardware compatibility. ... -
7
BlackHole
BlackHole is a modern macOS audio loopback driver
BlackHole is a modern virtual audio loopback driver for macOS that allows audio to be routed between applications with zero additional latency. It is widely used by musicians, streamers, developers, and audio engineers who need reliable internal audio routing without external hardware. BlackHole supports a wide range of sample rates and configurable channel counts, making it flexible for both simple and advanced audio workflows. The driver integrates directly with macOS Core Audio and appears in Audio MIDI Setup and supported audio applications. ... -
8
Atlas OS
An open and lightweight modification to Windows
Atlas is an open-source, script-based modification for Windows that enhances usability, privacy, and performance. It strips unnecessary background services, disables telemetry, and includes gaming and latency optimizations to make Windows feel lean and fast for enthusiasts. -
9
RealtimeSTT
A robust, efficient, low-latency speech-to-text library
RealtimeSTT is a Python-based realtime speech-to-text engine emphasizing low latency, wake-word detection, voice activity detection, and automatic speech segmentation. It provides asynchronous callbacks, nanosecond-precision timestamps, and CLI tools, suitable for building voice assistants, meeting transcribers, or live caption systems. -
Earn up to 16% annual interest with Nexo.Generate interest, access liquidity without selling, and execute trades seamlessly. All in one platform. Geographic restrictions, eligibility, and terms apply.
-
10
ALVR - Air Light VR
Stream VR games from your PC to your headset via Wi-Fi
...The system works by encoding video output from the PC, streaming it over Wi-Fi, and decoding it on the headset in real time, while also transmitting input data such as head tracking and controller movements back to the PC. ALVR supports low-latency streaming through optimized encoding techniques and network configurations, making it suitable for interactive VR experiences. It also includes customizable settings for bitrate, resolution, and performance tuning, allowing users to balance quality and responsiveness. The project is actively developed and supports multiple platforms, including Windows and Linux. -
11
SysDVR
Stream switch games to your PC via USB or network
...Video quality is fixed to 720p @ 30fps with h264 compression, this is a hardware limit. Audio quality is fixed to 16bit PCM @ 48kHz stereo. Not compressed. Very low latency with an optimal setup, most games are playable. -
12
scrcpy
Display and control your Android device
...It is cross-platform (GNU/Linux, macOS and Windows) and does not require any root access. scrcpy displays only the device screen but offers great performance (30~60fps) and quality (1920×1080 or above). It’s got low latency (35~70ms) and a very low startup time (less than a second). It offers plenty of great features and is non-intrusive, with nothing left installed inside the device. scrcpy works with Android devices with at least API 21 (Android 5.0) and adb debugging must be enabled on the device. -
13
XIU2/CloudflareSpeedTest
"Preferred IP" Test Cloudflare CDN latency and speed
"Preferred IP" Test Cloudflare CDN latency and speed, get the fastest IP (IPv4 / IPv6)! In addition, other CDN / website IPs are also supported. Many foreign websites are using Cloudflare CDN, but the IPs assigned to visitors from mainland China are not friendly (high latency, high packet loss, and slow speed). Although Cloudflare discloses all IP segments , it would be exhausting to find the one that suits you among so many IPs, so this software came into existence. -
14
LiteRT
LiteRT is the new name for TensorFlow Lite (TFLite)
LiteRT is an experimental, real-time inference runtime built by Google AI Edge to run lightweight ML models on edge devices with ultra-low latency. It focuses on delivering predictable and consistent performance for models used in time-critical applications like robotics, AR/VR, and IoT. LiteRT is designed to be hardware-agnostic, with minimal dependencies and tight control over execution scheduling. -
15
FlashInfer
FlashInfer: Kernel Library for LLM Serving
FlashInfer is a kernel library designed to enhance the serving of Large Language Models (LLMs) by optimizing inference performance. It provides a high-performance framework that integrates seamlessly with existing systems, aiming to reduce latency and improve efficiency in LLM deployments. FlashInfer supports various hardware architectures and is built to scale with the demands of production environments. -
16
SpacetimeDB
Multiplayer at the speed of light
SpacetimeDB is a high-performance, distributed database optimized for real-time multiplayer applications. It offers low-latency data synchronization across clients, ensuring a seamless and responsive user experience. With built-in conflict resolution and support for complex data types, SpacetimeDB simplifies the development of interactive, collaborative applications. -
17
OpenJarvis
Personal AI, On Personal Devices
...The framework provides shared primitives for building local-first agents, along with evaluation tools that measure performance using metrics such as energy consumption, latency, cost, and accuracy. OpenJarvis integrates with local inference engines like Ollama, vLLM, SGLang, and llama.cpp to run language models directly on personal hardware. It also includes a learning loop that allows models to improve over time using locally generated interaction traces. By prioritizing local execution and efficiency, OpenJarvis aims to provide a foundation for privacy-preserving personal AI assistants. -
18
Easy GPU PV
A Project dedicated to making GPU Partitioning on Windows easier
Easy-GPU-PV is an open-source project that automates the relatively complex steps required to set up GPU Paravirtualization (GPU-PV) on Windows Hyper-V, letting you partition a physical GPU and assign slices to virtual machines for low-latency remote use. It creates and installs a Windows VM, copies the necessary GPU-PV driver files into the VM, and helps install Parsec (an ultra-low-latency remote-desktop client) so you can connect to the VM at high framerates. The repo is practical and script-driven: the author provides PowerShell scripts (PreChecks.ps1, CopyFilesToVM.ps1, Update-VMGpuPartitionDriver.ps1, etc.) plus configuration values and an unattended install template to minimize manual steps. ... -
19
PeerDB
Fast, Simple and a cost effective tool to replicate data from Postgres
PeerDB is an open-source platform for real-time replication and transformation of data from PostgreSQL to analytical warehouses like BigQuery and Snowflake. It supports Change Data Capture (CDC) and provides seamless syncing and transformation logic with low latency. PeerDB is ideal for teams building real-time data pipelines without relying on expensive proprietary solutions. -
20
Canal
MySQL binlog
...It enables real-time data synchronization and change data capture (CDC) between MySQL and other systems such as Elasticsearch, Kafka, or HBase. Canal is widely used for data integration, replication, and monitoring across distributed systems, offering high performance and low-latency log parsing. -
21
Clock Signal
A latency-hating emulator of: the Acorn Electron, BBC Micro
...One of its most technically distinctive features is its signal-processing-based rendering pipeline, which simulates original video outputs such as composite signals instead of simply drawing pixels, resulting in highly accurate visual artifacts. CLK also prioritizes extremely low latency by decoupling audio and video pipelines and leveraging modern display capabilities. -
22
Selkies-GStreamer
Open-Source Low-Latency Accelerated Linux WebRTC HTML5 Remote Desktop
selkies-gstreamer is a GStreamer-based media streaming component used in the Selkies project, a cloud-native platform designed for interactive desktop and application streaming. This module acts as a high-performance media pipeline that captures video, encodes it with low latency, and streams it via WebRTC to client browsers. It is optimized for GPU-accelerated encoding and integrates with Kubernetes-based deployments to enable scalable, real-time remote desktop sessions. This component plays a critical role in delivering smooth, responsive experiences for cloud-based workstations, gaming, or visualization tools. -
23
Faster Whisper
Faster Whisper transcription with CTranslate2
Faster Whisper is an optimized implementation of the Whisper speech recognition model designed to deliver significantly faster inference while maintaining comparable accuracy. It leverages efficient inference engines and optimized computation strategies to reduce latency and resource consumption. The system is particularly useful for real-time or large-scale transcription tasks where performance is critical. It supports multiple model sizes, allowing users to balance speed and accuracy based on their needs. The architecture is designed to run efficiently on both CPUs and GPUs, making it accessible across different environments. ... -
24
Apollo
The easiest way to stream with the native resolution of your client
Apollo is a self-hosted desktop streaming host designed to enable low-latency game streaming from a personal computer to remote clients using protocols compatible with Moonlight and Artemis. It acts as a server that captures, encodes, and streams desktop or game sessions while supporting hardware acceleration across AMD, Intel, and NVIDIA GPUs. The project includes a web-based interface that allows users to configure streaming settings, manage connected clients, and control application launching remotely. ... -
25
Qbot
AI-powered Quantitative Investment Research Platform
...It bundles a lightweight GUI client (built with wxPython) and a modular backend so researchers can iterate on strategies, run batch backtests, and validate ideas in a near-real simulated environment that models latency and slippage. The project places special emphasis on AI-driven strategies — including supervised learning, reinforcement learning and multi-factor models — and offers a “model zoo” and example strategies to help users get started. For evaluation and analysis, Qbot integrates reporting and visualization (tearsheets, metrics) so you can compare performance across runs and inspect trade-level behavior. ...
