Search Results for "latency" - Page 9
Sort By:
Showing 661 open source projects for "latency"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
Build Data Resilience - Take the Assessment TodayIs your recovery strategy as strong as you think? Take this quick self-assessment to check your recovery readiness and gain tailored insights. In only 2 minutes, you'll learn where you fall on the recovery readiness scale.
-
1
userver
Production-ready C++ Asynchronous Framework with rich functionality
...Developed by Yandex, it provides a robust architecture for writing non-blocking network applications, with built-in support for gRPC, HTTP, database clients, metrics, and more. userver is designed for production-scale backend systems that require low latency and high reliability. -
2
LLM.swift
LLM.swift is a simple and readable library
LLM.swift is a Swift package that enables developers to run Large Language Models (LLMs) directly on Apple devices, including iOS, macOS, and watchOS. By leveraging Apple's hardware and software optimizations, LLM.swift facilitates on-device natural language processing tasks, ensuring user privacy and reducing latency associated with cloud-based solutions. -
3
Parlant
The behavior guidance framework for customer-facing LLM agents
Parlant is a lightweight speech-to-text and text-to-speech framework designed for real-time AI-driven voice applications. -
4
Rocket.jl
Functional reactive programming extensions library for Julia
Rocket.jl is a Julia package for reactive programming using Observables, to make it easier to work with asynchronous data. Rocket.jl has been designed with a focus on performance and modularity. -
Paessler: Easy to Use With Enterprise Power. Free TrialYou shouldn't have to choose between a monitoring tool that's easy to use and one that's powerful enough for a complex environment. PRTG's low-code interface lets any admin build dashboards, set alerts and monitor devices without scripting, while custom sensors and full API access are there when your team needs deeper control. One platform, no compromise. Download a free 30-day trial now.
-
5
FastDeploy
High-performance Inference and Deployment Toolkit for LLMs and VLMs
...FastDeploy includes advanced acceleration technologies such as speculative decoding, multi-token prediction, and efficient KV cache management to improve throughput and latency during inference. It also offers compatibility with OpenAI-style APIs and vLLM-like interfaces, allowing developers to integrate deployed models easily into existing applications and services. -
6
Lemonade
Lemonade helps users run local LLMs with the highest performance
...The repository highlights easy onboarding with downloads, docs, and a Discord for support, suggesting an active user community. Messaging centers on squeezing maximum throughput/latency from modern accelerators without users having to hand-tune kernels or flags. Releases further reinforce the “server” framing, pointing developers toward a service that can be integrated into apps and tools. -
7
Real-Time AI Voice Chat
Have a natural, spoken conversation with AI
Real-Time AI Voice Chat is a client-server application for holding low-latency spoken conversations with large language models. The browser captures microphone audio and streams it over WebSockets to a Python backend. RealtimeSTT converts speech into text, which is sent to an LLM such as Ollama or OpenAI for response generation. RealtimeTTS then synthesizes the answer and streams speech back to the browser. -
8
VoxCPM2
Tokenizer-Free TTS for Multilingual Speech Generation
VoxCPM2 is an advanced open-source text-to-speech system that redefines speech synthesis by eliminating traditional tokenization and instead generating continuous speech representations through a diffusion-based autoregressive architecture. Built on top of the MiniCPM model family, it enables highly natural, expressive, and context-aware speech generation that adapts tone, emotion, and pacing directly from input text. The system is trained on massive multilingual datasets, enabling support... -
9
AWS Neuron
Powering Amazon custom machine learning chips
AWS Neuron is a software development kit (SDK) for running machine learning inference using AWS Inferentia chips. It consists of a compiler, run-time, and profiling tools that enable developers to run high-performance and low latency inference using AWS Inferentia-based Amazon EC2 Inf1 instances. Using Neuron developers can easily train their machine learning models on any popular framework such as TensorFlow, PyTorch, and MXNet, and run it optimally on Amazon EC2 Inf1 instances. You can continue to use the same ML frameworks you use today and migrate your software onto Inf1 instances with minimal code changes and without tie-in to vendor-specific solutions. ... -
Cut Data Warehouse Costs by 54%BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
-
10
LoopVectorization.jl
Macro(s) for vectorizing loops
LoopVectorization.jl is a Julia package for accelerating numerical loops by automatically applying SIMD (Single Instruction, Multiple Data) vectorization and other low-level optimizations. It analyzes loops and generates highly efficient code that leverages CPU vector instructions, making it ideal for performance-critical computing in fields such as scientific computing, signal processing, and machine learning. -
11
SFBAudioEngine
A powerhouse of audio functionality for macOS, iOS, and tvOS
SFBAudioEngine is an advanced audio engine designed for macOS and iOS, focusing on high-quality playback, precise audio control, and support for a wide range of audio formats. Built for modern Apple platforms, it provides developers with a robust tool for integrating sophisticated audio functionalities into their applications. It emphasizes extensibility, performance, and clean API design. -
12
XMRig Proxy
Monero (XMR) Stratum protocol proxy
Extremely high-performance CryptoNote stratum protocol proxy. Works with any pool and any miner with nicehash support. Can easily handle over 100K connections on a cheap $5 (1024 MB) virtual machine. Reduce the number of pool connections up to 256 times, 100K workers become just 391 workers on the pool side. Written on C++/libuv same as XMRig miner. -
13
Apache Spark
A unified analytics engine for large-scale data processing
...Spark’s execution engine handles scheduling, shuffles, caching, and data locality so users can focus on transformations rather than infrastructure plumbing. With Spark Streaming (microbatches) and Structured Streaming, it delivers low-latency event processing suitable for real-time analytics. The built-in MLlib library provides scalable machine learning algorithms, while GraphX enables graph computations integrated with data pipelines. Spark supports multiple languages—Scala, Java, Python, R—and connects with many storage systems like HDFS, S3, Cassandra, and streaming platforms like Kafka, making it a versatile choice for big data workloads in analytics, ETL, and data science. -
14
Iperf 2
A means to measure network responsiveness and throughput
Throughput testing, latency testing, jitter measurement, packet loss measurement, TCP testing, UDP testing, ECN testing, L4S testing, responsiveness testing, bounceback testing, one-way delay measurement, histogram reporting, multicast testing, IPv6 support, parallel streams, bidirectional testing, full-duplex testing, congestion-control testing, socket pacing, CSV output, embedded systems support Current release: 2.2.2, Sept 29 , 2026 About iperf 2 and iperf3: Read about the differences between these programs at https://iperf2.sourceforge.io/IperfCompare.html Man page: https://iperf2.sourceforge.io/iperf-manpage.html Manual: https://iperf2.sourceforge.io/iperf2-user-manual.html -
15
Step 3.5 Flash
Fast, Sharp & Reliable Agentic Intelligence
...Unlike dense models that activate all their parameters for every token, Step 3.5 Flash uses a sparse Mixture-of-Experts (MoE) architecture that selectively engages only about 11 billion of its roughly 196 billion total parameters per token, delivering high-quality reasoning and interaction at far lower compute cost and latency than traditional large models. Its design targets deep reasoning, long-context handling, coding, and real-time responsiveness, making it suitable for building autonomous agents, advanced assistants, and long-chain cognitive workflows without sacrificing performance. -
16
Blocky
Fast and lightweight DNS proxy as ad-blocker for local network
...Unlike a single-purpose blocker, it supports advanced DNS behavior such as conditional forwarding and custom resolution for specific domains, letting you shape traffic in ways that fit split-horizon DNS, internal services, or privacy-focused upstream strategies. Performance is a major focus, with configurable caching, prefetching, and the ability to use multiple upstream resolvers simultaneously to reduce latency and avoid single points of failure. -
17
imagor
Fast, secure image processing server and Go library, using libvips
...It supports a wide variety of image formats and integrates seamlessly with cloud storage backends like AWS S3 and Google Cloud Storage. With support for HTTP and gRPC APIs, Imagor can be used in production environments to serve optimized images dynamically with high performance and low latency. -
18
MediaDevices
Go implementation of the MediaDevices API
mediadevices is a Go library developed by the Pion WebRTC team that enables real-time access to audio and video devices for building native Go applications involving media streaming and conferencing. It provides a cross-platform, unified API for capturing and manipulating media streams and is often used in combination with Pion WebRTC for peer-to-peer communications. Its support for device enumeration, media constraints, and frame processing makes it a powerful building block for custom... -
19
Spegel
Stateless cluster local OCI registry mirror.
Spegel is a distributed container image registry mirror designed to speed up container image pulls in large-scale Kubernetes clusters. It locally mirrors container images to cluster nodes, reducing latency and bandwidth consumption during container deployments. Spegel integrates natively with containerd and CRI-O, ensuring seamless operation in container runtimes without changing workflows. It’s particularly useful for air-gapped, edge, or resource-constrained environments where access to remote registries is slow or restricted. -
20
MagicAPI AI Gateway
Built for demanding AI workflows
The world's fastest AI Gateway proxy, written in Rust and optimized for maximum performance. This high-performance API gateway routes requests to various AI providers (OpenAI, GROQ) with streaming support, making it perfect for developers who need reliable and blazing-fast AI API access. -
21
Nixtla TimeGPT
TimeGPT-1: production ready pre-trained Time Series Foundation Model
TimeGPT is a production ready, generative pretrained transformer for time series. It's capable of accurately predicting various domains such as retail, electricity, finance, and IoT with just a few lines of code. Whether you're a bank forecasting market trends or a startup predicting product demand, TimeGPT democratizes access to cutting-edge predictive insights, eliminating the need for a dedicated team of machine learning engineers. A generative model for time series. TimeGPT is capable of... -
22
xkcptun
xkcptun is kcp tunnel for OpenWRT&LEDE, implemented in c language
...It is mainly designed for embedded and router-oriented environments such as LEDE and OpenWrt, where lightweight networking tools are often preferred. The project provides client and server components that use KCP-based tunneling to improve performance over unreliable or high-latency network links. It also includes a spy utility, making the generated build more than a minimal two-binary tunnel setup. xkcptun can be built with CMake and supports static linking for easier deployment on constrained systems. It is most relevant to users who need a compact KCP tunnel implementation for routers, gateways, and custom network appliances. -
23
Jaeger
Monitor and troubleshoot transactions in complex distributed systems
As on-the-ground microservice practitioners are quickly realizing, the majority of operational problems that arise when moving to a distributed architecture are ultimately grounded in two areas: networking and observability. It is simply an orders of magnitude larger problem to network and debug a set of intertwined distributed services versus a single monolithic application. Jaeger, inspired by Dapper and OpenZipkin, is a distributed tracing system released as open source by Uber... -
24
Gatling
Modern Load Testing as Code
Gatling is a high-performance load testing tool built on the JVM that emphasizes realism, scalability, and developer ergonomics. Test scenarios are scripted in a concise Scala-based DSL, allowing you to model user journeys with think times, feeders (dynamic data), checks, and assertions all in code. Its asynchronous, non-blocking engine (backed by Netty) can drive very high concurrency from a single injector, reducing the need for large injector farms. Gatling supports HTTP out of the box as... -
25
Apache Impala
Apache Impala
Impala provides low latency and high concurrency for BI/analytic queries on the Hadoop ecosystem, including Iceberg, open data formats, and most cloud storage options. Impala also scales linearly, even in multitenant environments. Impala is integrated with native Hadoop security and Kerberos for authentication, and via the Ranger module, you can ensure that the right users and applications are authorized for the right data.
