Search Results for "latency" - Page 10
Sort By:
Showing 661 open source projects for "latency"
View related business solutions-
Demo Series - Small Business Backup By VeeamWatch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
1
LLM Gateway
Route, manage, and analyze your LLM requests across multiple providers
LLM Gateway is an open-source middleware that consolidates interactions with multiple LLM providers—such as OpenAI, Anthropic, Google Vertex AI—behind a single, unified API compatible with OpenAI's spec. Designed for both self-hosted and cloud use, it enables developers to route requests dynamically, secure and manage API keys, monitor token usage and costs, and analyze performance metrics. With optional UI, telemetry, and Docker deployment, it's ideal for teams aiming to centralize LLM... -
2
conflux-rust
The official Rust implementation of Conflux protocol
conflux-rust is the Rust implementation of Conflux, a high-performance Layer 1 blockchain designed to deliver high throughput without compromising decentralization or security. Conflux introduces a Tree-Graph consensus mechanism that allows parallel block processing while maintaining consensus integrity. This implementation focuses on performance and is compatible with the Ethereum Virtual Machine (EVM), enabling developers to deploy smart contracts written for Ethereum. It provides a robust... -
3
Matchbox
Painless peer-to-peer WebRTC networking for rust wasm
Matchbox is a WebRTC-based networking library for the Bevy game engine, enabling multiplayer games to run in the browser or native environments with peer-to-peer communication. It handles matchmaking, NAT traversal, and synchronization in real-time, making it easier for game developers to add fast and scalable multiplayer features. Designed with simplicity and performance in mind, Matchbox supports both WebAssembly and desktop targets. It’s especially useful for browser-based games that need... -
4
atk4/data
Data Access PHP Framework for SQL & high-latency databases
ATK Data is a data persistence and modeling framework for PHP, developed as part of the Agile Toolkit. It provides a high-level abstraction for working with databases, making it easier to define and manipulate data models with minimal boilerplate code. It supports various SQL and NoSQL databases and integrates seamlessly with Agile UI and other PHP frameworks. -
Cut Data Warehouse Costs by 54%BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
-
5
Zep
Zep: A long-term memory store for LLM / Chatbot applications
Easily add relevant documents, chat history memory & rich user data to your LLM app's prompts. Understands chat messages, roles, and user metadata, not just texts and embeddings. Zep Memory and VectorStore implementations are shipped with your favorite frameworks: LangChain, LangChain.js, LlamaIndex, and more. Automatically embed texts and messages using state-of-the-art opeb source models, OpenAI, or bring your own vectors. Zep’s local embedding models and async enrichment ensure a snappy... -
6
SOFAJRaft
A production-grade java implementation of RAFT consensus algorithm
SOFAJRaft is a production-level, high-performance Java implementation based on the RAFT consistency algorithm that supports MULTI-RAFT-GROUP for high-load, low-latency scenarios. With SOFAJRaft you can focus on your business area. SOFAJRaft handles all RAFT-related technical challenges. SOFAJRaft is very user-friendly, which provides several examples, making it easy to understand and use. -
7
AutomatedLab
Framework that lets you deploy complex labs on HyperV and Azure
...There are only two requirements you need to make sure: You need the DVD ISO images and a Hyper-V host or an Azure subscription. Requires Windows Management Framework 5+ (Windows). Requires Intel VT-x or AMD/V capable CPU, a decent amount of RAM, and low-latency high-throughput storage (No spinning disks please, as there are issues related to them). This solution supports setting up virtual machines with Windows 7, 2008 R2, 8 / 8.1 and 2012 / 2012 R2, 10 / 2016, 2019, and SQL Server 2008, 2008R2, 2012, 2014, 2016, 2017, 2019. -
8
MiGPT-Next
Let the Xiaoai speaker "listen to you"
...It can be launched through Docker or installed as the @mi-gpt/next Node.js package. Unlike the earlier MiGPT release, the newer implementation removed continuous conversation and streaming response support because of API latency and device-state limitations. The repository is no longer maintained, but it remains useful as an example of programmable XiaoAI response routing. -
9
GR00T Whole-Body Control (WBC)
Welcome to GR00T Whole-Body Control (WBC)
...A C++ and TensorRT inference stack provides real-hardware deployment, while PyTorch checkpoints support Isaac Lab evaluation and continued training. The repository also includes VR teleoperation, data collection, kinematic planning, and low-latency control configurations. MotionBricks adds real-time latent motion generation for interactive animation and robotics applications. -
Paessler - Monitor Your Whole Network in MinutesWaiting weeks for a monitoring rollout isn't an option when infrastructure doesn't stop running. PRTG's auto-discovery scans your network and suggests from over 200 pre-configured sensor types, so you're watching servers, applications and devices within minutes, not after a multi-week deployment. Enterprise-strength monitoring, without the enterprise complexity. Start your free trial today.
-
10
Tailslayer
Library for reducing tail latency in RAM reads
Tailslayer is a cybersecurity and forensic analysis tool designed to extract and analyze artifacts from Tails OS environments. It focuses on uncovering traces of activity in systems that are designed to be privacy-preserving and ephemeral. The tool helps investigators identify residual data such as logs, configurations, or usage traces that may persist despite Tails’ security features. It is particularly relevant for digital forensics and research into privacy systems. Tailslayer emphasizes... -
11
Ollama Grid Search
A multi-platform desktop application to evaluate and compare LLM
...The system integrates directly with local or remote Ollama servers, enabling seamless access to models already deployed in a user’s environment. It also includes experiment logging and A/B testing capabilities, which allow users to compare outputs side by side and track performance metrics such as latency or token usage. -
12
ty
An extremely fast Python type checker and language server
...It is positioned as a next-generation alternative to tools such as mypy and Pyright, offering significantly faster performance through incremental analysis and optimized execution. The tool is designed from the ground up to power editor integrations, enabling real-time feedback as developers write code with minimal latency. ty includes advanced type system capabilities such as intersection types, improved type inference, and detailed diagnostics that help identify issues even in partially typed codebases. It supports integration with multiple development environments through its language server implementation, providing features like code navigation, auto-completion, and inline hints. -
13
EFAK-AI
A AI-Driven, Distributed and high-performance monitoring system
EFAK (Eagle For Apache Kafka) is an open-source monitoring and management platform designed to provide comprehensive visibility and operational control over Apache Kafka clusters through a unified web interface. The project focuses on simplifying Kafka administration by offering real-time insights into cluster health, performance metrics, and consumer activity, allowing engineers to quickly diagnose issues and optimize system behavior. It integrates advanced features such as intelligent... -
14
Hugging Face - Speech To Speech
Open speech-to-speech models and pipelines by Hugging Face toolkit AI
...It also serves as a foundation for building real-time or batch audio transformation systems. Overall, it highlights an emerging approach to voice technology that reduces latency and preserves more of the original speech characteristics. -
15
DFlash
Block Diffusion for Ultra-Fast Speculative Decoding
...This approach has been shown to deliver lossless acceleration on models like Qwen3-8B by combining block diffusion techniques with efficient batching, making it ideal for applications where latency and cost matter. The project includes support for multiple draft models, example integration code, and scripts to benchmark performance, and it is structured to work with popular model serving stacks like SGLang and the Hugging Face Transformers ecosystem. -
16
DevDocs
API Documentation Browser
...The repository includes scripts for updating doc sources, building, and deploying the documentation site. Because it is meant as a reference tool, performance and usability (e.g. fast search, minimal latency) are emphasized in design. -
17
Phoenix LiveView
Rich, real-time user experiences with server-rendered HTML
Phoenix LiveView is an Elixir library that enables rich, real-time user experiences by using server-rendered HTML over WebSockets, providing seamless dynamic interactivity without needing front-end JavaScript frameworks. It integrates deeply with Phoenix and ships by default in new Phoenix applications. LiveView brings a unified experience to building web applications. You no longer have to split work between client and server, across different toolings, layers, and abstractions. Instead,... -
18
Dragonfly
A modern replacement for Redis and Memcached
...The power of modern cloud hardware can never be realized with legacy software. Dragonfly is optimized for modern cloud computing, delivering 25x more throughput and 12x lower snapshotting latency when compared to legacy in-memory data stores like Redis, making it easy to deliver the real-time experience your customers expect. Scaling Redis workloads is expensive due to their inefficient, single-threaded model. Dragonfly is far more compute and memory efficient, resulting in up to 80% lower infrastructure costs. Dragonfly scales vertically first, only requiring clustering at an extremely high scale. ... -
19
Helicone
Open source LLM-Observability Platform for Developers
Open source LLM-Observability Platform for Developers. One-line integration for monitoring, metrics, evals, agent tracing, prompt management, playground, etc. Supports OpenAI SDK, Vercel AI SDK, Anthropic SDK, LiteLLM, LLamaIndex, LangChain, and more. -
20
Agrona
High Performance data structures and utility methods for Java
Agrona provides a library of data structures and utility methods that are a common need when building high-performance applications in Java. Many of these utilities are used in the Aeron efficient reliable UDP unicast, multicast, and IPC message transport and provides high-performance buffer implementations to support the Simple Binary Encoding Message Codec. -
21
django-prometheus
Export Django monitoring metrics for Prometheus.io
...This library provides Prometheus metrics for Django-related operations. Prometheus uses Histogram based grouping for monitoring latencies. You can define custom buckets for latency, adding more buckets decreases performance but increases accuracy. SQLite, MySQL, and PostgreSQL databases can be monitored. Just replace the ENGINE property of your database, replacing django.db.backends with django_prometheus.db.backends. You may want to monitor the creation/deletion/update rate for your model. This can be done by adding a mixin to them. ... -
22
TensorFlow Model Optimization Toolkit
A toolkit to optimize ML models for deployment for Keras & TensorFlow
The TensorFlow Model Optimization Toolkit is a suite of tools for optimizing ML models for deployment and execution. Among many uses, the toolkit supports techniques used to reduce latency and inference costs for cloud and edge devices (e.g. mobile, IoT). Deploy models to edge devices with restrictions on processing, memory, power consumption, network usage, and model storage space. Enable execution on and optimize for existing hardware or new special purpose accelerators. Choose the model and optimization tool depending on your task. ... -
23
dqlite
Embeddable, replicated and fault tolerant SQL engine
...It uses C-Raft, an optimised Raft implementation in C, to gain high-performance transactional consensus and fault tolerance while preserving SQlite’s outstanding efficiency and tiny footprint. Stable Golang client and a documented wire protocol for other languages. Runs on ARM, X86, POWER and IBM Z architectures. C-Raft is tuned to minimize transaction latency. C-Raft and dqlite are both written in C for maximum cross-platform portability. Published under the LGPLv3 license with a static linking exception for maximum compatibility. Includes common CLI pattern for database initialization and voting member joins and departures. -
24
Shairport Sync
AirPlay audio player
Shairport Sync adds multi-room capability with audio synchronization. Shairport Sync is an AirPlay 1 audio player. Switch to the development branch for a version with limited AirPlay 2 functionality. Shairport Sync plays audio streamed from iTunes, iOS, Apple TV and macOS devices and AirPlay sources such as Quicktime Player and OwnTone, among others. Audio played by a Shairport Sync-powered device stays synchronized with the source and hence with similar devices playing the same source. In... -
25
CF-Workers-SUB
Aggregates any of your nodes with multiple subscriptions
CF-Workers-SUB is a project that uses Cloudflare Workers to aggregate or convert multiple subscription sources (for proxy nodes/configs) into a personalized subscription link for the user. Essentially, it lets you input your own node(s) and then generate a unified subscription endpoint that others can use with tools like Clash, Sing-box, or V2Ray. The repository emphasizes being user-friendly for scenarios where one has many proxy/node links but wants to streamline into a single subscription...
