Search Results for "latency" - Page 7
Sort By:
Showing 661 open source projects for "latency"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
One Monitoring Tool for IT, OT and Cloud | Free TrialModern infrastructure spans data centers, cloud platforms and factory floors, and every blind spot between them is a risk. PRTG supports SNMP, WMI, SSH and other standard protocols to monitor IT, OT and hybrid environments through one customizable dashboard. Build the views your team needs, from network health to application performance, without switching tools. Try PRTG free for 30 days now.
-
1
RSocket
Java implementation of RSocket
...RSocket is intended to be consumed via one of the various implementation libraries which implement the RSocket Protocol. By default to make RSocket easier to use it copies the incoming Payload. Copying the payload comes at cost to performance and latency. If you want to use zero copy you must disable this. To disable copying you must include a payloadDecoder argument in your RSocketFactory. This will let you manage the Payload without copying the data from the underlying transport. You must free the Payload when you are done with them or you will get a memory leak. Used correctly this will reduce latency and increase performance. -
2
TensorFlow Serving
Serving system for machine learning models
TensorFlow Serving is a flexible, high-performance serving system for machine learning models, designed for production environments. It deals with the inference aspect of machine learning, taking models after training and managing their lifetimes, providing clients with versioned access via a high-performance, reference-counted lookup table. TensorFlow Serving provides out-of-the-box integration with TensorFlow models, but can be easily extended to serve other types of models and data. The... -
3
Zipkin
Distributed tracing system to gather timing data
Zipkin is a distributed tracing system. It helps gather timing data needed to troubleshoot latency problems in service architectures. Features include both the collection and lookup of this data. If you have a trace ID in a log file, you can jump directly to it. Otherwise, you can query based on attributes such as service, operation name, tags and duration. Some interesting data will be summarized for you, such as the percentage of time spent in a service, and whether or not operations failed. ... -
4
RealtimeTTS
Converts text to speech in realtime
RealtimeTTS is a low-latency text-to-speech library built for real-time applications such as voice chat with LLMs, assistants, and interactive tools. It is designed around a streaming model: you can feed it text incrementally (for example, as an LLM responds) and get audio output almost immediately, which keeps end-to-end latency very low. The library is engine-agnostic and plugs into a wide range of cloud and local TTS systems, including OpenAI, ElevenLabs, Azure, Coqui, Piper, StyleTTS2, Edge TTS, Google TTS, system TTS and others, so you can swap providers without rewriting your pipeline. ... -
Veeam Data Platform v13.1 - Get Your Free TrialTry Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
5
Vercel Storage
Vercel Postgres, KV, Blob, and Edge Config
Vercel Storage is a unified SDK and platform integration layer for accessing various storage backends like Redis, Postgres, and KV stores. It simplifies reading, writing, and managing data in serverless applications hosted on Vercel. The SDK provides a consistent developer experience with optimized performance for edge functions. -
6
Thulite
Web framework designed for speed, security, and SEO
Thulite is an AI-powered search and recommendation engine that enhances search functionality in applications. It provides intelligent query processing, result ranking, and personalized recommendations. -
7
BemiDB
Postgres read replica optimized for analytics
BemiDB is a high-performance, key-value database designed for efficient data retrieval and storage, optimized for applications requiring fast read and write operations. -
8
Quill Library
Asynchronous Low Latency C++ Logging Library
Quill is a high-performance asynchronous logging library. It is particularly suited for performance-critical applications where every microsecond counts. -
9
podinfo
Go microservice template for Kubernetes
Podinfo is a tiny web application made with Go that showcases the best practices of running microservices in Kubernetes. Podinfo is used by CNCF projects like Flux and Flagger for end-to-end testing and workshops. -
Build Securely on AWS with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
10
MQTT X
Powerful cross-platform MQTT 5.0 desktop, CLI, and WebSocket client
...MQTT stands for MQ Telemetry Transport. It is a publish/subscribe, extremely simple and lightweight messaging protocol, designed for constrained devices and low-bandwidth, high-latency or unreliable networks. To run MQTT Broker locally, EMQX is recommended: An Open-Source, Cloud-Native, Distributed MQTT Broker for IoT. After the MQTT is connected successfully, you can perform MQTT publish and subscription tests. -
11
AWL
Securely connect your devices into a private network
...By leveraging WireGuard tunneling and built-in NAT traversal, AWL facilitates seamless device connectivity at the IP level, enabling users to access services like SSH, RDP, or self-hosted applications without complex configurations. Its decentralized architecture ensures that traffic flows directly between devices, enhancing privacy and reducing latency. AWL is particularly beneficial for scenarios such as remote work, gaming, or accessing geographically restricted content. -
12
LLaMA 3
The official Meta Llama 3 GitHub site
This repository is the former home for Llama 3 model artifacts and getting-started code, covering pre-trained and instruction-tuned variants across multiple parameter sizes. It introduced the public packaging of weights, licenses, and quickstart examples that helped developers fine-tune or run the models locally and on common serving stacks. As the Llama stack evolved, Meta consolidated repositories and marked this one deprecated, pointing users to newer, centralized hubs for models,... -
13
Pipecat
Framework for building real-time voice and multimodal AI agents
...It provides developers with tools to orchestrate complex pipelines that combine speech recognition, language models, audio processing, and speech synthesis into a cohesive conversational system. Pipecat focuses on low-latency interactions so voice conversations with AI feel natural and responsive during live use. Pipecat allows applications to integrate multiple AI services and transports, enabling flexible deployment across different environments and communication channels. Developers can create a wide range of interactive systems including voice assistants, customer service agents, interactive storytelling applications, and multimodal interfaces that combine voice, video, images, and text. ... -
14
gpt-oss-safeguard
Safety reasoning models built-upon gpt-oss
...Rather than just outputting a numeric “safety score,” it is trained to reason about content with respect to a user-provided policy, allowing flexible, customizable moderation definitions rather than fixed rules — ideal when different platforms have different safety standards. The model comes in at least two variants: a large 120B-parameter version for heavy-duty, high-accuracy reasoning, and a 20B-parameter version optimized for lower latency or smaller compute resources. At inference time you supply both the content and your own safety policy (written in a structured prompt), and the model will evaluate the content and return its justification — enabling transparent, auditable moderation decisions. It supports running fully locally or in private infrastructure (no mandatory cloud dependence). -
15
Bailing
Bailing is a voice dialogue robot similar to GPT-4o
...The project is modular: each core function — ASR, VAD, LLM, TTS — exists as a separately replaceable component, which allows flexibility in picking your preferred models depending on resources or languages. It aims to be light enough to run without a GPU, making it usable on modest hardware or edge devices, while still maintaining low latency and smooth interaction. Bailing includes a memory system, giving the assistant the ability to remember user preferences and context across sessions, which enables more personalized and context-aware conversations. -
16
Code-Mode
Plug-and-play library to enable agents to call MCP and UTCP tools
...The repository contains both TypeScript and Python libraries, plus a code-mode-mcp component for integrating with MCP and UTCP ecosystems. Benchmarks in the README highlight improvements in latency and token cost for scenarios involving multiple tools, showing that code execution often outperforms traditional JSON-based function calling. -
17
Lyrion Music Server
Server for Squeezebox and compatible players
...It scans folders for music and cover art, builds fast search indexes, and serves rich metadata to web, mobile, and player UIs. Playback can be synchronized across rooms with per-player volume and latency controls, and it supports a wide range of formats via built-in decoders and on-the-fly transcoding. A powerful plugin system adds services like internet radio, podcasts, and streaming platforms, as well as utilities for alarms, lyrics, and advanced tagging. Administration happens through a friendly web interface, with options for library rescans, playlist management, and performance tuning on small devices like the Raspberry Pi. ... -
18
TEN
Open-source framework for conversational voice AI agents
TEN (Transformative Extensions Network) is an open source framework designed to empower developers to build real-time multimodal AI agents capable of voice, video, text, image, and data-stream interaction with ultra-low latency. It includes a full ecosystem, TEN Turn Detection, TEN Agent, and TMAN Designer, allowing developers to rapidly assemble human-like, responsive agents that can see, speak, hear, and interact. With support for languages like Python, C++, and Go, it offers flexible deployment on both edge and cloud environments. Using components like graph-based workflow design, drag-and-drop UI (via TMAN Designer), and reusable extensions such as real-time avatars, RAG (Retrieval-Augmented Generation), and image generation, TEN enables highly customizable, scalable agent development with minimal code. -
19
ReductStore
The fastest time series object store for Edge AI
...Merge blob and time series functionalities, reducing the need for multiple databases. Customize real-time data retention policies and replication strategies. Store billions of time-stamped blobs with AI labels and access them with low latency. Outperform other databases with a customized solution for time-series object data. Capture and access blob data as time series, tailored for edge computing, computer vision, and IoT. ReductStore handles blob data without size limits; your disk capacity is the only boundary. Ensure optimal storage management with FIFO quotas, preventing disk space shortages in real-time. ... -
20
Fortio
Fortio load testing library, command line tool, advanced echo server
...Fortio is a fast, small (4Mb docker image, minimal dependencies), reusable, embeddable go library as well as a command line tool and server process, the server includes a simple web UI and REST API to trigger run and see graphical representation of the results (both a single latency graph and a multiple results comparative min, max, avg, qps and percentiles graphs). -
21
SigNoz
SigNoz is an open-source APM. It helps developers monitor their apps
...SigNoz uses distributed tracing to gain visibility into your software stack. Visualise Metrics, Traces and Logs in a single pane of glass. You can see metrics like p99 latency, error rates for your services, external API calls and individual end points. You can find the root cause of the problem by going to the exact traces which are causing the problem and see detailed flamegraphs of individual request traces. Run aggregates on trace data to get business relevant metrics. Filter and query logs, build dashboards and alerts based on attributes in logs. -
22
Model Explorer
A modern model graph visualizer and debugger
Model Explorer is a visual tool for exploring, debugging, and optimizing ML models deployed on edge devices. Developed by Google AI Edge, it offers a browser-based interface to inspect layer-wise performance, memory usage, and inference timing of TensorFlow Lite and other supported models. It’s a powerful utility for developers optimizing models for constrained environments. -
23
PersonaLive
Expressive Portrait Image Animation for Live Streaming
...It leverages deep generative models that condition on a static reference image and a driving input (such as motion or expression cues) to produce a seamless animated portrait sequence that can run indefinitely without segmentation artifacts. The framework prioritizes low-latency and streamable output, making it suitable for real-time creative workflows, broadcast overlays, or interactive avatars on consumer-grade GPUs. PersonaLive’s architecture balances visual quality and efficiency by combining motion encoding, temporal modules, and hybrid implicit control signals to preserve identity and stable expression through long sequences. -
24
Perplexica
Perplexica is an AI-powered answering engine.
...Powered by SearxNG, it aggregates results from multiple search engines while keeping your identity and queries private. Perplexica offers multiple search modes—Speed, Balanced, and Quality—so you can trade off latency and depth depending on the task. It also enhances the experience with widgets and rich search types like images, videos, and domain-limited queries. With local search history, file uploads, and an easy Docker-based setup, it’s built for everyday research without sacrificing control or privacy. -
25
Lesan
New way to create web server and NoSQL data model
Lesan is a multilingual text processing and translation library designed for natural language processing (NLP) applications. It provides tools for text normalization, tokenization, and translation across multiple languages.
