Search Results for "latency" - Page 13
Sort By:
Showing 661 open source projects for "latency"
View related business solutions-
Demo Series - Small Business Backup By VeeamWatch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
-
Paessler - Monitor Your Whole Network in MinutesWaiting weeks for a monitoring rollout isn't an option when infrastructure doesn't stop running. PRTG's auto-discovery scans your network and suggests from over 200 pre-configured sensor types, so you're watching servers, applications and devices within minutes, not after a multi-week deployment. Enterprise-strength monitoring, without the enterprise complexity. Start your free trial today.
-
1
Tyrus
Eclipse Tyrus is the open source JSR 356 - Java API for WebSocket
...WebSocket protocol defined by IETF provides bi-directional communication between the server and the remote host. The pros are mainly the ability to communicate both ways, low latency and small communication overhead. Therefore Tyrus and WebSocket in general are suitable for web applications that require sending a huge volume of relatively small messages like online games or market ticker broadcasting. -
2
OxidizeBot
High performance Twitch bot in Rust
...OxidizeBot doesn't cost you anything, and its source code is available on GitHub for anyone to tinker with! Plays music moderates your chat, plays games, you name it! You own your data. It uses your internet for the best possible latency. It's light on system resources*. And running locally means it can perform rich interactions with your games like Chaos%. -
3
Ristretto
A high performance memory-bound Go cache
...We then repurposed Groupcache’s LRU, using mutex locks for thread safety. After having it around for a year, we noticed that the cache suffered from severe contention. A commit to remove that cache caused our query latency to dramatically improve by 5-10x. In essence, our cache was slowing us down! We concluded that the concurrent cache story in Go is broken and must be fixed. In March, we wrote about the State of Caching in Go, mentioning the problem of databases and systems requiring a smart memory-bound cache which can scale to the multi-threaded environment Go programs find themselves in. -
4
Asynq
Simple, reliable, and efficient distributed task queue in Go
Asynq is a Go library for queueing tasks and processing them asynchronously with workers. It's backed by Redis and is designed to be scalable yet easy to get started. Client puts tasks on a queue. Server pulls tasks off queues and starts a worker goroutine for each task. Tasks are processed concurrently by multiple workers. Task queues are used as a mechanism to distribute work across multiple machines. A system can consist of multiple worker servers and brokers, giving way to high... -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
5
YugabyteDB
The high-performance distributed SQL database for global apps
...Achieve continuous availability during infrastructure failures and on maintenance tasks such as software upgrades and distributed backups. Use powerful replication and data geo-partitioning capabilities to achieve the latency, resilience, and compliance your applications need. Deploy YugabyteDB in public, private, and hybrid cloud environments, on VMs, containers, or bare metal. Lower TCO for dev, staging, and production deployments. Powering a wide range of cloud-native workloads. Risk-free migration from on-prem to the cloud. -
6
PostGraphile
Execute a command and get an instant high-performance GraphQL API
...It eliminates the problems of over- and under-fetching, incorporates strong data types, has built-in introspection, documentation and deprecation capabilities, and is implemented in many programming languages. This all leads to gloriously low-latency user experiences, better developer experiences, and much increased productivity. Because of all this, GraphQL is typically used as a replacement for (or companion to) RESTful API services. PostgreSQL is the self-proclaimed “world’s most advanced open source database,” with each new release bring more amazing features and performance gains. ... -
7
NativeMind Extension
Your fully private, open-source, on-device AI assistant
...The extension is aimed at everyday browser workflows, offering features like multi-tab context awareness, webpage summarization, document understanding, contextual toolbars, and AI-assisted rewriting directly inside the browsing experience. Because it runs locally after setup, it is also positioned as an always-available assistant that avoids API quotas, network latency, and service outages common in cloud-based AI tools. -
8
Light-4J
A fast, lightweight and more productive microservices framework
...In 2014, I realized that the IT industry was moving from Monolithic to Microservices and from on-premise data centers to the public clouds. To reduce the production cost for my applications, I need to find a lightweight platform that has a small memory footprint, high throughput, and low latency in Java. Java EE and Spring/Spring Boot are too heavy to be considered. Other lightweight Java platforms all have different issues on the separation between the business logic and technical cross-cutting concerns. Moreover, they are not cloud-native or designed for container/cloud. -
9
Polly
A .NET resilience and transient-fault-handling library for policies
...Today's cloud application, mobile, data-streaming, and IoT technologies all depend vitally on reliable connectivity. But underlying systems can fail, and networks are notoriously fickle, outages, latency, transient blips, spikes in load, all challenge 100% reliability. Polly helps you navigate the unreliable network. By providing resilience strategies in fluent-to-express policies such as Retry, WaitAndRetry, and CircuitBreaker, Polly can help you reduce fragility, and keep your systems and customers connected. Example usages are fault-tolerance for any distributed systems and inter-process calls, such as WCF, RESTful calls between microservices, calls to cloud services, Internet of Things connectivity, etc. -
Build Securely on AWS with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
10
Open Gauss
Project-scoped Lean workflow orchestrator from Math, Inc.
...One of its defining strengths is its optimization for multi-core and distributed environments, allowing it to efficiently process high volumes of concurrent transactions with minimal latency. OpenGauss also incorporates AI-based optimization techniques, such as intelligent query planning, performance prediction, and automated tuning, which help reduce operational complexity and improve efficiency. -
11
Cloud Storage FUSE
A user-space file system for interacting with Google Cloud Storage
...The tool is particularly valuable in data-intensive workflows such as machine learning, where large datasets can be accessed on demand without requiring full local downloads. It supports performance optimizations like file caching, which stores frequently accessed data on local storage to significantly improve throughput and reduce latency. The system integrates with cloud-native environments such as Kubernetes and can be used in distributed architectures where multiple compute nodes access shared datasets. -
12
Grafbase
The Grafbase GraphQL Federation Gateway
...By supporting GraphQL federation standards, the platform enables teams to combine multiple subgraphs or services into a unified schema that clients can query as a single endpoint. Grafbase is designed for large-scale production environments, emphasizing high throughput, low latency, and efficient resource usage through its Rust implementation. The system also includes tools for schema governance, API lifecycle management, and collaboration workflows, helping engineering teams safely evolve complex APIs over time. -
13
FlexLLMGen
Running large language models on a single GPU
...This design allows organizations to deploy powerful language models for high-volume tasks without the infrastructure costs typically associated with large-scale AI systems. The project is particularly useful for workloads that prioritize throughput over latency, including benchmarking experiments and large corpus analysis. -
14
Chitu
High-performance inference framework for large language models
...The system also includes performance optimizations for large models, including support for quantized formats and efficient computation operators that reduce memory usage and latency. Its architecture aims to support enterprise adoption by ensuring stable long-term operation under production workloads. -
15
DeepSearcher
Open Source Deep Research Alternative to Reason and Search
...The project integrates with vector databases (including Milvus and related options) so organizations can index internal documents and query them with semantic retrieval. It also supports flexible embeddings, making it easier to choose different embedding models depending on domain requirements, latency targets, or accuracy goals. The overall workflow aims to minimize hallucinations by grounding outputs in retrieved material and then applying structured reasoning over that evidence before generating a final report. -
16
ttl
Fast, modern traceroute with real-time TUI, per-hop stats
ttl is a modern traceroute-style network diagnostic tool built to feel more like an interactive, real-time “mtr replacement” than a one-shot traceroute dump. It uses a full-screen terminal UI to continuously probe paths and refresh hop-by-hop measurements, which makes transient loss, jitter, and routing changes much easier to spot. The design emphasizes per-hop visibility with live statistics, and it enriches what you see by resolving network identity details like ASN and geolocation when... -
17
kgateway
The Cloud-Native API Gateway and AI Gateway
...It implements the Kubernetes Gateway API and can operate as both a lightweight in-cluster microgateway and a centralized gateway capable of handling billions of API calls with high performance and low latency. By integrating with Envoy and advanced data planes, it handles modern ingress concerns such as traffic routing, authentication, authorization, rate limiting, and observability for traditional HTTP/gRPC services and AI workloads alike. Beyond standard API traffic, kgateway also supports gateway patterns tailored for large language model (LLM) consumption, inference routing, and Model Context Protocol (MCP) orchestration, enabling secure access to models, tools, and agent interactions. -
18
Flowsurface
A native desktop charting platform for crypto markets
...This enables traders and analysts to understand actual executed trades, liquidity distribution, and tempo changes that often precede significant market movements. The platform connects directly to public exchange APIs and WebSocket streams from venues such as Binance, Bybit, and OKX, allowing low-latency real-time data ingestion without relying on third-party servers. Users can customize layouts across multiple panes, adjust aggregation intervals, and tailor the visual presentation to suit different trading strategies. -
19
Nethermind
A robust execution client for Ethereum node operators.
Nethermind is a high-performance, highly configurable Ethereum execution client built on .NET and designed for professional node operators. It provides fast synchronization, reliable JSON-RPC access, and support for major consensus mechanisms including PoS, Ethash, Clique, and AuRa. With features like Grafana dashboards and enterprise-grade logging, Nethermind makes monitoring and maintaining healthy nodes straightforward. Its architecture emphasizes speed and resilience, synchronizing to... -
20
v2flyNG
A V2Ray client for Android, support v2fly core
...Profiles can be added via subscription links or QR codes, and the app merges and updates them on schedule to keep node lists fresh. Per-app proxy controls allow you to include or exclude specific applications, which is useful for balancing privacy with bandwidth and latency. The client exposes routing controls, TLS settings, custom DNS, and UDP handling so advanced users can fine-tune behavior. Status panels and logs help diagnose connectivity issues and confirm that rules are being applied as intended. -
21
pgactive
PostgreSQL replication extension to create an active-active database
...Traditionally PostgreSQL supports active-standby setups (single writable master), but pgactive opens up use cases such as multi-region high-availability clusters, low-latency writes from distributed apps, and blue/green migrations where both sides are writable. It builds on PostgreSQL’s logical replication framework and offers mechanisms for conflict detection, resolution (e.g., last-write-wins), monitoring of lag and writes across nodes. Because active-active replication introduces new complexity (conflicts, schema changes, write amplification), pgactive provides tools for managing replication sets, conflict logging tables, and administrative commands to detach nodes or remove the extension. -
22
Bifrost
The Fastest LLM Gateway with built in OTel observability
...It is built to be high performance: in benchmark tests at 5,000 requests per second, it reportedly adds only microseconds of overhead and achieves perfect success rates with no failed requests. Bifrost supports features such as automatic fallback (failover between providers), load balancing across API keys/providers, and semantic caching to reduce latency and cost. It also includes observability with built-in metrics, tracing, logging, and supports governance features like rate limiting, access control, and cost budgeting. The architecture is modular: there is a core engine, plugin layers, and transport layers (HTTP APIs). -
23
xFormers
Hackable and optimized Transformers building blocks
xformers is a modular, performance-oriented library of transformer building blocks, designed to allow researchers and engineers to compose, experiment, and optimize transformer architectures more flexibly than monolithic frameworks. It abstracts components like attention layers, feedforward modules, normalization, and positional encoding, so you can mix and match or swap optimized kernels easily. One of its key goals is efficient attention: it supports dense, sparse, low-rank, and... -
24
3FS
A high-performance distributed file system
The 3FS repository (standing likely for “Feature 3F System” or similar) is focused on providing a feature extraction and transformation framework tailored to deep and large models, especially in token-based systems. Its primary aim is to support efficient and scalable feature transformation pipelines—especially for inference environments—by batching, caching, and integrating feature-based modules like segmenters, sparse retrievers, and scorers seamlessly. The repo includes APIs to define... -
25
Public Image Mirror
Many images are hosted overseas, such as GCR
...It uses a lazy-loading mechanism, caching image layers in third-party object storage, ensuring that frequently used images are delivered faster. The system is simple to use, requiring only a prefix replacement to pull images from the mirror instead of the original registry. By reducing latency and improving reliability, the service supports developers in accelerating Kubernetes, Docker, Containerd, and AI model image downloads in production environments.
