Search Results for "latency" - Page 2
Sort By:
Showing 46 open source projects for "latency"
View related business solutions-
Auth0 B2B Essentials: SSO, MFA, and RBAC Built InAuth0's B2B Essentials plan gives you everything you need to ship secure multi-tenant apps. Unlimited orgs, enterprise SSO, RBAC, audit log streaming, and higher auth and API limits included. Add on M2M tokens, enterprise MFA, or additional SSO connections as you scale.
-
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
1
FlashMLA
FlashMLA: Efficient Multi-head Latent Attention Kernels
FlashMLA is a high-performance decoding kernel library designed especially for Multi-Head Latent Attention (MLA) workloads, targeting NVIDIA Hopper GPU architectures. It provides optimized kernels for MLA decoding, including support for variable-length sequences, helping reduce latency and increase throughput in model inference systems using that attention style. The library supports both BF16 and FP16 data types, and includes a paged KV cache implementation with a block size of 64 to efficiently manage memory during decoding. On very compute-bound settings, it can reach up to ~660 TFLOPS on H800 SXM5 hardware, while in memory-bound configurations it can push memory throughput to ~3000 GB/s. ... -
2
Polly
A .NET resilience and transient-fault-handling library for policies
...Today's cloud application, mobile, data-streaming, and IoT technologies all depend vitally on reliable connectivity. But underlying systems can fail, and networks are notoriously fickle, outages, latency, transient blips, spikes in load, all challenge 100% reliability. Polly helps you navigate the unreliable network. By providing resilience strategies in fluent-to-express policies such as Retry, WaitAndRetry, and CircuitBreaker, Polly can help you reduce fragility, and keep your systems and customers connected. Example usages are fault-tolerance for any distributed systems and inter-process calls, such as WCF, RESTful calls between microservices, calls to cloud services, Internet of Things connectivity, etc. -
3
Size Limit
Calculate the real cost to run your JS app or lib
Size Limit is a JavaScript performance budget tool that measures the real cost of your JavaScript bundle and prevents regressions by enforcing limits in CI. It calculates not just raw bundle size, but also download and execution time under configurable network conditions, giving a more realistic sense of what users experience. The tool is modular: it offers a CLI and multiple plugins (file, webpack, time) plus presets tailored to different use cases, from big single-page apps to small npm... -
4
Centrifuge
Real-time messaging library for Go with scalability in mind
This library has no v1 release, API may change. Before v1 release patch version updates only have backward-compatible changes and fixes, minor version updates can have backward-incompatible API changes. Master branch can have unreleased code. Only two last Go minor versions are officially supported by this library. Centrifuge library is a real-time core of Centrifugo server. It's a general-purpose real-time messaging library for Go programming language. Real-time messaging can help create... -
Forever Free Full-Stack Observability | Grafana CloudBuilt on open standards like Prometheus and OpenTelemetry, Grafana Cloud includes Kubernetes Monitoring, Application Observability, Incident Response, plus the AI-powered Grafana Assistant. Get started with our generous free tier today.
-
5
Emoji Mart
One component to pick them all
Data required for the picker to work has been completely decoupled from the library. That gives developers the flexibility to better control their app bundle size and let them choose how and when this data is loaded. Callback when the Add custom emoji button is clicked. The button will only be displayed if this callback is provided. It is displayed when search returns no results. You can use custom emojis by providing an array of categories and their emojis. Emojis also support multiple skin... -
6
Competent Audio
Machine graph audio engine for computer games
Competent Audio (CA) is an audio engine suitable for video games. It is written in C, but is designed for interoperability with other languages. Windows and Linux binaries for x86 and amd64 are available. CA uses a machine graph model with support for arbitrary numbers of machines, limited only by the available system resources: - Samplers play back audio clips. - Mixers combine audio signals and optionally perform signal processing. - Sinks send audio signals to an output... -
7
CppServer
Fast and low latency asynchronous socket server & client C++ library
Ultra-fast and low latency asynchronous socket server & client C++ library with support TCP, SSL, UDP, HTTP, HTTPS, WebSocket protocols, and 10K connections problem solution. Cross platform (Linux, MacOS, Windows) Asynchronous communication. Supported CPU scalability designs: IO service per thread, thread pool. Supported transport protocols: TCP, SSL, UDP, UDP multicast. -
8
LMAX Disruptor
High performance inter-thread messaging library
LMAX aims to be the fastest trading platform in the world. Clearly, in order to achieve this we needed to do something special to achieve very low-latency and high-throughput with our Java platform. Performance testing showed that using queues to pass data between stages of the system was introducing latency, so we focused on optimising this area. The Disruptor is the result of our research and testing. We found that cache misses at the CPU-level, and locks requiring kernel arbitration are both extremely costly, so we created a framework which has "mechanical sympathy" for the hardware it’s running on, and that’s lock-free. ... -
9
Dragonboat
A feature complete and high performance multi-group Raft library in Go
Dragonboat is a high-performance multi-group Raft consensus library in pure Go. Consensus algorithms such as Raft provides fault tolerance by allowing a system to continue to operate as long as the majority of member servers are available. For example, a Raft shard of 5 servers can make progress even if 2 servers fail. It also appears to clients as a single entity with strong data consistency always provided. All Raft replicas can be used to handle read requests for aggregated read... -
8 Monitoring Tools in One APM. Install in 5 Minutes.AppSignal works out of the box for Ruby, Elixir, Node.js, Python, and more. 30-day free trial, no credit card required.
-
10
Index Advisor
PostgreSQL Index Advisor
...It passively monitors query patterns and recommends indexes to improve performance without requiring deep database expertise. This tool helps developers and DBAs reduce query latency and improve efficiency in production environments. -
11
Scalable-Software-Architecture
Collection of tech talks, papers and web links on Distributed Systems
Scalable-Software-Architecture gathers tech talks, academic papers, blog posts and web links related to building scalable software architecture, distributed systems, system design, and production-scale considerations. The aim is to help readers study how large systems operate: how to scale them, how to handle latency, failure, load, concurrency, and how to structure software for maintainability at scale. Because many interview and real-world engineering problems revolve around system design now, this collection serves as both prep material and a reference bank for engineers evolving beyond code to architecture. It promotes reading original source material (papers and talks) rather than merely summary blog posts, thereby helping practitioners deepen their mental models. ... -
12
CDN Up and Running
CDN Up and Running - Building a CDN from Scratch to Learn about CDN
...The project uses technologies such as Nginx, Lua, Docker, Prometheus, and Grafana to simulate realistic CDN environments and monitoring systems. It also explores performance considerations, including latency simulation, load balancing, and scalability. By integrating observability tools, it enables users to analyze system behavior and performance metrics. -
13
TengineKit
TengineKit - Free, Fast, Easy, Real-Time Face Detection
Free, Fast, Easy, Real-Time Face Detection & Face Landmarks & Face Attributes & Hand Detection & Hand Landmarks & Body Detection & Body Landmarks & Iris Landmarks & Yolov5 SDK On Mobile. TengineKit is an easy-to-integrate AI algorithm SDK. At present, it can run on various mobile phones at very low latency. We will continue to update this project for better results and better performance! -
14
NATS HTTP Round Tripper
This is a Golang http.RoundTripper that uses NATS as a transport
...It exposes an API compatible with the common “RoundTripper” abstraction, enabling developers to route request/response traffic through NATS subjects rather than traditional HTTP connections. This pattern lets services running in distributed environments take advantage of NATS’ low latency and flexible topology while retaining familiar client semantics. It can be an effective bridge for teams migrating from synchronous REST calls to a message-driven fabric without rewriting every call site. Because the transport is swappable, it promotes clean separation between business logic and the underlying network. The result is an incremental pathway to evented architectures with the ergonomics of conventional request/response programming. -
15
PerfKit Benchmarker
PerfKit Benchmarker (PKB) contains a set of benchmarks
PerfKitBenchmarker is an open-source benchmarking framework designed to measure and compare the performance of cloud infrastructure across multiple providers in a consistent and reproducible way. It allows users to evaluate metrics such as latency, throughput, provisioning time, and system performance using a standardized set of benchmarks. The tool supports a wide range of environments, including major cloud platforms, Kubernetes clusters, and even local hardware, making it highly versatile for performance analysis. It simplifies the process of running complex benchmarks by providing unified command-line workflows that handle resource provisioning, execution, and result collection. ... -
16
exchange-core java
Ultra-fast matching engine written in Java based on LMAX Disruptor
...Goldman Sachs GS Collections), Real Logic Agrona, OpenHFT Chronicle-Wire, LZ4 Java, and Adaptive Radix Trees. HFT optimized. Priority is a limit-order-move operation mean latency (currently ~0.5µs). Cancel operation takes ~0.7µs, placing new order ~1.0µs. Pipelined multi-core processing (based on LMAX Disruptor): each CPU core is responsible for certain processing stage, user accounts shard, or symbol order books shard. -
17
Hystrix
Latency and Fault Tolerance for Distributed Systems
Defend your app with Hystrix, a latency and fault tolerance library developed by the Netflix API team. It works by isolating points of access to remote systems, services and 3rd party libraries, thereby stopping cascading failure and providing fallback options, and making complex distributed systems more resilient in cases where failure is inevitable. In a distributed environment, failure is simply inevitable for some service dependencies. -
18
FastFlow: programming multi-core
Pattern-based multi/many-core parallel programming framework
...FastFlow run-time is built upon non-blocking threads and lock-free queues. Thanks to its very efficient CAS-free communication/synchronization support (e.g. few clock cycles core-to-core latency), FastFlow effectively supports the exploitation of fine grain parallelism, e.g. parallel codes managing very high frequency streams on commodity multi-core. FastFlow works on x86, x86_64, PPC, ARM, and Linux, Mac and Win XP/7. From Jan 1, 2018 code development migrated on GitHub at https://github.com/fastflow/fastflow -
19
LAMA
Heterogeneous Software Development Accelerated
...The framework supports multiple target platforms within a distributed heterogeneous environment. It offers optimized device code on the backend side, high scalability through latency hiding and asynchronous execution across multiple nodes. LAMA's modular and extensible software design supports the developer on several levels, regardless of whether writing his own portable code with the Heterogeneous Computing Development Kit or using prepared functionality from the Linear Algebra Package, the user always gains high productivity and maximum performance. -
20
jquery-scrollstop
A jQuery plugin that fires events when scrolling stops and starts
This plugin fires two events on the window when scrolling starts and stops: scroll start and scroll stop. -
21
BulkLoader
A bulk loading library for Actionscript
...It provides a unified interface to deal with different content types, handles connection pooling, progress reporting, caching, retries, priority, and other conveniences so developers spend less effort coordinating many concurrent loads. Statistics about loading (latency, speed, average speed). Various kinds on progress indication: ratio (items loaded / items to load), bytes, and weighted percentage. Configurable number of retries. Configurable logging.
