Search Results for "thread pool model"
Sort By:
Showing 99 open source projects for "thread pool model"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
1
Piscina
A fast, efficient Node.js Worker Thread Pool implementation
Piscina is a fast, efficient Node.js worker thread pool implementation, designed to perform heavy CPU-bound tasks in parallel, thereby improving application performance. -
2
Folia
Fork of Paper which adds regionized multithreading
Folia is an experimental fork of the Paper Minecraft server software designed to improve scalability by introducing region-based multithreading. Traditional Minecraft servers run most game logic on a single main thread, which creates performance bottlenecks when many players are active simultaneously. Folia addresses this limitation by dividing the game world into independent regions composed of nearby chunks and assigning each region its own tick loop. These regions run concurrently on multiple threads within a thread pool, allowing server hardware with many CPU cores to process gameplay events in parallel. ... -
3
CppServer
Fast and low latency asynchronous socket server & client C++ library
Ultra-fast and low latency asynchronous socket server & client C++ library with support TCP, SSL, UDP, HTTP, HTTPS, WebSocket protocols, and 10K connections problem solution. Cross platform (Linux, MacOS, Windows) Asynchronous communication. Supported CPU scalability designs: IO service per thread, thread pool. Supported transport protocols: TCP, SSL, UDP, UDP multicast. Supported Web protocols: HTTP, HTTPS, WebSocket, WebSocket secure. Supported Swagger OpenAPI iterative documentation. Supported message protocol based on Fast Binary Encoding. -
4
testng
TestNG testing framework
TestNG is a testing framework inspired from JUnit and NUnit but introduces some new functionalities that make it more powerful and easier to use. Run your tests in arbitrarily big thread pools with various policies available (all methods in their own thread, one thread per test class, etc...). -
Train ML Models With SQL You Already KnowBuild and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
-
5
Spartan Engine
A game engine with an emphasis on real-time cutting-edge solutions
...It supports next-gen performance and image quality technologies including variable rate shading, dynamic resolution scaling, temporal anti-aliasing, and upscaling via XeSS 2 and FSR 3. Beyond rendering, SpartanEngine offers PhysX-powered physics, CPU and GPU profiling, a thread pool for parallel workloads. -
6
Marl
A hybrid thread / fiber task scheduler written in C++ 11
marl is a lightweight C++ job system that schedules tasks on a pool of worker threads and runs them using cooperative fibers for high throughput. By decoupling “tasks” from OS threads, it minimizes context switches and lets workloads with fine-grained synchronization scale efficiently. The API is intentionally small—post tasks, wait on fences, and express dependencies—so you can retrofit it into existing engines without adopting a heavyweight framework. Under the hood, fibers allow tasks to... -
7
cocoyaxi
A go-style coroutine library in C++11 and more
cocoyaxi (co for short), is an elegant and efficient cross-platform C++ base library. It contains a series of high-quality base components, such as a go-style coroutine, coroutine-based network programming framework, command line, and config file parser, high-performance log library, unit testing framework, JSON library, etc. co has implemented a go-style coroutine, which has the following features. Multi-thread scheduling, the default number of threads is the number of system CPU cores.... -
8
ServiceTalk
A networking framework that evolves with your application
...Netty is a great low-level networking framework, but when used for service-to-service communication it presents a few opportunities for improvement. Fully asynchronous and requires knowledge of EventLoop threading model. Executing CPU-intensive or "blocking" code requires manual thread hops. Subtle out-of-order execution of tasks when code executes both on and off the EventLoop thread. APIs are not tailored towards common application use cases (e.g. request/response, RPC, etc..) The asynchronous programming paradigm presents a barrier to entry in scenarios where vertical scalability is not a primary concern. -
9
Rust Programming Language
Empowering everyone to build reliable and efficient software
The Rust Programming Language is a language that empowers you to build reliable and efficient software. It runs blazingly fast and is memory-efficient, so it can power performance-critical services and run on embedded devices. It has a rich type system and ownership model, ensuring both thread and memory safety. Consisting of a standard library, great documentation and a friendly compiler, plus a top-notch build tool, package manager, auto-formatter and many other great tools, it’s the language of choice for increased productivity. Hundreds of companies the world over are using Rust to power an amazing range of cross-platform solutions. ... -
Build Data Resilience - Take the Assessment TodayIs your recovery strategy as strong as you think? Take this quick self-assessment to check your recovery readiness and gain tailored insights. In only 2 minutes, you'll learn where you fall on the recovery readiness scale.
-
10
Moon
A lightweight game server framework implemented with Actor Model
Moon is a lightweight game server framework based on the actor model. One worker thread can have one or more actors (services), which communicate with each other through message queues. There are many features for game server development. -
11
JMX Exporter
A process for exposing JMX Beans via HTTP for Prometheus consumption
JMX to Prometheus exporter: a collector that can configurable scrape and expose mBeans of a JMX target. This exporter is intended to be run as a Java Agent, exposing a HTTP server and serving metrics of the local JVM. It can be also run as a standalone HTTP server and scrape remote JMX targets, but this has various disadvantages, such as being harder to configure and being unable to expose process metrics (e.g., memory and CPU usage). Running the exporter as a Java agent is strongly... -
12
neo.mjs
The application worker driven frontend framework
neo.mjs is the next-generation UI framework for creating desktop & mobile Web Apps. It has a very strong focus on performance and creating scalable & modular architectures. A clean & consistent API, as well as the ability to run without any build processes, will increase the productivity of your team while creating better solutions at the same time. While current libraries/frameworks like Angular, React or Vue provide reasonable performance for small or mostly static Apps, they lack when it... -
13
tt-metal
TT-NN operator library, and TT-Metalium low level kernel programming
tt-metal, also referred to in its documentation as TT-Metalium, is Tenstorrent’s low-level software development kit for programming applications on Tenstorrent AI accelerators. The project is designed for developers who need direct access to the company’s Tensix processor architecture, exposing a programming model that is closer to hardware control than high-level inference frameworks. Instead of following a traditional GPU model centered on massive thread parallelism, the platform is built around a grid of specialized compute nodes called Tensix cores, each with local SRAM, dedicated compute units, and multiple RISC-V control processors. ... -
14
Monoio
Rust async runtime based on io-uring
Monoio is a Rust asynchronous runtime designed for high-performance I/O-bound servers and applications, built around native OS async I/O primitives (e.g. io_uring on Linux, epoll / kqueue on other Unix-like systems), rather than layering atop an existing runtime. Its design philosophy centers on a “thread-per-core” model where each core runs its own event loop, minimizing cross-thread synchronization needs, avoiding the overhead and complexity of task scheduling, and letting developers write efficient, low-overhead asynchronous networking or I/O code. Because tasks do not need to be Send or Sync and can make use of thread-local data safely, Monoio simplifies certain concurrency paradigms while delivering performance benefits for workloads like high-throughput network servers, proxies, or real-time services. ... -
15
Redigo
Go client for Redis
...Connections support one concurrent caller to the Receive method and one concurrent caller to the Send and Flush methods. No other concurrency is supported including concurrent calls to the Do and Close methods. For full concurrent access to Redis, use the thread-safe Pool to get, use and release a connection from within a goroutine. -
16
libuv
Cross-platform asynchronous I/O
libuv is a high-performance, multi-platform C library focusing on asynchronous I/O, originally developed for Node.js. It provides a consistent event-loop and I/O abstraction layer across a range of systems, making non-blocking operations portable and efficient. Full-featured event loop backed by epoll, kqueue, IOCP, event ports. Asynchronous TCP and UDP sockets. Asynchronous DNS resolution. Asynchronous file and file system operations. File system events, ANSI escape code-controlled TTY. IPC... -
17
Claude Relay Service
Claude Code image, a one-stop open source transit service
claude-relay-service is an open-source proxy and relay platform that enables unified access to multiple AI model providers through a single self-hosted gateway. The project is designed to help users centralize subscriptions and API usage for services such as Claude, OpenAI, Gemini, and related tools. It acts as a middleware layer that forwards requests while managing authentication, routing, and cost-sharing scenarios. The system is particularly useful for teams or communities that want to pool access or simplify integration with different AI backends. ... -
18
core.async
Facilities for async programming and communication in Clojure
core.async is a Clojure library that brings asynchronous programming and communication to both Clojure and ClojureScript, enabling developers to write concurrent code using channels, go blocks, and CSP-style constructs rather than callbacks or threads. This project follows the version scheme MAJOR.MINOR.COMMITS where MAJOR and MINOR provide some relative indication of the size of the change, but do not follow semantic versioning. In general, all changes endeavor to be non-breaking (by moving... -
19
workerpool
Offload tasks to a pool of workers on node.js and in the browser
workerpool is a JavaScript library that simplifies the creation and management of worker threads and process pools for parallel task execution in Node.js and browser environments. The project provides an abstraction layer that allows developers to offload CPU-intensive operations to background workers without manually handling thread communication or lifecycle management. It supports task queuing, dynamic worker scaling, timeouts, transferable objects, and proxy-based APIs for interacting... -
20
Numba CUDA Target
The CUDA target for Numba
Numba CUDA Target is NVIDIA’s maintained CUDA backend for the Numba JIT compiler, enabling developers to write GPU-accelerated code directly in Python. It allows users to define CUDA kernels using Python syntax, which are then compiled into efficient GPU code at runtime using LLVM-based toolchains. This approach significantly lowers the barrier to entry for GPU programming by eliminating the need to write CUDA C++ while still delivering high performance. The project supports the SIMT... -
21
redux-saga
An alternative side effect model library for Redux applications
redux-saga is a library that aims to make application side effects (i.e. asynchronous things like data fetching and impure things like accessing the browser cache) easier to manage, more efficient to execute, easy to test, and better at handling failures. The mental model is that a saga is like a separate thread in your application that's solely responsible for side effects. redux-saga is a redux middleware, which means this thread can be started, paused and cancelled from the main application with normal redux actions, it has access to the full redux application state and it can dispatch redux actions as well. ... -
22
WebLLM
Bringing large-language models and chat to web browsers
WebLLM is a modular, customizable javascript package that directly brings language model chats directly onto web browsers with hardware acceleration. Everything runs inside the browser with no server support and is accelerated with WebGPU. We can bring a lot of fun opportunities to build AI assistants for everyone and enable privacy while enjoying GPU acceleration. WebLLM offers a minimalist and modular interface to access the chatbot in the browser. The WebLLM package itself does not come... -
23
Cats Effect
The pure asynchronous runtime for Scala
Cats-Effect is a high-quality functional programming library for Scala that provides a principled way to represent and manage side effects, particularly asynchronous and concurrent computations. It is part of the broader Typelevel ecosystem and builds on the abstractions from Cats (such as Functor, Monad, etc.). The core abstraction is the IO type (or effect types more generally), which encodes effectful computations in a pure, referentially transparent way. Cats-Effect offers capabilities... -
24
FeedKit
An RSS, Atom and JSON Feed parser written in Swift
...A common scenario in UI environments would be parsing a feed asynchronously from a user-initiated action, such as the touch of a button. Remember, you are responsible for manually bringing the resulting closure to whichever queue is appropriate. Usually to the Main thread, for UI apps, by calling DispatchQueue.main.async. FeedKit adopts Swift 5 Result type, as Result<Feed, ParserError>, and as such, if parsing succeeds you should now have a Strongly Typed Model of an RSS, Atom or JSON Feed, within the Feed enum. The RSS and Atom feed Models are rather extensive throughout the supported namespaces. -
25
JavaCore
JavaCore is a summary of experience with Java core technologies
...Separate sections explain collections, streams, traditional I/O, NIO, serialization, sockets, and networking. Its concurrency coverage includes threads, locks, atomics, thread pools, concurrent containers, synchronization, and the Java Memory Model. JVM chapters address memory, garbage collection, bytecode, class loading, diagnostics, monitoring, and performance tuning.
