Search Results for "thread pool model"
Sort By:
Showing 11 open source projects for "thread pool model"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
1
tt-metal
TT-NN operator library, and TT-Metalium low level kernel programming
tt-metal, also referred to in its documentation as TT-Metalium, is Tenstorrent’s low-level software development kit for programming applications on Tenstorrent AI accelerators. The project is designed for developers who need direct access to the company’s Tensix processor architecture, exposing a programming model that is closer to hardware control than high-level inference frameworks. Instead of following a traditional GPU model centered on massive thread parallelism, the platform is built around a grid of specialized compute nodes called Tensix cores, each with local SRAM, dedicated compute units, and multiple RISC-V control processors. ... -
2
Monoio
Rust async runtime based on io-uring
Monoio is a Rust asynchronous runtime designed for high-performance I/O-bound servers and applications, built around native OS async I/O primitives (e.g. io_uring on Linux, epoll / kqueue on other Unix-like systems), rather than layering atop an existing runtime. Its design philosophy centers on a “thread-per-core” model where each core runs its own event loop, minimizing cross-thread synchronization needs, avoiding the overhead and complexity of task scheduling, and letting developers write efficient, low-overhead asynchronous networking or I/O code. Because tasks do not need to be Send or Sync and can make use of thread-local data safely, Monoio simplifies certain concurrency paradigms while delivering performance benefits for workloads like high-throughput network servers, proxies, or real-time services. ... -
3
Claude Relay Service
Claude Code image, a one-stop open source transit service
claude-relay-service is an open-source proxy and relay platform that enables unified access to multiple AI model providers through a single self-hosted gateway. The project is designed to help users centralize subscriptions and API usage for services such as Claude, OpenAI, Gemini, and related tools. It acts as a middleware layer that forwards requests while managing authentication, routing, and cost-sharing scenarios. The system is particularly useful for teams or communities that want to pool access or simplify integration with different AI backends. ... -
4
WebLLM
Bringing large-language models and chat to web browsers
WebLLM is a modular, customizable javascript package that directly brings language model chats directly onto web browsers with hardware acceleration. Everything runs inside the browser with no server support and is accelerated with WebGPU. We can bring a lot of fun opportunities to build AI assistants for everyone and enable privacy while enjoying GPU acceleration. WebLLM offers a minimalist and modular interface to access the chatbot in the browser. The WebLLM package itself does not come... -
Veeam Data Platform v13.1Try Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
5
Auto Claude
Autonomous multi-session AI coding
Auto-Claude is an autonomous, multi-agent coding framework that organizes software work into a structured workflow where agents plan, build, and validate code with minimal manual micromanagement. Instead of relying on a single chat thread to do everything, it uses coordinated agents and a task-driven approach so multiple steps—like investigation, implementation, and testing—can be executed systematically. The project aims to make “agentic software engineering” feel like running a small... -
6
Claude Cognitive
Persistent context and multi-instance coordination
...This context routing dramatically reduces redundant token usage and accelerates large codebase interactions by focusing only on what truly matters to the current task. Additionally, Claude-Cognitive includes a pool coordinator to share state across multiple Claude Code instances, preserving what’s been learned or completed and preventing repetitive debugging or redundant exploration. -
7
Swift Concurrency Agent Skill
Add expert Swift Concurrency guidance to your AI coding tool
Swift Concurrency Agent Skill is an open-source “agent skill” designed to give AI coding assistants deep expertise in Apple’s Swift Concurrency model, including async/await, structured concurrency, task groups, actors, and thread safety. It is formatted according to the Agent Skills specification so that tools like Claude Code, Cursor, Copilot, and other LLM-powered systems can load it and apply guidance when relevant. The skill codifies practical best practices for writing efficient, safe, and modern concurrent Swift code and outlines how to modernize existing legacy code toward Swift 6 conventions. ... -
8
Eva AI
Eva is an A.I. assistant that helps users multi-task.
...Tell Eva "Listen" or "Hey listen" followed by a command. For more instructions, check the instruction manual included in the application. [Update] * 🆕 Removed paged memory cleanup * 🆕 Re-added physical model switch-up * 🆕 Added automatic microphone audio level maximisation * 🆕 Re-calibrated the * 🐞 Re-added the wake word engine reset mechanism * 🐞 Fixed UI related issues regarding threading * 🐞 Fixed thread synchronisation bugs -
9
Warlock-Studio
AI Suite for upscaling, interpolating & restoring images/videos
v6.0. Warlock-Studio is a Windows application that uses Real-ESRGAN, BSRGAN, IRCNN, GFPGAN, RealESRNet, RealESRAnime and RIFE Artificial Intelligence models to upscale, restore faces, interpolate frames and reduce noise in images and videos. the application supports GPU acceleration (including multi-GPU setups) and offers batch processing for large workloads. It includes drag-and-drop handling for single or multiple files, optional pre-resize functions, and an automatic tiling system... -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
10
GPT Discord Bot
Example Discord bot written in Python that uses the completions API
...It is built on top of the discord.py framework and the OpenAI Python library, providing a simple, extensible template for building AI-powered Discord applications. The bot supports a /chat command that spawns a public thread, carries full conversation context across messages, and gracefully closes the thread when context or message limits are reached. Developers can customize system instructions through a config file and modify the model used for responses. While minimal, this project offers a clear example of how to set up authentication, permissions, and message handling for deploying a functional GPT-powered chatbot in Discord. -
11
X-DeepLearning
An industrial deep learning framework for high-dimension sparse data
...Storage and communication optimization, parameters are automatically allocated globally without manual intervention, and requests are merged to completely eliminate computing/storage/communication hotspots of ps. Complete streaming training features including feature admission, feature elimination, model incremental export, feature counting statistics, etc. Background: XDL1.0 focuses on throughput optimization and adopts the one request per thread processing model, which can significantly improve the limit throughput under ultra-high concurrency.
- Previous
- You're on page 1
- Next
