Search Results for "shared memory allocator"
Sort By:
Showing 20 open source projects for "shared memory allocator"
View related business solutions-
Fully Managed MySQL, PostgreSQL, and SQL ServerCloud SQL handles your database ops end to end, so you can focus on your app.
-
Host LLMs in Production With On-Demand GPUsDeploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
-
1
OpenSquilla
Token-Efficient AI Agent with same budget, higher intelligence density
OpenSquilla is a token-efficient microkernel AI agent runtime designed for CLI, web UI, and chat-based workflows. It routes each turn through a shared loop that can select lower-cost models when appropriate while preserving tool dispatch, retries, memory, and decision logging. The project supports multiple LLM providers through a pluggable provider layer, making it adaptable to different model ecosystems. It includes persistent memory, built-in web search, on-device embeddings, and sandboxing for safer execution. ... -
2
MemClaw
Persistent memory for AI agent fleets (OSS)
MemClaw is an open-source governed shared memory platform for AI agent fleets. It is designed to help agents remember information across sessions, teams, tools, and models instead of keeping knowledge trapped inside isolated conversations. The project emphasizes enterprise-style governance, including permissions, tenant isolation, audit trails, visibility scopes, and agent trust tiers. -
3
EverOS
One portable memory layer for every AI agent
...The system is designed to preserve user context and agent experience across sessions without forcing dependence on a hosted service. EverOS can serve as shared memory infrastructure for coding assistants, personal agents, and custom applications. Its architecture emphasizes user ownership, portability, and self-evolving reuse of accumulated knowledge. -
4
Former.skill
AI skill generator designed to reconstruct conversational personality
Ex Skill is an AI skill generator designed to reconstruct the conversational personality and shared memories of a former partner from personal data. It can analyze exported chats, photos, social media records, PDFs, images, and manually entered descriptions. The system builds separate memory and persona layers covering relationship history, habits, emotional patterns, communication style, and behavior. Generated personas can respond in a style modeled after the source material. ... -
One Monitoring Tool for IT, OT and Cloud | Free TrialModern infrastructure spans data centers, cloud platforms and factory floors, and every blind spot between them is a risk. PRTG supports SNMP, WMI, SSH and other standard protocols to monitor IT, OT and hybrid environments through one customizable dashboard. Build the views your team needs, from network health to application performance, without switching tools. Try PRTG free for 30 days now.
-
5
I hate money
A simple shared budget manager web application
I hate money is a web application made to ease shared budget management. It keeps track of who bought what, when, and for whom; and helps to settle the bills. I hate money is written in python, using the flask framework. It’s developed with ease of use in mind and is trying to keep things simple. Hope you (will) like it! The code is distributed under a BSD beerware derivative: if you meet the people in person and you want to pay them a craft beer, you are highly encouraged to do so. -
6
METATRON
AI-powered penetration testing assistant using local LLM on linux
METATRON is a multi-agent AI orchestration framework designed to coordinate complex workflows across multiple intelligent agents. It provides a structured system for task delegation, communication, and collaboration between agents. The framework emphasizes scalability, allowing multiple agents to work together on large or complex problems. It includes mechanisms for managing context, memory, and execution flow across tasks. METATRON is particularly useful for building advanced AI systems... -
7
FramePack
Lets make video diffusion practical
FramePack explores compact representations for sequences of image frames, targeting tasks where many near-duplicate frames carry redundant information. The idea is to “pack” frames by detecting shared structure and storing differences efficiently, which can accelerate training or inference on video-like data. By reducing I/O and memory bandwidth, datasets become lighter to load while models still see the essential temporal variation. The repository demonstrates both packing and unpacking steps, making it straightforward to integrate into preprocessing pipelines. ... -
8
CogVideo
Text and image to video generation: CogVideoX and CogVideo
CogVideo is an open-source family of advanced video generation models that can create videos from text, images, or existing video inputs. Built on large-scale Transformer and diffusion architectures, it enables multimodal generation across text-to-video, image-to-video, and video continuation tasks. The latest CogVideoX models offer higher resolution outputs, longer video durations, and improved controllability through prompt engineering. The project includes tools for inference,... -
9
Qwen
The official repo of Qwen chat & pretrained large language model
Qwen is a series of large language models developed by Alibaba Cloud, consisting of various pretrained versions like Qwen-1.8B, Qwen-7B, Qwen-14B, and Qwen-72B. These models, which range from smaller to larger configurations, are designed for a wide range of natural language processing tasks. They are openly available for research and commercial use, with Qwen's code and model weights shared on GitHub. Qwen's capabilities include text generation, comprehension, and conversation, making it a... -
Cut Data Warehouse Costs by 54%BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
-
10
BigMac
An open-source toolkit for BigMac-style pipeline-parallel training
BigMac is an open-source toolkit for pipeline-parallel training of multimodal large language models. It preserves optimized language-model pipeline schedules while placing encoder and generator work around them. This design reduces activation memory without bringing back cross-module pipeline bubbles. Its scheduler creates global operator plans, while its executor runs those plans through a shared schedule abstraction. A Megatron-Core reference backend and Qwen3 and Qwen3-VL tutorials help developers connect the approach to real training workflows. The simulator lets researchers visualize schedules, compare pipeline strategies, and model timing imbalances caused by compute cost, input size, or uneven stage partitioning. ... -
11
LMCache
Supercharge Your LLM with the Fastest KV Cache Layer
LMCache is an extension layer for LLM serving engines that accelerates inference, especially with long contexts, by storing and reusing key-value (KV) attention caches across requests. Instead of rebuilding KV states for repeated or shared text segments, LMCache persists and retrieves them from multiple tiers—GPU memory, CPU DRAM, and local disk—then injects them into subsequent requests to reduce TTFT and increase throughput. Its design supports reuse beyond strict prefix matching and enables sharing across serving instances, improving efficiency under real multi-tenant traffic. ... -
12
ChatGPT Clone
ChatGPT interface with better UI
ChatGPT Clone demonstrates a ChatGPT-style conversational interface wired to large-language-model backends, packaged so developers can self-host and extend. The goal is to replicate the core chat UX—message history, streaming tokens, code blocks, and system prompts—while letting you plug in different provider APIs or local models. It showcases a clean separation between the web client and the message orchestration layer so you can experiment with prompts, roles, and memory strategies. The... -
13
Punica
Serving multiple LoRA finetuned LLM as one
Punica is a system designed to efficiently serve multiple LoRA-fine-tuned large language models within a shared GPU environment. LoRA is a parameter-efficient fine-tuning method that allows developers to adapt large pretrained models to specific tasks by adding lightweight adapter layers rather than retraining the entire model. Punica introduces a serving architecture that allows multiple LoRA adapters to share the same base model during inference, significantly reducing memory consumption and computational overhead. ... -
14
gpustat
A simple command-line utility for querying and monitoring GPU status
...It serves as a simplified alternative to the more verbose nvidia-smi tool by presenting key GPU metrics in a compact, developer-friendly format. The utility retrieves data through NVIDIA’s NVML bindings and displays information such as temperature, utilization, memory usage, and running processes directly in the terminal. Because it is easy to install via pip and requires minimal configuration, gpustat is widely used in machine learning environments, research clusters, and shared GPU servers. The tool also supports watch mode for continuous monitoring and JSON output for integration into automation pipelines. ... -
15
Photon provides very fast access to data containers (queues, maps, etc.) in shared memory - it can retrieve millions of data records per second. It also uses some RDB concepts like transactions and crash recovery. See web site for details.
-
16
pyxntp is a Python module which allows the implementation of a Reference Clock Driver from python, via the xntpd Shared Memory interface.
-
17
POSH (Python Object Sharing) is an extension module to Python that enables processes to share Python objects by placing them in shared memory.
-
18
This is a tiny educational library : smalltalk like objects, quick memory allocator, network marshall/unmarshall, dynamic module, debug, quick and dirty two-way link between our objects and mozilla javascript or python objects, ... and highly portable !
-
19
libshbuf introduces a new IPC concept: the "shared buffer", a more flexible and faster alternative for standard Unix FIFOs. Take some shared memory, flavour it with semaphore based locking and change notifications and refine it with an easy-to-use API.
-
20
A semantic memory software tool “reflects” one's “imagination”. In it, arbitrary concepts may be described, stored, arranged, transformed, and shared. One may verbalize thoughts as they arise in the mind to externalize and digitize “mental obj
- Previous
- You're on page 1
- Next
