157 models, 30 providers, one command to find what runs on hardware
Bionic is an on-premise replacement for ChatGPT
Delivery infrastructure for agentic apps
Open source IDE for orchestrating AI coding agents in large codebases
Graph-vector database for building unified AI backends fast
Python-free Rust inference server
A tool to snap pixels to a perfect grid
Fastest LLM inference runtime for Apple Silicon
The AI framework that adds the engineering to prompt engineering
A protocol for connecting any editor to any agent
Semantic search and document parsing tools for the command line
Open-source LLM load balancer and serving platform for hosting LLMs
The Rust workspace under rust/ is the current systems-language port
Visual AI IDE for building agents with prompt chains and graphs
Rust framework for building modular and scalable LLM-powered apps
LangChain for Rust, the easiest way to write LLM-based programs
Korvus is a search SDK that unifies the entire RAG pipeline
Renderer for the harmony response format to be used with gpt-oss
Your favorite Terminal Coding Agent, now in Rust
Switchyard lets LLM applications route traffic across models
An improved implementation of the Ralph Wiggum technique
A drop-in Apache Spark replacement written in Rust
Local, policy-gated signing and wallet management for every chain
Framework to prove inference of ML models blazingly fast
High-performance inference server for text embeddings models API layer