Fast, flexible LLM inference
157 models, 30 providers, one command to find what runs on hardware
Generate music based on natural language prompts using LLMs
LangChain for Rust, the easiest way to write LLM-based programs
A high-performance inference engine for AI models
Fast and efficient unstructured data extraction
Korvus is a search SDK that unifies the entire RAG pipeline
LLMs done the UNIX-y way
A program that provides LLMs with ability to complete complex tasks
An ecosystem of Rust libraries for working with large language models