CLI proxy that reduces LLM token consumption
157 models, 30 providers, one command to find what runs on hardware
Generate music based on natural language prompts using LLMs
Instant, controllable, local pre-trained AI models in Rust
Open-source LLM load balancer and serving platform for hosting LLMs
Fast and efficient unstructured data extraction
A high-performance inference engine for AI models
Korvus is a search SDK that unifies the entire RAG pipeline
Fast, flexible LLM inference
Distributed LLM and StableDiffusion inference
LLMs done the UNIX-y way
A program that provides LLMs with ability to complete complex tasks