157 models, 30 providers, one command to find what runs on hardware
Generate music based on natural language prompts using LLMs
Fast and efficient unstructured data extraction
Instant, controllable, local pre-trained AI models in Rust
Fast, flexible LLM inference
Open-source LLM load balancer and serving platform for hosting LLMs
Korvus is a search SDK that unifies the entire RAG pipeline
Distributed LLM and StableDiffusion inference