Generate music based on natural language prompts using LLMs
157 models, 30 providers, one command to find what runs on hardware
Fast and efficient unstructured data extraction
Fast, flexible LLM inference
The AI framework that adds the engineering to prompt engineering
Instant, controllable, local pre-trained AI models in Rust
Vector database plugin for Postgres, written in Rust
LangChain for Rust, the easiest way to write LLM-based programs
Korvus is a search SDK that unifies the entire RAG pipeline
Open-source LLM load balancer and serving platform for hosting LLMs
Distributed LLM and StableDiffusion inference
Rust crate for building chains in large language models
An ecosystem of Rust libraries for working with large language models