CLI proxy that reduces LLM token consumption
Fast, local-first web content extraction for LLMs
Open-source LLM load balancer and serving platform for hosting LLMs
Fast, flexible LLM inference
Beautiful git diff viewer, generate commits with AI
LangChain for Rust, the easiest way to write LLM-based programs
Generate music based on natural language prompts using LLMs
A high-performance inference engine for AI models
Korvus is a search SDK that unifies the entire RAG pipeline
The AI framework that adds the engineering to prompt engineering
Rust crate for building chains in large language models