CLI proxy that reduces LLM token consumption
157 models, 30 providers, one command to find what runs on hardware
The AI framework that adds the engineering to prompt engineering
LangChain for Rust, the easiest way to write LLM-based programs
The best way to use and work with blocks
Instant, controllable, local pre-trained AI models in Rust
Open-source LLM load balancer and serving platform for hosting LLMs
Rust crate for building chains in large language models