CLI proxy that reduces LLM token consumption
157 models, 30 providers, one command to find what runs on hardware
The AI framework that adds the engineering to prompt engineering
Fast, local-first web content extraction for LLMs
Generate music based on natural language prompts using LLMs
Fast, flexible LLM inference
A git prepare-commit-msg hook for authoring commit messages with GPT-3
Instant, controllable, local pre-trained AI models in Rust
Vector database plugin for Postgres, written in Rust
LangChain for Rust, the easiest way to write LLM-based programs
A high-performance inference engine for AI models
Beautiful git diff viewer, generate commits with AI
Distributed LLM and StableDiffusion inference
Fast and efficient unstructured data extraction
The best way to use and work with blocks
Korvus is a search SDK that unifies the entire RAG pipeline
Open-source LLM load balancer and serving platform for hosting LLMs
LLMs done the UNIX-y way
An e-book about the real-world application of LLM
Rust crate for building chains in large language models
A program that provides LLMs with ability to complete complex tasks
An ecosystem of Rust libraries for working with large language models