157 models, 30 providers, one command to find what runs on hardware
Generate music based on natural language prompts using LLMs
CLI proxy that reduces LLM token consumption
A git prepare-commit-msg hook for authoring commit messages with GPT-3
A high-performance inference engine for AI models
The AI framework that adds the engineering to prompt engineering
Fast, flexible LLM inference
Open-source LLM load balancer and serving platform for hosting LLMs
Fast and efficient unstructured data extraction
Instant, controllable, local pre-trained AI models in Rust
Vector database plugin for Postgres, written in Rust
The best way to use and work with blocks
Fast, local-first web content extraction for LLMs
LangChain for Rust, the easiest way to write LLM-based programs
Korvus is a search SDK that unifies the entire RAG pipeline
Beautiful git diff viewer, generate commits with AI
Distributed LLM and StableDiffusion inference
LLMs done the UNIX-y way
An e-book about the real-world application of LLM
Rust crate for building chains in large language models
A program that provides LLMs with ability to complete complex tasks
An ecosystem of Rust libraries for working with large language models