Fast, flexible LLM inference
Generate music based on natural language prompts using LLMs
Fast, local-first web content extraction for LLMs
Open-source LLM load balancer and serving platform for hosting LLMs
157 models, 30 providers, one command to find what runs on hardware
Instant, controllable, local pre-trained AI models in Rust
CLI proxy that reduces LLM token consumption
Fast and efficient unstructured data extraction
A program that provides LLMs with ability to complete complex tasks