Run models like Kimi-K2.5, GLM-5, DeepSeek, gpt-oss, Gemma, Qwen etc.
OmniRoute is an AI gateway for multi-provider LLM
Port of Facebook's LLaMA model in C/C++
Advanced LLM-powered brute-force tool combining AI intelligence
LLM Frontend for Power Users
Official code repo for the O'Reilly Book
The all-in-one Desktop & Docker AI application with full RAG and AI
AI Coding agent for the terminal
Open-source, high-performance AI model with advanced reasoning
LLM inference in C/C++
Run Local LLMs on Any Device. Open-source
A high-throughput and memory-efficient inference and serving engine
Distribute and run LLMs with a single file
From Vibe Coding to Agentic Engineering
The media player for language learning, with dual subtitles
Drag & drop UI to build your customized LLM flow
Powerful AI language model (MoE) optimized for efficiency/performance
Use any SDK to call 100+ LLMs
OpenAI-compatible proxy that aggregates free-tier keys from ~14 AI
Clippy, now with some AI
157 models, 30 providers, one command to find what runs on hardware
A Simple and Universal Swarm Intelligence Engine
AirLLM 70B inference with single 4GB GPU
lightweight package to simplify LLM API calls
The free, Open Source alternative to OpenAI, Claude and others