Port of Facebook's LLaMA model in C/C++
Run models like Kimi-K2.5, GLM-5, DeepSeek, gpt-oss, Gemma, Qwen etc.
OmniRoute is an AI gateway for multi-provider LLM
The all-in-one Desktop & Docker AI application with full RAG and AI
Python bindings for llama.cpp
Official code repo for the O'Reilly Book
From Vibe Coding to Agentic Engineering
SDG is a specialized framework
A high-throughput and memory-efficient inference and serving engine
LLM Frontend for Power Users
157 models, 30 providers, one command to find what runs on hardware
Advanced LLM-powered brute-force tool combining AI intelligence
Drag & drop UI to build your customized LLM flow
A Simple and Universal Swarm Intelligence Engine
The Multi-Agent Framework
Project aimed at extracting, exporting, and analyzing chat records
Ongoing research training transformer models at scale
AI Coding agent for the terminal
Run Local LLMs on Any Device. Open-source
One API for plugins and datasets, one interface for prompt engineering
Distribute and run LLMs with a single file
lightweight package to simplify LLM API calls
Desktop app for prototyping and debugging LangGraph applications
Open-source, high-performance AI model with advanced reasoning
Powerful AI language model (MoE) optimized for efficiency/performance