Port of Facebook's LLaMA model in C/C++
Run models like Kimi-K2.5, GLM-5, DeepSeek, gpt-oss, Gemma, Qwen etc.
OmniRoute is an AI gateway for multi-provider LLM
The all-in-one Desktop & Docker AI application with full RAG and AI
Python bindings for llama.cpp
Official code repo for the O'Reilly Book
SDG is a specialized framework
From Vibe Coding to Agentic Engineering
A high-throughput and memory-efficient inference and serving engine
LLM Frontend for Power Users
Advanced LLM-powered brute-force tool combining AI intelligence
157 models, 30 providers, one command to find what runs on hardware
A Simple and Universal Swarm Intelligence Engine
Drag & drop UI to build your customized LLM flow
Project aimed at extracting, exporting, and analyzing chat records
Run Local LLMs on Any Device. Open-source
AI Coding agent for the terminal
One API for plugins and datasets, one interface for prompt engineering
The Multi-Agent Framework
Ongoing research training transformer models at scale
Distribute and run LLMs with a single file
lightweight package to simplify LLM API calls
Desktop app for prototyping and debugging LangGraph applications
Open-source, high-performance AI model with advanced reasoning
Powerful AI language model (MoE) optimized for efficiency/performance