Run models like Kimi-K2.5, GLM-5, DeepSeek, gpt-oss, Gemma, Qwen etc.
Port of OpenAI's Whisper model in C/C++
Port of Facebook's LLaMA model in C/C++
AI video generator optimized for low VRAM and older GPUs use
Next-gen AI+IoT framework for T2/T3/T5AI/ESP32/and more
Open-source vector similarity search for Postgres
Run frontier MoE models on hardware you already own
C++ and Python Examples
llama and other large language models on iOS and MacOS offline
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU
Your personal AI assistant at all-in 888KiB
High-performance code intelligence MCP server
Flux 2 image generation model pure C inference
Run a 1-billion parameter LLM on a $10 board with 256MB RAM
ESP32 desk dashboard that shows Claude Code usage
Provides CTP stock options and Zhongtai Securities XTP
kaldi-asr/kaldi is the official location of the Kaldi project
DeepSeek 4 Flash local inference engine for Metal
MiniMax H3 inference engine for Mac computers
TEN, a voice agent framework to create conversational AI.
The Operator Splitting QP Solver
Run the full 2.78-trillion-parameter Kimi K3 model
ByteHook is an Android PLT hook library
Foundational Models for State-of-the-Art Speech and Text Translation
Run OpenClaw on a $5 chip