DeepSeek 4 Flash local inference engine for Metal
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU
Port of OpenAI's Whisper model in C/C++
Port of Facebook's LLaMA model in C/C++
Run models like Kimi-K2.5, GLM-5, DeepSeek, gpt-oss, Gemma, Qwen etc.
High-performance code intelligence MCP server
AI video generator optimized for low VRAM and older GPUs use
Flux 2 image generation model pure C inference
Open-source vector similarity search for Postgres
Run GLM-5.2 (744B MoE) on a 25GB-RAM consumer machine
Android inline hook library which supports thumb, arm32 and arm64
C++ and Python Examples
Next-gen AI+IoT framework for T2/T3/T5AI/ESP32/and more
Run the full 2.78-trillion-parameter Kimi K3 model
kaldi-asr/kaldi is the official location of the Kaldi project
C++ inference library for multiple SVC/TTS
The Operator Splitting QP Solver
A fast image processing library with low memory needs
Run a 1-billion parameter LLM on a $10 board with 256MB RAM
Open-source framework for conversational voice AI agents
FAIR Sequence Modeling Toolkit 2
Inference Llama 2 in one file of pure C
Low-latency AI inference engine optimized for mobile devices
Your personal AI assistant at all-in 888KiB
ByteHook is an Android PLT hook library