Run models like Kimi-K2.5, GLM-5, DeepSeek, gpt-oss, Gemma, Qwen etc.
Port of OpenAI's Whisper model in C/C++
Port of Facebook's LLaMA model in C/C++
AI video generator optimized for low VRAM and older GPUs use
High-performance code intelligence MCP server
Open-source vector similarity search for Postgres
A fast image processing library with low memory needs
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU
C++ and Python Examples
Flux 2 image generation model pure C inference
Run OpenClaw on a $5 chip
TEN, a voice agent framework to create conversational AI.
Run GLM-5.2 (744B MoE) on a 25GB-RAM consumer machine
MiniMax H3 inference engine for Mac computers
Run the full 2.78-trillion-parameter Kimi K3 model
Next-gen AI+IoT framework for T2/T3/T5AI/ESP32/and more
FAIR Sequence Modeling Toolkit 2
kaldi-asr/kaldi is the official location of the Kaldi project
C++ inference library for multiple SVC/TTS
The Operator Splitting QP Solver
DeepSeek 4 Flash local inference engine for Metal
Run a 1-billion parameter LLM on a $10 board with 256MB RAM
ByteHook is an Android PLT hook library
Foundational Models for State-of-the-Art Speech and Text Translation
Provides CTP stock options and Zhongtai Securities XTP