A 2.78-trillion-parameter Kimi K3 running inference on a single CPU
Port of Facebook's LLaMA model in C/C++
Flux 2 image generation model pure C inference
Run GLM-5.2 (744B MoE) on a 25GB-RAM consumer machine
Run the full 2.78-trillion-parameter Kimi K3 model
FAIR Sequence Modeling Toolkit 2
Foundational Models for State-of-the-Art Speech and Text Translation
Locally run an Instruction-Tuned Chat-Style LLM