A 2.78-trillion-parameter Kimi K3 running inference on a single CPU
Port of Facebook's LLaMA model in C/C++
Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference
Awesome multilingual OCR toolkits based on PaddlePaddle
Flux 2 image generation model pure C inference
Run GLM-5.2 (744B MoE) on a 25GB-RAM consumer machine
C#/.NET binding of llama.cpp, including LLaMa/GPT model inference
Run the full 2.78-trillion-parameter Kimi K3 model
Open-source large language model family from Tencent Hunyuan
FAIR Sequence Modeling Toolkit 2
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
Hackable and optimized Transformers building blocks
Fast, Sharp & Reliable Agentic Intelligence
Foundational Models for State-of-the-Art Speech and Text Translation
Clean and efficient FP8 GEMM kernels with fine-grained scaling
FlashMLA: Efficient Multi-head Latent Attention Kernels
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
CodeGeeX: An Open Multilingual Code Generation Model (KDD 2023)
llama.go is like llama.cpp in pure Golang
Locally run an Instruction-Tuned Chat-Style LLM
ChatGPT integration with Unity Editor
Learning embeddings for classification, retrieval and ranking