C#/.NET binding of llama.cpp, including LLaMa/GPT model inference
Port of Facebook's LLaMA model in C/C++
Fast, Sharp & Reliable Agentic Intelligence
Sharp Monocular Metric Depth in Less Than a Second
Clean and efficient FP8 GEMM kernels with fine-grained scaling
Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference
Awesome multilingual OCR toolkits based on PaddlePaddle
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
Flux 2 image generation model pure C inference
FAIR Sequence Modeling Toolkit 2
CodeGeeX: An Open Multilingual Code Generation Model (KDD 2023)
Open-source large language model family from Tencent Hunyuan
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
Foundational Models for State-of-the-Art Speech and Text Translation
FlashMLA: Efficient Multi-head Latent Attention Kernels
Real-time behaviour synthesis with MuJoCo, using Predictive Control
llama.go is like llama.cpp in pure Golang
ChatGPT integration with Unity Editor
Locally run an Instruction-Tuned Chat-Style LLM
Code release for "Masked-attention Mask Transformer
Learning embeddings for classification, retrieval and ranking
Learning Continuous Signed Distance Functions for Shape Representation