AIMET is a library that provides advanced quantization and compression
Official inference framework for 1-bit LLMs
C++ image processing and machine learning library with using of SIMD
PhantomBot is an actively developed open source interactive Twitch bot
Run Bonsai (1-bit) and Ternary-Bonsai language models locally
Fast inference engine for Transformer models
Oobabooga - The definitive Web UI for local AI, with powerful features
Kimi K2 is the large language model series developed by Moonshot AI
Z80-μLM is a 2-bit quantized language model
Qwen3-VL, the multimodal large language model series by Alibaba Cloud
This repo contains the code for 1D tokenizer and generator
Official inference repo for FLUX.2 models
Accessible large language models via k-bit quantization for PyTorch
High-performance Inference and Deployment Toolkit for LLMs and VLMs
A scientific machine learning (SciML) wrapper for the FEniCS
NeurIPS2025 Spotlight] Quantized Attention
20+ high-performance LLMs with recipes to pretrain, finetune at scale
ComfyUI integration for Microsoft's VibeVoice text-to-speech model
A fast image processing library with low memory needs
GLM-4.5: Open-source LLM for intelligent agents by Z.ai
CUDA Templates for Linear Algebra Subroutines
Running a 28.9M parameter LLM on an $8 microcontroller
ChatGLM3 series: Open Bilingual Chat LLMs | Open Source Bilingual Chat
Open Source Document Management System for Digital Archives
Ring is a reasoning MoE LLM provided and open-sourced by InclusionAI