Port of Facebook's LLaMA model in C/C++
Python bindings for llama.cpp
Run Local LLMs on Any Device. Open-source
Personal AI, On Personal Devices
Interface for OuteTTS models
Run a full local LLM stack with one command using Docker
Your Personal AI Assistant; easy to install, deploy on local or coud
Run Bonsai (1-bit) and Ternary-Bonsai language models locally
Structured Outputs
Qwen3 is the large language model series developed by Qwen team
Oobabooga - The definitive Web UI for local AI, with powerful features
Semantic ifs from open models, on a 3090 at home
MiniCPM5: SOTA on-device LLMs, small yet powerful
Performance-optimized AI inference on your GPUs
GLM-4 series: Open Multilingual Multimodal Chat LMs
Towards Human-Sounding Speech
Private AI agents, assistants and search over your own documents
A local-first AI assistant that gets real work done
Implement a small-parameter Chinese large language model from zero
Run GGUF models easily with a UI or API. One File. Zero Install.
Inference Llama 2 in one file of pure C
Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere
Chinese LLaMA & Alpaca large language model + local CPU/GPU training
JetBrains’ 4B parameter code model for completions