Run PyTorch LLMs locally on servers, desktop and mobile
Distribute and run LLMs with a single file
C#/.NET binding of llama.cpp, including LLaMa/GPT model inference
A RWKV management and startup tool, full automation, only 8MB
Production ready toolkit to run AI locally
The easiest way to use Ollama in .NET
Inference Llama 2 in one file of pure C
Chat with your documents using local AI
CodeGeeX: An Open Multilingual Code Generation Model (KDD 2023)
Llama 2 Everywhere (L2E)
An ecosystem of Rust libraries for working with large language models
Locally run an Instruction-Tuned Chat-Style LLM