AirLLM Files

AirLLM 70B inference with single 4GB GPU

This is an exact mirror of the AirLLM project, hosted at https://github.com/lyogavin/airllm. SourceForge is not affiliated with AirLLM.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	InfoDownloads / Week
v3.1.0	2026-07-29	42
v3.0.1	2026-06-30	2
v3.0.0	2026-06-30	0
Totals: 3 Items		44

Other Useful Business Software

Build Agents and Models on One Platform

Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

Gemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.

Try It Free

Save Up to 91% on Cloud Compute With Spot VMs

Automatic sustained-use discounts. One free VM per month. No negotiation needed.

Run batch jobs at 60-91% off with Spot VMs. Long-running workloads get automatic discounts with sustained use.

Try Free

Build Agents and Models on One Platform

Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

Try It Free

Recommended Projects

Colibrì
Run GLM-5.2 (744B MoE) on a 25GB-RAM consumer machine
uzu
A high-performance inference engine for AI models
shimmy
Python-free Rust inference server
qvac-fabric-llm.cpp
QVAC Fabric: cross-platform LLM inference and fine-tuning
bitsandbytes
Accessible large language models via k-bit quantization for PyTorch

AirLLM Files

AirLLM 70B inference with single 4GB GPU

Get an email when there's a new version of AirLLM