llama.cpp Files

LLM inference in C/C++

This is an exact mirror of the llama.cpp project, hosted at https://github.com/ggml-org/llama.cpp. SourceForge is not affiliated with llama.cpp.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
cudart-llama-bin-win-cuda-12.4-x64.zip	< 16 hours ago	391.4 MB	0
b9753 source code.tar.gz	< 20 hours ago	35.0 MB	0
b9753 source code.zip	< 20 hours ago	36.5 MB	0
README.md	< 20 hours ago	3.7 kB	0
Totals: 4 Items		462.9 MB	0

server: fix report progress for loading spec models, add "stages" list (#24870) * server: fix report progress for loading spec models, add "stages" list * improve * nits * nits 2

macOS/iOS:

macOS Apple Silicon (arm64)
macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED
macOS Intel (x64)
iOS XCFramework

Linux:

Android:

Android arm64 (CPU)

Windows:

openEuler:

DISABLED
openEuler x86 (310p)
openEuler x86 (910b, ACL Graph)
openEuler aarch64 (310p)
openEuler aarch64 (910b, ACL Graph)

UI:

UI

Source: README.md, updated 2026-06-21

Other Useful Business Software

Atera - an All-in-one platform for IT management Icon

Atera - an All-in-one platform for IT management

Ideal for IT departments and MSPs (managed service providers)

Your IT essentials, integrated & elevated. Take your IT management from automated to autonomous, download Atera's agent to start your free trial!

Try Atera now

Enterprise-grade ITSM, for every business Icon

Enterprise-grade ITSM, for every business

Give your IT, operations, and business teams the ability to deliver exceptional services—without the complexity.

Freshservice is an intuitive, AI-powered platform that helps IT, operations, and business teams deliver exceptional service without the usual complexity. Automate repetitive tasks, resolve issues faster, and provide seamless support across the organization. From managing incidents and assets to driving smarter decisions, Freshservice makes it easy to stay efficient and scale with confidence.

Try it Free

$300 Free Credits for Your Google Cloud Projects

Start building on Google Cloud with $300 in free credits. No commitment, no credit card required until you're ready to scale.

Launch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.

Start Free Trial

Recommended Projects

qvac-fabric-llm.cpp
QVAC Fabric: cross-platform LLM inference and fine-tuning
llama.cpp
Port of Facebook's LLaMA model in C/C++
shimmy
Python-free Rust inference server
wllama
WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
ds4.c
DeepSeek 4 Flash local inference engine for Metal