llama.cpp Files

Port of Facebook's LLaMA model in C/C++

This is an exact mirror of the llama.cpp project, hosted at https://github.com/ggerganov/llama.cpp. SourceForge is not affiliated with llama.cpp.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
llama-b7870-xcframework.zip	< 14 hours ago	174.4 MB	0
llama-b7870-bin-win-vulkan-x64.zip	< 14 hours ago	47.1 MB	0
llama-b7870-bin-win-sycl-x64.zip	< 14 hours ago	120.1 MB	0
llama-b7870-bin-win-opencl-adreno-arm64.zip	< 14 hours ago	24.9 MB	0
llama-b7870-bin-win-hip-radeon-x64.zip	< 14 hours ago	362.3 MB	0
llama-b7870-bin-win-cuda-13.1-x64.zip	< 14 hours ago	145.8 MB	0
llama-b7870-bin-win-cuda-12.4-x64.zip	< 14 hours ago	221.2 MB	0
llama-b7870-bin-win-cpu-x64.zip	< 14 hours ago	30.6 MB	0
llama-b7870-bin-win-cpu-arm64.zip	< 14 hours ago	24.1 MB	0
llama-b7870-bin-ubuntu-x64.tar.gz	< 14 hours ago	24.3 MB	0
llama-b7870-bin-ubuntu-vulkan-x64.tar.gz	< 14 hours ago	41.1 MB	0
llama-b7870-bin-ubuntu-s390x.tar.gz	< 14 hours ago	25.3 MB	0
llama-b7870-bin-macos-x64.tar.gz	< 14 hours ago	84.5 MB	0
llama-b7870-bin-macos-arm64.tar.gz	< 14 hours ago	29.9 MB	0
llama-b7870-bin-910b-openEuler-x86-aclgraph.tar.gz	< 14 hours ago	61.0 MB	0
llama-b7870-bin-910b-openEuler-aarch64-aclgraph.tar.gz	< 14 hours ago	55.1 MB	0
llama-b7870-bin-310p-openEuler-x86.tar.gz	< 14 hours ago	61.0 MB	0
llama-b7870-bin-310p-openEuler-aarch64.tar.gz	< 14 hours ago	55.1 MB	0
cudart-llama-bin-win-cuda-13.1-x64.zip	< 14 hours ago	402.6 MB	0
cudart-llama-bin-win-cuda-12.4-x64.zip	< 14 hours ago	391.4 MB	0
b7870 source code.tar.gz	< 15 hours ago	28.9 MB	0
b7870 source code.zip	< 15 hours ago	29.9 MB	0
README.md	< 15 hours ago	2.5 kB	0
Totals: 23 Items		2.4 GB	0

arg : add -kvu to llama-batched-bench (#19172)

macOS/iOS: - macOS Apple Silicon (arm64) - macOS Intel (x64) - iOS XCFramework

Linux: - Ubuntu x64 (CPU) - Ubuntu x64 (Vulkan) - Ubuntu s390x (CPU)

Windows: - Windows x64 (CPU) - Windows arm64 (CPU) - Windows x64 (CUDA 12) - CUDA 12.4 DLLs - Windows x64 (CUDA 13) - CUDA 13.1 DLLs - Windows x64 (Vulkan) - Windows x64 (SYCL) - Windows x64 (HIP)

openEuler: - openEuler x86 (310p) - openEuler x86 (910b, ACL Graph) - openEuler aarch64 (310p) - openEuler aarch64 (910b, ACL Graph)

Source: README.md, updated 2026-01-29

Other Useful Business Software

AI-generated apps that pass security review Icon

AI-generated apps that pass security review

Stop waiting on engineering. Build production-ready internal tools with AI—on your company data, in your cloud.

Retool lets you generate dashboards, admin panels, and workflows directly on your data. Type something like “Build me a revenue dashboard on my Stripe data” and get a working app with security, permissions, and compliance built in from day one. Whether on our cloud or self-hosted, create the internal software your team needs without compromising enterprise standards or control.

Try Retool free

Find Hidden Risks in Windows Task Scheduler Icon

Find Hidden Risks in Windows Task Scheduler

Free diagnostic script reveals configuration issues, error patterns, and security risks. Instant HTML report.

Windows Task Scheduler might be hiding critical failures. Download the free JAMS diagnostic tool to uncover problems before they impact production—get a color-coded risk report with clear remediation steps in minutes.

Download Free Tool

Recommended Projects

LLamaSharp
C#/.NET binding of llama.cpp, including LLaMa/GPT model inference
llama.cpp Python Bindings
Python bindings for llama.cpp
Alpaca.cpp
Locally run an Instruction-Tuned Chat-Style LLM
GPT-NeoX
Implementation of model parallel autoregressive transformers on GPUs
ChatGLM.cpp
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)