llama.cpp Python Bindings Files

Python bindings for llama.cpp

This is an exact mirror of the llama.cpp Python Bindings project, hosted at https://github.com/abetlen/llama-cpp-python. SourceForge is not affiliated with llama.cpp Python Bindings.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
llama_cpp_python-0.3.30-py3-none-manylinux_2_35_x86_64.whl	2026-06-16	866.1 MB	0
v0.3.30-rocm72 source code.tar.gz	2026-06-16	420.8 kB	0
v0.3.30-rocm72 source code.zip	2026-06-16	478.1 kB	0
Totals: 3 Items		867.0 MB	0

Other Useful Business Software

Error to trace to log to deploy. One click. No SSH.

Catch the cause before the pager goes off.

AppSignal links every error to the trace, the trace to the log, the log to the deploy that shipped it.

Free 30 days.

Compliant and Reliable File Transfers Backed by Top Security Certifications

Cerberus FTP Server delivers SOC 2 Type II certified security and FIPS 140-2 validated encryption.

Stop relying on non-certified, legacy file transfer tools that creak under the weight of modern security demands. Get full audit trails, advanced access controls and more supported by an award-winning team of experts. Start your free 25-day trial today.

Start Free Trial

$300 Free Credits to Build on Google Cloud

New to Google Cloud? Get $300 in credits to explore Compute Engine, BigQuery, Cloud Run, Gemini Enterprise Agent Platform, and more.

Start your next project with $300 in free Google Cloud credit. Spin up VMs, run containers, query petabytes in BigQuery, or build agents with Gemini Enterprise Agent Platform. Once your credits are used, keep building with 20+ always-free tier products including Compute Engine, Cloud Storage, GKE, and Cloud Run functions. No commitment required—just sign up and start building.

Claim $300 Free

Recommended Projects

llama.cpp
Port of Facebook's LLaMA model in C/C++
LLamaSharp
C#/.NET binding of llama.cpp, including LLaMa/GPT model inference
Alpaca.cpp
Locally run an Instruction-Tuned Chat-Style LLM
LLaMA-Factory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
llama2.c
Inference Llama 2 in one file of pure C

llama.cpp Python Bindings Files

Python bindings for llama.cpp

Get an email when there's a new version of llama.cpp Python Bindings