llama.cpp Python Bindings Files

Python bindings for llama.cpp

This is an exact mirror of the llama.cpp Python Bindings project, hosted at https://github.com/abetlen/llama-cpp-python. SourceForge is not affiliated with llama.cpp Python Bindings.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
llama_cpp_python-0.3.35-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl	2026-08-17	142.8 MB	0
llama_cpp_python-0.3.35-py3-none-win_amd64.whl	2026-08-17	45.5 MB	0
v0.3.35-vulkan source code.tar.gz	2026-08-17	427.0 kB	0
v0.3.35-vulkan source code.zip	2026-08-17	484.2 kB	0
Totals: 4 Items		189.2 MB	0

Other Useful Business Software

$300 Free Credits to Build on Google Cloud

New customers can spin up VMs, build with AI, and query data at no cost.

Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.

Start Free

Go from Code to Production URL in Seconds

Cloud Run deploys apps in any language instantly. Scales to zero. Pay only when code runs.

Skip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.

Try it free

$300 Free Credits to Build on Google Cloud

New customers can spin up VMs, build with AI, and query data at no cost.

Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.

Start Free

Recommended Projects

llama.cpp
Port of Facebook's LLaMA model in C/C++
Alpaca.cpp
Locally run an Instruction-Tuned Chat-Style LLM
LLaMA-Factory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama
llama2.c
Inference Llama 2 in one file of pure C

llama.cpp Python Bindings Files

Python bindings for llama.cpp

Get an email when there's a new version of llama.cpp Python Bindings