llama.cpp Python Bindings Files

Python bindings for llama.cpp

This is an exact mirror of the llama.cpp Python Bindings project, hosted at https://github.com/abetlen/llama-cpp-python. SourceForge is not affiliated with llama.cpp Python Bindings.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
llama_cpp_python-0.3.34-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl	< 24 hours ago	130.1 MB	0
llama_cpp_python-0.3.34-py3-none-win_amd64.whl	< 24 hours ago	42.3 MB	0
v0.3.34-vulkan source code.tar.gz	< 24 hours ago	423.3 kB	0
v0.3.34-vulkan source code.zip	< 24 hours ago	480.5 kB	0
Totals: 4 Items		173.4 MB	0

Other Useful Business Software

$300 Free Credits for Your Google Cloud Projects

Start building on Google Cloud with $300 in free credits. No commitment, no credit card required until you're ready to scale.

Launch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.

Start Free Trial

Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.

Try Free

$300 Free Credits for Your Google Cloud Projects

Start building on Google Cloud with $300 in free credits. No commitment, no credit card required until you're ready to scale.

Start Free Trial

Recommended Projects

llama.cpp
Port of Facebook's LLaMA model in C/C++
LLamaSharp
C#/.NET binding of llama.cpp, including LLaMa/GPT model inference
Chinese-LLaMA-Alpaca 2
Chinese LLaMA-2 & Alpaca-2 Large Model Phase II Project
Alpaca.cpp
Locally run an Instruction-Tuned Chat-Style LLM
LLaMA-Factory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

llama.cpp Python Bindings Files

Python bindings for llama.cpp

Get an email when there's a new version of llama.cpp Python Bindings