llama.cpp Python Bindings Files

Python bindings for llama.cpp

This is an exact mirror of the llama.cpp Python Bindings project, hosted at https://github.com/abetlen/llama-cpp-python. SourceForge is not affiliated with llama.cpp Python Bindings.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
v0.3.34-hip-radeon	< 15 hours ago		0
v0.3.34-cu132	< 16 hours ago		0
v0.3.34-rocm72	< 17 hours ago		0
v0.3.34-vulkan	< 18 hours ago		0
v0.3.34-metal	< 18 hours ago		0
Totals: 5 Items			0

Other Useful Business Software

Ship Agents Faster

Transform your applications and workflows into powerful agentic systems at global scale.

Gemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.

Get Started Free

$300 Free Credits for Your Google Cloud Projects

Start building on Google Cloud with $300 in free credits. No commitment, no credit card required until you're ready to scale.

Launch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.

Start Free Trial

Ship Agents Faster

Transform your applications and workflows into powerful agentic systems at global scale.

Get Started Free

Recommended Projects

llama.cpp
Port of Facebook's LLaMA model in C/C++
LLamaSharp
C#/.NET binding of llama.cpp, including LLaMa/GPT model inference
Chinese-LLaMA-Alpaca 2
Chinese LLaMA-2 & Alpaca-2 Large Model Phase II Project
Alpaca.cpp
Locally run an Instruction-Tuned Chat-Style LLM
LLaMA-Factory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

llama.cpp Python Bindings Files

Python bindings for llama.cpp

Get an email when there's a new version of llama.cpp Python Bindings