llama.cpp Files

Port of Facebook's LLaMA model in C/C++

This is an exact mirror of the llama.cpp project, hosted at https://github.com/ggerganov/llama.cpp. SourceForge is not affiliated with llama.cpp. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
llama-b7052-xcframework.zip	< 15 hours ago	143.4 MB	0
llama-b7052-bin-win-vulkan-x64.zip	< 15 hours ago	29.0 MB	0
llama-b7052-bin-win-sycl-x64.zip	< 15 hours ago	104.1 MB	0
llama-b7052-bin-win-opencl-adreno-arm64.zip	< 15 hours ago	12.3 MB	0
llama-b7052-bin-win-hip-radeon-x64.zip	< 15 hours ago	339.7 MB	0
llama-b7052-bin-win-cuda-12.4-x64.zip	< 15 hours ago	182.7 MB	0
llama-b7052-bin-win-cpu-x64.zip	< 15 hours ago	15.1 MB	0
llama-b7052-bin-win-cpu-arm64.zip	< 15 hours ago	11.8 MB	0
llama-b7052-bin-ubuntu-x64.zip	< 15 hours ago	17.1 MB	0
llama-b7052-bin-ubuntu-vulkan-x64.zip	< 15 hours ago	31.5 MB	0
llama-b7052-bin-ubuntu-s390x.zip	< 15 hours ago	17.7 MB	0
llama-b7052-bin-macos-x64.zip	< 15 hours ago	33.3 MB	0
llama-b7052-bin-macos-arm64.zip	< 15 hours ago	15.1 MB	0
cudart-llama-bin-win-cuda-12.4-x64.zip	< 15 hours ago	391.4 MB	0
b7052 source code.tar.gz	< 19 hours ago	27.2 MB	0
b7052 source code.zip	< 19 hours ago	28.0 MB	0
Totals: 16 Items		1.4 GB	0

Other Useful Business Software

Our Free Plans just got better! | Auth0 Icon

Our Free Plans just got better! | Auth0

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.

Try free now

Gen AI apps are built with MongoDB Atlas Icon

Gen AI apps are built with MongoDB Atlas

The database for AI-powered applications.

MongoDB Atlas is the developer-friendly database used to build, scale, and run gen AI and LLM-powered apps—without needing a separate vector database. Atlas offers built-in vector search, global availability across 115+ regions, and flexible document modeling. Start building AI apps faster, all in one place.

Start Free

Recommended Projects

GPT4All
GPT4All is an open-source project that allows users to run large language models (LLMs) locally on their desktops or laptops, eliminating the need for API calls or GPUs. The software provides a simple, user-friendly application that can be downloaded and run on various platforms, including...
OpenLLM
An open platform for operating large language models (LLMs) in production. Fine-tune, serve, deploy, and monitor any LLMs with ease. With OpenLLM, you can run inference with any open-source large-language models, deploy to the cloud or on-premises, and build powerful AI apps. Built-in supports a...
LLamaSharp
The C#/.NET binding of llama.cpp. It provides APIs to infer the LLaMa Models and deploy it on the local environment. It works on both Windows, Linux and MAC without the requirement for compiling llama.cpp yourself. Its performance is close to llama.cpp. Furthermore, it provides integrations with...
llama.cpp Python Bindings
llama-cpp-python provides Python bindings for llama.cpp, enabling the integration of LLaMA (Large Language Model Meta AI) language models into Python applications. This facilitates the use of LLaMA's capabilities in natural language processing tasks within Python environments.
ChatGLM.cpp
ChatGLM.cpp is a C++ implementation of the ChatGLM-6B model, enabling efficient local inference without requiring a Python environment. It is optimized for running on consumer hardware.