llama.cpp Files

Port of Facebook's LLaMA model in C/C++

This is an exact mirror of the llama.cpp project, hosted at https://github.com/ggerganov/llama.cpp. SourceForge is not affiliated with llama.cpp. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
llama-b6999-xcframework.zip	< 21 hours ago	142.8 MB	0
llama-b6999-bin-win-vulkan-x64.zip	< 21 hours ago	28.9 MB	0
llama-b6999-bin-win-sycl-x64.zip	< 21 hours ago	104.0 MB	0
llama-b6999-bin-win-opencl-adreno-arm64.zip	< 21 hours ago	12.2 MB	0
llama-b6999-bin-win-hip-radeon-x64.zip	< 21 hours ago	339.5 MB	4
llama-b6999-bin-win-cuda-12.4-x64.zip	< 21 hours ago	182.4 MB	0
llama-b6999-bin-win-cpu-x64.zip	< 21 hours ago	15.0 MB	0
llama-b6999-bin-win-cpu-arm64.zip	< 21 hours ago	11.7 MB	0
llama-b6999-bin-ubuntu-x64.zip	< 21 hours ago	13.7 MB	0
llama-b6999-bin-ubuntu-vulkan-x64.zip	< 21 hours ago	28.2 MB	0
llama-b6999-bin-ubuntu-s390x.zip	< 21 hours ago	13.3 MB	4
llama-b6999-bin-macos-x64.zip	< 21 hours ago	29.7 MB	0
llama-b6999-bin-macos-arm64.zip	< 21 hours ago	11.6 MB	0
cudart-llama-bin-win-cuda-12.4-x64.zip	< 21 hours ago	391.4 MB	0
b6999 source code.tar.gz	< 21 hours ago	26.4 MB	0
b6999 source code.zip	< 21 hours ago	27.3 MB	0
Totals: 16 Items		1.4 GB	8

Other Useful Business Software

Level Up Your Cyber Defense with External Threat Management Icon

Level Up Your Cyber Defense with External Threat Management

See every risk before it hits. From exposed data to dark web chatter. All in one unified view.

Move beyond alerts. Gain full visibility, context, and control over your external attack surface to stay ahead of every threat.

Try for Free

Build Securely on AWS with Proven Frameworks Icon

Build Securely on AWS with Proven Frameworks

Lay a foundation for success with Tested Reference Architectures developed by Fortinet’s experts. Learn more in this white paper.

Moving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.

Download Now

Recommended Projects

llama.cpp Python Bindings
llama-cpp-python provides Python bindings for llama.cpp, enabling the integration of LLaMA (Large Language Model Meta AI) language models into Python applications. This facilitates the use of LLaMA's capabilities in natural language processing tasks within Python environments.
ChatGLM.cpp
ChatGLM.cpp is a C++ implementation of the ChatGLM-6B model, enabling efficient local inference without requiring a Python environment. It is optimized for running on consumer hardware.
Ling
Ling is a Mixture-of-Experts (MoE) large language model (LLM) provided and open-sourced by inclusionAI. The project offers different sizes (Ling-lite, Ling-plus) and emphasizes flexibility and efficiency: being able to scale, adapt expert activation, and perform across a range of natural...
OpenLLM
An open platform for operating large language models (LLMs) in production. Fine-tune, serve, deploy, and monitor any LLMs with ease. With OpenLLM, you can run inference with any open-source large-language models, deploy to the cloud or on-premises, and build powerful AI apps. Built-in supports a...
GPT4All
GPT4All is an open-source project that allows users to run large language models (LLMs) locally on their desktops or laptops, eliminating the need for API calls or GPUs. The software provides a simple, user-friendly application that can be downloaded and run on various platforms, including...