llama.cpp Files

Port of Facebook's LLaMA model in C/C++

This is an exact mirror of the llama.cpp project, hosted at https://github.com/ggerganov/llama.cpp. SourceForge is not affiliated with llama.cpp. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
llama-b6966-xcframework.zip	< 19 hours ago	142.8 MB	0
llama-b6966-bin-win-vulkan-x64.zip	< 19 hours ago	28.6 MB	0
llama-b6966-bin-win-sycl-x64.zip	< 19 hours ago	103.8 MB	0
llama-b6966-bin-win-opencl-adreno-arm64.zip	< 19 hours ago	12.0 MB	0
llama-b6966-bin-win-hip-radeon-x64.zip	< 19 hours ago	339.3 MB	0
llama-b6966-bin-win-cuda-12.4-x64.zip	< 19 hours ago	182.3 MB	0
llama-b6966-bin-win-cpu-x64.zip	< 19 hours ago	14.8 MB	0
llama-b6966-bin-win-cpu-arm64.zip	< 19 hours ago	11.6 MB	0
llama-b6966-bin-ubuntu-x64.zip	< 19 hours ago	13.5 MB	0
llama-b6966-bin-ubuntu-vulkan-x64.zip	< 19 hours ago	27.9 MB	0
llama-b6966-bin-ubuntu-s390x.zip	< 19 hours ago	13.1 MB	0
llama-b6966-bin-macos-x64.zip	< 19 hours ago	29.4 MB	0
llama-b6966-bin-macos-arm64.zip	< 19 hours ago	11.5 MB	0
cudart-llama-bin-win-cuda-12.4-x64.zip	< 19 hours ago	391.4 MB	0
b6966 source code.tar.gz	< 21 hours ago	26.4 MB	0
b6966 source code.zip	< 21 hours ago	27.3 MB	0
Totals: 16 Items		1.4 GB	0

Other Useful Business Software

Simple, Secure Domain Registration Icon

Simple, Secure Domain Registration

Get your domain at wholesale price. Cloudflare offers simple, secure registration with no markups, plus free DNS, CDN, and SSL integration.

Register or renew your domain and pay only what we pay. No markups, hidden fees, or surprise add-ons. Choose from over 400 TLDs (.com, .ai, .dev). Every domain is integrated with Cloudflare's industry-leading DNS, CDN, and free SSL to make your site faster and more secure. Simple, secure, at-cost domain registration.

Sign up for free

MongoDB Atlas runs apps anywhere Icon

MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.

Start Free

Recommended Projects

GPT-NeoX
This repository records EleutherAI's library for training large-scale language models on GPUs. Our current framework is based on NVIDIA's Megatron Language Model and has been augmented with techniques from DeepSpeed as well as some novel optimizations. We aim to make this repo a centralized and...
llama.cpp Python Bindings
llama-cpp-python provides Python bindings for llama.cpp, enabling the integration of LLaMA (Large Language Model Meta AI) language models into Python applications. This facilitates the use of LLaMA's capabilities in natural language processing tasks within Python environments.
ChatGLM.cpp
ChatGLM.cpp is a C++ implementation of the ChatGLM-6B model, enabling efficient local inference without requiring a Python environment. It is optimized for running on consumer hardware.
Ling
Ling is a Mixture-of-Experts (MoE) large language model (LLM) provided and open-sourced by inclusionAI. The project offers different sizes (Ling-lite, Ling-plus) and emphasizes flexibility and efficiency: being able to scale, adapt expert activation, and perform across a range of natural...
OpenLLM
An open platform for operating large language models (LLMs) in production. Fine-tune, serve, deploy, and monitor any LLMs with ease. With OpenLLM, you can run inference with any open-source large-language models, deploy to the cloud or on-premises, and build powerful AI apps. Built-in supports a...