llama.cpp Files

Port of Facebook's LLaMA model in C/C++

This is an exact mirror of the llama.cpp project, hosted at https://github.com/ggerganov/llama.cpp. SourceForge is not affiliated with llama.cpp. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
llama-b7012-xcframework.zip	< 8 hours ago	142.8 MB	0
llama-b7012-bin-win-vulkan-x64.zip	< 8 hours ago	28.8 MB	0
llama-b7012-bin-win-sycl-x64.zip	< 8 hours ago	104.0 MB	0
llama-b7012-bin-win-opencl-adreno-arm64.zip	< 8 hours ago	12.2 MB	0
llama-b7012-bin-win-hip-radeon-x64.zip	< 8 hours ago	339.5 MB	0
llama-b7012-bin-win-cuda-12.4-x64.zip	< 8 hours ago	182.5 MB	0
llama-b7012-bin-win-cpu-x64.zip	< 8 hours ago	15.0 MB	0
llama-b7012-bin-win-cpu-arm64.zip	< 8 hours ago	11.7 MB	0
llama-b7012-bin-ubuntu-x64.zip	< 8 hours ago	13.7 MB	0
llama-b7012-bin-ubuntu-vulkan-x64.zip	< 8 hours ago	28.2 MB	0
llama-b7012-bin-ubuntu-s390x.zip	< 8 hours ago	13.3 MB	0
llama-b7012-bin-macos-x64.zip	< 8 hours ago	29.7 MB	0
llama-b7012-bin-macos-arm64.zip	< 8 hours ago	11.6 MB	0
cudart-llama-bin-win-cuda-12.4-x64.zip	< 8 hours ago	391.4 MB	0
b7012 source code.tar.gz	< 12 hours ago	27.1 MB	0
b7012 source code.zip	< 12 hours ago	28.0 MB	0
Totals: 16 Items		1.4 GB	0

Other Useful Business Software

The All-in-One Commerce Platform for Businesses - Shopify Icon

The All-in-One Commerce Platform for Businesses - Shopify

Shopify offers plans for anyone that wants to sell products online and build an ecommerce store, small to mid-sized businesses as well as enterprise

Shopify is a leading all-in-one commerce platform that enables businesses to start, build, and grow their online and physical stores. It offers tools to create customized websites, manage inventory, process payments, and sell across multiple channels including online, in-person, wholesale, and global markets. The platform includes integrated marketing tools, analytics, and customer engagement features to help merchants reach and retain customers. Shopify supports thousands of third-party apps and offers developer-friendly APIs for custom solutions. With world-class checkout technology, Shopify powers over 150 million high-intent shoppers worldwide. Its reliable, scalable infrastructure ensures fast performance and seamless operations at any business size.

Learn More

Simple, Secure Domain Registration Icon

Simple, Secure Domain Registration

Get your domain at wholesale price. Cloudflare offers simple, secure registration with no markups, plus free DNS, CDN, and SSL integration.

Register or renew your domain and pay only what we pay. No markups, hidden fees, or surprise add-ons. Choose from over 400 TLDs (.com, .ai, .dev). Every domain is integrated with Cloudflare's industry-leading DNS, CDN, and free SSL to make your site faster and more secure. Simple, secure, at-cost domain registration.

Sign up for free

Recommended Projects

llama.cpp Python Bindings
llama-cpp-python provides Python bindings for llama.cpp, enabling the integration of LLaMA (Large Language Model Meta AI) language models into Python applications. This facilitates the use of LLaMA's capabilities in natural language processing tasks within Python environments.
ChatGLM.cpp
ChatGLM.cpp is a C++ implementation of the ChatGLM-6B model, enabling efficient local inference without requiring a Python environment. It is optimized for running on consumer hardware.
OpenLLM
An open platform for operating large language models (LLMs) in production. Fine-tune, serve, deploy, and monitor any LLMs with ease. With OpenLLM, you can run inference with any open-source large-language models, deploy to the cloud or on-premises, and build powerful AI apps. Built-in supports a...
GPT4All
GPT4All is an open-source project that allows users to run large language models (LLMs) locally on their desktops or laptops, eliminating the need for API calls or GPUs. The software provides a simple, user-friendly application that can be downloaded and run on various platforms, including...
Alpaca.cpp
Run a fast ChatGPT-like model locally on your device. This combines the LLaMA foundation model with an open reproduction of Stanford Alpaca a fine-tuning of the base model to obey instructions (akin to the RLHF used to train ChatGPT) and a set of modifications to llama.cpp to add a chat...