Distributed Llama Files

Connect home devices into a powerful cluster to accelerate LLM

This is an exact mirror of the Distributed Llama project, hosted at https://github.com/b4rtaz/distributed-llama. SourceForge is not affiliated with Distributed Llama. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
0.13.5 source code.tar.gz	2025-04-19	1.3 MB	0
0.13.5 source code.zip	2025-04-19	1.4 MB	0
README.md	2025-04-19	657 Bytes	0
Totals: 3 Items		2.7 MB	0

The Vulkan matmul shader (matmul-forward-q80-q40-f32.comp) was optimized.

Tested on NVIDIA Tesla T4 16 GB using the llama3_1_8b_instruct_q40 model with --buffer-float-type q80.

Before:

🔶 Pred  151 ms Sync    0 ms | Sent     0 kB Recv     0 kB | )
🔶 Pred  151 ms Sync    0 ms | Sent     0 kB Recv     0 kB |  to
🔶 Pred  153 ms Sync    0 ms | Sent     0 kB Recv     0 kB |  be

This version:

🔶 Pred   97 ms Sync    0 ms | Sent     0 kB Recv     0 kB |  obtained
🔶 Pred   96 ms Sync    0 ms | Sent     0 kB Recv     0 kB |  by
🔶 Pred   96 ms Sync    0 ms | Sent     0 kB Recv     0 kB |  pert

Source: README.md, updated 2025-04-19

Other Useful Business Software

Our Free Plans just got better! | Auth0

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.

Try free now

Gen AI apps are built with MongoDB Atlas

The database for AI-powered applications.

MongoDB Atlas is the developer-friendly database used to build, scale, and run gen AI and LLM-powered apps—without needing a separate vector database. Atlas offers built-in vector search, global availability across 115+ regions, and flexible document modeling. Start building AI apps faster, all in one place.

Start Free

Recommended Projects

Artificial Intelligence Controller
AICI: Prompts as (Wasm) Programs
Apache OpenOffice
The free and Open Source productivity suite
Clonezilla
A partition and disk imaging/cloning program
KeePass
A lightweight and easy-to-use password manager
7-Zip
A free file archiver for extremely high compression

Distributed Llama Files

Connect home devices into a powerful cluster to accelerate LLM

Get an email when there's a new version of Distributed Llama