jamesob's guide to running SOTA LLMs Files

Everything I know about running LLMs locally

This is an exact mirror of the jamesob's guide to running SOTA LLMs project, hosted at https://github.com/jamesob/local-llm. SourceForge is not affiliated with jamesob's guide to running SOTA LLMs.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size
local-llm source code.tar.gz	< 12 hours ago	11.0 MB
local-llm source code.zip	< 12 hours ago	11.0 MB
Totals: 2 Items		22.1 MB

Other Useful Business Software

Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.

Try Free

Our Free Plans just got better! | Auth0

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.

Try free now

Our Free Plans just got better! | Auth0

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

Try free now

Recommended Projects

AirLLM
AirLLM 70B inference with single 4GB GPU
LiteRT-LM
LiteRT-LM is Google's production-ready inference framework
llmfit
157 models, 30 providers, one command to find what runs on hardware
whichllm
Find the local LLM that actually runs and performs best
llama.cpp
LLM inference in C/C++

jamesob's guide to running SOTA LLMs Files

Everything I know about running LLMs locally

Get an email when there's a new version of jamesob's guide to running SOTA LLMs