FlexLLMGen Files

Running large language models on a single GPU

This is an exact mirror of the FlexLLMGen project, hosted at https://github.com/FMInference/FlexLLMGen. SourceForge is not affiliated with FlexLLMGen.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
FlexLLMGen source code.tar.gz	2024-10-28	40.0 MB	0
FlexLLMGen source code.zip	2024-10-28	43.1 MB	1
Totals: 2 Items		83.1 MB	1

Other Useful Business Software

Gemini 3 and 200+ AI Models on One Platform

Access Google's best plus Claude, Llama, and Gemma. Fine-tune and deploy from one console.

Build generative AI apps with Vertex AI. Switch between models without switching platforms.

Start Free

Try Google Cloud Risk-Free With $300 in Credit

No hidden charges. No surprise bills. Cancel anytime.

Use your credit across every product. Compute, storage, AI, analytics. When it runs out, 20+ products stay free. You only pay when you choose to.

Start Free

Featured

Gemini 3 and 200+ AI Models on One Platform

Access Google's best plus Claude, Llama, and Gemma. Fine-tune and deploy from one console.

Build generative AI apps with Vertex AI. Switch between models without switching platforms.

Start Free

Recommended Projects

Mixtral offloading
Run Mixtral-8x7B models in Colab or consumer desktops
RTP-LLM
Alibaba's high-performance LLM inference engine for diverse apps
PowerInfer
High-speed Large Language Model Serving for Local Deployment
uzu
A high-performance inference engine for AI models
LightLLM
LightLLM is a Python-based LLM (Large Language Model) inference

FlexLLMGen Files

Running large language models on a single GPU

Get an email when there's a new version of FlexLLMGen