mistral.rs Files

Fast, flexible LLM inference

This is an exact mirror of the mistral.rs project, hosted at https://github.com/EricLBuehler/mistral.rs. SourceForge is not affiliated with mistral.rs.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	InfoDownloads / Week
v0.7.0	2026-01-28	10
v0.6.0	2025-06-10	1
v0.5.0	2025-03-24	0
v0.4.0	2025-01-22	1
v0.3.4	2024-11-28	1
Totals: 5 Items		13

Other Useful Business Software

Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.

Try Free

Gemini 3 and 200+ AI Models on One Platform

Access Google's best plus Claude, Llama, and Gemma. Fine-tune and deploy from one console.

Build generative AI apps with Vertex AI. Switch between models without switching platforms.

Start Free

Featured

Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.

Try Free

Recommended Projects

Text Generation Inference
Large Language Model Text Generation Inference
LazyLLM
Easiest and laziest way for building multi-agent LLMs applications
RTP-LLM
Alibaba's high-performance LLM inference engine for diverse apps
CTranslate2
Fast inference engine for Transformer models
FastDeploy
High-performance Inference and Deployment Toolkit for LLMs and VLMs

mistral.rs Files

Fast, flexible LLM inference

Get an email when there's a new version of mistral.rs