mistral.rs Files

Fast, flexible LLM inference

This is an exact mirror of the mistral.rs project, hosted at https://github.com/EricLBuehler/mistral.rs. SourceForge is not affiliated with mistral.rs.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	InfoDownloads / Week
v0.8.0	2026-04-02	0
v0.7.0	2026-01-28	2
v0.6.0	2025-06-10	1
v0.5.0	2025-03-24	0
v0.4.0	2025-01-22	0
Totals: 5 Items		3

Other Useful Business Software

Try Google Cloud Risk-Free With $300 in Credit

No hidden charges. No surprise bills. Cancel anytime.

Use your credit across every product. Compute, storage, AI, analytics. When it runs out, 20+ products stay free. You only pay when you choose to.

Start Free

Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.

Try Free

Try Google Cloud Risk-Free With $300 in Credit

No hidden charges. No surprise bills. Cancel anytime.

Use your credit across every product. Compute, storage, AI, analytics. When it runs out, 20+ products stay free. You only pay when you choose to.

Start Free

Recommended Projects

Text Generation Inference
Large Language Model Text Generation Inference
shimmy
Python-free Rust inference server
FastDeploy
High-performance Inference and Deployment Toolkit for LLMs and VLMs
CTranslate2
Fast inference engine for Transformer models
LoRAX
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

mistral.rs Files

Fast, flexible LLM inference

Get an email when there's a new version of mistral.rs