TensorRT LLM Files

TensorRT LLM provides users with an easy-to-use Python API

This is an exact mirror of the TensorRT LLM project, hosted at https://github.com/NVIDIA/TensorRT-LLM. SourceForge is not affiliated with TensorRT LLM.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	InfoDownloads / Week
v1.2.0	2026-03-10	2
v1.1.0	2025-12-11	0
v1.0.0	2025-10-16	0
v0.21.0	2025-08-01	0
v0.20.0	2025-06-18	0
Totals: 5 Items		2

Other Useful Business Software

MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.

Start Free

Try Google Cloud Risk-Free With $300 in Credit

No hidden charges. No surprise bills. Cancel anytime.

Use your credit across every product. Compute, storage, AI, analytics. When it runs out, 20+ products stay free. You only pay when you choose to.

Start Free

Featured

MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

Start Free

Recommended Projects

TensorRT
C++ library for high performance inference on NVIDIA GPUs
FasterTransformer
Transformer related optimization, including BERT, GPT
LLM Action
Technical principles related to large models
Torch-TensorRT
PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
tiny-llm
A course of learning LLM inference serving on Apple Silicon

TensorRT LLM Files

TensorRT LLM provides users with an easy-to-use Python API

Get an email when there's a new version of TensorRT LLM