TensorRT LLM Files

TensorRT LLM provides users with an easy-to-use Python API

This is an exact mirror of the TensorRT LLM project, hosted at https://github.com/NVIDIA/TensorRT-LLM. SourceForge is not affiliated with TensorRT LLM.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	InfoDownloads / Week
v1.2.1	2026-04-16	1
v1.2.0	2026-03-10	2
v1.1.0	2025-12-11	1
v1.0.0	2025-10-16	1
v0.21.0	2025-08-01	1
Totals: 5 Items		6

Other Useful Business Software

Earn up to 16% annual interest with Nexo.

Let your crypto work for you

Put idle assets to work with competitive interest rates, borrow without selling, and trade with precision. All in one platform. Geographic restrictions, eligibility, and terms apply.

Get started with Nexo.

Gemini 3 and 200+ AI Models on One Platform

Access Google's best plus Claude, Llama, and Gemma. Fine-tune and deploy from one console.

Build, govern, and optimize agents and models with Gemini Enterprise Agent Platform.

Start Free

Gemini 3 and 200+ AI Models on One Platform

Access Google's best plus Claude, Llama, and Gemma. Fine-tune and deploy from one console.

Build, govern, and optimize agents and models with Gemini Enterprise Agent Platform.

Start Free

Recommended Projects

TensorRT
C++ library for high performance inference on NVIDIA GPUs
RTP-LLM
Alibaba's high-performance LLM inference engine for diverse apps
SimpleLLM
950 line, minimal, extensible LLM inference engine built from scratch
Torch-TensorRT
PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
Triton Inference Server
The Triton Inference Server provides an optimized cloud

TensorRT LLM Files

TensorRT LLM provides users with an easy-to-use Python API

Get an email when there's a new version of TensorRT LLM