TensorRT LLM Files

TensorRT LLM provides users with an easy-to-use Python API

This is an exact mirror of the TensorRT LLM project, hosted at https://github.com/NVIDIA/TensorRT-LLM. SourceForge is not affiliated with TensorRT LLM.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
README.md	2026-04-16	176 Bytes	0
v1.2.1 source code.tar.gz	2026-04-16	417.5 MB	0
v1.2.1 source code.zip	2026-04-16	423.0 MB	1
Totals: 3 Items		840.5 MB	1

Highlights

Fixed Issue
Fixed an issue that caused KV cache corruption (#12770)
Infrastructure Changes
Upgraded xgrammar and flashinfer (#12811)

Source: README.md, updated 2026-04-16

Other Useful Business Software

Full-stack observability with actually useful AI | Grafana Cloud

Our generous forever free tier includes the full platform, including the AI Assistant, for 3 users with 10k metrics, 50GB logs, and 50GB traces.

Built on open standards like Prometheus and OpenTelemetry, Grafana Cloud includes Kubernetes Monitoring, Application Observability, Incident Response, plus the AI-powered Grafana Assistant. Get started with our generous free tier today.

Create free account

Go From AI Idea to AI App Fast

One platform to build, fine-tune, and deploy ML models. No MLOps team required.

Access Gemini 3 and 200+ models. Build chatbots, agents, or custom models with built-in monitoring and scaling.

Try Free

Full-stack observability with actually useful AI | Grafana Cloud

Our generous forever free tier includes the full platform, including the AI Assistant, for 3 users with 10k metrics, 50GB logs, and 50GB traces.

Create free account

Recommended Projects

TensorRT
C++ library for high performance inference on NVIDIA GPUs
RTP-LLM
Alibaba's high-performance LLM inference engine for diverse apps
SimpleLLM
950 line, minimal, extensible LLM inference engine built from scratch
Torch-TensorRT
PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
Triton Inference Server
The Triton Inference Server provides an optimized cloud

TensorRT LLM Files

TensorRT LLM provides users with an easy-to-use Python API

Get an email when there's a new version of TensorRT LLM

Highlights