Megatron Files

Ongoing research training transformer models at scale

This is an exact mirror of the Megatron project, hosted at https://github.com/NVIDIA/Megatron-LM. SourceForge is not affiliated with Megatron. Megatron is a trademark of NVIDIA CORPORATION.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	InfoDownloads / Week
core_v0.20.0	2026-10-27	0
26.09-lambda.rc1	2026-10-13	0
26.09-alpha.rc3	2026-10-13	0
26.09-alpha.rc2	2026-10-08	2
26.09-alpha.rc1	2026-10-06	2
Totals: 5 Items		4

Other Useful Business Software

$300 Free Credits to Build on Google Cloud

New customers can spin up VMs, build with AI, and query data at no cost.

Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.

Start Free

Ship Agents Faster

Transform your applications and workflows into powerful agentic systems at global scale.

Gemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.

Start Free

$300 Free Credits to Build on Google Cloud

New customers can spin up VMs, build with AI, and query data at no cost.

Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.

Start Free

Recommended Projects

Megatron-LM
Ongoing research training transformer models at scale
Transformer Engine
A library for accelerating Transformer models on NVIDIA GPUs
higgsfield
Fault-tolerant, highly scalable GPU orchestration
NVIDIA NeMo
Toolkit for conversational AI
CPT
CPT: A Pre-Trained Unbalanced Transformer