Megatron Files

Ongoing research training transformer models at scale

This is an exact mirror of the Megatron project, hosted at https://github.com/NVIDIA/Megatron-LM. SourceForge is not affiliated with Megatron. Megatron is a trademark of NVIDIA CORPORATION.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
26.09-alpha.rc2 source code.tar.gz	2026-10-08	16.1 MB	0
26.09-alpha.rc2 source code.zip	2026-10-08	18.3 MB	0
Totals: 2 Items		34.4 MB	0

Other Useful Business Software

Cut Data Warehouse Costs by 54%

Easily migrate from Snowflake, Redshift, or Databricks with free tools.

BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.

Start Free

Demo Series - Small Business Backup By Veeam

Learn how to protect your Microsoft 365 data, with simple, actionable tips today.

Watch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.

Watch Demo Series

Recommended Projects

Megatron-LM
Ongoing research training transformer models at scale
Transformer Engine
A library for accelerating Transformer models on NVIDIA GPUs
higgsfield
Fault-tolerant, highly scalable GPU orchestration
Finetune Transformer LM
Code for "Improving Language Understanding by Generative Pre-Training"
NVIDIA NeMo
Toolkit for conversational AI