Megatron Files

Ongoing research training transformer models at scale

This is an exact mirror of the Megatron project, hosted at https://github.com/NVIDIA/Megatron-LM. SourceForge is not affiliated with Megatron. Megatron is a trademark of NVIDIA CORPORATION.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	InfoDownloads / Week
core_v0.19.2	< 17 hours ago	0
core_v0.19.0	2026-08-19	2
core_v0.18.2	2026-07-20	0
core_v0.18.0	2026-06-23	0
core_v0.17.1	2026-05-25	0
Totals: 5 Items		2

Other Useful Business Software

MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.

Start Free

Build Securely on AWS with Proven Frameworks

Lay a foundation for success with Tested Reference Architectures developed by Fortinet’s experts. Learn more in this white paper.

Moving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.

Download Now

Recommended Projects

Megatron-LM
Ongoing research training transformer models at scale
GPT-NeoX
Implementation of model parallel autoregressive transformers on GPUs
Transformers.jl
Julia Implementation of Transformer models
Transformer Engine
A library for accelerating Transformer models on NVIDIA GPUs
NVIDIA NeMo
Toolkit for conversational AI