Megatron Files

Ongoing research training transformer models at scale

This is an exact mirror of the Megatron project, hosted at https://github.com/NVIDIA/Megatron-LM. SourceForge is not affiliated with Megatron. Megatron is a trademark of NVIDIA CORPORATION.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	InfoDownloads / Week
26.04-alpha.rc1	2026-04-22	2
core_v0.17.0	2026-04-14	1
core_v0.16.1	2026-03-16	0
core_v0.16.0	2026-02-26	0
core_v0.15.3	2026-02-06	0
Totals: 5 Items		3

Other Useful Business Software

Go From AI Idea to AI App Fast

One platform to build, fine-tune, and deploy ML models. No MLOps team required.

Access Gemini 3 and 200+ models. Build chatbots, agents, or custom models with built-in monitoring and scaling.

Try Free

MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.

Start Free

Go From AI Idea to AI App Fast

One platform to build, fine-tune, and deploy ML models. No MLOps team required.

Access Gemini 3 and 200+ models. Build chatbots, agents, or custom models with built-in monitoring and scaling.

Try Free

Recommended Projects

Megatron-LM
Ongoing research training transformer models at scale
GPT-NeoX
Implementation of model parallel autoregressive transformers on GPUs
Transformer Engine
A library for accelerating Transformer models on NVIDIA GPUs
NVIDIA NeMo
Toolkit for conversational AI
higgsfield
Fault-tolerant, highly scalable GPU orchestration

Megatron Files

Ongoing research training transformer models at scale

Get an email when there's a new version of Megatron