Megatron Files

Ongoing research training transformer models at scale

This is an exact mirror of the Megatron project, hosted at https://github.com/NVIDIA/Megatron-LM. SourceForge is not affiliated with Megatron. Megatron is a trademark of NVIDIA CORPORATION.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
core_v0.18.0	2026-06-23		0
core_v0.17.1	2026-05-25		0
26.04-alpha.rc2	2026-05-06		0
26.04-alpha.rc1	2026-04-22		0
core_v0.17.0	2026-04-14		0
Totals: 5 Items			0

Other Useful Business Software

Our Free Plans just got better! | Auth0

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.

Try free now

Train ML Models With SQL You Already Know

BigQuery automates data prep, analysis, and predictions with built-in AI assistance.

Build and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.

Try Free

Our Free Plans just got better! | Auth0

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

Try free now

Recommended Projects

Megatron-LM
Ongoing research training transformer models at scale
Transformers.jl
Julia Implementation of Transformer models
Transformer Engine
A library for accelerating Transformer models on NVIDIA GPUs
higgsfield
Fault-tolerant, highly scalable GPU orchestration
CPT
CPT: A Pre-Trained Unbalanced Transformer

Megatron Files

Ongoing research training transformer models at scale

Get an email when there's a new version of Megatron