Megatron Files

Ongoing research training transformer models at scale

This is an exact mirror of the Megatron project, hosted at https://github.com/NVIDIA/Megatron-LM. SourceForge is not affiliated with Megatron. Megatron is a trademark of NVIDIA CORPORATION. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
NVIDIA Megatron Core 0.12.1 source code.tar.gz	2025-05-20	6.4 MB	0
NVIDIA Megatron Core 0.12.1 source code.zip	2025-05-20	7.3 MB	3
Totals: 2 Items		13.8 MB	3

Other Useful Business Software

Our Free Plans just got better! | Auth0

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.

Try free now

Powering the best of the internet | Fastly

Fastly's edge cloud platform delivers faster, safer, and more scalable sites and apps to customers.

Ensure your websites, applications and services can effortlessly handle the demands of your users with Fastly. Fastly’s portfolio is designed to be highly performant, personalized and secure while seamlessly scaling to support your growth.

Try for free

Recommended Projects

abstract2paper
Auto-generate an entire paper from a prompt or abstract using NLP
DeSmuME: Nintendo DS emulator
DeSmuME is a Nintendo DS emulator
Apache OpenOffice
The free and Open Source productivity suite
KeePass
A lightweight and easy-to-use password manager
Clonezilla
A partition and disk imaging/cloning program

Megatron Files

Ongoing research training transformer models at scale

Get an email when there's a new version of Megatron