Megatron Files

Ongoing research training transformer models at scale

This is an exact mirror of the Megatron project, hosted at https://github.com/NVIDIA/Megatron-LM. SourceForge is not affiliated with Megatron. Megatron is a trademark of NVIDIA CORPORATION. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
NVIDIA Megatron Core 0.13.1 source code.tar.gz	2025-08-11	9.3 MB	0
NVIDIA Megatron Core 0.13.1 source code.zip	2025-08-11	10.2 MB	0
Totals: 2 Items		19.4 MB	0

Other Useful Business Software

Gen AI apps are built with MongoDB Atlas

Build gen AI apps with an all-in-one modern database: MongoDB Atlas

MongoDB Atlas provides built-in vector search and a flexible document model so developers can build, scale, and run gen AI apps without stitching together multiple databases. From LLM integration to semantic search, Atlas simplifies your AI architecture—and it’s free to get started.

Start Free

Build Securely on AWS with Proven Frameworks

Lay a foundation for success with Tested Reference Architectures developed by Fortinet’s experts. Learn more in this white paper.

Moving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.

Download Now

Recommended Projects

abstract2paper
Auto-generate an entire paper from a prompt or abstract using NLP
KeePass
A lightweight and easy-to-use password manager
Clonezilla
A partition and disk imaging/cloning program
Apache OpenOffice
The free and Open Source productivity suite
DeSmuME: Nintendo DS emulator
DeSmuME is a Nintendo DS emulator

Megatron Files

Ongoing research training transformer models at scale

Get an email when there's a new version of Megatron