Megatron Files

Ongoing research training transformer models at scale

This is an exact mirror of the Megatron project, hosted at https://github.com/NVIDIA/Megatron-LM. SourceForge is not affiliated with Megatron. Megatron is a trademark of NVIDIA CORPORATION. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	InfoDownloads / Week
core_v0.15.0	2025-12-05	0
core_v0.14.0	2025-10-08	3
25.09-alpha.rc1	2025-10-01	2
core_v0.13.1	2025-08-11	0
core_v0.12.3	2025-08-09	0
Totals: 5 Items		5

Other Useful Business Software

Our Free Plans just got better! | Auth0

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.

Try free now

Inventors: Validate Your Idea, Protect It and Gain Market Advantages

SenseIP is ideal for individual inventors, startups, and businesses

senseIP is an AI innovation platform for inventors, automating any aspect of IP from the moment you have an idea. You can have it researched for uniqueness and protected; quickly and effortlessly, without expensive attorneys. Built for business success while securing your competitive edge.

Learn More

Recommended Projects

GPT-NeoX
Implementation of model parallel autoregressive transformers on GPUs
NVIDIA NeMo
Toolkit for conversational AI
Transformers.jl
Julia Implementation of Transformer models
GPT Neo
An implementation of model parallel GPT-2 and GPT-3-style models
Transformer Engine
A library for accelerating Transformer models on NVIDIA GPUs

Megatron Files

Ongoing research training transformer models at scale

Get an email when there's a new version of Megatron