Ongoing research training transformer models at scale
This is an exact mirror of the Megatron project, hosted at https://github.com/NVIDIA/Megatron-LM.
SourceForge is not affiliated with Megatron.
Megatron is a trademark of NVIDIA CORPORATION.
Changelog Details
- cp: `ci: Skip cleanup-taint-node jobs during deployments (3612)` into `core_r0.16.0` by @ko3n1g :: PR: [#3613]
- beep boop 🤖: Bumping versions by @svcnvidia-nemo-ci :: PR: [#3616]
- cp: `docs: Fix version picker urls (3621)` into `core_r0.16.0` by @ko3n1g :: PR: [#3622]
- cp: `ci: Increase changelog generation max PRs fetched (3620)` into `core_r0.16.0` by @ko3n1g :: PR: [#3623]
- Cherry-pick [#3399] for Mamba Uneven PP fix by @kevalmorabia97 :: PR: [#3544]
- cp: `fix: async_utils: explicit GC in persistent checkpoint worker loop (3591)` into `core_r0.16.0` by @ko3n1g :: PR: [#3628]
Source: README.md, updated 2026-03-16
Other Useful Business Software
MongoDB Atlas runs apps anywhere
Deploy in 115+ regions with the modern database for every enterprise.
MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
Start Free
Fully Managed MySQL, PostgreSQL, and SQL Server
Automatic backups, patching, replication, and failover. Focus on your app, not your database.
Cloud SQL handles your database ops end to end, so you can focus on your app.