Ongoing research training transformer models at scale
This is an exact mirror of the Megatron project, hosted at https://github.com/NVIDIA/Megatron-LM.
SourceForge is not affiliated with Megatron.
Megatron is a trademark of NVIDIA CORPORATION.
Changelog Details
- beep boop 🤖: Bumping versions by @svcnvidia-nemo-ci :: PR: [#4349]
- cp: `NVFP4 native weights for DDP (4005)` into `core_r0.17.0` by @ko3n1g :: PR: [#4290]
- docs: bump project.json and versions1.json to 0.17.0 by @ko3n1g :: PR: [#4361]
- [docs] ci: fix version picker in 0.17.0 docs by @ko3n1g :: PR: [#4363]
- [docs] ci: use parent-relative json_url for version picker by @ko3n1g :: PR: [#4366]
- Backport NVRx async checkpoint compatibility to core_r0.17.0 by @sbak5 :: PR: [#4453]
- cp: `add permute fusion into hybrid ep (4089)` into `core_r0.17.0` by @ko3n1g :: PR: [#4488]
- cp: `get rid of weights_only=False (4434)` into `core_r0.17.0` by @ko3n1g :: PR: [#4554]
- cp: `SafeUnpickler class for safe pickle usage (4319)` into `core_r0.17.0` by @ko3n1g :: PR: [#4555]
- cp: `checkpoint integrity verification (4305)` into `core_r0.17.0` by @ko3n1g :: PR: [#4556]
- fix(async_ckpt): import inspect in async_utils on core_r0.17.0 by @ko3n1g :: PR: [#4597]
- chore(beep boop 🤖): Bump `uv.lock` (core_r0.17.0) (2026-05-04) by @svcnvidia-nemo-ci :: PR: [#4598]
- cp: fix: Replace polynomial rolling hash with SHA-256 for prefix caching (#4158) by @chtruong814 :: PR: [#4612]
- build: relax transformers cap to <=5.3.0 on core_r0.17.0 by @ko3n1g :: PR: [#4701]
- chore: Bump TE to latest 2.14 by @chtruong814 :: PR: [#4772]
- cp: additional tests for nvrx (#4522) by @chtruong814 :: PR: [#4826]
- Release 0.17.0 by @ko3n1g
- Bump mfsdp to 0.4.0 by @ko3n1g
- cp: `NVFP4 native weights for DDP (4005)` into `core_r0.17.0` (#4290) by @ko3n1g
- docs: bump project.json and versions1.json to 0.17.0 (#4361) by @ko3n1g
- [docs] ci: fix version picker in 0.17.0 docs (#4363) by @ko3n1g
- [docs] ci: use parent-relative json_url for version picker (#4366) by @ko3n1g
- chore(beep boop 🤖): Bump (core_r0.17.0) (2026-04-20) by @github-actions[bot]
- Backport NVRx async checkpoint compatibility to core_r0.17.0 (#4453) by @sbak5
- add permute fusion into hybrid ep (#4089) by @Autumn1998
- Merge pull request [#4488] from NVIDIA/cherry-pick-4089-core_r0.17.0 by @ko3n1g
- get rid of weights_only=False (#4434) by @dimapihtar
- SafeUnpickler class for safe pickle usage (#4319) by @dimapihtar
- checkpoint integrity verification (#4305) by @dimapihtar
- Merge pull request [#4554] from NVIDIA/cherry-pick-4434-core_r0.17.0 by @ko3n1g
- Merge pull request [#4555] from NVIDIA/cherry-pick-4319-core_r0.17.0 by @ko3n1g
- Merge pull request [#4556] from NVIDIA/cherry-pick-4305-core_r0.17.0 by @ko3n1g
- fix(async_ckpt): import inspect in async_utils on core_r0.17.0 (#4597) by @ko3n1g
- chore(beep boop 🤖): Bump `uv.lock` (core_r0.17.0) (2026-05-04) (#4598) by @svcnvidia-nemo-ci
- cp: fix: Replace polynomial rolling hash with SHA-256 for prefix caching (#4158) (#4612) by @chtruong814
- build: relax transformers cap to <=5.3.0 on core_r0.17.0 (#4701) by @ko3n1g
- chore(beep boop 🤖): Bump (core_r0.17.0) (2026-05-11) by @github-actions[bot]
- chore: Bump TE to latest 2.14 (#4772) by @chtruong814
- cp: additional tests for nvrx (#4522) (#4826) by @chtruong814
- chore(beep boop 🤖): Bump (core_r0.17.0) (2026-05-18) by @github-actions[bot]
- chore(beep boop 🤖): Bump (core_r0.17.0) (2026-05-25) by @github-actions[bot]
Source: README.md, updated 2026-05-25
Other Useful Business Software
Fully Managed MySQL, PostgreSQL, and SQL Server
Automatic backups, patching, replication, and failover. Focus on your app, not your database.
Cloud SQL handles your database ops end to end, so you can focus on your app.
Try Free
Build Agents and Models on One Platform
Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.
Gemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.