Ongoing research training transformer models at scale
This is an exact mirror of the Megatron project, hosted at https://github.com/NVIDIA/Megatron-LM.
SourceForge is not affiliated with Megatron.
Megatron is a trademark of NVIDIA CORPORATION.
Changelog Details
- beep boop 🤖: Bumping versions by @svcnvidia-nemo-ci :: PR: [#4349]
- cp: `NVFP4 native weights for DDP (4005)` into `core_r0.17.0` by @ko3n1g :: PR: [#4290]
- docs: bump project.json and versions1.json to 0.17.0 by @ko3n1g :: PR: [#4361]
- [docs] ci: fix version picker in 0.17.0 docs by @ko3n1g :: PR: [#4363]
- [docs] ci: use parent-relative json_url for version picker by @ko3n1g :: PR: [#4366]
- Backport NVRx async checkpoint compatibility to core_r0.17.0 by @sbak5 :: PR: [#4453]
- cp: `add permute fusion into hybrid ep (4089)` into `core_r0.17.0` by @ko3n1g :: PR: [#4488]
- cp: `get rid of weights_only=False (4434)` into `core_r0.17.0` by @ko3n1g :: PR: [#4554]
- cp: `SafeUnpickler class for safe pickle usage (4319)` into `core_r0.17.0` by @ko3n1g :: PR: [#4555]
- cp: `checkpoint integrity verification (4305)` into `core_r0.17.0` by @ko3n1g :: PR: [#4556]
- fix(async_ckpt): import inspect in async_utils on core_r0.17.0 by @ko3n1g :: PR: [#4597]
- chore(beep boop 🤖): Bump `uv.lock` (core_r0.17.0) (2026-05-04) by @svcnvidia-nemo-ci :: PR: [#4598]
- cp: fix: Replace polynomial rolling hash with SHA-256 for prefix caching (#4158) by @chtruong814 :: PR: [#4612]
- build: relax transformers cap to <=5.3.0 on core_r0.17.0 by @ko3n1g :: PR: [#4701]
- chore: Bump TE to latest 2.14 by @chtruong814 :: PR: [#4772]
- cp: additional tests for nvrx (#4522) by @chtruong814 :: PR: [#4826]
- Release 0.17.0 by @ko3n1g
- Bump mfsdp to 0.4.0 by @ko3n1g
- cp: `NVFP4 native weights for DDP (4005)` into `core_r0.17.0` (#4290) by @ko3n1g
- docs: bump project.json and versions1.json to 0.17.0 (#4361) by @ko3n1g
- [docs] ci: fix version picker in 0.17.0 docs (#4363) by @ko3n1g
- [docs] ci: use parent-relative json_url for version picker (#4366) by @ko3n1g
- chore(beep boop 🤖): Bump (core_r0.17.0) (2026-04-20) by @github-actions[bot]
- Backport NVRx async checkpoint compatibility to core_r0.17.0 (#4453) by @sbak5
- add permute fusion into hybrid ep (#4089) by @Autumn1998
- Merge pull request [#4488] from NVIDIA/cherry-pick-4089-core_r0.17.0 by @ko3n1g
- get rid of weights_only=False (#4434) by @dimapihtar
- SafeUnpickler class for safe pickle usage (#4319) by @dimapihtar
- checkpoint integrity verification (#4305) by @dimapihtar
- Merge pull request [#4554] from NVIDIA/cherry-pick-4434-core_r0.17.0 by @ko3n1g
- Merge pull request [#4555] from NVIDIA/cherry-pick-4319-core_r0.17.0 by @ko3n1g
- Merge pull request [#4556] from NVIDIA/cherry-pick-4305-core_r0.17.0 by @ko3n1g
- fix(async_ckpt): import inspect in async_utils on core_r0.17.0 (#4597) by @ko3n1g
- chore(beep boop 🤖): Bump `uv.lock` (core_r0.17.0) (2026-05-04) (#4598) by @svcnvidia-nemo-ci
- cp: fix: Replace polynomial rolling hash with SHA-256 for prefix caching (#4158) (#4612) by @chtruong814
- build: relax transformers cap to <=5.3.0 on core_r0.17.0 (#4701) by @ko3n1g
- chore(beep boop 🤖): Bump (core_r0.17.0) (2026-05-11) by @github-actions[bot]
- chore: Bump TE to latest 2.14 (#4772) by @chtruong814
- cp: additional tests for nvrx (#4522) (#4826) by @chtruong814
- chore(beep boop 🤖): Bump (core_r0.17.0) (2026-05-18) by @github-actions[bot]
- chore(beep boop 🤖): Bump (core_r0.17.0) (2026-05-25) by @github-actions[bot]
Source: README.md, updated 2026-05-25
Other Useful Business Software
Ship Agents Faster
Transform your applications and workflows into powerful agentic systems at global scale.
Gemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
Get Started Free
Compliant and Reliable File Transfers Backed by Top Security Certifications
Cerberus FTP Server delivers SOC 2 Type II certified security and FIPS 140-2 validated encryption.
Stop relying on non-certified, legacy file transfer tools that creak under the weight of modern security demands. Get full audit trails, advanced access controls and more supported by an award-winning team of experts. Start your free 25-day trial today.