Download Latest Version
v0.19.4 Patch Release source code.zip (218.1 MB)
Get an email when there's a new version of DeepSeed
| Name | Modified | Size | Downloads / Week |
|---|---|---|---|
| Parent folder | |||
| README.md | 2026-07-22 | 9.3 kB | |
| v0.19.3 Patch Release source code.tar.gz | 2026-07-22 | 216.8 MB | |
| v0.19.3 Patch Release source code.zip | 2026-07-22 | 218.1 MB | |
| Totals: 3 Items | 434.9 MB | 1 | |
What's Changed
- Update version post release by @loadams in https://github.com/deepspeedai/DeepSpeed/pull/8070
- Validate fp16 dynamic loss scaling parameters are positive by @aryanputta in https://github.com/deepspeedai/DeepSpeed/pull/8050
- Add merge queue DCO workflow by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/8086
- Stop obsolete CI jobs on workflow cancellation by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/8034
- Fix ZeRO-3: Use per-param dtype for output buffers in _allgather_params_coalesced by @albertvillanova in https://github.com/deepspeedai/DeepSpeed/pull/8073
- fix: close file descriptor in deepspeed_io_handle_t::wait() to prevent fd leak by @MarkCLChang in https://github.com/deepspeedai/DeepSpeed/pull/8075
- Add type hints to top-level public API functions by @arunshar in https://github.com/deepspeedai/DeepSpeed/pull/8079
- Default gradient_clipping to 1.0 by @sfc-gh-truwase in https://github.com/deepspeedai/DeepSpeed/pull/8068
- activation_checkpointing: default num_layers to None so configure() assert fires by @Kymi808 in https://github.com/deepspeedai/DeepSpeed/pull/8041
- Add configurable engine log level by @sfc-gh-truwase in https://github.com/deepspeedai/DeepSpeed/pull/8067
- [CI] diff driven test selection by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/8077
- Enable bf16 check_grad_overflow by default (matching fp16) by @yongzhe-wang in https://github.com/deepspeedai/DeepSpeed/pull/8035
- Support AutoEP with ZeRO-3 zero.Init source modules by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/8060
- Update publication list in README.md by @PKUWZP in https://github.com/deepspeedai/DeepSpeed/pull/8095
- fix: AutoTP partition_config uses full hierarchical module path by @delock in https://github.com/deepspeedai/DeepSpeed/pull/8088
- Reject Muon optimizer with reduce_scatter in ZeRO-1/2 by @whycoming in https://github.com/deepspeedai/DeepSpeed/pull/8090
- Fix DeepCompile profile metadata backfill by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/8094
- Add numerical-correctness test for Muon under ZeRO-1/2 by @whycoming in https://github.com/deepspeedai/DeepSpeed/pull/8091
- Don't swallow KeyboardInterrupt/SystemExit in NPUOpBuilder by @ajinkyajawale14499 in https://github.com/deepspeedai/DeepSpeed/pull/8096
- Avoid CUDA context initialization during op compatibility checks at import by @Achyuthan-S in https://github.com/deepspeedai/DeepSpeed/pull/8078
- [DeepCompile] fix gather params in dynamo skipped frames for ZeRO3 by @XAheli in https://github.com/deepspeedai/DeepSpeed/pull/8059
- Feat: zero3 deprecate elastic checkpoint by @nathon-lee in https://github.com/deepspeedai/DeepSpeed/pull/8099
- Fix eigenvalue parsing for compression-only quantize configs by @sowndappan5 in https://github.com/deepspeedai/DeepSpeed/pull/8057
- fix: log eigenvalue monitor values by @he-yufeng in https://github.com/deepspeedai/DeepSpeed/pull/8049
- Fix DeepCompile profiling memory cleanup by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/8106
- Add optional torchembed RoPE backend to apply_rotary_pos_emb by @py-ai-dev in https://github.com/deepspeedai/DeepSpeed/pull/8052
- Fix minor comment/docstring typos in runtime and inference modules by @nathon-lee in https://github.com/deepspeedai/DeepSpeed/pull/8046
- feat(zenflow): run the overlapped CPU optimizer in a native process by @Antlera in https://github.com/deepspeedai/DeepSpeed/pull/8058
- fix: add buffer-length check in shm.cpp by @orbisai0security in https://github.com/deepspeedai/DeepSpeed/pull/8082
- Fix FlopsProfiler crash when dp_world_size is None under sequence parallelism by @vineethsaivs in https://github.com/deepspeedai/DeepSpeed/pull/8122
- Fix Python 3.9 import-time TypeError in AutoEP ep_router by @vineethsaivs in https://github.com/deepspeedai/DeepSpeed/pull/8119
- Add input validation for save_checkpoint and warmup LR schedulers by @jahnavi-yelamanchi in https://github.com/deepspeedai/DeepSpeed/pull/8126
- Fix ZeRO-3: use per-param dtype for quantize-scale buffer in _allgather_params_coalesced by @roycho96 in https://github.com/deepspeedai/DeepSpeed/pull/8128
- Fix ZeRO-3 autocast gather with mixed parameter dtypes by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/8113
- doc: Remove suggestion to build extensions in parallel by @Flamefire in https://github.com/deepspeedai/DeepSpeed/pull/7899
- feat(types): add type hints to public comm API functions by @NovusEdge in https://github.com/deepspeedai/DeepSpeed/pull/8118
- Add Hybrid Engine rollout in DeepSpeed to support On-Policy Distillation (OPSD) Trainer by @PKUWZP in https://github.com/deepspeedai/DeepSpeed/pull/8027
- Add AutoEP + AutoTP parallel folding by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/8064
- Make DCO workflow Probot compatible by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/8110
- ZeRO 1/2: wait on all IPG-bucket producer streams in average_tensor (#8061) by @arunshar in https://github.com/deepspeedai/DeepSpeed/pull/8080
- Fix CommsLogger.stop_profiling_comms not disabling global profiling by @vineethsaivs in https://github.com/deepspeedai/DeepSpeed/pull/8137
- Guard WarmupCosineLR against total_num_steps == warmup_num_steps (ZeroDivisionError) by @vineethsaivs in https://github.com/deepspeedai/DeepSpeed/pull/8142
- Add EXAONE 4.5 model support for Inference V2 by @Bias92 in https://github.com/deepspeedai/DeepSpeed/pull/8121
- fix(autotp): when using autotp, ignore the consistency of certain data within the tp_group. by @1787648106 in https://github.com/deepspeedai/DeepSpeed/pull/8125
- Reduce blockDim in fake_quantize_kernel for improved SM occupancy by @flutist in https://github.com/deepspeedai/DeepSpeed/pull/8115
- Fix DeepSpeedInferenceConfig crash on bool moe backward-compat value by @winklemad in https://github.com/deepspeedai/DeepSpeed/pull/8145
- fix(exceptions): narrow broad Exception clauses to specific types by @sowndappan5 in https://github.com/deepspeedai/DeepSpeed/pull/8136
- fix(muon): support ZeRO-1/2 reduce scatter by @Micuks in https://github.com/deepspeedai/DeepSpeed/pull/8141
- [DeepCompile] Add lightweight pass contracts for optimization passes by @jahnavi-yelamanchi in https://github.com/deepspeedai/DeepSpeed/pull/8139
- Fix DeepCompile fallback handling for scalar outputs by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/8149
- Use synthetic CIFAR data in AlexNet tests by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/8143
- Update CI badge by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/8150
- Update Zhipeng Wang affiliation to Google in COMMITTERS.md by @PKUWZP in https://github.com/deepspeedai/DeepSpeed/pull/8153
- Fix ZeRO-3 hooks for attribute-delegating modules by @Functionhx in https://github.com/deepspeedai/DeepSpeed/pull/8144
- Fix repeated gradient scaling across pipeline stages by @Functionhx in https://github.com/deepspeedai/DeepSpeed/pull/8154
- Z3: Support for activation ckpt with frozen params by @sfc-gh-truwase in https://github.com/deepspeedai/DeepSpeed/pull/8148
- Adopt PTF Code of Conduct by @sfc-gh-truwase in https://github.com/deepspeedai/DeepSpeed/pull/8165
New Contributors
- @aryanputta made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/8050
- @albertvillanova made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/8073
- @MarkCLChang made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/8075
- @arunshar made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/8079
- @Kymi808 made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/8041
- @yongzhe-wang made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/8035
- @whycoming made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/8090
- @ajinkyajawale14499 made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/8096
- @Achyuthan-S made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/8078
- @XAheli made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/8059
- @he-yufeng made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/8049
- @py-ai-dev made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/8052
- @vineethsaivs made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/8122
- @jahnavi-yelamanchi made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/8126
- @NovusEdge made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/8118
- @1787648106 made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/8125
- @winklemad made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/8145
- @Micuks made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/8141
- @Functionhx made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/8144
Full Changelog: https://github.com/deepspeedai/DeepSpeed/compare/v0.19.2...v0.19.3