DeepSeed Files

What's Changed

• Update version after 0.17.1 release by @loadams in https://github.com/deepspeedai/DeepSpeed/pull/7345
• s/UlyssesPlus/Arctic Long Sequence Training (ALST)/ by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7348
• Don't break set_start_method by @tjruwase in https://github.com/deepspeedai/DeepSpeed/pull/7349
• Fix error of <glog/logging.h> by @Freed-Wu in https://github.com/deepspeedai/DeepSpeed/pull/7351
• Improve padding util for compile by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7355
• Fix 404s by @tjruwase in https://github.com/deepspeedai/DeepSpeed/pull/7363
• Fix tutorial title by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7365
• Restore real inputs for recompilation by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7356
• Fix(scheduler): WarmupLR inherits optimizer lr when not specified by @Flink-ddd in https://github.com/deepspeedai/DeepSpeed/pull/7360
• sequence parallel default dtype by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7364
• Enable torch.autocast with ZeRO by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/6993
• add Arctic Long Sequence Training paper reference by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7372
• Flops profiler support for F.interpolate by @sfc-gh-truwase in https://github.com/deepspeedai/DeepSpeed/pull/7353
• Relax tolerances for FP8 unit test only for ROCm + FP16 by @rraminen in https://github.com/deepspeedai/DeepSpeed/pull/7373
• Update latest news with DeepNVMe by @loadams in https://github.com/deepspeedai/DeepSpeed/pull/7375
• Fix release of IPG buffer by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7376
• fix wandb.log() call by removing sync kwarg by @ned2 in https://github.com/deepspeedai/DeepSpeed/pull/7383
• Fix dtype mismatch in TestParamPartitioningSkipInit by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7377
• Add support for ws=1 scenario by @NirSonnenschein in https://github.com/deepspeedai/DeepSpeed/pull/7379
• fix(inference): Add missing dtype attribute to ParameterBase setter by @Flink-ddd in https://github.com/deepspeedai/DeepSpeed/pull/7378
• add blog link by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7385
• fix broken url by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7390
• add support for CUDAtk12.9 by @loscrossos in https://github.com/deepspeedai/DeepSpeed/pull/7394
• Fix unbound local error for return_val by @HollowMan6 in https://github.com/deepspeedai/DeepSpeed/pull/7395
• Fix ZeRO stage 1 and add stage 2 support with DeepCompile by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7366
• Improve coverage of DeepCompile by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7386
• Added device detection to communication logging by @alexk101 in https://github.com/deepspeedai/DeepSpeed/pull/7398
• fix: Add csrc/compile to include paths for DeepCompile builder by @HollowMan6 in https://github.com/deepspeedai/DeepSpeed/pull/7401
• fix: DeepCompile for torch 2.8 by @HollowMan6 in https://github.com/deepspeedai/DeepSpeed/pull/7402
• fix(comm): Expose GradBucket in deepspeed.comm API by @Flink-ddd in https://github.com/deepspeedai/DeepSpeed/pull/7400
• fix: fix FileNotFoundError for build_win.bat by @gjj2828 in https://github.com/deepspeedai/DeepSpeed/pull/7399
• fix: engine initializes optimizer attributes at the beginning by @HollowMan6 in https://github.com/deepspeedai/DeepSpeed/pull/7410

New Contributors

• @Freed-Wu made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7351
• @Flink-ddd made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7360
• @ned2 made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7383
• @alexk101 made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7398
• @gjj2828 made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7399

Full Changelog: https://github.com/deepspeedai/DeepSpeed/compare/v0.17.1...v0.17.2