Download Latest Version Version v0.5.0 Release Today! source code.zip (4.5 MB)
Email in envelope

Get an email when there's a new version of Colossal-AI

Home / v0.4.7
Name Modified Size InfoDownloads / Week
Parent folder
README.md 2025-01-03 3.6 kB
0
Version v0.4.7 Release Today! source code.tar.gz 2025-01-03 3.1 MB
0
Version v0.4.7 Release Today! source code.zip 2025-01-03 4.5 MB
0
Totals: 3 Items   7.6 MB 0

What's Changed

Release

Pre-commit.ci

Sharderformer

  • [Sharderformer] Support zbv in Sharderformer Policy (#6150) by duanjunwen

Checkpointio

  • [checkpointio] support non blocking pin load (#6172) by Hongxin Liu
  • [checkpointio]support asyncio for 3d (#6152) by flybird11111
  • [checkpointio] fix async io (#6155) by flybird11111
  • [checkpointio] support debug log (#6153) by Hongxin Liu
  • [checkpointio] fix zero optimizer async save memory (#6151) by Hongxin Liu
  • Merge pull request [#6149] from ver217/hotfix/ckpt by Wang Binluo
  • [checkpointio] disable buffering by ver217
  • [checkpointio] fix pinned state dict by ver217
  • [checkpointio] fix size compute by ver217
  • [checkpointio] fix performance issue (#6139) by Hongxin Liu
  • [checkpointio] support async model save (#6131) by Hongxin Liu

News

  • [news] release colossalai for sora (#6166) by binmakeswell

Hotfix

  • [hotfix] improve compatibility (#6165) by Hongxin Liu
  • [Hotfix] hotfix normalization (#6163) by duanjunwen
  • [hotfix] fix zero comm buffer init (#6154) by Hongxin Liu
  • [hotfix] fix flash attn window_size err (#6132) by duanjunwen

Doc

  • [doc] add bonus event (#6164) by binmakeswell
  • [doc] update cloud link (#6148) by Sze-qq
  • [doc] add hpc cloud intro (#6147) by Sze-qq

Device

Fix

  • [fix] fix bug caused by perf version (#6156) by duanjunwen
  • [fix] multi-node backward slowdown (#6134) by Hanks

Optim

Zerobubble

Async io

Ckpt

Cli

  • [cli] support run as module option (#6135) by Hongxin Liu

Zero

Coati

  • [Coati] Refine prompt for better inference (#6117) by Tong Li

Plugin

  • [plugin] support get_grad_norm (#6115) by Hongxin Liu

Full Changelog: https://github.com/hpcaitech/ColossalAI/compare/v0.4.7...v0.4.6

Source: README.md, updated 2025-01-03