Skip to content

DeepSpeed v0.3.15

Compare
Choose a tag to compare
@jeffra jeffra released this 19 Apr 16:31
· 2110 commits to master since this release

v0.3.15 Release notes

  • ZeRO-Infinity release allowing nvme offload and more!

  • Deprecated cpu_offload in config JSON, see JSON docs for more details.

  • Automatic external parameter registration, more details in the ZeRO 3 docs.

  • Several bug fixes for ZeRO stage 3