Skip to content

Releases: EleutherAI/DeeperSpeed

2.0

09 Mar 23:11
457850d
Compare
Choose a tag to compare

DeeperSpeed 2.0 is based off upstream DeepSpeed 0.8.3 and is intended to closely match the upstream along with:

Any additional fixes we find that are yet to be accepted into DeepSpeed
Branches for optimal performance on EleutherAI's compute providers (e.g. stability, coreweave)

1.0

09 Mar 22:58
7069d10
Compare
Choose a tag to compare
1.0

DeeperSpeed 1.0 is the legacy version based on DeepSpeed 0.3.15. This version is meant to be combined with GPT-NeoX v1.0.