tag:github.com,2008:https://github.com/samadejacobs/DeepSpeed/releases 2022-05-24T20:27:50Z tag:github.com,2008:Repository/508411488/v0.6.5 2022-05-24T20:27:50Z <p>Fixing several bugs in the inference-api and the kernels (<a class="issue-link js-issue-link" href="https://github.com/deepspeedai/DeepSpeed/pull/1951">deepspeedai…</a></p> <p><a class="issue-link js-issue-link" href="https://github.com/deepspeedai/DeepSpeed/pull/1951">…#1951</a>)</p> <p>Co-authored-by: Jeff Rasley &lt;jerasley@microsoft.com&gt;</p> RezaYazdaniAminabadi tag:github.com,2008:Repository/508411488/v0.6.4 2022-05-06T12:28:30Z <p>Improve z3 trace management (<a class="issue-link js-issue-link" href="https://github.com/deepspeedai/DeepSpeed/pull/1916">deepspeedai#1916</a>)</p> <p>* Fix OOM and type mismatch</p> <p>* Toggle prefetching</p> <p>* Disable z3 prefetching for inference (temp workaround)</p> <p>* Fix zero3 tracing issues</p> <p>* Remove debug prints</p> <p>* Enable prefetch for inference</p> <p>* Code clarity</p> <p>* Invalidate trace cache</p> <p>* Trace cache invalidation when needed <br />Separate nvme prefetch from all-gather prefetch</p> <p>* Track last used step id</p> <p>* Use debug name in error message</p> <p>* Construct param trace from module trace</p> <p>Co-authored-by: Jeff Rasley &lt;jerasley@microsoft.com&gt;</p> tjruwase tag:github.com,2008:Repository/508411488/v0.6.3 2022-04-27T00:17:00Z mrwyattii tag:github.com,2008:Repository/508411488/v0.6.2 2022-04-25T17:09:29Z <p>Fix OOM and type mismatch (<a class="issue-link js-issue-link" href="https://github.com/deepspeedai/DeepSpeed/pull/1884">deepspeedai#1884</a>)</p> <p>Co-authored-by: Jeff Rasley &lt;jerasley@microsoft.com&gt;</p> tjruwase tag:github.com,2008:Repository/508411488/v0.6.1 2022-03-24T02:53:18Z <p>qkv_out can be a single tensor or a list. Handling these cases separe…</p> <p>…tely. (<a class="issue-link js-issue-link" href="https://github.com/deepspeedai/DeepSpeed/pull/1850">deepspeedai#1850</a>)</p> <p>Co-authored-by: Jeff Rasley &lt;jerasley@microsoft.com&gt;</p> samyam tag:github.com,2008:Repository/508411488/v0.6.0 2022-03-07T20:58:01Z jeffra tag:github.com,2008:Repository/508411488/v0.5.10 2022-01-14T19:05:05Z <p>[ZeRO] Default disable elastic ckpt in stage 1+2 and reduce CPU memor…</p> <p>…y overhead during ckpt load (<a class="issue-link js-issue-link" href="https://github.com/deepspeedai/DeepSpeed/pull/1525">deepspeedai#1525</a>)</p> <p>Co-authored-by: Olatunji Ruwase &lt;olruwase@microsoft.com&gt;</p> jeffra tag:github.com,2008:Repository/508411488/v0.5.9 2022-01-03T18:28:43Z <p>Various small documentation text improvements (<a class="issue-link js-issue-link" href="https://github.com/deepspeedai/DeepSpeed/pull/1665">deepspeedai#1665</a>)</p> <p>Co-authored-by: Jeff Rasley &lt;jerasley@microsoft.com&gt;</p> manuelciosici tag:github.com,2008:Repository/508411488/v0.5.8 2021-11-30T18:02:12Z aphedges tag:github.com,2008:Repository/508411488/v0.5.7 2021-11-19T22:45:02Z jeffra