tag:github.com,2008:https://github.com/samadejacobs/DeepSpeed/releases Release notes from DeepSpeed 2022-05-24T20:27:50Z tag:github.com,2008:Repository/508411488/v0.6.5 2022-05-24T20:27:50Z v0.6.5: Fixing several bugs in the inference-api and the kernels (#1951) <p>Co-authored-by: Jeff Rasley <a href="mailto:jerasley@microsoft.com">jerasley@microsoft.com</a></p> RezaYazdaniAminabadi tag:github.com,2008:Repository/508411488/v0.6.4 2022-05-06T12:28:30Z v0.6.4: Improve z3 trace management (#1916) <ul> <li> <p>Fix OOM and type mismatch</p> </li> <li> <p>Toggle prefetching</p> </li> <li> <p>Disable z3 prefetching for inference (temp workaround)</p> </li> <li> <p>Fix zero3 tracing issues</p> </li> <li> <p>Remove debug prints</p> </li> <li> <p>Enable prefetch for inference</p> </li> <li> <p>Code clarity</p> </li> <li> <p>Invalidate trace cache</p> </li> <li> <p>Trace cache invalidation when needed<br> Separate nvme prefetch from all-gather prefetch</p> </li> <li> <p>Track last used step id</p> </li> <li> <p>Use debug name in error message</p> </li> <li> <p>Construct param trace from module trace</p> </li> </ul> <p>Co-authored-by: Jeff Rasley <a href="mailto:jerasley@microsoft.com">jerasley@microsoft.com</a></p> tjruwase tag:github.com,2008:Repository/508411488/v0.6.3 2022-04-27T00:17:00Z v0.6.3 <p>bumped to v0.6.3</p> mrwyattii tag:github.com,2008:Repository/508411488/v0.6.2 2022-04-25T17:09:29Z v0.6.2: Fix OOM and type mismatch (#1884) <p>Co-authored-by: Jeff Rasley <a href="mailto:jerasley@microsoft.com">jerasley@microsoft.com</a></p> tjruwase tag:github.com,2008:Repository/508411488/v0.6.1 2022-03-24T02:53:18Z v0.6.1 <p>qkv_out can be a single tensor or a list. Handling these cases separe…</p> samyam tag:github.com,2008:Repository/508411488/v0.6.0 2022-03-07T20:58:01Z v0.6.0 <p>force amd install via sudo (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1161916225" data-permission-text="Title is private" data-url="https://github.com/deepspeedai/DeepSpeed/issues/1815" data-hovercard-type="pull_request" data-hovercard-url="/deepspeedai/DeepSpeed/pull/1815/hovercard" href="https://github.com/deepspeedai/DeepSpeed/pull/1815">deepspeedai#1815</a>)</p> jeffra tag:github.com,2008:Repository/508411488/v0.5.10 2022-01-14T19:05:05Z v0.5.10 <p>[ZeRO] Default disable elastic ckpt in stage 1+2 and reduce CPU memor…</p> jeffra tag:github.com,2008:Repository/508411488/v0.5.9 2022-01-03T18:28:43Z v0.5.9: Various small documentation text improvements (#1665) <p>Co-authored-by: Jeff Rasley <a href="mailto:jerasley@microsoft.com">jerasley@microsoft.com</a></p> manuelciosici tag:github.com,2008:Repository/508411488/v0.5.8 2021-11-30T18:02:12Z v0.5.8 <p>Remove unused import of ssl.OP_ENABLE_MIDDLEBOX_COMPAT (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1066717770" data-permission-text="Title is private" data-url="https://github.com/deepspeedai/DeepSpeed/issues/1601" data-hovercard-type="pull_request" data-hovercard-url="/deepspeedai/DeepSpeed/pull/1601/hovercard" href="https://github.com/deepspeedai/DeepSpeed/pull/1601">deepspeedai#1601</a>)</p> aphedges tag:github.com,2008:Repository/508411488/v0.5.7 2021-11-19T22:45:02Z v0.5.7 <p>Several fixes for our read-the-docs build (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1058939783" data-permission-text="Title is private" data-url="https://github.com/deepspeedai/DeepSpeed/issues/1579" data-hovercard-type="pull_request" data-hovercard-url="/deepspeedai/DeepSpeed/pull/1579/hovercard" href="https://github.com/deepspeedai/DeepSpeed/pull/1579">deepspeedai#1579</a>)</p> jeffra