tag:github.com,2008:https://github.com/samadejacobs/DeepSpeed/releasesRelease notes from DeepSpeed2022-05-24T20:27:50Ztag:github.com,2008:Repository/508411488/v0.6.52022-05-24T20:27:50Zv0.6.5: Fixing several bugs in the inference-api and the kernels (#1951)<p>Co-authored-by: Jeff Rasley <a href="mailto:jerasley@microsoft.com">jerasley@microsoft.com</a></p>RezaYazdaniAminabaditag:github.com,2008:Repository/508411488/v0.6.42022-05-06T12:28:30Zv0.6.4: Improve z3 trace management (#1916)<ul>
<li>
<p>Fix OOM and type mismatch</p>
</li>
<li>
<p>Toggle prefetching</p>
</li>
<li>
<p>Disable z3 prefetching for inference (temp workaround)</p>
</li>
<li>
<p>Fix zero3 tracing issues</p>
</li>
<li>
<p>Remove debug prints</p>
</li>
<li>
<p>Enable prefetch for inference</p>
</li>
<li>
<p>Code clarity</p>
</li>
<li>
<p>Invalidate trace cache</p>
</li>
<li>
<p>Trace cache invalidation when needed<br>
Separate nvme prefetch from all-gather prefetch</p>
</li>
<li>
<p>Track last used step id</p>
</li>
<li>
<p>Use debug name in error message</p>
</li>
<li>
<p>Construct param trace from module trace</p>
</li>
</ul>
<p>Co-authored-by: Jeff Rasley <a href="mailto:jerasley@microsoft.com">jerasley@microsoft.com</a></p>tjruwasetag:github.com,2008:Repository/508411488/v0.6.32022-04-27T00:17:00Zv0.6.3<p>bumped to v0.6.3</p>mrwyattiitag:github.com,2008:Repository/508411488/v0.6.22022-04-25T17:09:29Zv0.6.2: Fix OOM and type mismatch (#1884)<p>Co-authored-by: Jeff Rasley <a href="mailto:jerasley@microsoft.com">jerasley@microsoft.com</a></p>tjruwasetag:github.com,2008:Repository/508411488/v0.6.12022-03-24T02:53:18Zv0.6.1<p>qkv_out can be a single tensor or a list. Handling these cases separe…</p>samyamtag:github.com,2008:Repository/508411488/v0.6.02022-03-07T20:58:01Zv0.6.0<p>force amd install via sudo (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1161916225" data-permission-text="Title is private" data-url="https://github.com/deepspeedai/DeepSpeed/issues/1815" data-hovercard-type="pull_request" data-hovercard-url="/deepspeedai/DeepSpeed/pull/1815/hovercard" href="https://github.com/deepspeedai/DeepSpeed/pull/1815">deepspeedai#1815</a>)</p>jeffratag:github.com,2008:Repository/508411488/v0.5.102022-01-14T19:05:05Zv0.5.10<p>[ZeRO] Default disable elastic ckpt in stage 1+2 and reduce CPU memor…</p>jeffratag:github.com,2008:Repository/508411488/v0.5.92022-01-03T18:28:43Zv0.5.9: Various small documentation text improvements (#1665)<p>Co-authored-by: Jeff Rasley <a href="mailto:jerasley@microsoft.com">jerasley@microsoft.com</a></p>manuelciosicitag:github.com,2008:Repository/508411488/v0.5.82021-11-30T18:02:12Zv0.5.8<p>Remove unused import of ssl.OP_ENABLE_MIDDLEBOX_COMPAT (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1066717770" data-permission-text="Title is private" data-url="https://github.com/deepspeedai/DeepSpeed/issues/1601" data-hovercard-type="pull_request" data-hovercard-url="/deepspeedai/DeepSpeed/pull/1601/hovercard" href="https://github.com/deepspeedai/DeepSpeed/pull/1601">deepspeedai#1601</a>)</p>aphedgestag:github.com,2008:Repository/508411488/v0.5.72021-11-19T22:45:02Zv0.5.7<p>Several fixes for our read-the-docs build (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1058939783" data-permission-text="Title is private" data-url="https://github.com/deepspeedai/DeepSpeed/issues/1579" data-hovercard-type="pull_request" data-hovercard-url="/deepspeedai/DeepSpeed/pull/1579/hovercard" href="https://github.com/deepspeedai/DeepSpeed/pull/1579">deepspeedai#1579</a>)</p>jeffra