Skip to content

Commit

Permalink
[docs] add mii repo link
Browse files Browse the repository at this point in the history
  • Loading branch information
jeffra committed Oct 12, 2022
1 parent ab77677 commit 5a16213
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/_posts/2022-10-11-mii.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ The Deep Learning (DL) open-source community has seen tremendous growth in the l

There has been significant progress in system optimizations for DL model inference that can drastically reduce both latency and cost, but those are not easily accessible. The main reason for this limited accessibility is that the DL model inference landscape is diverse with models varying in size, architecture, system performance characteristics, hardware requirements, etc. Identifying the appropriate set of system optimizations applicable to a given model and applying them correctly is often beyond the scope of most data scientists, making low latency and low-cost inference mostly inaccessible.

DeepSpeed-MII is a new open-source python library from DeepSpeed, aimed towards making low-latency, low-cost inference of powerful models not only feasible but also easily accessible.
[DeepSpeed-MII](https://github.com/microsoft/DeepSpeed-MII) is a new open-source python library from DeepSpeed, aimed towards making low-latency, low-cost inference of powerful models not only feasible but also easily accessible.

* MII offers access to highly optimized implementations of **thousands of widely used DL models.**
* MII supported models achieve significantly lower latency and cost compared to their original implementation.
Expand Down

0 comments on commit 5a16213

Please sign in to comment.