Skip to content

Latest commit

 

History

History
78 lines (62 loc) · 2.26 KB

index.md

File metadata and controls

78 lines (62 loc) · 2.26 KB

Examples

To see MLServer in action you can check out the examples below. These are end-to-end notebooks, showing how to serve models with MLServer.

Inference Runtimes

If you are interested in how MLServer interacts with particular model frameworks, you can check the following examples. These focus on showcasing the different inference runtimes that ship with MLServer out of the box. Note that, for advanced use cases, you can also write your own custom inference runtime (see the example below on custom models).

:caption: Inference Runtimes
:titlesonly:
:hidden:

./sklearn/README.md
./xgboost/README.md
./lightgbm/README.md
./tempo/README.md
./mlflow/README.md
./custom/README.md
./alibi-detect/README.md
./huggingface/README.md

MLServer Features

To see some of the advanced features included in MLServer (e.g. multi-model serving), check out the examples below.

:caption: MLServer Features
:titlesonly:
:hidden:

./mms/README.md
./model-repository/README.md
./content-type/README.md
./conda/README.md
./custom-json/README.md
./kafka/README.md

Tutorials

Tutorials are designed to be beginner-friendly and walk through accomplishing a series of tasks using MLServer (and other tools).

:caption: Tutorials
:titlesonly:
:hidden:

./cassava/README.md