Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

[MXNET-503] Website landing page for MMS #11037

Merged
merged 6 commits into from
Jun 5, 2018

Conversation

aaronmarkham
Copy link
Contributor

Description

This is the content for a website landing page for MMS. Navigation updates will come later.

@aaronmarkham aaronmarkham requested a review from szha as a code owner May 23, 2018 23:19
@szha szha requested a review from piiswrong May 24, 2018 05:44
Copy link
Contributor

@sandeep-krishnamurthy sandeep-krishnamurthy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Few minor additions

@@ -0,0 +1,91 @@
# Model Server for Apache MXNet (incubating)

Model Server for Apache MXNet (incubating), otherwise known as MXNet Model Server (MMS), is an open source project aimed at providing a simple yet scalable solution for model inference. It is a set of command line tools for packaging model archives and serving them. The tools are written in Python, and have been extended to support containers for easy deployment and scaling. MMS also supports basic logging and advanced logging with AWS CloudWatch integration.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we link the Github repo from MMS?

@@ -0,0 +1,91 @@
# Model Server for Apache MXNet (incubating)

Model Server for Apache MXNet (incubating), otherwise known as MXNet Model Server (MMS), is an open source project aimed at providing a simple yet scalable solution for model inference. It is a set of command line tools for packaging model archives and serving them. The tools are written in Python, and have been extended to support containers for easy deployment and scaling. MMS also supports basic logging and advanced logging with AWS CloudWatch integration.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Word "metrics" is important along with logging.

@@ -0,0 +1,91 @@
# Model Server for Apache MXNet (incubating)

Model Server for Apache MXNet (incubating), otherwise known as MXNet Model Server (MMS), is an open source project aimed at providing a simple yet scalable solution for model inference. It is a set of command line tools for packaging model archives and serving them. The tools are written in Python, and have been extended to support containers for easy deployment and scaling. MMS also supports basic logging and advanced logging with AWS CloudWatch integration.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we say MMS supports both Gluon and MXNet symbolic models along with ONNX models?


While the name implies that MMS is just for MXNet, it is in fact much more flexible, as it can support models in the [ONNX](https://onnx.ai) format. This means that models created and trained in PyTorch, Caffe2, or other ONNX-supporting frameworks can be served with MMS.

To find out more about MXNet's support for ONNX models and using ONNX with MMS, refer to the following resources:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There are some tutorials on exporting PyTorch models to ONNX, should we link it from the work PyTorch models?

mxnet-model-server \
--models squeezenet=https://s3.amazonaws.com/model-server/models/squeezenet_v1.1/squeezenet_v1.1.model
```

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we show an example output here for clarity of URL, port number etc. that we use in next section? Something like - Your server should start up like below etc.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

added output sample

* [MXNet Forum - MMS Discussions](https://discuss.mxnet.io/c/mxnet-model-server)


## Further Reading
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Probably we should also reference AWS blogpost on using MMS with Fargate for productionization of DL model?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

added link to blog

Copy link
Contributor

@sandeep-krishnamurthy sandeep-krishnamurthy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks LGTM

Copy link
Contributor

@lupesko lupesko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Once @sandeep-krishnamurthy comments are addressed

@szha
Copy link
Member

szha commented May 25, 2018

Pinging @piiswrong for review

* [Create an ONNX model (that will run with MMS) from PyTorch](https://github.com/onnx/onnx-mxnet/blob/master/README.md#quick-start)


## Using Containers
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I added a docker pull command and a link to the parent on docker hub. I think it would be nicer to have an actual organization page and have the repos listed there. One stop shopping, but this should be fine for now!

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍🏼

@john-andrilla
Copy link
Contributor

  1. AWS CloudWatch > Amazon CloudWatch
  2. AWS Elastic Container Service > Amazon Elastic Container Service (Amazon ECS)
  3. "free models" requires approval
  4. Revise: As the process for creating archives is likely to evolve as the project adds features it is recommended > The process for creating archives is likely to evolve. As the project adds features, we recommend
  5. What is "a simple serving solution" ?

@aaronmarkham aaronmarkham changed the title Website landing page for MMS [MXNET-503] Website landing page for MMS Jun 1, 2018
@aaronmarkham
Copy link
Contributor Author

Thanks @john-andrilla - I've addressed each comment in my latest commit (fixed stuff, removed "free").
How about "a flexible, scalable, multi-framework serving solution"?

@eric-haibin-lin eric-haibin-lin merged commit d552640 into apache:master Jun 5, 2018
szha added a commit to szha/mxnet that referenced this pull request Jun 5, 2018
szha added a commit that referenced this pull request Jun 6, 2018
zheng-da pushed a commit to zheng-da/incubator-mxnet that referenced this pull request Jun 28, 2018
* new landing page for MMS

* added links

* more links

* updates from feedback

* added docker hub info

* addressed comments
zheng-da pushed a commit to zheng-da/incubator-mxnet that referenced this pull request Jun 28, 2018
XinYao1994 pushed a commit to XinYao1994/incubator-mxnet that referenced this pull request Aug 29, 2018
* new landing page for MMS

* added links

* more links

* updates from feedback

* added docker hub info

* addressed comments
XinYao1994 pushed a commit to XinYao1994/incubator-mxnet that referenced this pull request Aug 29, 2018
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants