Skip to content

Commit

Permalink
Upgrade to DJL 0.16.0
Browse files Browse the repository at this point in the history
  • Loading branch information
frankfliu committed Mar 22, 2022
1 parent 413529c commit 49d24cc
Show file tree
Hide file tree
Showing 4 changed files with 9 additions and 9 deletions.
6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -60,14 +60,14 @@ brew services stop djl-serving
For Ubuntu

```
curl -O https://publish.djl.ai/djl-serving/djl-serving_0.15.0-1_all.deb
sudo dpkg -i djl-serving_0.15.0-1_all.deb
curl -O https://publish.djl.ai/djl-serving/djl-serving_0.16.0-1_all.deb
sudo dpkg -i djl-serving_0.16.0-1_all.deb
```

For Windows

We are considering to create a `chocolatey` package for Windows. For the time being, you can
download djl-serving zip file from [here](https://publish.djl.ai/djl-serving/serving-0.15.0.zip).
download djl-serving zip file from [here](https://publish.djl.ai/djl-serving/serving-0.16.0.zip).

### Docker

Expand Down
2 changes: 1 addition & 1 deletion serving/docker/Dockerfile
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
FROM ubuntu:18.04
ARG djl_version=0.15.0
ARG djl_version=0.16.0

RUN apt-get update && \
DEBIAN_FRONTEND=noninteractive apt-get install --no-install-recommends -y \
Expand Down
8 changes: 4 additions & 4 deletions serving/docker/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,10 +10,10 @@ Run
cd djl-serving/serving/docker

# build djl-serving cpu docker image
docker build -t deepjavalibrary/djl-serving:0.15.0 --build-arg djl_version=0.15.0 .
docker build -t deepjavalibrary/djl-serving:0.16.0 --build-arg djl_version=0.16.0 .

# build docker image for inferentia
docker build -t deepjavalibrary/djl-serving:0.15.0-inf1 --build-arg version=0.15.0 -f inf1.Dockerfile .
docker build -t deepjavalibrary/djl-serving:0.16.0-inf1 --build-arg version=0.16.0 -f inf1.Dockerfile .
```

## Run docker image
Expand All @@ -28,7 +28,7 @@ mkdir models
cd models
curl -O https://resources.djl.ai/test-models/pytorch/bert_qa_jit.tar.gz

docker run -it --rm -v $PWD:/opt/ml/model -p 8080:8080 deepjavalibrary/djl-serving:0.15.0
docker run -it --rm -v $PWD:/opt/ml/model -p 8080:8080 deepjavalibrary/djl-serving:0.16.0
```

Here is an example to run djl-serving with AWS Inferentia:
Expand All @@ -38,5 +38,5 @@ mkdir models
cd models

curl -O https://resources.djl.ai/test-models/pytorch/bert_qa_inf1.tar.gz
docker run --device /dev/neuron0 -it --rm -v $PWD:/opt/ml/model -p 8080:8080 deepjavalibrary/djl-serving:0.15.0-inf1
docker run --device /dev/neuron0 -it --rm -v $PWD:/opt/ml/model -p 8080:8080 deepjavalibrary/djl-serving:0.16.0-inf1
```
2 changes: 1 addition & 1 deletion serving/docker/inf1.Dockerfile
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
ARG version=0.15.0
ARG version=0.16.0
FROM deepjavalibrary/djl-serving:$version

RUN apt-get update -y \
Expand Down

0 comments on commit 49d24cc

Please sign in to comment.