Skip to content

Commit 80be987

Browse files
authored
Add info about shared /mnt directory to TensorFlow predictor docs (#1802)
1 parent 0038078 commit 80be987

File tree

2 files changed

+4
-0
lines changed

2 files changed

+4
-0
lines changed

docs/workloads/batch/predictors.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -147,6 +147,8 @@ Cortex provides a `tensorflow_client` to your Predictor's constructor. `tensorfl
147147

148148
When multiple models are defined using the Predictor's `models` field, the `tensorflow_client.predict()` method expects a second argument `model_name` which must hold the name of the model that you want to use for inference (for example: `self.client.predict(payload, "text-generator")`).
149149

150+
If you need to share files between your predictor implementation and the TensorFlow Serving container, you can create a new directory within `/mnt` (e.g. `/mnt/user`) and write files to it. The entire `/mnt` directory is shared between containers, but do not write to any of the directories in `/mnt` that already exist (they are used internally by Cortex).
151+
150152
## ONNX Predictor
151153

152154
**Uses ONNX Runtime version 1.4.0 by default**

docs/workloads/realtime/predictors.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -199,6 +199,8 @@ Your API can accept requests with different types of payloads such as `JSON`-par
199199

200200
Your `predictor` method can return different types of objects such as `JSON`-parseable, `string`, and `bytes` objects. Navigate to the [API responses](#api-responses) section to learn about how to configure your `predictor` method to respond with different response codes and content-types.
201201

202+
If you need to share files between your predictor implementation and the TensorFlow Serving container, you can create a new directory within `/mnt` (e.g. `/mnt/user`) and write files to it. The entire `/mnt` directory is shared between containers, but do not write to any of the directories in `/mnt` that already exist (they are used internally by Cortex).
203+
202204
## ONNX Predictor
203205

204206
**Uses ONNX Runtime version 1.4.0 by default**

0 commit comments

Comments
 (0)