Skip to content

Commit 648c9ee

Browse files
nafi3000tensorflow-copybara
authored andcommitted
Add bool return_single_response field to PredictStreamedOptions.
This field will be used to indicate whether the output is returned as one single response or not. If true, the response will be a single `PredictResponse`, otherwise it will be a stream of `PredictResponse`. PiperOrigin-RevId: 674121859
1 parent 4a830ca commit 648c9ee

File tree

1 file changed

+5
-0
lines changed

1 file changed

+5
-0
lines changed

tensorflow_serving/apis/predict.proto

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -166,6 +166,11 @@ message PredictStreamedOptions {
166166
// input tensors for request 1 should be [[1, 2], [5, 6]] and request 2 should
167167
// be [[3, 4], [7, 8]].
168168
map<string, int32> split_dimensions = 2;
169+
170+
// If true, there will be a single PredictResponse output.
171+
// If false, output can be split into 1 or more PredictResponses.
172+
// Value of this field should be the same for all requests in the stream.
173+
bool return_single_response = 3;
169174
}
170175

171176
// Response for PredictRequest on successful run.

0 commit comments

Comments
 (0)