Skip to content

Support other predictor kinds for AsyncAPI #1980

Closed
@vishalbollu

Description

@vishalbollu

Add support for Tensorflow and ONNX predictor types.

Additional notes:

  • Disable serverside batching for TensorFlow predictor on AsyncAPI kind because AsyncAPI doesn't support multiple processes/threads

Metadata

Metadata

Assignees

Labels

AsyncAPISomething related to the AsyncAPI kindenhancementNew feature or request

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions