DJLServing KServe V2 Protocol

APIs

Health:

GET v2/health/live

GET v2/health/ready

GET v2/models/${MODEL_NAME}[/versions/${MODEL_VERSION}]/ready

Model Metadata:

GET v2/models/${MODEL_NAME}[/versions/${MODEL_VERSION}]

Inference:

POST v2/models/${MODEL_NAME}[/versions/${MODEL_VERSION}]/infer

Reference from Kserve

See KServe Requirements

Instructions

Instructions for using plugins can be found on the main plugins page.