README.md

HTTP/REST and GRPC Protocol

This directory contains documents related to the HTTP/REST and GRPC protocols used by Triton. Triton uses the KFServing community standard inference protocols plus several extensions that are defined in the following documents:

• Binary tensor data extension
• Classification extension
• Model configuration extension
• Model repository extension
• Schedule policy extension
• Sequence extension
• Shared-memory extension
• Statistics extension

For the GRPC protocol the protobuf specification is also available.