Skip to content

Make results compatible to MLPerf submission checker for 6.0 #29

@tanvi-mlcommons

Description

@tanvi-mlcommons

Submission checker for inference requires the result to be in certain format to be validated.

  1. Publish a minimal schema for 6.0 validation that endpoints must follow
  2. Create a thin translation layer that:
    a. Takes endpoint output (primarily JSON right now but we should keep this open to any format)
    b. Converts it into the format the submission checker expects

Metadata

Metadata

Labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions