Skip to content

Improve the scope of Model Evaluation to AOTI and ET #938

New issue
New issue
Open
Open
Improve the scope of Model Evaluation to AOTI and ET#938
Labels
Evaluation/BenchmarkingIssues Related to Evaluation and BenchmarkingKnown GapsThese are known Gaps/Issues/Bug items in torchchatenhancementNew feature or requesttriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module
@Jack-Khuu

Description

@Jack-Khuu
Jack-Khuu
opened on Jul 22, 2024

🚀 The feature, motivation and pitch

Currently, model evaluation is a WIP and mostly focused on pure PyTorch and compile.
This is planned work to improve PT support and expand to evaluation for AOTI and ET as well

Alternatives

No response

Additional context

No response

RFC (Optional)

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    Evaluation/BenchmarkingIssues Related to Evaluation and BenchmarkingKnown GapsThese are known Gaps/Issues/Bug items in torchchatenhancementNew feature or requesttriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions