Skip to content

[Feature] enable AMX support for vLLM on GNR/EMR/SPR #2045

@louie-tsai

Description

@louie-tsai

Priority

P3-Medium

OS type

Ubuntu

Hardware type

Xeon-GNR

Running nodes

Single Node

Description

Need to make use of AMX of GNR/EMR for vLLM on OPEA

Metadata

Metadata

Assignees

Labels

A1high prorityfeatureNew feature or request

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions