Skip to content

Arm backend: Add FP8 support to the VGF runtime - #24028

Open
YufengShi-dudu wants to merge 1 commit into
pytorch:mainfrom
YufengShi-dudu:add-fp8-support-to-vgf-runtime
Open

YufengShi-dudu wants to merge 1 commit into
pytorch:mainfrom
YufengShi-dudu:add-fp8-support-to-vgf-runtime

Conversation

@YufengShi-dudu

@YufengShi-dudu YufengShi-dudu commented Oct 20, 2026 •

Copy link
Copy Markdown
Collaborator

Change-Id: I48dd7274e17c999e8a7575af7c33459ff1dd475f

cc @digantdesai @freddan80 @per @zingo @oscarandersson8218 @mansnils @Sebastian-Larsson @robell @rascani

Map E4M3 and E5M2 Vulkan formats to VGF tensor metadata and reconstruct
runtime outputs from raw buffers while preserving FP8 dtype and layout.

Add VGF matmul tests for both FP8 formats with reference output
comparison enabled. Mark the case affected by the missing FP8 CPU bmm
kernel as a strict expected failure.

Change-Id: I48dd7274e17c999e8a7575af7c33459ff1dd475f
Signed-off-by: Yufeng Shi <yufeng.shi@arm.com>
@YufengShi-dudu YufengShi-dudu added partner: arm For backend delegation, kernels, demo, etc. from the 3rd-party partner, Arm ciflow/trunk release notes: arm Changes to the ARM backend delegate module: arm Issues related to arm backend labels Oct 20, 2026
@pytorch-bot

pytorch-bot Bot commented Oct 20, 2026 •

Copy link
Copy Markdown

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/24028

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 Cancelled Job, 3 Unrelated Failures

As of commit 1e17804 with merge base a39d597 (image):

CANCELLED JOB - The following job was cancelled. Please retry:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 20, 2026
@YufengShi-dudu YufengShi-dudu changed the title Arm backend: Add FP8 format support to VGF runtime Arm backend: Add FP8 support to the VGF runtime Oct 20, 2026

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ciflow/trunk CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. module: arm Issues related to arm backend partner: arm For backend delegation, kernels, demo, etc. from the 3rd-party partner, Arm release notes: arm Changes to the ARM backend delegate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant