Converting all uint16 to int in quantized mat mul shader to improve perf.

[trivedivivek]

Summary:

This Diff

This diff improves the performance of the quantized matrix multiplication shader in the Executorch Vulkan runtime by converting all uint16 to int in the shader code.

Differential Revision: D84777696

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/15193

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

• [ROCm][CI] Machines under the label linux.rocm.gpu.2 are undergoing maintenance.

❌ 6 New Failures, 4 Pending, 3 Unrelated Failures

As of commit 373dc7c with merge base 419727c ():

NEW FAILURES - The following jobs have failed:

• pull / test-samsung-models-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 277c1b0df434e816a6e483604be280329722a3596b26b7504323671f3a2e3efe /exec failed with exit code 1
• pull / unittest-arm-backend-with-no-fvp (test_pytest_models) / linux-job (gh)
  RuntimeError: Command docker exec -t afecc853ddb7d812adbd7d684780cba8e83788cd21c674889e8241bbb5978702 /exec failed with exit code 1
• pull / unittest-nxp-neutron / linux-job (gh)
  RuntimeError: Command docker exec -t 05fa326ab8f8847cefc4b91e814969b5fe5f39e1ac33ded57b1e82f2b95e1a4a /exec failed with exit code 1
• Test CUDA Builds / export-voxtral-cuda-non-quantized / linux-job (gh)
  RuntimeError: Command docker exec -t d2c5e57de7cf67372215ef9aa14bd1ca1a4f90563c095fbd2aa4e51581cff5ac /exec failed with exit code 2
• Test CUDA Builds / export-voxtral-cuda-quantized-int4-tile-packed / linux-job (gh)
  RuntimeError: Command docker exec -t f53697f396f3252ad3dcd0dcfe6f004f6646f1cd0e94ac00789553430163199f /exec failed with exit code 2
• Test CUDA Builds / export-voxtral-cuda-quantized-int4-weight-only / linux-job (gh)
  RuntimeError: Command docker exec -t 9e50cae8482039b28e91a96ee5fa22017f2f48f1e275ad7e8d2722995704267a /exec failed with exit code 2

FLAKY - The following job failed but was likely due to flakiness present on trunk:

• pull / unittest-editable / linux / linux-job (gh) (matched linux rule in flaky-rules.json)
  The runner has received a shutdown signal. This can happen when the runner service is stopped, or a manually started runner is canceled.

BROKEN TRUNK - The following jobs failed but was present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• pull / android / run-emulator (gh) (trunk failure)
  The process '/usr/bin/sh' failed with exit code 255
• pull / unittest / linux / linux-job (gh) (trunk failure)

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[meta-codesync]

@trivedivivek has exported this pull request. If you are a Meta employee, you can view the originating Diff in D84777696.

[github-actions]

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.