(Prototype) Support weight consumption in control flow submodules

[GregoryComer]

Summary

This is a prototype PR to implement weight consumption in control flow submodules, including e2e support through XNNPACK.

Note: This is mainly up for design discussion. I'll clean up + split for actual review once we align on the approach.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/17677

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 44 New Failures, 2 Unrelated Failures

As of commit e5cae72 with merge base 2c9f2b3 ():

NEW FAILURES - The following jobs have failed:

• Lint / lintrunner / linux-job (gh)
  >>> Lint for exir/tests/test_remove_unused_parameters_pass.py:
• periodic / test-models-linux (buck2, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
  RuntimeError: Command docker exec -t 631773a7643fc3bbbd56e0efd7a80eb6e811606dd037b9ff6e44e7802ea0344c /exec failed with exit code 1
• periodic / test-models-linux (cmake, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
  RuntimeError: Command docker exec -t 4e9e3dcabe37eaa8359866eccfc16aef50a17718185ff42e19304bf135a20c82 /exec failed with exit code 1
• periodic / test-models-linux (cmake, vit, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
  RuntimeError: Command docker exec -t d1f33bfc484065d9361631976b67069d4a32f4bfd0c88288173050c326d3bfc8 /exec failed with exit code 1
• pull / android / build-llm-demo / linux-job (gh)
  RuntimeError: Command docker exec -t 750471ebff709c75ff2234bbd7f901ae9887fbe9cf305926ccb4a5e63cabe2d0 /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  RuntimeError: Command docker exec -t 9c5e1d36a846802162e29764dc9363a80f4245ff29954694c55247c1afe42ac7 /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.arm64.2xlarge, executorch-ubuntu-22.04-gc... / linux-job (gh)
  RuntimeError: Command docker exec -t 1192395252e2273b26bd9c5b5efa30489db029021c26201d9c83c235a7f1a634 /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu... / linux-job (gh)
  RuntimeError: Command docker exec -t c0db470c182a5b82fece48cc1dee4819a755d2208280357231370ec7151ef39b /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  RuntimeError: Command docker exec -t f490e4914a72ae509c95b37cdb79b8b579b488a8ef254b3bb115944b3eb70dee /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu-22.04-... / linux-job (gh)
  RuntimeError: Command docker exec -t 85a5a37baf8fe56e9640a66992066b3274680727f73172fb5236dd3cdb4d19b4 /exec failed with exit code 1
• pull / test-llama-runner-qnn-linux (fp32, qnn_8a8w, qnn) / linux-job (gh)
  RuntimeError: Command docker exec -t de14067f0ea2c0ab6b4744cccadb4ee4c6759a45a976e11baf090dae76774788 /exec failed with exit code 1
• pull / test-lora-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 12c4cdf0a4b99e6d3e05a898f90f44956021d413de5497b895ddb39543d4046c /exec failed with exit code 1
• pull / test-lora-multimethod-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 8a5719e4124517f7837e9fc11c7fc72910be7457218f0eebf7e6f87fa01fa528 /exec failed with exit code 1
• pull / test-mediatek-models-linux / linux-job (gh)
  RuntimeError: Command docker exec -t a0304c3f3e56b1e85fd5828793ae9e266b2067c1ed30861fa6753bc25704a0c5 /exec failed with exit code 2
• pull / test-models-linux (emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
  RuntimeError: Command docker exec -t 34d2fe5065dd17ad339384703be68d90c34b9b5047cbed7a4d59e571c96a70f7 /exec failed with exit code 1
• pull / test-models-linux (emformer_transcribe, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 64876225129ad9bc7a602e1edeec2ce8f51ac2b3c78876b62fce50011d5cb952 /exec failed with exit code 1
• pull / test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
  RuntimeError: Command docker exec -t c61e5d910805845e2545fabf8469b1e0f54cd858a4b064c0323190a2912759a2 /exec failed with exit code 1
• pull / test-models-linux (linear, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 9ed49483bcfff4157b0cd224d16c9ea59193ccf28a0c95a5136c0e8fa067bbca /exec failed with exit code 1
• pull / test-models-linux (mv2, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 4aa0f738c6106d4d6f9de7c3479733e9c9f9cbc4ccb6717f795d037a8724f71a /exec failed with exit code 1
• pull / test-models-linux (resnet18, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t efbd2b2108aad77ba524d03993f70ba0bec75bea14995881c133cd494363edc0 /exec failed with exit code 1
• pull / test-models-linux (resnet50, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 1b83ca834c494eb5914f4ddaadd77e2b5cc4d4d66dcdc6732b2f7f1cd907bf73 /exec failed with exit code 1
• pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
  RuntimeError: Command docker exec -t 92fe4b030167f2771baf7e865e7677c021075f774ad491df4d4ee1f17a74dc3c /exec failed with exit code 1
• pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
  RuntimeError: Command docker exec -t 7ba5bc9b75a67b045222f9d1b38d0495499103f45db6f462d1318fff44e5717e /exec failed with exit code 1
• pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
  RuntimeError: Command docker exec -t 1c9adc4a9772711e33d1842b590c37566185d594b7f8969aa6371dd8267adccc /exec failed with exit code 1
• pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
  RuntimeError: Command docker exec -t d366e0fbc3d95397f5d032e8a5b3736a4d958d3b840ebaa4afc479b11941a58c /exec failed with exit code 1
• pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
  RuntimeError: Command docker exec -t 952e16600773b96dcbd63857ad27eae5e04eba9d32add920d2e485f7f02ee56c /exec failed with exit code 1
• pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
  RuntimeError: Command docker exec -t b35154eb8564de55510ba2b23a082a3b660e6c8521b103c6cec3ca9dac427cd4 /exec failed with exit code 1
• pull / test-moshi-linux / linux-job (gh)
  test_exported_decoder_xnnpack
• pull / test-openvino-linux / linux-job (gh)
  RuntimeError: Command docker exec -t ea463244be7683c71f951c60cad20f4c0e0dea621ffd1fb9aed888173ec3aa4f /exec failed with exit code 1
• pull / test-parakeet-xnnpack-linux / linux-job (gh)
  RuntimeError: Command docker exec -t f3df72f2aefadedfe1220312c0957aace53d9ff64b6b9f951cbf050d9e68adc3 /exec failed with exit code 1
• pull / test-samsung-models-linux / linux-job (gh)
  RuntimeError: Command docker exec -t ede1a6eb93a63ec0381525565e7fe6d2228283228c588c526da0f33a4c1c8b3d /exec failed with exit code 1
• pull / test-samsung-quantmodels-linux / linux-job (gh)
  RuntimeError: Command docker exec -t f2039925557794518ddd51be71ee62b9ec074825deb7c11fe10425b5cc2843b9 /exec failed with exit code 1
• pull / test-voxtral-realtime-xnnpack-linux / linux-job (gh)
  RuntimeError: Command docker exec -t bb3bf792ba5c536fd0b5908de89ff1805eb8a6db7f227ee1ed00c5dee97bda18 /exec failed with exit code 1
• pull / test-vulkan-models-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 1d1e21ff030a408a251e1690965a34359c516101b35bf6d97cb6a43c0d94acf7 /exec failed with exit code 1
• pull / unittest / linux / linux-job (gh)
  export/tests/test_target_recipes.py::TestTargetRecipes::test_ios_fp32_recipe_with_xnnpack_fallback
• pull / unittest / macos / macos-job (gh)
  export/tests/test_target_recipes.py::TestTargetRecipes::test_ios_fp32_recipe_with_xnnpack_fallback
• pull / unittest / windows / windows-job (gh)
  Process completed with exit code 139.
• pull / unittest-arm-backend-with-no-deps (test_pytest_models_tosa) / linux-job (gh)
  RuntimeError: Command docker exec -t ca0f086b38eaafddb8a52976a505ee990825a572d46295b93f1113207b21ccf6 /exec failed with exit code 1
• pull / unittest-arm-backend-with-no-deps (test_pytest_ops_no_target) / linux-job (gh)
  RuntimeError: Command docker exec -t 6f396a88a068d6bcfb5eafefb173d009ff8612bfb7c8bc9103f56745a4141df1 /exec failed with exit code 1
• pull / unittest-arm-backend-with-no-deps (test_pytest_ops_tosa) / linux-job (gh)
  RuntimeError: Command docker exec -t ca638165bd6f45babf43fd1d96d112335810e7286611fe1a00edc7c07f22f421 /exec failed with exit code 1
• pull / unittest-editable / linux / linux-job (gh)
  export/tests/test_target_recipes.py::TestTargetRecipes::test_ios_fp32_recipe_with_xnnpack_fallback
• pull / unittest-editable / macos / macos-job (gh)
  export/tests/test_target_recipes.py::TestTargetRecipes::test_ios_fp32_recipe_with_xnnpack_fallback
• pull / unittest-editable / windows / windows-job (gh)
  Process completed with exit code 139.
• pull / unittest-nxp-neutron / linux-job (gh)
  RuntimeError: Command docker exec -t 6b8cb02f6140e80e40f91e1506bd73b2fbbf1db93337799fbea6c2965d08dcb7 /exec failed with exit code 1

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

• pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04... / linux-job (gh) (detected as infra flaky with no log or failing log classifier)
• pull / test-models-linux (ic3, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh) (detected as infra flaky with no log or failing log classifier)

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.