move rope related logic together

[helunwencser]

Stack from ghstack (oldest at bottom):

• -> move rope related logic together #6560

Right now, rope related code scatters around a few different places in llama_transformer. It makes it hard to make changes to rope related things.

This PR moves all rope related logic into its own module.

Differential Revision: D65173598

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/6560

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 8 New Failures

As of commit 48f4cec with merge base 97e0417 ():

NEW FAILURES - The following jobs have failed:

• pull / test-llama-runner-linux (bf16, custom) / linux-job (gh)
  RuntimeError: Command docker exec -t 9b55adb90d293961ed68cbff40469a6f640c1bc2cc84285858add0b2bc4f16a5 /exec failed with exit code 1
• pull / test-llama-runner-linux (bf16, portable) / linux-job (gh)
  RuntimeError: Command docker exec -t 30aa76fac401b5c5530c94c40d1d136ce482f63b6016293a01825bbf5eb8f199 /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, portable) / linux-job (gh)
  RuntimeError: Command docker exec -t a09a0cc55d348bea40b20b2ba9dc27f3dc9623ffd9f8860eaf315e86ccba0ed9 /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, xnnpack+custom) / linux-job (gh)
  RuntimeError: Command docker exec -t d3f58726c1dcf0cb2426c91d229bcd843713798beb40201b0981d6117c11c9fc /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, xnnpack+custom+qe) / linux-job (gh)
  RuntimeError: Command docker exec -t 4e4fcded6e9c6e2d575147c448c36232c691b85e28fadba2daea81b6417cf04a /exec failed with exit code 1
• pull / test-llama-runner-qnn-linux (fp32, qnn) / linux-job (gh)
  RuntimeError: Command docker exec -t 77e9931ca1349087bf87e479befb9347889d8be4f8cffc71812364a4b8b10745 /exec failed with exit code 1
• pull / test-llava-runner-linux / linux-job (gh)
  test_llava_export
• pull / unittest / macos / macos-job (gh)
  extension/llm/modules/test/test_attention.py::AttentionTest::test_attention_aoti

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D65173598

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D65173598

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D65173598

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D65173598