Skip to content

Arm backend: Fix flaky test LSTM by bumping allowed atol/rtol slightly #9452

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conversation

zingo
Copy link
Collaborator

@zingo zingo commented Mar 20, 2025

This fix some rare fails on the LSTM test as we seem to have been too close with the values.

cc @digantdesai @freddan80 @per @oscarandersson8218

Signed-off-by: Zingo Andersen <zingo.andersen@arm.com>
Change-Id: I58fec922a83f507ad0229680a232c8c8b16523eb
@zingo zingo requested a review from digantdesai as a code owner March 20, 2025 15:08
Copy link

pytorch-bot bot commented Mar 20, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/9452

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 47a5c97 with merge base 6fb42ef (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@zingo zingo added partner: arm For backend delegation, kernels, demo, etc. from the 3rd-party partner, Arm ciflow/trunk topic: not user facing labels Mar 20, 2025
@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Mar 20, 2025
Copy link
Contributor

@digantdesai digantdesai left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks. We can debug ATOL/RTOL issues in parallel and keep relaxed version on CI if we want, as opposed to unmarked flaky tests.

@zingo zingo merged commit 7a2a300 into pytorch:main Mar 20, 2025
165 of 166 checks passed
oscarandersson8218 pushed a commit to oscarandersson8218/executorch that referenced this pull request Mar 21, 2025
pytorch#9452)

This fix some rare fails on the LSTM test as we seem to have been too
close with the values.

Signed-off-by: Zingo Andersen <zingo.andersen@arm.com>
DannyYuyang-quic pushed a commit to CodeLinaro/executorch that referenced this pull request Apr 2, 2025
pytorch#9452)

This fix some rare fails on the LSTM test as we seem to have been too
close with the values.

Signed-off-by: Zingo Andersen <zingo.andersen@arm.com>
@zingo zingo deleted the Arm-backend-Fix-flaky-test-LSTM-by-bumping-allowed-atol/rtol-slightly branch April 4, 2025 10:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ciflow/trunk CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. partner: arm For backend delegation, kernels, demo, etc. from the 3rd-party partner, Arm topic: not user facing
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants