Skip to content

Assorted test deflaking#37191

Merged
peppy merged 4 commits intoppy:masterfrom
bdach:more-test-fails
Apr 3, 2026
Merged

Assorted test deflaking#37191
peppy merged 4 commits intoppy:masterfrom
bdach:more-test-fails

Conversation

@bdach
Copy link
Copy Markdown
Collaborator

@bdach bdach commented Apr 3, 2026

A few quick ones from #37190.

Rewrite TestSceneDeleteLocalScore to have less context menu containers (and hopefully no longer flake)

As seen in https://github.com/ppy/osu/actions/runs/23890777748#user-content-r3s3.

This is a speculative fix but I'm feeling somewhat confident about this one.

BeatmapLeaderboardWedge has TWO separate ContextMenuContainers itself, and the test mentioned here was bringing a third. I have a feeling that the test flaking may have something to do with the fact that the test logic would attempt to click a menu item on specifically ONE of the three context menus. My bet is that when it fails, it's because it's trying the wrong one, but I don't have reproduction.

Wait for text to appear in flaking TestSceneDrawableRoomPlaylist.TestSelectableMouseHandling test

As seen in https://github.com/ppy/osu/actions/runs/23888446400#user-content-r1s1.

Speculative. Banking on the fact that it takes time to load the sprite texts.

Remove all tests from TestSceneWikiMarkdownContainer dependent on existence of wiki on dev

Deletes a flaky as seen in https://github.com/ppy/osu/actions/runs/23878899702#user-content-r2s2.

The year is 2026 and LLM scrapers hammer the entire internet all over to scrape whatever ounce of Human Content there is left to feed the Moloch so that it can regurgitate it back in the form of The Most Average Speech You've Ever Read. We are not immune to this, and as such the LLM homunculi have hit the dev.ppy.sh wiki instance enough times for it to just completely be banished to the blagole.

Which means I get to freely delete flaky tests that should never have been running as part of CI because they're completely useless now and it's not like we're ever turning them back on again.

Use equality check in TestSceneBeatmapCarouselScrolling.TestScrollPositionMaintainedOnRemove_SecondSelected that's less sensitive to floating point

As seen in https://github.com/ppy/osu/actions/runs/23826420794#user-content-r0s1.

bdach added 4 commits April 3, 2026 14:33
…ers (and hopefully no longer flake)

As seen in
https://github.com/ppy/osu/actions/runs/23890777748#user-content-r3s3.

This is a speculative fix but I'm feeling somewhat confident about this
one.

`BeatmapLeaderboardWedge` has TWO separate `ContextMenuContainer`
itself, and the test mentioned here was bringing a third. I have a
feeling that the test flaking may have something to do with the fact
that the test logic would attempt to click a menu item on specifically
ONE of the three context menus. My bet is that when it fails, it's
because it's trying the wrong one, but I don't have reproduction.
…tSelectableMouseHandling` test

As seen in
https://github.com/ppy/osu/actions/runs/23888446400#user-content-r1s1.

Speculative. Banking on the fact that it takes time to load the sprite
texts.
…xistence of wiki on dev

Deletes a flaky as seen in
https://github.com/ppy/osu/actions/runs/23878899702#user-content-r2s2.

The year is 2026 and LLM scrapers hammer the entire internet all over to
scrape whatever ounce of Human Content there is left to feed the Moloch
so that it can regurgitate it back in the form of The Most Average
Speech You've Ever Read. We are not immune to this, and as such the LLM
homunculi have hit the dev.ppy.sh wiki instance enough times for it to
just completely be banished to the blagole.

Which means I get to freely delete flaky tests that should never have
been running as part of CI because they're completely useless now and
it's not like we're ever turning them back on again.
…sitionMaintainedOnRemove_SecondSelected` that's less sensitive to floating point

As seen in
https://github.com/ppy/osu/actions/runs/23826420794#user-content-r0s1.
@bdach bdach self-assigned this Apr 3, 2026
@bdach bdach added the area:test coverage Adds or modifies test coverage without adding any functionality. label Apr 3, 2026
@bdach bdach mentioned this pull request Apr 3, 2026
22 tasks
@peppy peppy self-requested a review April 3, 2026 14:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:test coverage Adds or modifies test coverage without adding any functionality. size/L

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

2 participants