[BUG] InternalTestClusterTests.testDataFolderAssignmentAndCleaning is flaky

[peteralfonsi]

Describe the bug

The test sometimes fails with a ClusterManagerNotDiscoveredException.

Related component

Other

To Reproduce

./gradlew ':test:framework:test' --tests "org.opensearch.test.test.InternalTestClusterTests.testDataFolderAssignmentAndCleaning" -Dtests.seed=B5A3BA2C240332A6 -Dtests.security.manager=true -Dtests.jvm.argline="-XX:TieredStopAtLevel=1 -XX:ReservedCodeCacheSize=64m" -Dtests.locale=nb-NO -Dtests.timezone=America/Scoresbysund -Druntime.java=21

Expected behavior

The test should always pass.

Additional Details

CI with failure: https://build.ci.opensearch.org/job/gradle-check/35241/

[andrross]

[Triage - attendees 1 2 3 4 5 6]
@peteralfonsi Thanks for filing. Please feel free to investigate further and put out a fix.