-
Notifications
You must be signed in to change notification settings - Fork 8.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fixes flakiness on timelion suggestions #89538
Fixes flakiness on timelion suggestions #89538
Conversation
@elasticmachine merge upstream |
Pinging @elastic/kibana-app (Team:KibanaApp) |
@elasticmachine merge upstream |
@stratoula Can you explain what the original issue was? It seems like it's showing one additional suggestion? |
💚 Build SucceededMetrics [docs]
History
To update your PR or re-run it, just comment with: |
@flash1293 yes. When it failed for the first time I noticed this: But this was not the problem. I used a 7.11 cloud instance and I saw at first that the suggestions loaded for the split on the cloud are not the same as locally (locally never fails). And an additional note here: The way that these timelion tests work is: update the expression, click a suggestion from the list, then update again the expression, clicking another suggestion. Imho, it seems to be very flaky for cloud. |
Is it an issue the expression in the screenshot is broken? |
The expression brokes when the test fails, so it fails on |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Got it, makes sense, thanks. LGTM to fix the test for now, but as it's loosening our test coverage a little, it would be cool to add back a better test for this later.
If I understood correctly, the suggestion list didn't updated yet and that's why the number is wrong, so we could also add a retry loop for the 51:
await retry.try(async () => {
const suggestions = await PageObjects.timelion.getSuggestionItemsText();
expect(suggestions.length).to.eql(51);
});
Thanx Joe! I tried it but retry doesn't fix it. The suggestion list always returns a wrong number so I will create an issue to investigate it and also fix the coverage |
* Fixes flakiness on timelion suggestions * Improvements * Remove flakiness Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com> # Conflicts: # test/functional/apps/timelion/_expression_typeahead.js
* Fixes flakiness on timelion suggestions * Improvements * Remove flakiness Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com> # Conflicts: # test/functional/apps/timelion/_expression_typeahead.js
Summary
Closes #89352
Flaky cloud tester run for 15 times https://internal-ci.elastic.co/job/elastic+estf-cloud-kibana-flaky-test-runner/
This is going to remove the flakiness (I hope). What we want is to test that the suggestions are returned.
Checklist