Skip to content

Conversation

@carlcsaposs-canonical
Copy link
Contributor

Reverts part of #250

An Allure Report can only be generated for one of the test suite combinations (otherwise results with identical test case IDs will override each other. Any parametrization that pytest is not aware of [because it was done in spread—i.e. juju version, ubuntu base] will result in duplicate test case IDs)

Removing the 20.04 base does not change this—we are only able to generate an Allure Report for one of the Juju versions we test with

TL;DR the Allure Report should only use tests from a single spread variant. The variant naming was not changed, so the Allure Report config should not have been changed

An Allure Report can only be generated for one of the test suite combinations (otherwise results with identical test case IDs will override each other—so any parametrization that pytest is not aware of [because it was done in spread—i.e. juju version, ubuntu base] will result in duplicate test case IDs)

Removing the 20.04 base does not change this—we are only able to generate an Allure Report for one of the Juju versions we test with

TL;DR the Allure Report should only use tests from a single spread variant. The variant naming was not changed, so the Allure Report config should not have been changed
@carlcsaposs-canonical carlcsaposs-canonical added the not bug or enhancement PR is not 'bug' or 'enhancement'. For release notes label May 22, 2025
@sinclert-canonical
Copy link

@paulomach could we merge this? I believe the failing test is due to flakiness.

@paulomach
Copy link

@paulomach could we merge this? I believe the failing test is due to flakiness.

Yes. @carlcsaposs-canonical , all good

@carlcsaposs-canonical carlcsaposs-canonical merged commit be36621 into main Jun 10, 2025
41 of 42 checks passed
@carlcsaposs-canonical carlcsaposs-canonical deleted the fix-allure branch June 10, 2025 12:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Libraries: Out of sync not bug or enhancement PR is not 'bug' or 'enhancement'. For release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants