You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
There are redundant/flaky performance tests in the Reassure suite. These tests are difficult to maintain and provide low value, as their scenarios are already covered elsewhere or offer little regression detection. This creates unnecessary complexity, slows down the test suite, and increases the likelihood of false positives.
Solution:
Remove the redundant tests that verify scenarios already covered in separate tests. Eliminate tests that check interactions with minimal impact on regression detection. Focus on retaining tests that provide high-value regression coverage, and reorganize the test suites for better maintainability by moving essential tests to lower levels where they are easier to manage.
Move the reassure test documentation to the contributingGuidelines
Update the guidelines to provide more guidance on how to prevent adding any redundant tests
The text was updated successfully, but these errors were encountered:
Coming from this proposal in Slack.
Problem:
There are redundant/flaky performance tests in the Reassure suite. These tests are difficult to maintain and provide low value, as their scenarios are already covered elsewhere or offer little regression detection. This creates unnecessary complexity, slows down the test suite, and increases the likelihood of false positives.
Solution:
Remove the redundant tests that verify scenarios already covered in separate tests. Eliminate tests that check interactions with minimal impact on regression detection. Focus on retaining tests that provide high-value regression coverage, and reorganize the test suites for better maintainability by moving essential tests to lower levels where they are easier to manage.
The text was updated successfully, but these errors were encountered: