Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release 4.9.1 - RC 2 - Pyserver integration #26062

Closed
2 tasks done
nico-stefani opened this issue Sep 30, 2024 · 4 comments
Closed
2 tasks done

Release 4.9.1 - RC 2 - Pyserver integration #26062

nico-stefani opened this issue Sep 30, 2024 · 4 comments

Comments

@nico-stefani
Copy link
Member

nico-stefani commented Sep 30, 2024

The following issue aims to run all Pyserver integration tests for the current release candidate, report the results, and open new issues for any encountered errors.

Pyserver integration tests information

Main release candidate issue #25996
Version 4.9.1
Release candidate # RC2
Tag v4.9.1-rc2
Previous Pyserver integration tests issue #25890

Test report procedure

All individual test checks must be marked as:

Pass The test ran successfully.
Xfail The test was expected to fail and it failed. It must be properly justified and reported in an issue.
Skip The test was not run. It must be properly justified and reported in an issue.
Fail The test failed. A new issue must be opened to evaluate and address the problem.

All test results must have one the following statuses:

🟢 All checks passed.
🔴 There is at least one failed check.
🟡 There is at least one expected fail or skipped test and no failures.

Any failing test must be properly addressed with a new issue, detailing the error and the possible cause. It must be included in the Fixes section of the current release candidate main issue.

Any expected fail or skipped test must have an issue justifying the reason. All auditors must validate the justification for an expected fail or skipped test.

An extended report of the test results must be attached as a zip or txt. This report can be used by the auditors to dig deeper into any possible failures and details.

Conclusions

All tests have been executed and the results can be found below.

Status Test Failure type Notes
🟢 API tier 0/1 test report
🟢 API tier 2 test report
🟢 RBAC tier 0/1 test report

All tests have passed and the fails have been reported or justified. I therefore conclude that this issue is finished and OK for this release candidate.

Auditors validation

The definition of done for this one is the validation of the conclusions and the test results from all auditors.

All checks from below must be accepted in order to close this issue.

@nico-stefani
Copy link
Member Author

API Tier 0 and 1

Build

Test name Pass XPass Skip XFail Fail Issues Ref. Status
test_api/test_config/test_DOS_blocking_system/test_DOS_blocking_system.py 1 0 0 0 0 🟢
test_api/test_config/test_bruteforce_blocking_system/test_bruteforce_blocking_system.py 1 0 0 0 0 🟢
test_api/test_config/test_cors/test_cors.py 1 0 0 1 0 🟢
test_api/test_config/test_drop_privileges/test_drop_privileges.py 2 0 0 0 0 🟢
test_api/test_config/test_experimental_features/test_experimental_features.py 1 0 0 0 0 🟢
test_api/test_config/test_host_port/test_host_port.py 4 0 0 0 0 🟢
test_api/test_config/test_https/test_https.py 2 0 0 0 0 🟢
test_api/test_config/test_indexer/test_indexer.py 6 0 0 0 0 🟢
test_api/test_config/test_jwt_token_exp_timeout/test_jwt_token_exp_timeout.py 2 0 0 0 0 🟢
test_api/test_config/test_limit_eps/test_limit_eps.py 6 0 0 0 0 🟢
test_api/test_config/test_logs/test_logs_format.py 8 0 0 0 0 🟢
test_api/test_config/test_rbac/test_rbac_mode.py 2 0 0 0 0 🟢
test_api/test_config/test_request_timeout/test_request_timeout.py 1 0 0 0 0 🟢
test_api/test_config/test_upload_configuration/test_upload_configuration.py 2 0 0 0 0 🟢
test_api/test_config/test_virustotal_public_key/test_virustotal_api_key.py 3 0 0 0 0 🟢
test_api/test_middlewares/test_response_postprocessing.py 4 0 0 0 0 🟢
test_api/test_middlewares/test_set_secure_headers.py 1 0 0 0 0 🟢
test_api/test_rbac/test_add_old_resource.py 4 0 0 0 0 🟢
test_api/test_rbac/test_manage_admin_resource.py 7 0 0 0 0 🟢
test_api/test_rbac/test_policy_position.py 1 0 0 0 0 🟢
test_api/test_rbac/test_remove_resource.py 4 0 0 0 0 🟢
test_api/test_rbac/test_remove_resources_relation.py 3 0 0 0 0 🟢
test_api/test_statistics/test_statistics_format.py 5 0 0 0 0 🟢

@nico-stefani
Copy link
Member Author

API Tier 2

Build

Test name Pass XPass Skip XFail Fail Issues Ref. Status
test_api/test_config/test_max_upload_size/test_max_upload_size.py 3 0 0 0 0 🟢

@nico-stefani
Copy link
Member Author

RBAC Tier 0 and 1

Build

Test name Pass XPass Skip XFail Fail Issues Ref. Status
test_api/test_rbac/test_add_old_resource.py 4 0 0 0 0 🟢
test_api/test_rbac/test_manage_admin_resource.py 7 0 0 0 0 🟢
test_api/test_rbac/test_policy_position.py 1 0 0 0 0 🟢
test_api/test_rbac/test_remove_resource.py 4 0 0 0 0 🟢
test_api/test_rbac/test_remove_resources_relation.py 3 0 0 0 0 🟢

@nico-stefani nico-stefani self-assigned this Sep 30, 2024
@wazuhci wazuhci moved this from In progress to Pending review in Release 4.9.1 Sep 30, 2024
@fdalmaup
Copy link
Member

fdalmaup commented Oct 1, 2024

Review

LGTM

@wazuhci wazuhci moved this from Pending review to Pending final review in Release 4.9.1 Oct 1, 2024
@juliamagan juliamagan changed the title Release 4.9.1 - RC2 - Pyserver integration Release 4.9.1 - RC 2 - Pyserver integration Oct 1, 2024
@wazuhci wazuhci moved this from Pending final review to Done in Release 4.9.1 Oct 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
No open projects
Status: Done
Development

No branches or pull requests

3 participants