Skip to content

[Security Solution] Fix flaky tests: Rule Management team 8.16 #187301

New issue
New issue
Open
Open
[Security Solution] Fix flaky tests: Rule Management team 8.16#187301

Description

@banderror

banderror
openedon Jul 1, 2024

Epic: #153633

Summary

Fix and unskip flaky/failing tests that belong to the Rule Management team.

Our "inbox" of failed and skipped tests:

Sub-tasks

Prebuilt rules
Beta Give feedback
  1. Failing test: Rules Management - Bundled Prebuilt Rules Integration Tests - Serverless Env - Complete License.x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/bundled_prebuilt_rules_package/trial_license_complete_tier/install_latest_bundled_prebuilt_rules·ts - Rules Management - Prebuilt Rules - Bundled Prebuilt Rules Package @ess @serverless @skipInQA install_bundled_prebuilt_rules should install prebuilt rules from the package that comes bundled with Kibana #180087
    Feature:Prebuilt Detection Rules Team: SecuritySolution Team:Detection Rule Management Team:Detections and Resp blocker failed-test legit-flake skipped-test

Rule management
Beta Give feedback
  1. [Security Solution] Flaky test: bulk_edit_rules_actions.cy.ts #176908
    Feature:Rule Actions Feature:Rule Management Team: SecuritySolution Team:Detection Rule Management Team:Detections and Resp failed-test
  2. Failing test: Security Solution Cypress.x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/rule_actions/bulk_actions/bulk_edit_rules_actions·cy·ts - Detection rules, bulk edit of rule actions Restricted action privileges User with no privileges can't add rule actions User with no privileges can't add rule actions #178810
    Feature:Rule Actions Feature:Rule Management Team: SecuritySolution Team:Detection Rule Management Team:Detections and Resp failed-test
  3. Failing test: Security Solution Cypress.x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/rule_actions/bulk_actions/bulk_edit_rules_actions·cy·ts - Detection rules, bulk edit of rule actions Restricted action privileges User with no privileges can't add rule actions User with no privileges can't add rule actions #179256
    Feature:Rule Actions Feature:Rule Management Team: SecuritySolution Team:Detection Rule Management Team:Detections and Resp failed-test
  4. Failing test: Security Solution Cypress.x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/rules_table/rules_table_persistent_state·cy·ts - Rules table: persistent state while on a happy path "before each" hook for "loads from the url" "before each" hook for "loads from the url" #179477
    Feature:Rule Management Team: SecuritySolution Team:Detection Rule Management Team:Detections and Resp failed-test

Rule monitoring
Beta Give feedback
  1. Failing test: Rules Management - Rule Management Integration Tests - Serverless Env - Complete Tier.x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/rule_management/trial_license_complete_tier/get_rule_execution_results·ts - Rules Management - Rule Management API @ess @serverless Get Rule Execution Results should return execution events ordered by @timestamp desc when a status filter is active and there are more than 1000 executions #177223
    Feature:Rule Monitoring Team: SecuritySolution Team:Detection Rule Management Team:Detections and Resp blocker failed-test legit-flake skipped-test
  2. Failing test: Security Solution Cypress.x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/rule_details/execution_log·cy·ts - Event log should display the execution log should display the execution log #184360
    Team:Detection Rule Management blocker failed-test skipped-test v8.15.0

Misc
Beta Give feedback
  1. [Security Solution] Unskip tests broken by 181616 and fixed by 182432 #182682
    0 of 8
    8.16 candidate Team: SecuritySolution Team:Detection Rule Management Team:Detections and Resp test
    banderror
  2. [Security Solution] Fix the periodic pipeline for the Rule Management tests #182685
    2 of 4
    8.16 candidate Team: SecuritySolution Team:Detection Rule Management Team:Detections and Resp test
    banderror
  3. [Security Solution] Unskip maintenance window callout Cypress tests skipped because of a bug in serverless roles #184160
    8.16 candidate Feature:Rule Management Team: SecuritySolution Team:Detection Rule Management Team:Detections and Resp skipped-test
    nikitaindik
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

No one assigned

    Labels

    8.16 candidateMetaTeam: SecuritySolutionSecurity Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc.Team:Detection Rule ManagementSecurity Detection Rule Management TeamTeam:Detections and RespSecurity Detection Response Teamtechnical debtImprovement of the software architecture and operational architecturetesttest-api-integrationtest_ui_functional

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions