Skip to content

WIP: [Storage] - Change order of execution for vm_export module - #6585

Open
acinko-rh wants to merge 1 commit into
RedHatQE:mainfrom
acinko-rh:change_sequence_of_execution_for_vm_export_main
Open

acinko-rh wants to merge 1 commit into
RedHatQE:mainfrom
acinko-rh:change_sequence_of_execution_for_vm_export_main

Conversation

@acinko-rh

@acinko-rh acinko-rh commented Oct 15, 2026 •

Copy link
Copy Markdown
Contributor

Move vm_export tests to execute at the midpoint of the test suite rather than wherever they sort alphabetically. This is done by reordering items in the pytest_collection_modifyitems hook after all filtering is complete.

What this PR does / why we need it:

Changes the execution order of vm_export tests to run at the midpoint of the test suite instead of following alphabetical collection order. The reordering is applied in the pytest_collection_modifyitems hook after all existing filters complete, ensuring vm_export tests are interspersed within the suite rather than grouped together at a specific alphabetical position.

Which issue(s) this PR fixes:

https://redhat.atlassian.net/browse/CNV-98692

Special notes for reviewer:

This change only affects test execution order and does not modify any test logic or functionality. The reordering preserves the relative order of all other tests and is transparent to pytest runs—no command-line flags or configuration changes are required.

jira-ticket:

NONE

Summary by CodeRabbit

  • Tests
    • Adjusted the VM export tests’ order in the test suite.

@openshift-virtualization-qe-bot-4

Copy link
Copy Markdown

Report bugs in Issues

Welcome! 🎉

This pull request will be automatically processed with the following features:

🔄 Automatic Actions

  • Reviewer Assignment: Reviewers are automatically assigned based on the OWNERS file in the repository root
  • Size Labeling: PR size labels (XS, S, M, L, XL, XXL) are automatically applied based on changes
  • Issue Creation: A tracking issue is created for this PR and will be closed when the PR is merged or closed
  • Branch Labeling: Branch-specific labels are applied to track the target branch
  • Auto-verification: Auto-verified users have their PRs automatically marked as verified
  • Labels: Enabled categories: branch, can-be-merged, cherry-pick, has-conflicts, hold, size, verified, wip

📋 Available Commands

PR Status Management

  • /wip - Mark PR as work in progress (adds WIP: prefix to title)
  • /wip cancel - Remove work in progress status
  • /hold - Block PR merging (PR author or approvers)
  • /hold cancel - Unblock PR merging (PR author or approvers)
  • /verified - Mark PR as verified
  • /verified cancel - Remove verification status
  • /reprocess - Trigger complete PR workflow reprocessing (useful if webhook failed or configuration changed)
  • /regenerate-welcome - Regenerate this welcome message
  • /security-override - Set security check runs to pass (maintainers only)
  • /security-override cancel - Re-run security checks

Review & Approval

  • /lgtm - Approve changes (looks good to me)
  • /approve - Approve PR (approvers only)
  • /assign-reviewers - Assign reviewers based on OWNERS file
  • /assign-reviewer @username - Assign specific reviewer
  • /check-can-merge - Check if PR meets merge requirements

Testing & Validation

  • /retest tox - Run Python test suite with tox
  • /retest build-container - Rebuild and test container image
  • /retest verify-bugs-are-open - verify-bugs-are-open
  • /retest all - Run all available tests

Container Operations

  • /build-and-push-container - Build and push container image (tagged with PR number)
    • Supports additional build arguments: /build-and-push-container --build-arg KEY=value

Cherry-pick Operations

  • /cherry-pick <branch> - Schedule cherry-pick to target branch when PR is merged
    • Multiple branches: /cherry-pick branch1 branch2 branch3
  • /cherry-pick-retry <branch> - Retry a failed cherry-pick (merged PRs only)

Branch Management

  • /rebase - Rebase this PR branch onto its base branch

Label Management

  • /<label-name> - Add a label to the PR
  • /<label-name> cancel - Remove a label from the PR

✅ Merge Requirements

This PR will be automatically approved when the following conditions are met:

  1. Approval: /approve from at least one approver
  2. LGTM Count: Minimum 2 /lgtm from reviewers
  3. Status Checks: All required status checks must pass
  4. No Blockers: No wip, hold, has-conflicts labels and PR must be mergeable (no conflicts)
  5. Verified: PR must be marked as verified

📊 Review Process

Approvers and Reviewers

Approvers:

  • jpeimer

Reviewers:

  • Acedus
  • Ahmad-Hafe
  • Dsanatar
  • acinko-rh
  • akalenyu
  • awels
  • dalia-frank
  • ema-aka-young
  • josemacassan
  • jpeimer
  • kgoldbla
  • kshvaika
Available Labels
  • hold
  • verified
  • wip
  • lgtm
  • approve
AI Features
  • Cherry-Pick Conflict Resolution: Enabled (openai/gpt-5.6-luna)
Security Checks
  • Suspicious Path Detection: Monitors paths: .claude/, .vscode/, .cursor/, .devcontainer/, .pi/, .github/workflows/, .github/actions/
  • Committer Identity Check: Verifies last committer matches PR author
  • Mandatory: Security checks block merge (use /security-override to bypass — maintainers only)

💡 Tips

  • WIP Status: Use /wip when your PR is not ready for review
  • Verification: The verified label is removed on new commits unless the push is detected as a clean rebase
  • Cherry-picking: Cherry-pick labels are processed when the PR is merged
  • Container Builds: Container images are automatically tagged with the PR number
  • Permission Levels: Some commands require approver permissions
  • Auto-verified Users: Certain users have automatic verification and merge privileges

📌 Additional Information

Custom Commands:

  • /test-plan — Triggers CodeRabbit to analyze the PR's changed files and post a test execution plan
  • /rerun-smoke — Adds retest-smoke label on the PR to trigger smoke tests execution

For more information, please refer to the project documentation or contact the maintainers.

@coderabbitai

coderabbitai Bot commented Oct 15, 2026 •

Copy link
Copy Markdown
Contributor

Review in Change Stack →

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration
  • Configuration used: Repository: RedHatQE/openshift-virtualization-tests/.coderabbit.yaml
  • Review profile: ASSERTIVE
  • Plan: Advanced
  • Run ID: 7739f970-c024-49f2-b120-f1971b9f0b65
📥 Commits

Reviewing files that changed from the base of the PR and between 82d017e and a81930f.

📒 Files selected for processing: 1
  • tests/storage/vm_export/test_vm_export.py
🔗 Linked repositories identified

CodeRabbit considers these linked repositories for cross-repo context during reviews:

Included review availability: This review used your included allowance. Your plan provides up to 1 included review per hour; 0 remain after this review.

⏰ Context from checks skipped due to timeout: 4
  • GitHub Check: verify-bugs-are-open
  • GitHub Check: build-container
  • GitHub Check: tox
  • GitHub Check: verified
⚠️ CI failures not shown inline: 1

GitHub Check: can-be-merged: Check if can be merged

Conclusion: failure

View job details

Some required check runs in progress verify-bugs-are-open, build-container, tox
Some check runs not started: cnv-smoke/validation, verify-bugs-are-open, build-container, tox, verified
Missing approved from approvers: jpeimer
Missing lgtm from reviewers. Minimum 2 required, (0 given). Reviewers: awels, ema-aka-young, Acedus, myakove, dshchedr, Ahmad-Hafe, Dsanatar, josemacassan, kshvaika, vsibirsk, RoniKishner, kgoldbla, rnetser, dalia-frank, jpeimer, akalenyu.
🧰 Additional context used
📚 Code guidelines: 3
docs/SOFTWARE_TEST_DESCRIPTION.md — auto-discovered
AGENTS.md — configured
docs/CODING_AND_STYLE_GUIDE.md — auto-discovered
📓 Path-based instructions: 5
When an `STP:` link is present and linked-repo analysis finds missing or misaligned scenarios, you MUST post an INLINE review comment on the `STP:` line (or the module docstring when the STP line is unchanged) containing: **STP coverage: X/...

⚙️ CodeRabbit configuration file

Files:

  • tests/storage/vm_export/test_vm_export.py
You may approve the PR when ALL of the following are true: All your review comments have been addressed with either: a code/doc change that fixes the issue, or a substantive author response that justifies no code change.

⚙️ CodeRabbit configuration file

Files:

  • tests/storage/vm_export/test_vm_export.py
Applicability reference: AGENTS.md: # AI Review and Development Standards **STD Docstring Format (MANDATORY):** When writing or reviewing STD (Software Test Description) test docstrings, follow the format defined in [`docs/SOFTWARE_TEST_DES...

📄 CodeRabbit inference engine (docs/SOFTWARE_TEST_DESCRIPTION.md)

Files:

  • tests/storage/vm_export/test_vm_export.py
Source excerpt: **Scope:** All traceability and STD lifecycle/format rules below, including the `__test__ = False` Usage Rules, apply only to product tests under `tests/`.

📄 CodeRabbit inference engine (AGENTS.md)

Files:

  • tests/storage/vm_export/test_vm_export.py
Applicability reference: AGENTS.md: # AI Review and Development Standards [`docs/CODING_AND_STYLE_GUIDE.md`](docs/CODING_AND_STYLE_GUIDE.md) — Detailed coding and style conventions Source excerpt: Tests are to be placed in `test_

📄 CodeRabbit inference engine (docs/CODING_AND_STYLE_GUIDE.md)

Files:

  • tests/storage/vm_export/test_vm_export.py
🔇 Additional comments: 1
tests/storage/vm_export/test_vm_export.py: 1

24-26: LGTM!

📝 Walkthrough

The VM export test module now schedules its tests to run after test_windows_memory_dump.

Changes: VM export test ordering

Layer / File(s) Summary
Set VM export test order
tests/storage/vm_export/test_vm_export.py
A module-level pytest ordering marker schedules these tests after test_windows_memory_dump.

Priority: ⬇️ Low

Estimated code review effort: 1 (Trivial) | ~3 minutes

Change: Other

Merge Risk: ⚪ Minimal · up to a8193

The change places VM export tests after the Windows memory-dump test in the full suite. No merge-blocking issue is established.

Pre-merge checks: Passed 7
Passed Passed checks: 7 passed
Check name Status Explanation
Linked Issues check Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check Passed Check skipped because no linked issues were found for this pull request.
Pr Template Sections Passed All required PR template sections are present in the supplied live PR description. The What this PR does / why we need it: section contains meaningful content. The issue, reviewer-notes, and `jira-t…
New Test Traceability Passed PASS: The pull request changes only the module-level pytestmark in tests/storage/vm_export/test_vm_export.py. It adds no test_* function or method, so the new-test traceability requirement does …
Manual Std Lifecycle Passed PASS: The PR only adds a module-level pytestmark = pytest.mark.order(...) in tests/storage/vm_export/test_vm_export.py. It does not add or modify any test function or method, and it does not chang…
Stp Scenario Coverage Passed PASS — The PR modifies only tests/storage/vm_export/test_vm_export.py by adding a module-level pytest.mark.order. The module, classes, and test functions contain no STP:, Jira:, or RFE: URL …
Title check Passed The title is 65 characters and clearly describes the change to the execution order of the vm_export tests. The WIP prefix does not prevent it from meeting the stated requirement.
✨ Finishing Touches: 💡 1
🛠️ Fix failing CI checks: 💡
  • Commit to this branch
  • Create a new PR
🧪 Generate unit tests (beta)
  • Create a new PR
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

Assisted-by: OpenAI Codex (GPT-6) <noreply@openai.com>
Signed-off-by: Adam Cinko <acinko@redhat.com>
@acinko-rh
acinko-rh force-pushed the change_sequence_of_execution_for_vm_export_main branch from 2a850d7 to a81930f Compare October 15, 2026 06:08
@openshift-virtualization-qe-bot-2

Copy link
Copy Markdown
Contributor

Clean rebase detected — no code changes compared to previous head (2a850d7).

@jpeimer

jpeimer commented Oct 15, 2026

Copy link
Copy Markdown
Contributor

/hold

@acinko-rh I believe you need this patch to debug the 4.19 gating failures, it is not intended for merge?

@acinko-rh

Copy link
Copy Markdown
Contributor Author

/build-and-push-container


Generated by Codex · Agents: Codex (primary) · Skills: storage-pr-verification · Models: Codex (exact model variant unavailable)

@acinko-rh

Copy link
Copy Markdown
Contributor Author

/hold

@acinko-rh I believe you need this patch to debug the 4.19 gating failures, it is not intended for merge?

@jpeimer #6479 (comment) the reason is Ruth asked me to start from main

@acinko-rh

Copy link
Copy Markdown
Contributor Author

/wip

@openshift-virtualization-qe-bot-3 openshift-virtualization-qe-bot-3 changed the title [Storage] - Change order of execution for vm_export module WIP: [Storage] - Change order of execution for vm_export module Oct 15, 2026

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants