Skip to content

Comments

Persist flaky monitor reports across PRs#1417

Merged
KCarretto merged 2 commits intomainfrom
flaky-monitor-persistence-15160182109113442812
Dec 26, 2025
Merged

Persist flaky monitor reports across PRs#1417
KCarretto merged 2 commits intomainfrom
flaky-monitor-persistence-15160182109113442812

Conversation

@google-labs-jules
Copy link
Contributor

Updated the flaky-monitor workflow to persist reports across PRs by moving it to a separate workflow triggered by workflow_run. This allows the reporter to access historical data from the main branch context.


PR created automatically by Jules for task 15160182109113442812 started by @KCarretto

Refactors the flaky test monitoring to run in a separate workflow triggered by `workflow_run`.
This allows the `github-test-reporter` to run in the context of the default branch, enabling it to access and maintain a history of test reports across different Pull Requests for accurate flaky test detection and historical comparison.

- Removes `flaky-monitor` job from `tests.yml`
- Adds `.github/workflows/flaky-monitor.yml` triggered on `workflow_run` of `Tests`
- Configuring artifact download from the triggering run
- Sets appropriate permissions for PR commenting and artifact access
@google-labs-jules
Copy link
Contributor Author

👋 Jules, reporting for duty! I'm here to lend a hand with this pull request.

When you start a review, I'll add a 👀 emoji to each comment to let you know I've read it. I'll focus on feedback directed at me and will do my best to stay out of conversations between you and other bots or reviewers to keep the noise down.

I'll push a commit with your requested changes shortly after. Please note there might be a delay between these steps, but rest assured I'm on the job!

For more direct control, you can switch me to Reactive Mode. When this mode is on, I will only act on comments where you specifically mention me with @jules. You can find this option in the Pull Request section of your global Jules UI settings. You can always switch back!


For security, I will only act on instructions from the user who triggered this task.

New to Jules? Learn more at jules.google/docs.

Implements a robust flaky test monitoring solution that persists test reports to an orphan branch (`flaky-monitor-results`) instead of relying on ephemeral workflow artifacts.

- Creates `.github/workflows/flaky-monitor.yml` triggered by `workflow_run` on `Tests`.
- Manages an orphan branch `flaky-monitor-results` to store historical test reports.
- Configures the monitor to aggregate historical reports from the branch with the current run's artifacts.
- Ensures only runs against the `main` branch update the persistent history.
- Removes the ephemeral `flaky-monitor` job from `.github/workflows/tests.yml`.
@KCarretto KCarretto marked this pull request as ready for review December 26, 2025 20:10
@KCarretto KCarretto requested a review from hulto December 26, 2025 20:10
@KCarretto KCarretto merged commit 4f14168 into main Dec 26, 2025
7 checks passed
@KCarretto KCarretto deleted the flaky-monitor-persistence-15160182109113442812 branch December 26, 2025 23:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants