🏥 Repository Health Dashboard

🏥 Daily Health Check — 2026-08-31

Status: 🔴 6 critical · 🟡 5 warnings · 🔵 0 info
Since yesterday: 🆕 5 new · ✅ 4 resolved · 📌 4 unchanged

🆕 New Findings (5)

These appeared since the last health check (2026-08-30).

🔴 Evaluation workflow failed on main: vally (dotnet-blazor--claude-opus-5) — Run vally evaluations

Fingerprint: pipeline:evaluation:vally-(dotnet-blazor--claude-opus-5):run-vally-evaluations:failure
Details: Run #8011 "schedule: newer" (schedule event on main, created 2026-08-30T07:09Z) failed in job evaluate / vally (dotnet-blazor--claude-opus-5) at the Run vally evaluations step.
Action: Inspect vally evaluation logs for this shard/model combination.
Investigation: dispatched (see table below).

🔴 Evaluation workflow failed on main: vally (dotnet-data--claude-opus-5) — Run vally evaluations

Fingerprint: pipeline:evaluation:vally-(dotnet-data--claude-opus-5):run-vally-evaluations:failure
Details: Same run #8011 — job evaluate / vally (dotnet-data--claude-opus-5) failed at the Run vally evaluations step.
Action: Inspect vally evaluation logs for this shard/model combination.
Investigation: dispatched (see table below).

🔴 Evaluation workflow failed on main: vally (dotnet-maui--claude-opus-5) — Run vally evaluations

Fingerprint: pipeline:evaluation:vally-(dotnet-maui--claude-opus-5):run-vally-evaluations:failure
Details: Same run #8011 — job evaluate / vally (dotnet-maui--claude-opus-5) failed at the Run vally evaluations step.
Action: Inspect vally evaluation logs for this shard/model combination. (Not dispatched — budget cap of 2 reached; prioritize alongside dotnet-blazor/dotnet-data above.)

🔴 Evaluation workflow failed on main: vally (dotnet-diag--claude-sonnet-5) — Run vally evaluations

Fingerprint: pipeline:evaluation:vally-(dotnet-diag--claude-sonnet-5):run-vally-evaluations:failure
Details: Same run #8011 — job evaluate / vally (dotnet-diag--claude-sonnet-5) failed at the Run vally evaluations step.
Action: Inspect vally evaluation logs for this shard/model combination. (Not dispatched — budget cap of 2 reached.)

🟡 Issue Triage workflow failed: Execute GitHub Copilot CLI step

Fingerprint: pipeline:issue-triage:agent:execute-github-copilot-cli:failure
Details: Run #65 (issues event, created 2026-08-30T19:19Z) failed in job agent at the Execute GitHub Copilot CLI step. Other jobs in the run (pre_activation, pat_pool, activation, detection, safe_outputs, conclusion) succeeded.
Action: Review the agent execution logs for the triage workflow run.
Investigation: dispatched (see table below).

All 4 vally-shard failures above trace back to the same single scheduled run (#33298539883, run #8011), alongside the pre-existing evaluation:failure-rate:warning finding — see Correlation note in Trends.

🔍 Investigation Results

Deep investigations are dispatched for new critical/warning findings.
The grooming workflow links results ~3 hours after this run.

Finding	Severity	Investigation	First Seen	Result
Evaluation failure rate across all branches exceeds 30% (critical)	🔴 Critical	🔄 Dispatched	2026-08-30	⏳ Investigation dispatched — results arriving shortly...
Evaluation workflow failed on main: vally (dotnet-ai--claude-haiku-4.5) — Run vally evaluations	🔴 Critical	🔄 Dispatched	2026-08-30	⏳ Investigation dispatched — results arriving shortly...
Evaluation workflow failed on main: vally (dotnet-blazor--claude-opus-5) — Run vally evaluations	🔴 Critical	🔄 Dispatched	2026-08-31	⏳ Investigation dispatched — results arriving shortly...
Evaluation workflow failed on main: vally (dotnet-data--claude-opus-5) — Run vally evaluations	🔴 Critical	🔄 Dispatched	2026-08-31	⏳ Investigation dispatched — results arriving shortly...

✅ Resolved Since Yesterday (4)

These were in yesterday's report but are no longer detected in the last 24h.

Evaluation failure rate across all branches exceeds 30% (critical)

Re-sampled with the current 24h window (7 runs across all branches/events): 1 failure / 3 completed success-or-failure runs = ~25% failure rate — now below the 30% critical threshold, but still above 15%, so this demotes to the pre-existing pipeline:evaluation:failure-rate:warning finding rather than disappearing entirely (see Existing Findings).

Evaluation workflow failed on main: vally (dotnet-ai--claude-haiku-4.5) — Run vally evaluations

No recurrence of this specific shard/model failure in the last 24h — different shards (dotnet-blazor, dotnet-data, dotnet-maui, dotnet-diag) failed instead in today's scheduled run.

skill-coverage workflow run cancelled on main (comment job)

No cancelled/timed-out runs detected on main in the last 24h window.

Orphan plugin: dotnet-test-migration not in marketplace.json

plugins/dotnet-test-migration is now listed in .github/plugin/marketplace.json (./plugins/dotnet-test-migration) — no longer orphaned.

Note: pipeline:evaluation:vally-(dotnet-maui--claude-haiku-4.5)... and dotnet-diag--mai-code-1-flash-picker from two runs ago were already dropped in the prior run and remain absent.

📌 Existing Findings (4)

These have been present since before today. Sorted by age.

🟡 Warning — Orphan plugin: dotnet-experimental not in marketplace.json · first seen 2026-05-14 · 68 occurrences

Fingerprint: infra:orphan-plugin:dotnet-experimental
Category: Infra · Severity: 🟡 Warning

The plugin directory plugins/dotnet-experimental/ has a valid plugin.json (skills field resolves correctly) but is still not listed in .github/plugin/marketplace.json. ~109 days outstanding.

Suggested action: Either add dotnet-experimental to marketplace.json if ready for consumers, or remove the plugin directory if no longer needed.

🟡 Warning — Validate PAT Pool workflow failed: Build summary step · first seen 2026-08-05 · 9 occurrences

Fingerprint: pipeline:validate-pat-pool:validate-copilot-pat-pool:build-summary:failure
Category: Pipeline · Severity: 🟡 Warning

The validate-pat-pool.yml workflow failed again at the Build summary step (Run #85, all 10 individual PAT validation steps succeeded, only the summary step failed).

Suggested action: This recurring failure has now persisted for 9+ occurrences since 2026-08-05 — file a dedicated tracking issue given the sustained recurrence; the summary-generation logic itself likely has a bug independent of the PATs it validates.

🟡 Warning — Evaluation failure rate across all branches exceeds 15% · first seen 2026-08-27 · 3 occurrences

Fingerprint: pipeline:evaluation:failure-rate:warning
Category: Pipeline · Severity: 🟡 Warning

24h window (7 total runs, all branches/events): 1 failure, 3 successes, 2 skipped, 1 action_required. Failure rate = 1/(1+3) = 25%, above the 15% warning threshold (demoted from critical — see Resolved section). Event breakdown: 1 schedule failure (the same run driving the 4 new vally-shard findings above), 0 pull_request/workflow_dispatch failures.

Suggested action: Continue monitoring; if failure rate persists above 15% next run, treat as trending upward.

🔴 Critical — Eval avg run duration exceeds 55 min (critical threshold) · first seen 2026-08-28 · 2 occurrences

Fingerprint: resource:eval-duration:critical
Category: Resource · Severity: 🔴 Critical

Sampled the last 30 evaluation.yml runs on main; for the 30 completed (success/failure) runs within the last 14 days, average duration is ~76.5 min, above the 55-min critical threshold (60-min workflow timeout).

Suggested action: Investigate whether the evaluation matrix has grown or a subset of shards are consistently slow; consider increasing the timeout or splitting the matrix to reduce per-run duration. This likely correlates with the recurring scheduled-run failures above.

📊 Trends (7-day)

Metric	Today	7d Avg	Δ	Trend
Eval duration (min, main, n=30, 14d)	~76.5	~93 (prior estimates)	-16.5	✅
Eval success rate (main, n=30 completed)	72% (13/18 strict)	~76%	-4pp	⚠️
Eval success rate (all branches, 24h, n=3 completed)	75% (3/4) — wait, see note	50% (prior day)	~	✅
Eval scheduled cancellation rate (24h, main)	0% (0/1)	0%	0	➡️
Workflow failure rate (7d)	not fully computed this run (time budget)	—	—	➡️
Compute hours/day	not computed this run (time budget)	—	—	➡️

Correlation: All 4 new critical vally-shard failures (dotnet-blazor, dotnet-data, dotnet-maui, dotnet-diag) trace back to the same single scheduled run (#33298539883), consistent with last run's pattern where multiple shards failed together in one scheduled run. Combined with the still-critical eval-duration finding (~76.5 min avg) and the still-active evaluation:failure-rate:warning, this continues to suggest the eval pipeline occasionally fails broadly within a single scheduled run — worth checking whether resource contention, a shared dependency, or a transient infra issue around scheduled-run time is the common cause.

Recommendations:

Investigate the single failed scheduled run (#33298539883 / run #8011) holistically — 4 shards failed together at "Run vally evaluations", suggesting a shared cause rather than per-shard flakiness.

The eval-duration critical finding persists at 2 occurrences (~76.5 min avg) — prioritize investigating matrix growth or slow shards; this may also explain schedule-driven shard failures if runs are timing out under load.

File a standalone tracking issue for the validate-pat-pool Build-summary failure, now at 9 occurrences since 2026-08-05.

Resolve the remaining dotnet-experimental orphan-plugin gap in marketplace.json (109+ days outstanding) — dotnet-test-migration was resolved this run, showing the pattern is fixable.

Investigate the new Issue Triage workflow failure (Execute GitHub Copilot CLI step) — first occurrence, could indicate an emerging Copilot CLI/agent issue worth tracking if it recurs.

⚠️ Skipped Pages deployment check (I5): no Pages-related MCP tool/endpoint available this run — check appears not applicable or not reachable with available tooling.
⚠️ Skipped relaxed-skill-validation (I3): no validate-skills.yml file exists in .github/workflows/; closest analog skill-validator.yml does not contain fail-on-warning: false — no finding raised.
⚠️ Skipped verdict-warn-only (I4): evaluation.yml does not contain --verdict-warn-only — no finding raised.
⚠️ I6 (unpinned third-party actions): scanned all workflow YAML files for non-actions/* references — found github/codeql-action and super-linter/super-linter, both already pinned to full commit SHAs. No unpinned-action findings.
⚠️ I7 (orphan skills): all 15 plugin directories under plugins/*/ have a plugin.json at their root resolving a ./skills/ path containing the discovered skill directories; no orphan skills detected.
⚠️ U3 (cost trend) and full 7-day workflow-failure-rate/compute-hours trends not computed this run due to time budget — carried over as "not computed" from prior runs.

_{🤖 Generated by DevOps Health Check agentic workflow · Run #33353465682 · 2026-08-31T03:20 UTC}> Generated by DevOps Daily Health Check · auto · 185.9 AIC · ⌖ 4.32 AIC · ⊞ 20.5K · ◷

🏥 Daily Health Check — 2026-09-12

Status: 🔴 16 critical · 🟡 4 warnings · 🔵 0 info
Since yesterday: 🆕 17 new · ✅ 6 resolved · 📌 3 unchanged

📌 Maintainer action needed: please pin this issue as the canonical health dashboard and unpin/close any stale duplicate.

🆕 New Findings (17)

These appeared since the last health check (2026-08-31).

🔴 Evaluation failure rate across all branches exceeds 30%

Fingerprint: pipeline:evaluation:failure-rate:critical
Details: 43 evaluation runs in the last 24 hours: 11 failures, 10 successes, 1 cancellation, 19 skipped, and 2 other conclusions. Failure rate is 52.4% (11/21, cancellations excluded); non-success rate is 30.2% (13/43). Failures comprised 7 workflow-dispatch, 3 pull-request-review, and 1 scheduled run. Recent samples: run 9098, run 9095, run 9092, run 9085, and run 9082.
Common failures: Copilot token selection dominated the failed jobs; session-data publishing also failed repeatedly.
Action: Investigate token-pool availability first, then rerun affected evaluations.
Investigation: dispatched.

🔴 Evaluation failed: csharp-refactoring token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet--csharp-refactoring--claude-sonnet-4.6):select-available-copilot-token-from-pool:failure
Details: The same job failed at Select available Copilot token from pool in three main-branch dispatches: 9095, 9085, and 9080.
Action: Check PAT pool exhaustion or selection logic before retrying PR Add .NET refactoring skill #873 evaluations.
Investigation: dispatched.

🔴 Evaluation failed: publish session data

Fingerprint: `pipeline:evaluation:publish-session-(redacted)
Details: publish-session-data failed at Push to dashboard-session-data branch (dotnet/skills-data) in the same three main-branch dispatches: 9095, 9085, and 9080.
Action: Confirm whether this is downstream fallout from missing evaluation artifacts or an independent branch-push failure.

🔴 Scheduled evaluation failed: dotnet-advanced token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-advanced--claude-sonnet-4.6):select-available-copilot-token-from-pool:failure
Details: Scheduled run 9057 failed before evaluation at token selection.
Action: Restore token-pool capacity and retry the shard.

🔴 Scheduled evaluation failed: dotnet-ai token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-ai--claude-sonnet-4.6):select-available-copilot-token-from-pool:failure
Details: Scheduled run 9057 failed before evaluation at token selection.
Action: Restore token-pool capacity and retry the shard.

🔴 Scheduled evaluation failed: dotnet-aspnetcore token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-aspnetcore--claude-sonnet-4.6):select-available-copilot-token-from-pool:failure
Details: Scheduled run 9057 failed before evaluation at token selection.
Action: Restore token-pool capacity and retry the shard.

🔴 Scheduled evaluation failed: dotnet-blazor token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-blazor--claude-sonnet-4.6):select-available-copilot-token-from-pool:failure
Details: Scheduled run 9057 failed before evaluation at token selection.
Action: Restore token-pool capacity and retry the shard.

🔴 Scheduled evaluation failed: dotnet-data token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-data--claude-sonnet-4.6):select-available-copilot-token-from-pool:failure
Details: Scheduled run 9057 failed before evaluation at token selection.
Action: Restore token-pool capacity and retry the shard.

🔴 Scheduled evaluation failed: dotnet-diag token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-diag--claude-sonnet-4.6):select-available-copilot-token-from-pool:failure
Details: Scheduled run 9057 failed before evaluation at token selection.
Action: Restore token-pool capacity and retry the shard.

🔴 Scheduled evaluation failed: dotnet token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet--claude-sonnet-4.6):select-available-copilot-token-from-pool:failure
Details: Scheduled run 9057 failed before evaluation at token selection.
Action: Restore token-pool capacity and retry the shard.

🔴 Scheduled evaluation failed: dotnet-maui token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-maui--claude-sonnet-4.6):select-available-copilot-token-from-pool:failure
Details: Scheduled run 9057 failed before evaluation at token selection.
Action: Restore token-pool capacity and retry the shard.

🔴 Scheduled evaluation failed: dotnet-msbuild default token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-msbuild--shard-default--claude-sonnet-4.6):select-available-copilot-token-from-pool:failure
Details: Scheduled run 9057 failed before evaluation at token selection.
Action: Restore token-pool capacity and retry the shard.

🔴 Scheduled evaluation failed: dotnet-msbuild heavy token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-msbuild--shard-heavy--claude-sonnet-4.6):select-available-copilot-token-from-pool:failure
Details: Scheduled run 9057 failed before evaluation at token selection.
Action: Restore token-pool capacity and retry the shard.

🔴 Scheduled evaluation failed: dotnet-msbuild medium token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-msbuild--shard-medium--claude-sonnet-4.6):select-available-copilot-token-from-pool:failure
Details: Scheduled run 9057 failed before evaluation at token selection.
Action: Restore token-pool capacity and retry the shard.

🔴 Scheduled evaluation failed: dotnet-nuget token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-nuget--claude-sonnet-4.6):select-available-copilot-token-from-pool:failure
Details: Scheduled run 9057 failed before evaluation at token selection.
Action: Restore token-pool capacity and retry the shard.

🟡 Dependabot update workflow failed

Fingerprint: pipeline:dependabot:dependabot:run-dependabot:failure
Details: Dependabot run 176 failed in job Dependabot at Run Dependabot.
Action: Review the update failure and rerun after correcting the dependency-update error.

🟡 DevOps Health Groom Dashboard workflow failed

Fingerprint: pipeline:devops-health-groom-dashboard:agent:execute-github-copilot-cli:failure
Details: Groom run 328 failed in job agent at Execute GitHub Copilot CLI.
Action: Inspect the agent execution logs because failed grooming can delay investigation results.

🔍 Investigation Results

Deep investigations are dispatched for new critical/warning findings.
The grooming workflow links results ~3 hours after this run.

Finding	Severity	Investigation	First Seen	Result
Evaluation failure rate across all branches exceeds 30%	🔴 Critical	🔄 Dispatched	2026-09-12	⏳ Investigation dispatched — results arriving shortly...
Evaluation failed: csharp-refactoring token selection	🔴 Critical	🔄 Dispatched	2026-09-12	⏳ Investigation dispatched — results arriving shortly...

✅ Resolved Since Yesterday (6)

These were in the previous report but are no longer detected.

Evaluation failure rate across all branches exceeds 15%

The warning fingerprint was replaced by the critical bucket because the current failure rate is 52.4%. See evaluation runs.

Evaluation workflow failed: dotnet-blazor with claude-opus-5

No recurrence of this exact job/step fingerprint in the current 24-hour window. See evaluation runs.

Evaluation workflow failed: dotnet-data with claude-opus-5

No recurrence of this exact job/step fingerprint in the current 24-hour window. See evaluation runs.

Evaluation workflow failed: dotnet-maui with claude-opus-5

No recurrence of this exact job/step fingerprint in the current 24-hour window. See evaluation runs.

Evaluation workflow failed: dotnet-diag with claude-sonnet-5

No recurrence of this exact job/step fingerprint in the current 24-hour window. See evaluation runs.

Issue Triage workflow failed at Execute GitHub Copilot CLI

No matching main failure occurred in the current 24-hour window. See Issue Triage runs.

📌 Existing Findings (3)

These have been present since before today. Sorted by age.

🟡 Orphan plugin: dotnet-experimental not in marketplace.json · first seen 2026-05-14 · 69 occurrences

Fingerprint: infra:orphan-plugin:dotnet-experimental

plugins/dotnet-experimental/plugin.json is valid and points to ./skills/, but no marketplace entry targets that directory. Review marketplace configuration.

Suggested action: Register the plugin when ready for consumers, or remove it if it is intentionally retired.

🟡 Validate PAT Pool workflow failed: Build summary step · first seen 2026-08-05 · 10 occurrences

Fingerprint: pipeline:validate-pat-pool:validate-copilot-pat-pool:build-summary:failure

All ten PAT checks succeeded, but Build summary failed again in run 97.

Suggested action: Fix the recurring summary-generation bug independently of token validity.

🔴 Eval avg run duration exceeds 55 min · first seen 2026-08-28 · 3 occurrences

Fingerprint: resource:eval-duration:critical

The 25 completed main-branch evaluation runs sampled over 14 days averaged 98.8 minutes, well above the 55-minute critical threshold. Review evaluation runs.

Suggested action: Split or reduce the evaluation matrix and address queue/runtime bottlenecks.

📊 Trends (7-day)

Metric	Today	7d Avg	Δ	Trend
Eval duration (min)	98.8	76.5 prior sample	+22.3	⚠️
Eval success rate (main)	0% (0/4 completed)	unavailable	—	⚠️
Eval success rate (all branches)	47.6% (10/21 completed)	unavailable	—	⚠️
Eval scheduled cancellation rate	0% (0/1)	0% prior	0pp	➡️
Workflow failure rate (7d)	unavailable	unavailable	—	➡️
Compute hours/day	unavailable	unavailable	—	➡️

Correlation: The critical failure-rate spike, 12 scheduled shard failures, and three repeated csharp-refactoring failures all share the same token-selection step. The 98.8-minute evaluation average compounds this risk but scheduled cancellation remained 0%.

Recommendations:

Restore and validate Copilot PAT pool capacity before retrying evaluation runs.

Investigate why session-data publication fails after token-selection failures.

Fix the PAT validation summary step, now recurring for 10 health checks.

Resolve the long-standing dotnet-experimental marketplace registration gap.

⚠️ Skipped Pages deployment check: the available GitHub read tools expose no Pages deployment endpoint.
⚠️ Skipped exact 7-day workflow-failure and repository-wide compute-hour trends: the bounded Actions result set did not cover the complete windows.
I1/I2 passed: CODEOWNERS and Dependabot configuration are present. I3/I4 passed: no relaxed validation or verdict-warn-only configuration was found. I6 found no confirmed unpinned third-party action. I7 found no orphan skill. Scheduled evaluation cancellation was 0%.

_{🤖 Generated by DevOps Health Check agentic workflow · Run #34669930818 · 2026-09-12T03:18:37 UTC}> Generated by DevOps Daily Health Check · gpt56 · 157.3 AIC · ⌖ 44.1 AIC · ⊞ 25.9K · ◷

🏥 Daily Health Check — 2026-09-13

Status: 🔴 12 critical · 🟡 2 warnings · 🔵 0 info
Since yesterday: 🆕 10 new · ✅ 16 resolved · 📌 4 unchanged

📌 Maintainer action needed: please pin this issue as the canonical health dashboard and unpin/close any stale duplicate.

Executive summary: Ten new evaluation job failures appeared in one scheduled run; the aggregate evaluation failure rate and duration remain critical, while 16 prior run-specific failures resolved.

⚠️ Skipped Pages deployment health: the available GitHub read interface does not expose Pages deployment status. Complete all-workflow compute and 7-day failure-rate metrics were also unavailable because the run listing was capped before the requested time window.

🆕 New Findings (10)

These appeared since the last health check (2026-09-12).

🔴 Evaluation failed: dotnet MAI token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet--mai-code-1-flash-picker):select-available-copilot-token-from-pool:failure
Evidence: Scheduled evaluation run 9100, failed job; failed at Select available Copilot token from pool.
Action: Verify MAI token-pool availability and token selection logic before the next scheduled evaluation.

🔴 Evaluation failed: dotnet-advanced MAI token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-advanced--mai-code-1-flash-picker):select-available-copilot-token-from-pool:failure
Evidence: Scheduled evaluation run 9100, failed job; failed at Select available Copilot token from pool.
Action: Correlate with the other MAI token-selection failures and restore usable pool capacity.

🔴 Evaluation failed: dotnet-ai Claude Haiku evaluations

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-ai--claude-haiku-4.5):run-vally-evaluations:failure
Evidence: Scheduled evaluation run 9100, failed job; failed at Run vally evaluations.
Action: Inspect the Vally failure independently from the shared MAI token-pool incident.

🔴 Evaluation failed: dotnet-ai MAI token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-ai--mai-code-1-flash-picker):select-available-copilot-token-from-pool:failure
Evidence: Scheduled evaluation run 9100, failed job; failed at Select available Copilot token from pool.
Action: Restore token-pool capacity and rerun the affected shard.

🔴 Evaluation failed: dotnet-aspnetcore MAI token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-aspnetcore--mai-code-1-flash-picker):select-available-copilot-token-from-pool:failure
Evidence: Scheduled evaluation run 9100, failed job; failed at Select available Copilot token from pool.
Action: Restore token-pool capacity and rerun the affected shard.

🔴 Evaluation failed: dotnet-blazor MAI token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-blazor--mai-code-1-flash-picker):select-available-copilot-token-from-pool:failure
Evidence: Scheduled evaluation run 9100, failed job; failed at Select available Copilot token from pool.
Action: Restore token-pool capacity and rerun the affected shard.

🔴 Evaluation failed: dotnet-data MAI token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-data--mai-code-1-flash-picker):select-available-copilot-token-from-pool:failure
Evidence: Scheduled evaluation run 9100, failed job; failed at Select available Copilot token from pool.
Action: Restore token-pool capacity and rerun the affected shard.

🔴 Evaluation failed: dotnet-diag MAI token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-diag--mai-code-1-flash-picker):select-available-copilot-token-from-pool:failure
Evidence: Scheduled evaluation run 9100, failed job; failed at Select available Copilot token from pool.
Action: Restore token-pool capacity and rerun the affected shard.

🔴 Evaluation failed: dotnet-maui Claude Haiku evaluations

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-maui--claude-haiku-4.5):run-vally-evaluations:failure
Evidence: Scheduled evaluation run 9100, failed job; failed at Run vally evaluations.
Action: Inspect the Vally failure independently from the shared MAI token-pool incident.

🔴 Evaluation failed: dotnet-maui MAI token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-maui--mai-code-1-flash-picker):select-available-copilot-token-from-pool:failure
Evidence: Scheduled evaluation run 9100, failed job; failed at Select available Copilot token from pool.
Action: Restore token-pool capacity and rerun the affected shard.

Correlation: Eight failures share the MAI token-selection step in the same scheduled run, indicating a common pool-capacity or token-selection fault rather than independent skill regressions. Two Claude Haiku shards failed later in Vally and should be investigated separately. The scheduled run lasted 363.1 minutes, reinforcing the existing duration-critical signal.

🔍 Investigation Results

Deep investigations are dispatched for new critical/warning findings.
The grooming workflow links results ~3 hours after this run.

Finding	Severity	Investigation	First Seen	Result
Evaluation failure rate across all branches exceeds 30%	🔴 Critical	🔄 Dispatched	2026-09-12	⏳ Investigation dispatched — results arriving shortly...
Evaluation failed: dotnet MAI token selection	🔴 Critical	🔄 Dispatched	2026-09-13	⏳ Investigation dispatched — results arriving shortly...
Evaluation failed: dotnet-advanced MAI token selection	🔴 Critical	🔄 Dispatched	2026-09-13	⏳ Investigation dispatched — results arriving shortly...

✅ Resolved Since Yesterday (16)

These were in the previous report but are no longer detected.

~~Evaluation failed: csharp-refactoring token selection~~ — no matching failure in the last 24 hours.
~~Evaluation failed: publish session data~~ — no matching failure in the last 24 hours.
~~Scheduled evaluation failed: dotnet token selection~~ — prior Claude Sonnet fingerprint cleared.
~~Scheduled evaluation failed: dotnet-advanced token selection~~ — prior Claude Sonnet fingerprint cleared.
~~Scheduled evaluation failed: dotnet-ai token selection~~ — prior Claude Sonnet fingerprint cleared.
~~Scheduled evaluation failed: dotnet-aspnetcore token selection~~ — prior Claude Sonnet fingerprint cleared.
~~Scheduled evaluation failed: dotnet-blazor token selection~~ — prior Claude Sonnet fingerprint cleared.
~~Scheduled evaluation failed: dotnet-data token selection~~ — prior Claude Sonnet fingerprint cleared.
~~Scheduled evaluation failed: dotnet-diag token selection~~ — prior Claude Sonnet fingerprint cleared.
~~Scheduled evaluation failed: dotnet-maui token selection~~ — prior Claude Sonnet fingerprint cleared.
~~Scheduled evaluation failed: dotnet-msbuild default token selection~~ — no matching failure.
~~Scheduled evaluation failed: dotnet-msbuild heavy token selection~~ — no matching failure.
~~Scheduled evaluation failed: dotnet-msbuild medium token selection~~ — no matching failure.
~~Scheduled evaluation failed: dotnet-nuget token selection~~ — no matching failure.
~~Dependabot update workflow failed~~ — no matching main-branch failure in the last 24 hours.
~~DevOps Health Groom Dashboard workflow failed~~ — no matching main-branch failure in the last 24 hours.

📌 Existing Findings (4)

These have been present since before today. Sorted by age.

🔴 Evaluation failure rate across all branches exceeds 30% — first seen 2026-09-12 · 2 occurrences

The last 24 hours contained 3 evaluation events: 1 failure, 0 successes, 0 cancellations, and 2 skipped review events. Excluding cancellations and skipped runs, the failure rate is 100%. The sole completed run was the scheduled run 9100.

Action: Resolve the common token-pool failure, then rerun evaluation to restore a meaningful successful sample.

🔴 Eval avg run duration exceeds 55 min — first seen 2026-08-28 · 4 occurrences

The latest 30 completed main-branch evaluation runs averaged 93.8 minutes; the latest scheduled run lasted 363.1 minutes.

Action: Separate queue delay from execution time and reduce long-running scheduled matrices or adjust scheduling/concurrency.

🟡 Validate PAT Pool failed at Build summary — first seen 2026-08-05 · 11 occurrences

Run 98 failed at Build summary after all ten PAT validation steps completed successfully.

Action: Fix summary logic so a successful pool validation does not fail the workflow.

🟡 Orphan plugin: dotnet-experimental — first seen 2026-05-14 · 70 occurrences

plugins/dotnet-experimental contains a valid plugin.json and registered skills, but no marketplace entry points to the directory.

Action: Add ./plugins/dotnet-experimental to .github/plugin/marketplace.json, or remove the plugin if it is intentionally undiscoverable.

📊 Trends (7-day)

Metric	Today	7d Avg	Δ	Trend
Eval duration (min)	363.1	93.8	+269.3	↗️ Increasing (watch)
Eval success rate (main)	0%	8.0%	-8.0 pp	⚠️ Degrading
Eval success rate (all branches)	0%	43.8% sampled	-43.8 pp	⚠️ Degrading
Eval scheduled cancellation rate	0%	0% observed	0 pp	➡️ Stable
Workflow failure rate (7d)	unavailable	unavailable	—	➡️ Incomplete source window
Compute hours/day	unavailable	unavailable	—	➡️ Incomplete source window

Recommendations:

Restore MAI token-pool capacity or selection behavior first; it accounts for 8 of 10 new job failures.
Investigate the two independent Claude Haiku Vally failures after the shared token issue is contained.
Correct the recurring PAT summary failure and either register or retire dotnet-experimental.

_{🤖 Generated by DevOps Health Check agentic workflow · Run #357 · 2026-09-13 03:21 UTC}> Generated by DevOps Daily Health Check · gpt56 · 158.4 AIC · ⌖ 27.8 AIC · ⊞ 25.9K · ◷

🏥 Daily Health Check — 2026-09-14

Status: 🔴 3 critical · 🟡 4 warnings · 🔵 0 info
Since yesterday: 🆕 4 new · ✅ 11 resolved · 📌 3 unchanged

📌 Maintainer action needed: please pin this issue as the canonical health dashboard and unpin/close any stale duplicate.

Executive summary: Four new pipeline failures were detected. The all-branch evaluation failure rate remains critical at 64.9%, while the prior evaluation-duration threshold breach cleared.

Priority: Investigate the two failed Claude Opus evaluation jobs first, then the Copilot CLI failures in dashboard grooming and issue triage. The 23 evaluation push failures suggest a workflow/configuration issue distinct from the two scheduled Vally job failures.

⚠️ Skipped Pages deployment checks: the available GitHub read tools do not expose Pages deployment status.
⚠️ Skipped weekly compute-cost comparison: prior daily compute metrics are not present in cache memory.
⚠️ No known-noise cache entry was available; no findings were demoted.

🆕 New Findings (4)

These appeared since the last health check (2026-09-13).

🔴 Evaluation failed: dotnet-advanced Claude Opus evaluations

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-advanced--claude-opus-5):run-vally-evaluations:failure
Details: Scheduled evaluation run 34744495801 failed in evaluate / vally (dotnet-advanced--claude-opus-5) at Run vally evaluations after 590.3 minutes.
Link: Failed job
Suggested action: Inspect Vally output and runner resource usage; this run approached ten hours and materially exceeded the historical duration range.

🔴 Evaluation failed: dotnet-blazor Claude Opus evaluations

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-blazor--claude-opus-5):run-vally-evaluations:failure
Details: The same scheduled evaluation run failed in evaluate / vally (dotnet-blazor--claude-opus-5) at Run vally evaluations.
Link: Failed job
Suggested action: Compare this failure with the dotnet-advanced failure to identify shared model, token, runner, or Vally infrastructure causes.

🟡 DevOps Health Groom Dashboard failed in Copilot CLI

Fingerprint: pipeline:devops-health-groom-dashboard:agent:execute-github-copilot-cli:failure
Details: Run 34742644468 failed in job agent at Execute GitHub Copilot CLI.
Link: Failed job
Suggested action: Review the agent step log and confirm the grooming workflow can parse and update the investigation table.

🟡 Issue Triage failed in Copilot CLI

Fingerprint: pipeline:issue-triage:agent:execute-github-copilot-cli:failure
Details: Run 34746721850 failed in job agent at Execute GitHub Copilot CLI.
Link: Failed job
Suggested action: Review the Copilot CLI failure and compare it with the dashboard-groom failure for shared agent-runtime causes.

🔍 Investigation Results

Deep investigations are dispatched for new critical/warning findings.
The grooming workflow links results ~3 hours after this run.

Finding	Severity	Investigation	First Seen	Result
Evaluation failure rate across all branches exceeds 30%	🔴 Critical	🔄 Dispatched	2026-09-12	⏳ Investigation dispatched — results arriving shortly...
Evaluation failed: dotnet-advanced Claude Opus evaluations	🔴 Critical	🔄 Dispatched	2026-09-14	⏳ Investigation dispatched — results arriving shortly...
Evaluation failed: dotnet-blazor Claude Opus evaluations	🔴 Critical	🔄 Dispatched	2026-09-14	⏳ Investigation dispatched — results arriving shortly...

✅ Resolved Since Yesterday (11)

These were in the previous report but are no longer detected.

~~Evaluation failed: dotnet MAI token selection~~ — no matching main-branch failure in the last 24 hours. Previous run
~~Evaluation failed: dotnet-advanced MAI token selection~~ — no matching failure. Previous run
~~Evaluation failed: dotnet-ai Claude Haiku evaluations~~ — no matching failure. Previous run
~~Evaluation failed: dotnet-ai MAI token selection~~ — no matching failure. Previous run
~~Evaluation failed: dotnet-blazor MAI token selection~~ — no matching failure. Previous run
~~Evaluation failed: dotnet-aspnetcore MAI token selection~~ — no matching failure. Previous run
~~Evaluation failed: dotnet-diag MAI token selection~~ — no matching failure. Previous run
~~Evaluation failed: dotnet-data MAI token selection~~ — no matching failure. Previous run
~~Evaluation failed: dotnet-maui Claude Haiku evaluations~~ — no matching failure. Previous run
~~Evaluation failed: dotnet-maui MAI token selection~~ — no matching failure. Previous run
~~Eval average run duration exceeds 55 min~~ — 14-day average is now 49.2 minutes across 215 completed main-branch evaluation runs. Evaluation workflow

📌 Existing Findings (3)

These have been present since before today. Sorted by severity and age.

🔴 Evaluation failure rate across all branches exceeds 30% — first seen 2026-09-12 · 3 occurrences

Fingerprint: pipeline:evaluation:failure-rate:critical
Details: 24 failures and 13 successes in the last 24 hours produce a 64.9% failure rate; 23 failures were push events and 1 was scheduled. Cancelled runs were excluded. Recent samples: 34779904262, 34778961056, 34777920251, 34776932328, 34775958038.
Suggested action: Fix the repeated push-time workflow/configuration failures, then address the scheduled Vally job failures.

🟡 Validate PAT Pool workflow failed: Build summary step — first seen 2026-08-05 · 12 occurrences

Fingerprint: pipeline:validate-pat-pool:validate-copilot-pat-pool:build-summary:failure
Details: Run 34799923235 failed at Build summary in Validate Copilot PAT Pool.
Link: Failed job
Suggested action: Review summary generation against the current PAT pool output schema.

🟡 Orphan plugin: dotnet-experimental not in marketplace.json — first seen 2026-05-14 · 71 occurrences

Fingerprint: infra:orphan-plugin:dotnet-experimental
Details: plugins/dotnet-experimental/plugin.json exists, but .github/plugin/marketplace.json has no source entry for ./plugins/dotnet-experimental.
Link: Plugin directory
Suggested action: Register the plugin in the marketplace or remove the plugin manifest if it is intentionally undiscoverable.

📊 Trends (7-day)

Metric	Today	7d Avg	Δ	Trend
Eval duration (min)	590.3 scheduled run	48.9	+541.4	⚠️ Degrading
Eval success rate (main)	87.5% (7/8)	63.6% (56/88)	+23.9 pp	✅ Improving
Eval success rate (all branches)	35.1% (13/37 decisive)	N/A	N/A	➡️ Baseline unavailable
Eval scheduled cancellation rate	0% (0/1)	N/A	N/A	✅ No cancellations
Workflow failure rate (7d)	1.6% (4/245 observed runs)	N/A	N/A	➡️ Baseline unavailable
Compute hours/day	12.1 h	N/A	N/A	➡️ Baseline unavailable

_{🤖 Generated by DevOps Health Check agentic workflow · Run #34802232015 · 2026-09-14T03:25:39Z UTC}> Generated by DevOps Daily Health Check · gpt56 · 252.8 AIC · ⌖ 30.2 AIC · ⊞ 25.1K · ◷

🏥 Daily Health Check — 2026-09-16

Status: 🔴 18 critical · 🟡 2 warnings · 🔵 0 info
Since yesterday: 🆕 17 new · ✅ 4 resolved · 📌 3 unchanged

📌 Maintainer action needed: please pin this issue as the canonical health dashboard and unpin/close any stale duplicate.

🆕 New Findings (17)

These appeared since the last health check (2026-09-14).

🔴 Evaluation session-data publishing failed

Fingerprint: `pipeline:evaluation:publish-session-(redacted)
Evidence: The publish-session-data job failed repeatedly at Push to dashboard-session-data branch (dotnet/skills-data) across recent evaluation runs.
Action: Investigate branch update contention or write failures and make publishing idempotent.
Link: Latest failed job

🔴 Evaluation failed: dotnet-msbuild agent.msbuild on Claude Sonnet 5

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-msbuild--agent.msbuild--claude-sonnet-5):run-vally-evaluations:failure
Evidence: Repeated Run vally evaluations failures in the last 24 hours.
Action: Compare the repeated runs and isolate the stable evaluator or fixture failure.
Link: Failed job

🔴 Evaluation failed: dotnet-msbuild agent.msbuild on GPT-5.6 Luna

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-msbuild--agent.msbuild--gpt-5.6-luna):run-vally-evaluations:failure
Evidence: Repeated Run vally evaluations failures in the same dotnet-msbuild evaluation runs.
Action: Compare model-independent failures with the Claude lane before changing skill content.
Link: Failed job

🔴 Evaluation failed: dotnet-msbuild medium shard on Claude Sonnet 5

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-msbuild--shard-medium--claude-sonnet-5):run-vally-evaluations:failure
Evidence: The medium shard failed at Run vally evaluations.
Action: Inspect the failing shard output and compare it with the agent.msbuild lanes.
Link: Failed job

🔴 Evaluation failed: dotnet-msbuild heavy shard on Claude Sonnet 5

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-msbuild--shard-heavy--claude-sonnet-5):run-vally-evaluations:failure
Evidence: The heavy shard failed at Run vally evaluations.
Action: Inspect the failed shard for a common evaluator dependency failure.
Link: Failed job

🔴 Scheduled evaluation failed: dotnet MAI token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet--mai-code-1-flash-picker):select-available-copilot-token-from-pool:failure
Evidence: Select available Copilot token from pool failed in the scheduled run.
Action: Restore available MAI credentials or reduce concurrent token demand.
Link: Failed job

🔴 Scheduled evaluation failed: dotnet-advanced MAI token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-advanced--mai-code-1-flash-picker):select-available-copilot-token-from-pool:failure
Evidence: MAI token selection failed before evaluation.
Action: Review shared token-pool availability and concurrency.
Link: Failed job

🔴 Scheduled evaluation failed: dotnet-aspnetcore MAI token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-aspnetcore--mai-code-1-flash-picker):select-available-copilot-token-from-pool:failure
Evidence: MAI token selection failed before evaluation.
Action: Review shared token-pool availability and concurrency.
Link: Failed job

🔴 Scheduled evaluation failed: dotnet-ai on Claude Haiku 4.5

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-ai--claude-haiku-4.5):run-vally-evaluations:failure
Evidence: Run vally evaluations failed in the scheduled matrix.
Action: Inspect the Vally failure independently from the MAI token-pool failures.
Link: Failed job

🔴 Scheduled evaluation failed: dotnet-ai MAI token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-ai--mai-code-1-flash-picker):select-available-copilot-token-from-pool:failure
Evidence: MAI token selection failed before evaluation.
Action: Review shared token-pool availability and concurrency.
Link: Failed job

🔴 Scheduled evaluation failed: dotnet-blazor MAI token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-blazor--mai-code-1-flash-picker):select-available-copilot-token-from-pool:failure
Evidence: MAI token selection failed before evaluation.
Action: Review shared token-pool availability and concurrency.
Link: Failed job

🔴 Scheduled evaluation failed: dotnet-data MAI token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-data--mai-code-1-flash-picker):select-available-copilot-token-from-pool:failure
Evidence: MAI token selection failed before evaluation.
Action: Review shared token-pool availability and concurrency.
Link: Failed job

🔴 Scheduled evaluation failed: dotnet-diag MAI token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-diag--mai-code-1-flash-picker):select-available-copilot-token-from-pool:failure
Evidence: MAI token selection failed before evaluation.
Action: Review shared token-pool availability and concurrency.
Link: Failed job

🔴 Scheduled evaluation failed: dotnet-maui on Claude Haiku 4.5

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-maui--claude-haiku-4.5):run-vally-evaluations:failure
Evidence: Run vally evaluations failed in the scheduled matrix.
Action: Inspect the Vally failure independently from token-pool failures.
Link: Failed job

🔴 Scheduled evaluation failed: dotnet-maui MAI token selection

Fingerprint: pipeline:evaluation:evaluate-/-vally-(dotnet-maui--mai-code-1-flash-picker):select-available-copilot-token-from-pool:failure
Evidence: MAI token selection failed before evaluation.
Action: Review shared token-pool availability and concurrency.
Link: Failed job

🔴 Evaluation workflow file validation failed on main

Fingerprint: pipeline:evaluation:workflow-file:workflow-validation:failure
Evidence: A main-branch push failed before any job was created, consistent with workflow-file validation failure.
Action: Inspect the workflow annotations for the failed run and keep actionlint required.
Link: Failed run

🔴 Scheduled evaluation average duration exceeds 55 minutes

Fingerprint: resource:eval-duration:critical
Evidence: 14 completed scheduled runs averaged 405.6 minutes; the latest took 366.8 minutes.
Action: Reduce matrix duration or adjust scheduling/concurrency so evaluations complete reliably.
Link: Latest scheduled run

🔍 Investigation Results

Deep investigations are dispatched for new critical/warning findings.
The grooming workflow links results ~3 hours after this run.

Finding	Severity	Investigation	First Seen	Result
Evaluation failure rate across all branches exceeds 30%	🔴 Critical	🔄 Dispatched	2026-09-12	⏳ Investigation dispatched — results arriving shortly...
Evaluation session-data publishing failed	🔴 Critical	🔄 Dispatched	2026-09-16	⏳ Investigation dispatched — results arriving shortly...
Evaluation failed: dotnet-msbuild agent.msbuild on Claude Sonnet 5	🔴 Critical	🔄 Dispatched	2026-09-16	⏳ Investigation dispatched — results arriving shortly...

✅ Resolved Since Yesterday (4)

These were in the previous report but are no longer detected.

~~Evaluation failed: dotnet-advanced Claude Opus evaluations~~ — the fingerprint was not observed in the current 24-hour window.
~~Evaluation failed: dotnet-blazor Claude Opus evaluations~~ — the fingerprint was not observed in the current 24-hour window.
~~DevOps Health Groom Dashboard failed in Copilot CLI~~ — no matching main-branch failure was observed.
~~Issue Triage failed in Copilot CLI~~ — no matching main-branch failure was observed.

📌 Existing Findings (3)

These have been present since before today. Sorted by age.

🔴 Evaluation failure rate across all branches exceeds 30% — first seen 2026-09-12 · 4 occurrences

The last 24 hours contain 37 failures and 48 successes across 85 decisive evaluation runs, a 43.5% failure rate. There were also 8 cancellations among 270 total runs; failures were 17 push, 17 workflow-dispatch, 2 issue-comment, and 1 scheduled run. Evaluation runs

🟡 Validate PAT Pool workflow failed: Build summary step — first seen 2026-08-05 · 13 occurrences

The latest scheduled run failed at Build summary after the individual token checks. Failed job

🟡 Orphan plugin: dotnet-experimental not in marketplace.json — first seen 2026-05-14 · 72 occurrences

plugins/dotnet-experimental/plugin.json exists, but .github/plugin/marketplace.json has no source entry for ./plugins/dotnet-experimental. Plugin directory

🧭 Analysis & Recommendations

The failure-rate spike combines three separate signals: repeated dotnet-msbuild Vally failures, repeated session-data publishing failures, and widespread scheduled MAI token-selection failures. The 405.6-minute scheduled average also indicates sustained capacity pressure rather than a single transient run.

Restore reliable session-data publishing and make concurrent branch updates retry safely.
Check shared MAI token-pool capacity before rerunning the scheduled matrix.
Isolate the model-independent dotnet-msbuild failures, then reduce scheduled matrix duration.

⚠️ Skipped Pages deployment health: the available GitHub read tools do not expose the Pages deployment endpoint.
⚠️ Weekly compute-cost comparison and complete 7-day workflow rates are unavailable from the retained cache/API window; partial values are labeled below.

📊 Trends (7-day)

Metric	Today	7d Avg	Δ	Trend
Eval duration (min)	366.8 scheduled	405.6 (14d scheduled)	-38.8	✅ Improving, still critical
Eval success rate (main)	5.1% (2/39 decisive main-triggered)	unavailable	—	⚠️ Degrading
Eval success rate (all branches)	56.5% (48/85 decisive)	unavailable	—	⚠️ Degrading
Eval scheduled cancellation rate	0% (0/1)	0% observed	0 pp	➡️ Stable
Workflow failure rate (7d)	unavailable	unavailable	—	➡️ Incomplete source window
Compute hours/day	≥12.2 h sampled	unavailable	—	↗️ Partial lower bound

_{🤖 Generated by DevOps Health Check agentic workflow · Run #35051253550 · 2026-09-16 03:20 UTC}> Generated by DevOps Daily Health Check · gpt56 · 221 AIC · ⌖ 32.3 AIC · ⊞ 25.9K · ◷

fix(devops-health): resilient dashboard issue discovery (#737)

🏥 Repository Health Dashboard #695

Description

🏥 Daily Health Check — 2026-08-31

🆕 New Findings (5)

🔴 Evaluation workflow failed on main: vally (dotnet-blazor--claude-opus-5) — Run vally evaluations

🔴 Evaluation workflow failed on main: vally (dotnet-data--claude-opus-5) — Run vally evaluations

🔴 Evaluation workflow failed on main: vally (dotnet-maui--claude-opus-5) — Run vally evaluations

🔴 Evaluation workflow failed on main: vally (dotnet-diag--claude-sonnet-5) — Run vally evaluations

🟡 Issue Triage workflow failed: Execute GitHub Copilot CLI step

🔍 Investigation Results

✅ Resolved Since Yesterday (4)

Evaluation failure rate across all branches exceeds 30% (critical)

Evaluation workflow failed on main: vally (dotnet-ai--claude-haiku-4.5) — Run vally evaluations

skill-coverage workflow run cancelled on main (comment job)

Orphan plugin: dotnet-test-migration not in marketplace.json

📌 Existing Findings (4)

📊 Trends (7-day)

🏥 Daily Health Check — 2026-09-12

🆕 New Findings (17)

🔴 Evaluation failure rate across all branches exceeds 30%

🔴 Evaluation failed: csharp-refactoring token selection

🔴 Evaluation failed: publish session data

🔴 Scheduled evaluation failed: dotnet-advanced token selection

🔴 Scheduled evaluation failed: dotnet-ai token selection

🔴 Scheduled evaluation failed: dotnet-aspnetcore token selection

🔴 Scheduled evaluation failed: dotnet-blazor token selection

🔴 Scheduled evaluation failed: dotnet-data token selection

🔴 Scheduled evaluation failed: dotnet-diag token selection

🔴 Scheduled evaluation failed: dotnet token selection

🔴 Scheduled evaluation failed: dotnet-maui token selection

🔴 Scheduled evaluation failed: dotnet-msbuild default token selection

🔴 Scheduled evaluation failed: dotnet-msbuild heavy token selection

🔴 Scheduled evaluation failed: dotnet-msbuild medium token selection

🔴 Scheduled evaluation failed: dotnet-nuget token selection

🟡 Dependabot update workflow failed

🟡 DevOps Health Groom Dashboard workflow failed

🔍 Investigation Results

✅ Resolved Since Yesterday (6)

Evaluation failure rate across all branches exceeds 15%

Evaluation workflow failed: dotnet-blazor with claude-opus-5

Evaluation workflow failed: dotnet-data with claude-opus-5

Evaluation workflow failed: dotnet-maui with claude-opus-5

Evaluation workflow failed: dotnet-diag with claude-sonnet-5

Issue Triage workflow failed at Execute GitHub Copilot CLI

📌 Existing Findings (3)

📊 Trends (7-day)

🏥 Daily Health Check — 2026-09-13

🆕 New Findings (10)

🔴 Evaluation failed: dotnet MAI token selection

🔴 Evaluation failed: dotnet-advanced MAI token selection

🔴 Evaluation failed: dotnet-ai Claude Haiku evaluations

🔴 Evaluation failed: dotnet-ai MAI token selection

🔴 Evaluation failed: dotnet-aspnetcore MAI token selection

🔴 Evaluation failed: dotnet-blazor MAI token selection

🔴 Evaluation failed: dotnet-data MAI token selection

🔴 Evaluation failed: dotnet-diag MAI token selection

🔴 Evaluation failed: dotnet-maui Claude Haiku evaluations

🔴 Evaluation failed: dotnet-maui MAI token selection

🔍 Investigation Results

✅ Resolved Since Yesterday (16)

📌 Existing Findings (4)

📊 Trends (7-day)

🏥 Daily Health Check — 2026-09-14

🆕 New Findings (4)

🔴 Evaluation failed: dotnet-advanced Claude Opus evaluations

🔴 Evaluation failed: dotnet-blazor Claude Opus evaluations

🟡 DevOps Health Groom Dashboard failed in Copilot CLI

🟡 Issue Triage failed in Copilot CLI

🔍 Investigation Results

✅ Resolved Since Yesterday (11)

📌 Existing Findings (3)

📊 Trends (7-day)

🏥 Daily Health Check — 2026-09-16

🆕 New Findings (17)

🔴 Evaluation session-data publishing failed

🔴 Evaluation failed: dotnet-msbuild agent.msbuild on Claude Sonnet 5

🔴 Evaluation failed: dotnet-msbuild agent.msbuild on GPT-5.6 Luna

🔴 Evaluation failed: dotnet-msbuild medium shard on Claude Sonnet 5

🔴 Evaluation failed: dotnet-msbuild heavy shard on Claude Sonnet 5

🔴 Scheduled evaluation failed: dotnet MAI token selection