[delight] User Experience Analysis Report - 2026-10-20

[github-actions[bot]]

Executive Summary

Reviewed 1 gallery doc, 1 validation file, 1 workflow sample (not in depth). Some pre-sampled files were not fully readable due to tool restrictions, so CLI and workflow-message review was skipped.

Overall Quality: Good.

Key Finding: The release-notes gallery page promises more than its single example demonstrates, and a validation error omits the offending value.

Quality Highlights ✅

• pkg/workflow/concurrency_validation.go: errors use a structured what/why/how-to-fix format, with an inline example ("Provide a non-empty concurrency group name... Example: 'my-workflow-${{ github.ref }}'").

Improvement Opportunities 💡

High Priority: docs/src/content/docs/gallery/ai-release-notes.md

• Intro (line 6) says the agent runs on release, branch push, or schedule, but the only example (lines 10-34) covers release: published.
• No engine: is shown and there are no prerequisites, e.g. the secret needed for the engine.
• No link to the safe-outputs reference even though the page leans on it.
• Rating: ⚠️

Medium Priority: pkg/workflow/concurrency_validation.go

• Lines 144-149: the queue/cancel-in-progress error does not tell the user which field to change first, and it does not show a corrected YAML snippet.
• Rating: ✅ / minor

Files Reviewed

• docs/src/content/docs/gallery/ai-release-notes.md - ⚠️
• pkg/workflow/concurrency_validation.go - ✅
• CLI commands and workflow messages: not reviewed this run

Metrics

• Files Analyzed: 2 (✅ 1, ⚠️ 1, ❌ 0)

🎯 Actionable Tasks

Task 1: Improve the release-notes gallery page

File to Modify: docs/src/content/docs/gallery/ai-release-notes.md

Current Experience: Intro mentions three triggers; the example shows one; no prerequisites or safe-outputs link.

Design Principle: Clarity and Precision; Documentation Quality.

Proposed Improvement: Add a short Prerequisites list (engine secret, permissions), a second schedule: trigger snippet, and a link to the safe-outputs reference in Learn More.

Success Criteria

• Only ai-release-notes.md changed
• Every trigger named in the intro has an example
• Rating improves from ⚠️ to ✅

Scope Constraint: Single file only.

Task 2: Make the queue/cancel-in-progress error self-contained

File to Modify: pkg/workflow/concurrency_validation.go

Proposed Improvement: Lines 144-149: lead the suggestion with the recommended fix and include an inline example such as concurrency: { group: ..., queue: single, cancel-in-progress: true }.

Success Criteria

• Only concurrency_validation.go changed (and existing tests still pass)
• Error includes a corrected example

Scope Constraint: Single file only.

📊 User experience analysis by Delight · copilot · auto · 16.4 AIC · ⌖ 0.731 AIC · ⊞ 12.8K · ◷

• expires on Oct 23, 2026, 6:51 AM UTC-08:00