-
Notifications
You must be signed in to change notification settings - Fork 1.9k
Add ai-summary-comment skill for automated PR review comments #33585
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
12fe5a3 to
7926fd5
Compare
1f29b15 to
90cd944
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull request overview
This PR adds a new pr-comment skill for posting structured progress comments to GitHub PRs during automated review workflows. The skill creates a single aggregated comment containing all review phases with validation to ensure phase content completeness before posting.
Changes:
- New skill with PowerShell script for posting/updating PR review comments with phase content validation
- Integration guidance added to PR agent workflow documentation
- Support for tracking multiple review sessions per commit with collapsible details
Reviewed changes
Copilot reviewed 4 out of 4 changed files in this pull request and generated 11 comments.
| File | Description |
|---|---|
.github/skills/pr-comment/SKILL.md |
Skill documentation defining usage, parameters, and workflow integration (contains critical documentation issues) |
.github/skills/pr-comment/scripts/post-pr-comment.ps1 |
PowerShell script that posts/updates single aggregated PR comment with validation (contains minor naming issue) |
.github/agents/pr.md |
Updated to add mandatory pr-comment skill invocation after Pre-Flight, Tests, and Gate phases |
.github/agents/pr/post-gate.md |
Updated to add mandatory pr-comment skill invocation after Fix and Report phases |
|
/rebase |
8177e55 to
c849f31
Compare
962d07b to
5b1bd65
Compare
Introduces documentation and PowerShell scripts for the pr-comment skill, including detailed usage guides, validation rules, and self-contained comment requirements. Adds dynamic section extraction, flexible pattern matching, and improved error handling for posting and updating automated PR review comments on GitHub.
Renames the pr-comment skill and all related scripts, documentation, and references to ai-summary-comment for improved clarity and alignment with its purpose. Updates all usage examples, file paths, and preview file names accordingly.
a27360e to
4b87475
Compare
🤖 AI Summary📊 Expand Full Review🔍 Pre-Flight — Context & Validation📝 Review Session — Rename pr-comment skill to ai-summary-comment ·
|
| File | Purpose |
|---|---|
.github/skills/ai-summary-comment/SKILL.md |
Skill documentation |
.github/skills/ai-summary-comment/IMPROVEMENTS.md |
Improvement notes |
.github/skills/ai-summary-comment/scripts/post-ai-summary-comment.ps1 |
Main comment script |
.github/skills/ai-summary-comment/scripts/post-try-fix-comment.ps1 |
Try-fix section updates |
.github/skills/ai-summary-comment/scripts/post-write-tests-comment.ps1 |
Write-tests section updates |
.github/skills/ai-summary-comment/scripts/post-verify-tests-comment.ps1 |
Verify-tests section updates |
.github/skills/ai-summary-comment/scripts/post-pr-finalize-comment.ps1 |
PR finalization comment |
.github/skills/pr-finalize/SKILL.md |
Minor documentation updates |
Status
✅ COMPLETE - Context gathering finished
📋 Report — Final Recommendation
📝 Review Session — Rename pr-comment skill to ai-summary-comment · 4b87475
Recommendation
✅ APPROVE - New agent infrastructure skill, no runtime code changes
Title Review
❌ Needs Update - Current title references "PR Comment" but skill is named ai-summary-comment
Suggested Title: Add AI Summary Comment skill for automated PR review progress tracking
Description Review
❌ Missing - No description provided. PR needs a proper description with:
- NOTE block for artifact testing
- Description of what the skill does
- Table of scripts included
- Platforms affected section
Key Capabilities Added
- Posts unified AI Summary comment to PRs with collapsible sections
- Section-based updates (PR-REVIEW, TRY-FIX, WRITE-TESTS, VERIFY-TESTS)
- Duplicate prevention via
<!-- AI Summary -->marker - DryRun preview mode for testing before posting
- Auto-loading of state files from
CustomAgentLogsTmp/PRState/
Action Required
- Update PR title to match skill name
- Add comprehensive PR description
📋 PR Finalization ReviewReview 1: Finalization review ❌ Needs RewriteTitle
|
> [!NOTE] > Are you waiting for the changes in this PR to be merged? > It would be very helpful if you could [test the resulting artifacts](https://github.com/dotnet/maui/wiki/Testing-PR-Builds) from this PR and let us know in a comment if this change resolves your issue. Thank you! ### Description of Change Adds a new `ai-summary-comment` skill for posting automated progress comments on GitHub PRs. **New files added:** - `.github/skills/ai-summary-comment/SKILL.md` - Skill definition and usage guide - `.github/skills/ai-summary-comment/IMPROVEMENTS.md` - Documentation of dynamic section extraction improvements - `.github/skills/ai-summary-comment/NO-EXTERNAL-REFERENCES-RULE.md` - Self-contained comment requirements - `.github/skills/ai-summary-comment/scripts/post-ai-summary-comment.ps1` - Main script for posting aggregated PR comments - `.github/skills/ai-summary-comment/scripts/post-pr-finalize-comment.ps1` - PR finalize comment script - `.github/skills/ai-summary-comment/scripts/post-try-fix-comment.ps1` - Try-fix phase comment script - `.github/skills/ai-summary-comment/scripts/post-verify-tests-comment.ps1` - Test verification comment script - `.github/skills/ai-summary-comment/scripts/post-write-tests-comment.ps1` - Write tests comment script **Key features:** - Dynamic section extraction from PR state files - Flexible regex pattern matching for section titles - Two-level validation (errors vs warnings) - Debug mode for troubleshooting - Creates single aggregated review comment with collapsible sections per commit
…#33585) > [!NOTE] > Are you waiting for the changes in this PR to be merged? > It would be very helpful if you could [test the resulting artifacts](https://github.com/dotnet/maui/wiki/Testing-PR-Builds) from this PR and let us know in a comment if this change resolves your issue. Thank you! ### Description of Change Adds a new `ai-summary-comment` skill for posting automated progress comments on GitHub PRs. **New files added:** - `.github/skills/ai-summary-comment/SKILL.md` - Skill definition and usage guide - `.github/skills/ai-summary-comment/IMPROVEMENTS.md` - Documentation of dynamic section extraction improvements - `.github/skills/ai-summary-comment/NO-EXTERNAL-REFERENCES-RULE.md` - Self-contained comment requirements - `.github/skills/ai-summary-comment/scripts/post-ai-summary-comment.ps1` - Main script for posting aggregated PR comments - `.github/skills/ai-summary-comment/scripts/post-pr-finalize-comment.ps1` - PR finalize comment script - `.github/skills/ai-summary-comment/scripts/post-try-fix-comment.ps1` - Try-fix phase comment script - `.github/skills/ai-summary-comment/scripts/post-verify-tests-comment.ps1` - Test verification comment script - `.github/skills/ai-summary-comment/scripts/post-write-tests-comment.ps1` - Write tests comment script **Key features:** - Dynamic section extraction from PR state files - Flexible regex pattern matching for section titles - Two-level validation (errors vs warnings) - Debug mode for troubleshooting - Creates single aggregated review comment with collapsible sections per commit
Note
Are you waiting for the changes in this PR to be merged?
It would be very helpful if you could test the resulting artifacts from this PR and let us know in a comment if this change resolves your issue. Thank you!
Description of Change
Adds a new
ai-summary-commentskill for posting automated progress comments on GitHub PRs.New files added:
.github/skills/ai-summary-comment/SKILL.md- Skill definition and usage guide.github/skills/ai-summary-comment/IMPROVEMENTS.md- Documentation of dynamic section extraction improvements.github/skills/ai-summary-comment/NO-EXTERNAL-REFERENCES-RULE.md- Self-contained comment requirements.github/skills/ai-summary-comment/scripts/post-ai-summary-comment.ps1- Main script for posting aggregated PR comments.github/skills/ai-summary-comment/scripts/post-pr-finalize-comment.ps1- PR finalize comment script.github/skills/ai-summary-comment/scripts/post-try-fix-comment.ps1- Try-fix phase comment script.github/skills/ai-summary-comment/scripts/post-verify-tests-comment.ps1- Test verification comment script.github/skills/ai-summary-comment/scripts/post-write-tests-comment.ps1- Write tests comment scriptKey features: