Skip to content

Conversation

@kubaflo
Copy link
Contributor

@kubaflo kubaflo commented Jan 18, 2026

Note

Are you waiting for the changes in this PR to be merged?
It would be very helpful if you could test the resulting artifacts from this PR and let us know in a comment if this change resolves your issue. Thank you!

Description of Change

Adds a new ai-summary-comment skill for posting automated progress comments on GitHub PRs.

New files added:

  • .github/skills/ai-summary-comment/SKILL.md - Skill definition and usage guide
  • .github/skills/ai-summary-comment/IMPROVEMENTS.md - Documentation of dynamic section extraction improvements
  • .github/skills/ai-summary-comment/NO-EXTERNAL-REFERENCES-RULE.md - Self-contained comment requirements
  • .github/skills/ai-summary-comment/scripts/post-ai-summary-comment.ps1 - Main script for posting aggregated PR comments
  • .github/skills/ai-summary-comment/scripts/post-pr-finalize-comment.ps1 - PR finalize comment script
  • .github/skills/ai-summary-comment/scripts/post-try-fix-comment.ps1 - Try-fix phase comment script
  • .github/skills/ai-summary-comment/scripts/post-verify-tests-comment.ps1 - Test verification comment script
  • .github/skills/ai-summary-comment/scripts/post-write-tests-comment.ps1 - Write tests comment script

Key features:

  • Dynamic section extraction from PR state files
  • Flexible regex pattern matching for section titles
  • Two-level validation (errors vs warnings)
  • Debug mode for troubleshooting
  • Creates single aggregated review comment with collapsible sections per commit

@kubaflo kubaflo changed the title pr-comment sill pr-comment skill Jan 18, 2026
@kubaflo kubaflo changed the title pr-comment skill Add a PR-Comment Skill Jan 18, 2026
@kubaflo kubaflo force-pushed the pr-comment-skill branch 2 times, most recently from 1f29b15 to 90cd944 Compare January 20, 2026 16:19
@kubaflo kubaflo changed the title Add a PR-Comment Skill Add PR Comment Skill for Automated PR Review Progress Tracking Jan 20, 2026
@kubaflo kubaflo marked this pull request as ready for review January 20, 2026 16:26
Copilot AI review requested due to automatic review settings January 20, 2026 16:26
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adds a new pr-comment skill for posting structured progress comments to GitHub PRs during automated review workflows. The skill creates a single aggregated comment containing all review phases with validation to ensure phase content completeness before posting.

Changes:

  • New skill with PowerShell script for posting/updating PR review comments with phase content validation
  • Integration guidance added to PR agent workflow documentation
  • Support for tracking multiple review sessions per commit with collapsible details

Reviewed changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated 11 comments.

File Description
.github/skills/pr-comment/SKILL.md Skill documentation defining usage, parameters, and workflow integration (contains critical documentation issues)
.github/skills/pr-comment/scripts/post-pr-comment.ps1 PowerShell script that posts/updates single aggregated PR comment with validation (contains minor naming issue)
.github/agents/pr.md Updated to add mandatory pr-comment skill invocation after Pre-Flight, Tests, and Gate phases
.github/agents/pr/post-gate.md Updated to add mandatory pr-comment skill invocation after Fix and Report phases

@PureWeen
Copy link
Member

/rebase

@kubaflo kubaflo force-pushed the pr-comment-skill branch 3 times, most recently from 962d07b to 5b1bd65 Compare January 26, 2026 13:10
Introduces documentation and PowerShell scripts for the pr-comment skill, including detailed usage guides, validation rules, and self-contained comment requirements. Adds dynamic section extraction, flexible pattern matching, and improved error handling for posting and updating automated PR review comments on GitHub.
Renames the pr-comment skill and all related scripts, documentation, and references to ai-summary-comment for improved clarity and alignment with its purpose. Updates all usage examples, file paths, and preview file names accordingly.
@kubaflo
Copy link
Contributor Author

kubaflo commented Jan 27, 2026

🤖 AI Summary

📊 Expand Full Review
🔍 Pre-Flight — Context & Validation
📝 Review SessionRename pr-comment skill to ai-summary-comment · 4b87475

Summary

This PR adds the ai-summary-comment skill for posting automated progress comments to GitHub PRs during agent review workflows.

Files Changed

File Purpose
.github/skills/ai-summary-comment/SKILL.md Skill documentation
.github/skills/ai-summary-comment/IMPROVEMENTS.md Improvement notes
.github/skills/ai-summary-comment/scripts/post-ai-summary-comment.ps1 Main comment script
.github/skills/ai-summary-comment/scripts/post-try-fix-comment.ps1 Try-fix section updates
.github/skills/ai-summary-comment/scripts/post-write-tests-comment.ps1 Write-tests section updates
.github/skills/ai-summary-comment/scripts/post-verify-tests-comment.ps1 Verify-tests section updates
.github/skills/ai-summary-comment/scripts/post-pr-finalize-comment.ps1 PR finalization comment
.github/skills/pr-finalize/SKILL.md Minor documentation updates

Status

COMPLETE - Context gathering finished


📋 Report — Final Recommendation
📝 Review SessionRename pr-comment skill to ai-summary-comment · 4b87475

Recommendation

APPROVE - New agent infrastructure skill, no runtime code changes

Title Review

Needs Update - Current title references "PR Comment" but skill is named ai-summary-comment

Suggested Title: Add AI Summary Comment skill for automated PR review progress tracking

Description Review

Missing - No description provided. PR needs a proper description with:

  • NOTE block for artifact testing
  • Description of what the skill does
  • Table of scripts included
  • Platforms affected section

Key Capabilities Added

  • Posts unified AI Summary comment to PRs with collapsible sections
  • Section-based updates (PR-REVIEW, TRY-FIX, WRITE-TESTS, VERIFY-TESTS)
  • Duplicate prevention via <!-- AI Summary --> marker
  • DryRun preview mode for testing before posting
  • Auto-loading of state files from CustomAgentLogsTmp/PRState/

Action Required

  1. Update PR title to match skill name
  2. Add comprehensive PR description

@kubaflo
Copy link
Contributor Author

kubaflo commented Jan 27, 2026

📋 PR Finalization Review

Review 1: Finalization review ❌ Needs Rewrite

Title ⚠️ Needs Update

Current: Add PR Comment Skill for Automated PR Review Progress Tracking

Issues:

  • Title references "PR Comment Skill" but the actual skill is named ai-summary-comment
  • The skill was renamed from pr-comment to ai-summary-comment in the second commit
Click to see proposed title

Add ai-summary-comment skill for automated PR review comments


Description ❌ Needs Rewrite

  • Title references "PR Comment Skill" but the actual skill is named ai-summary-comment
  • The skill was renamed from pr-comment to ai-summary-comment in the second commit

✨ Suggested PR Description

Click to see proposed description

note in for people that find this PR -->

[!NOTE]
Are you waiting for the changes in this PR to be merged?
It would be very helpful if you could test the resulting artifacts from this PR and let us know in a comment if this change resolves your issue. Thank you!

Description of Change

Adds a new ai-summary-comment skill for posting automated progress comments on GitHub PRs.

New files added:

  • .github/skills/ai-summary-comment/SKILL.md - Skill definition and usage guide
  • .github/skills/ai-summary-comment/IMPROVEMENTS.md - Documentation of dynamic section extraction improvements
  • .github/skills/ai-summary-comment/NO-EXTERNAL-REFERENCES-RULE.md - Self-contained comment requirements
  • .github/skills/ai-summary-comment/scripts/post-ai-summary-comment.ps1 - Main script for posting aggregated PR comments
  • .github/skills/ai-summary-comment/scripts/post-pr-finalize-comment.ps1 - PR finalize comment script
  • .github/skills/ai-summary-comment/scripts/post-try-fix-comment.ps1 - Try-fix phase comment script
  • .github/skills/ai-summary-comment/scripts/post-verify-tests-comment.ps1 - Test verification comment script
  • .github/skills/ai-summary-comment/scripts/post-write-tests-comment.ps1 - Write tests comment script

Key features:

  • Dynamic section extraction from PR state files
  • Flexible regex pattern matching for section titles
  • Two-level validation (errors vs warnings)
  • Debug mode for troubleshooting
  • Creates single aggregated review comment with collapsible sections per commit

Also modified:

  • .github/skills/pr-finalize/SKILL.md - Removed mandatory save summary section (32 lines)

Issues Fixed

N/A - New feature

Platforms Affected

N/A - Developer tooling only (GitHub skills/scripts)

@kubaflo kubaflo changed the title Add PR Comment Skill for Automated PR Review Progress Tracking Add ai-summary-comment skill for automated PR review comments Jan 27, 2026
@PureWeen PureWeen merged commit 3487b6d into dotnet:main Jan 28, 2026
2 of 3 checks passed
@kubaflo kubaflo added the area-ai-agents Copilot CLI agents, agent skills, AI-assisted development label Jan 28, 2026
rmarinho pushed a commit that referenced this pull request Jan 29, 2026
> [!NOTE]
> Are you waiting for the changes in this PR to be merged?
> It would be very helpful if you could [test the resulting
artifacts](https://github.com/dotnet/maui/wiki/Testing-PR-Builds) from
this PR and let us know in a comment if this change resolves your issue.
Thank you!

### Description of Change

Adds a new `ai-summary-comment` skill for posting automated progress
comments on GitHub PRs.

**New files added:**
- `.github/skills/ai-summary-comment/SKILL.md` - Skill definition and
usage guide
- `.github/skills/ai-summary-comment/IMPROVEMENTS.md` - Documentation of
dynamic section extraction improvements
- `.github/skills/ai-summary-comment/NO-EXTERNAL-REFERENCES-RULE.md` -
Self-contained comment requirements
-
`.github/skills/ai-summary-comment/scripts/post-ai-summary-comment.ps1`
- Main script for posting aggregated PR comments
-
`.github/skills/ai-summary-comment/scripts/post-pr-finalize-comment.ps1`
- PR finalize comment script
- `.github/skills/ai-summary-comment/scripts/post-try-fix-comment.ps1` -
Try-fix phase comment script
-
`.github/skills/ai-summary-comment/scripts/post-verify-tests-comment.ps1`
- Test verification comment script
-
`.github/skills/ai-summary-comment/scripts/post-write-tests-comment.ps1`
- Write tests comment script

**Key features:**
- Dynamic section extraction from PR state files
- Flexible regex pattern matching for section titles
- Two-level validation (errors vs warnings)
- Debug mode for troubleshooting
- Creates single aggregated review comment with collapsible sections per
commit
kubaflo added a commit to kubaflo/maui that referenced this pull request Feb 2, 2026
…#33585)

> [!NOTE]
> Are you waiting for the changes in this PR to be merged?
> It would be very helpful if you could [test the resulting
artifacts](https://github.com/dotnet/maui/wiki/Testing-PR-Builds) from
this PR and let us know in a comment if this change resolves your issue.
Thank you!

### Description of Change

Adds a new `ai-summary-comment` skill for posting automated progress
comments on GitHub PRs.

**New files added:**
- `.github/skills/ai-summary-comment/SKILL.md` - Skill definition and
usage guide
- `.github/skills/ai-summary-comment/IMPROVEMENTS.md` - Documentation of
dynamic section extraction improvements
- `.github/skills/ai-summary-comment/NO-EXTERNAL-REFERENCES-RULE.md` -
Self-contained comment requirements
-
`.github/skills/ai-summary-comment/scripts/post-ai-summary-comment.ps1`
- Main script for posting aggregated PR comments
-
`.github/skills/ai-summary-comment/scripts/post-pr-finalize-comment.ps1`
- PR finalize comment script
- `.github/skills/ai-summary-comment/scripts/post-try-fix-comment.ps1` -
Try-fix phase comment script
-
`.github/skills/ai-summary-comment/scripts/post-verify-tests-comment.ps1`
- Test verification comment script
-
`.github/skills/ai-summary-comment/scripts/post-write-tests-comment.ps1`
- Write tests comment script

**Key features:**
- Dynamic section extraction from PR state files
- Flexible regex pattern matching for section titles
- Two-level validation (errors vs warnings)
- Debug mode for troubleshooting
- Creates single aggregated review comment with collapsible sections per
commit
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area-ai-agents Copilot CLI agents, agent skills, AI-assisted development

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants