Skip to content

Review: Claude Skill for Review of Github PRs#22245

Open
nielslyngsoe wants to merge 43 commits intomainfrom
v17/feature/claude-review-files
Open

Review: Claude Skill for Review of Github PRs#22245
nielslyngsoe wants to merge 43 commits intomainfrom
v17/feature/claude-review-files

Conversation

@nielslyngsoe
Copy link
Copy Markdown
Member

@nielslyngsoe nielslyngsoe commented Mar 24, 2026

Added Claude Skill to review a Github PR. This requires the client to have the GH CLI and be authorized.

See example of review in this comment:
#22228 (comment)

Test Nodes
Run this Skill by typing /review in the Claude terminal

AIs own review of this skill

  • The skill produces a consistent, scannable format
  • The skill filters internal changes from the summary (cleaner "Other changes")
  • The skill surfaces the complexity advisory prominently for large PRs
  • The skill is more opinionated on breaking changes (Request Changes vs soft recommendations)
  • The skill uses more tokens (~15-50% more) due to the structured analysis steps

Copilot AI review requested due to automatic review settings March 24, 2026 19:42
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds a new internal Claude “review” skill for Umbraco CMS PR reviews, along with reference docs that guide impact analysis, breaking-change detection, and review criteria.

Changes:

  • Introduces .claude/skills/review/SKILL.md defining an automated GH CLI-based PR review workflow.
  • Adds reference docs for impact analysis and breaking-change checks.
  • Adds a “coding preferences & review criteria” reference used by the skill when scoring/reviewing changes.

Reviewed changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated 5 comments.

File Description
.claude/skills/review/SKILL.md Defines the end-to-end workflow and output format for the automated PR review skill.
.claude/skills/review/references/impact-analysis.md Documents how to assess ripple effects/consumers and check dependency direction.
.claude/skills/review/references/breaking-changes.md Documents how to detect/mitigate breaking changes (C# + TS) using repo versioning policy.
.claude/skills/review/references/coding-preferences.md Defines the scoring criteria and review standards the skill will apply.

Copy link
Copy Markdown
Contributor

@hifi-phil hifi-phil left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a really good solid review skill. I think that the SKILL file should be broken, adding more reference file to keep it simpler. This will make it easier to understand and also easier to maintain.

@@ -0,0 +1,324 @@
---
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think that this skill file is too long, I would split out into further reference files

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@hifi-phil Now its down to 225 lines. Is that maybe still too long?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants