ci(l1): prevent AI review comments from using #N notation that GitHub auto-links as issue references#6187
Conversation
🤖 Kimi Code ReviewThe change adds formatting rules to the AI review prompt. This is a documentation-only change that doesn't affect any code. The new rules are clear and will help maintain consistent formatting in AI-generated reviews. No issues found. Automated review by Kimi (Moonshot AI) · custom prompt |
🤖 Codex Code ReviewNo code changes to review; this PR only updates reviewer prompt text in Automated review by OpenAI Codex · custom prompt |
🤖 Claude Code ReviewThat's fine - I have enough context from the PR description. Let me now provide the code review. Code Review - PR #6187SummaryThis PR adds formatting rules to the AI review prompt to prevent GitHub from auto-linking enumerated items as issue/PR references. The change is small, well-motivated, and correctly addresses the problem described. Findings✅ Overall Assessment: LGTM The changes are minimal, focused, and solve a real UX problem with the AI code reviewer workflow. Detailed ReviewFile: Positives:
Minor Suggestions:
Non-issues:
Testing ConsiderationsWhile this is a prompt change that doesn't have traditional unit tests, you may want to:
ConclusionThis is a well-executed fix for an annoying UX issue. The change is minimal, clear, and should effectively prevent the GitHub auto-linking problem. Approved for merge. Automated review by Claude (Anthropic) · custom prompt |
#N notation that GitHub auto-links as issue references#N notation that GitHub auto-links as issue references
#N notation that GitHub auto-links as issue references#N notation that GitHub auto-links as issue references
🤖 Kimi Code ReviewThis PR adds formatting rules to the AI review prompt template. The changes are straightforward and correct:
The changes are appropriate and will help ensure consistent formatting in AI-generated reviews. No issues found. Automated review by Kimi (Moonshot AI) · custom prompt |
🤖 Codex Code ReviewReviewed the diff. It only updates Looks good. Automated review by OpenAI Codex · custom prompt |
Greptile OverviewGreptile SummaryThis PR adds formatting instructions to the AI code review prompt to prevent GitHub from auto-linking enumerated items as issue/PR references. The change instructs AI reviewers to use
Confidence Score: 5/5
|
| Filename | Overview |
|---|---|
| .github/prompts/ai-review.md | Added formatting rules to prevent GitHub from auto-linking #N notation as issue references in AI review comments |
🤖 Claude Code ReviewPerfect! Now I have all the context I need to review this PR. Let me provide my code review. Code Review: PR 6187SummaryThis PR adds formatting rules to the AI review prompt to prevent GitHub from auto-linking enumerated items (like Review Findings✅ Correctness & ImplementationThe implementation is correct and minimal. The added formatting rules (.github/prompts/ai-review.md:21-23) clearly instruct AI reviewers to:
✅ Documentation & ClarityThe instructions are clear, provide concrete examples ( ✅ Impact & Risk
ObservationsMinor suggestion (optional): The formatting rules could optionally include an instruction to add "Output your review findings in markdown format" to ensure structured output, but this may already be implicit in the AI models' behavior. Note on effectiveness: The success of this change depends on:
The PR author should verify that the Verdict✅ Approved - This is a good, targeted fix for a real UX issue. The implementation is minimal and correct. Automated review by Claude (Anthropic) · custom prompt |
There was a problem hiding this comment.
Pull request overview
Updates the AI review prompt to avoid using #1, #2, etc. when enumerating findings, preventing GitHub from auto-linking them as issue/PR references in PR activity feeds.
Changes:
- Adds explicit formatting rules to the AI reviewer prompt to avoid
#Nenumeration. - Instructs the model to refer back to enumerated items as “Item N” / “Point N” instead of “Issue #N”.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
|
|
||
| Formatting rules: | ||
| - NEVER use `#N` (e.g. #1, #2) for enumeration — GitHub renders those as issue/PR references. Use `1.`, `2.`, etc. or bullet points instead. | ||
| - When referring back to items, use "Item 1", "Point 2", etc. — never "Issue #1" or "#1". |
There was a problem hiding this comment.
The new "NEVER" wording is broad enough to be read as forbidding legitimate references to GitHub issues/PRs (e.g., #6186) in review text, not just enumeration. Consider scoping this to "when enumerating findings" and (if needed) documenting how to reference real issues/PRs without triggering accidental autolinks (e.g., wrap in backticks or use "PR 6186").
| - When referring back to items, use "Item 1", "Point 2", etc. — never "Issue #1" or "#1". | |
| - When referring back to enumerated review items, use "Item 1", "Point 2", etc., and avoid using bare "#1", "#2", etc. as enumeration labels. Legitimate GitHub issues/PRs may still be referenced (for example, "PR 6186" or `#6186`). |
See lambdaclass/ethrex#6187 for more context. Review agents make use of `#N` for numbering comments, which triggers GitHub references, linking all reviewed PRs with links to the first PRs of the repo (see #1 for an example).
Motivation
The Claude AI code reviewer (
.github/workflows/pr_ai_review.yaml) enumerates findings using#1,#2, etc., which GitHub auto-links as references to issues/PRs. This clutters PR activity feeds and confuses readers. Example: #6186 (comment)Description
Add formatting rules to the AI review prompt (
.github/prompts/ai-review.md) instructing the model to use1.,2.or bullet points instead of#N, and to refer back to items as "Item 1", "Point 2" rather than "Issue #1".Checklist
STORE_SCHEMA_VERSION(crates/storage/lib.rs) if the PR includes breaking changes to theStorerequiring a re-sync.