Smoke Test: Claude - 22351306979 #18141
Description
Summary
Automated smoke test for Claude engine validation. Run §22351306979 on 2026-02-24.
Overall Status: PARTIAL (Serena find_symbol unavailable; push/resolve/close skipped)
PR used for review tests: #18130 ("Do not post 'PR created' status comment on the created PR itself")
Test Results
Core Tests (#1–#10)
| # | Test | Status | Notes |
|---|---|---|---|
| 1 | GitHub MCP: Last 2 merged PRs | ✅ | #18135, #18132 retrieved |
| 2 | Safe Inputs GH CLI: Query 2 PRs | ✅ | #18135, #18132 returned |
| 3 | Serena MCP: activate_project | ✅ | Project activated at /home/runner/work/gh-aw/gh-aw |
| 3 | Serena MCP: find_symbol | ❌ | MCP connection closed with EOF on every attempt |
| 4 | Make Build | ✅ | go build succeeded: gh-aw binary built (version 5bfbb99) |
| 5 | Playwright: github.com | ✅ | Page title: "GitHub · Change is constant. GitHub keeps you ahead. · GitHub" |
| 6 | Tavily Web Search | ✅ | 3 results returned for "GitHub Agentic Workflows" |
| 7 | File Writing | ✅ | /tmp/gh-aw/agent/smoke-test-claude-22351306979.txt created |
| 8 | Bash Verification | ✅ | File content verified via cat |
| 9 | Discussion Interaction | ✅ | Latest discussion #18136 found; comic-book comment added |
| 10 | Agentic Workflows MCP | ✅ | smoke-claude: active, compiled=Yes, engine=claude |
PR Review Tests (#11–#17) — PR #18130
| # | Test | Status | Notes |
|---|---|---|---|
| 11 | Update PR body (append) | ✅ | Appended test message to PR #18130 |
| 12 | PR Review Comments (×2) | ✅ | Comments on update_activation_comment.cjs:39 and .test.cjs:93 |
| 13 | Submit PR Review | ✅ | COMMENT review submitted on PR #18130 |
| 14 | Resolve Review Thread | Skipped — no unresolved threads found at time of check | |
| 15 | Add Reviewer | ✅ | Added copilot as reviewer on PR #18130 |
| 16 | Push to PR Branch | Skipped — running on main (clean tree), not the PR branch |
|
| 17 | Close PR | Skipped — no suitable test/bot PR to close safely |
Error Details
Test #3 (Serena find_symbol): MCP connection closed with EOF on all 3 attempts (calling "tools/call": client is closing: EOF). activate_project succeeded on first call but subsequent find_symbol calls failed.
Agentic Workflow Status
workflow: smoke-claude | engine: claude | compiled: Yes | status: active
triggers: pull_request (labeled "smoke"), reaction: heart, schedule: every 12h
References:
💥 [THE END] — Illustrated by Smoke Claude
- expires on Feb 24, 2026, 2:54 PM UTC