Agentic Workflow Audit Report - 2026-02-21

[github-actions[bot]]

Audit Summary

• Period: 2026-02-20 05:40 UTC → 2026-02-21 05:40 UTC (last 24 hours)
• Runs Analyzed: 22 (17 completed successfully, 4 failures, 1 in-progress)
• Workflows Active: 18 distinct workflows ran
• Success Rate: 81.0% (17/21 completed runs)
• Issues Found: 1 critical (recurring), 1 isolated
• Total Tokens: 27,786,836
• Total Cost: $5.14
• Total Turns: 103

---

Critical Error — Issue Monster: Lockdown Mode Token Missing

Severity: High | Occurrences: 3 failures in this period (runs #1949, #1950, #1951)

The Issue Monster workflow is consistently failing with:

Error: Lockdown mode is enabled (lockdown: true) but no custom GitHub token is configured.

Please configure one of the following as a repository secret:
  - GH_AW_GITHUB_TOKEN (recommended)
  - GH_AW_GITHUB_MCP_SERVER_TOKEN (alternative)
  - Custom github-token in your workflow frontmatter

Issue Monster ran 3 times (scheduled at ~30m intervals) and failed every time due to the same root cause. The workflow uses lockdown mode but is missing the required fine-grained PAT secret. Each failure triggered a comment on issue #17387.

Action Required: Configure GH_AW_GITHUB_TOKEN repository secret per the authentication docs.

---

Error Analysis

Critical Errors

Workflow	Failures	Root Cause
Issue Monster	3	Lockdown mode active without GH_AW_GITHUB_TOKEN secret
Smoke Multi PR	1	Initial run #4 failed; retry run #5 succeeded

Warnings

None in this period.

View All Failed Runs

Run	Workflow	Created	URL
#1951	Issue Monster	2026-02-21 05:24 UTC	§22251099084
#1950	Issue Monster	2026-02-21 04:56 UTC	§22250719656
#1949	Issue Monster	2026-02-21 04:13 UTC	§22250109958
#4	Smoke Multi PR	2026-02-21 02:17 UTC	§22248465878

---

Missing Data

Workflow	Run	Count	Notes
Smoke Agent	#4	1	Agent reported missing data; completed successfully

---

MCP Server Failures

No MCP server failures detected in this period.

---

Performance Metrics

• Average Token Usage (runs with data): ~1,847,000 tokens/run
• Total Cost (24h): $5.14
• Highest Cost Workflow: Daily Documentation Updater ($1.99, claude, 34 turns)
• Average Turns (claude runs): ~21 turns/run
• Engines in use: claude (6 runs), copilot (11 runs), codex (3 runs)

View Top Token Consumers

Workflow	Tokens	Cost	Engine
Duplicate Code Detector	8,899,230	n/a	codex
Chroma Issue Indexer	5,428,358	n/a	copilot
Example: Custom Error Patterns	2,501,098	n/a	copilot
Smoke Multi PR (success)	2,364,363	n/a	copilot
Daily Documentation Updater	1,938,415	$1.99	claude
Multi-Device Docs Tester	1,228,757	$1.68	claude
Daily Safe Outputs Conformance	1,004,398	$1.48	claude
Smoke Multi PR (failure)	978,171	n/a	copilot
Contribution Check	695,842	n/a	copilot
GitHub Remote MCP Auth Test	692,886	n/a	copilot

---

Trend Charts

Workflow Health (14 Days)

Today's 81% success rate is slightly lower than the projected baseline average (~85-90%). The pattern of 4 failures is dominated by the recurring Issue Monster lockdown error. Without that workflow's failures, today's success rate would be ~94%.

Token Usage & Cost (14 Days)

Today's token usage of ~27.8M tokens and $5.14 cost is within the expected range. Claude-engine workflows account for the largest share of estimated costs ($5.14 total), while copilot and codex costs are not separately tracked. The Duplicate Code Detector (8.9M tokens, codex) and Chroma Issue Indexer (5.4M tokens, copilot) are the largest single token consumers.

---

Affected Workflows

Workflow	Status	Issue
Issue Monster	❌ Failing repeatedly	Missing GH_AW_GITHUB_TOKEN secret for lockdown mode
Smoke Multi PR	⚠️ Intermittent	Initial run failed, retry succeeded

---

Recommendations

1. Configure GH_AW_GITHUB_TOKEN secret for Issue Monster — this is the highest priority fix. Without it, the workflow will continue failing every 30 minutes. Run: gh aw secrets set GH_AW_GITHUB_TOKEN --value "YOUR_FINE_GRAINED_PAT"
2. Investigate Smoke Multi PR initial failure — run Add workflow: githubnext/agentics/weekly-research #4 failed while run Add workflow: githubnext/agentics/weekly-research #5 (retry) succeeded. Review if this is a race condition or timing issue in multi-PR branch creation.
3. Monitor Smoke Agent missing data — Smoke Agent reported 1 missing data item but completed successfully. Verify the expected data source is reliably available.
4. Review 18 "Unknown" status workflows — many workflows show status: Unknown which may indicate stale or misconfigured GitHub Actions workflow states.

---

Historical Context

This is the first audit run — no prior audit data available for comparison. Repo memory has been initialized with today's data to establish a baseline for future trend analysis.

---

Next Steps

• Configure GH_AW_GITHUB_TOKEN secret to fix Issue Monster lockdown failures
• Review Smoke Multi PR run Add workflow: githubnext/agentics/weekly-research #4 failure to understand intermittent issue
• Investigate 18 workflows showing status: Unknown
• Monitor tomorrow's audit to verify Issue Monster fix resolves recurring failures

References:

• §22251311631 — Current audit run
• §22251099084 — Issue Monster failure (latest)
• #17387 — Issue Monster failure tracking issue

AI generated by Agentic Workflow Audit Agent

• expires on Feb 28, 2026, 5:52 AM UTC

[github-actions[bot]]

This discussion was automatically closed because it expired on 2026-02-28T05:52:34.798Z.

Closed by Workflow