Skip to content

Conversation

Copy link
Contributor

Copilot AI commented Jan 30, 2026

The test coverage verification was reporting 3406 "missing" tests (44% coverage) because go test -json emits both parent tests (TestFoo) and subtests (TestFoo/subtest_name), while the test definition scanner only finds parent test functions.

Changes

  • Modified scripts/extract-executed-tests.sh to strip subtest suffixes (everything after /)
  • Ensures extracted test names match the format produced by list-all-tests.sh
# Before: extracted subtests as separate entries
TestExtractActionRepo
TestExtractActionRepo/action_with_version_tag
TestExtractActionRepo/action_with_SHA

# After: only parent test names
TestExtractActionRepo

This eliminates false negatives in the coverage comparison, allowing CI to correctly validate that all defined tests are executed.

Original prompt

Reference: https://github.com/githubnext/gh-aw/actions/runs/21499856490/job/61945115501

Fix test list


💬 We'd love your input! Share your thoughts on Copilot coding agent in our 2 minute survey.

Copilot AI and others added 2 commits January 30, 2026 01:01
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
- Modified extract-executed-tests.sh to strip subtest names (after /)
- This ensures only top-level test names are extracted
- Fixes CI failure where 3406 subtests were incorrectly counted as missing tests

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copilot AI changed the title [WIP] Fix issues in test list Fix test coverage check to handle Go subtests correctly Jan 30, 2026
Copilot AI requested a review from pelikhan January 30, 2026 01:06
@pelikhan pelikhan marked this pull request as ready for review January 30, 2026 01:08
@pelikhan pelikhan merged commit d8a46c5 into copilot/compute-frontmatter-hash Jan 30, 2026
1 check passed
@pelikhan pelikhan deleted the copilot/fix-test-list branch January 30, 2026 01:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants