Skip to content

Smoke-test binaries by resolving proto bin, not by running --version#9

Merged
jlouazel merged 1 commit into
mainfrom
jlouazel/smoke-test-no-version-probe
Jun 23, 2026
Merged

Smoke-test binaries by resolving proto bin, not by running --version#9
jlouazel merged 1 commit into
mainfrom
jlouazel/smoke-test-no-version-probe

Conversation

@jlouazel

Copy link
Copy Markdown
Collaborator

Motivation

The smoke-test ran proto run <tool> -- --version on every pinned tool, assuming all tools answer --version. They don't: kubeconform uses -v, and cloud-provider-kind is a daemon with no version flag. PR #8 (which adds both) fails CI on all platforms because of this, even though the binaries install and resolve correctly.

Summary

  • The smoke-test now verifies a tool resolves to a real executable file rather than executing it, so tools with non-standard or absent version flags pass without per-tool special-casing.
  • The probe rejects an exe-path that resolves to a directory or a non-executable, covering the nested-archive misconfiguration class, not just a missing target.
  • A latent set -e bug that aborted the loop on the first unresolvable tool (masking every later failure) is fixed, so CI now reports all failures in one run.

I verified the new probe against PR #8's two tools locally: both pass. Once this lands, PR #8 goes green on rebase.

- Drop the --version probe; not every tool answers --version (kubeconform uses -v, cloud-provider-kind is a daemon), so it produced false failures
- Resolve proto bin and assert the path is an executable file (-f -x), catching the dangling exe-path bug without per-tool special-casing
- Force PROTO_REPORTER=text so proto bin emits a bare path in agent environments
- Guard the command substitution with || true so set -e does not abort the loop on the first unresolvable tool

Signed-off-by: Jean-Baptiste Louazel <jb.louazel@genesis-ai.company>
@jlouazel jlouazel requested a review from pylaligand June 23, 2026 21:29
@jlouazel jlouazel enabled auto-merge (squash) June 23, 2026 21:29
@jlouazel jlouazel merged commit 7363a3b into main Jun 23, 2026
5 checks passed
@jlouazel jlouazel deleted the jlouazel/smoke-test-no-version-probe branch June 23, 2026 21:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants