Skip to content

HOLMES CI auto-detect schema + per-PR bundle dir #223

Description

@flyingrobots

Quick Task: HOLMES CI auto-detect schema + per-PR bundle dir

Overview

Make HOLMES evaluate the PR’s actual schema by auto-detecting a repo schema file and tying the evidence bundle to that schema’s directory (e.g., <schema-dir>/.wesley). This removes reliance on the example fixtures and ensures scores reflect the PR.

Acceptance Criteria

  • Detect schema path in this order: WESLEY_SCHEMA (if present & exists) → first tracked schema.graphql → first tracked *.graphql → fallback to example schema.
  • Expose schema and bundle_dir as job outputs and plumb them through all HOLMES jobs.
  • Always regenerate the bundle for each run; bind scores to the current commit SHA.

Definition of Done

  • Tests / validation: Open a PR that changes the repo schema and confirm HOLMES scores change; inspect the comment for the detected path.
  • Docs / comms touched: Add a short note to README/docs on how detection works and how to override with WESLEY_SCHEMA.

Links

Activity

  1. added
    choreMaintenance / refactor / tooling
    holmesHOLMES scoring + workflows
    ciContinuous Integration / workflows
    on Oct 25, 2025
  2. moved this to Todo in Wesleyon Oct 26, 2025
  3. changed the title [-][Task][Quick]: HOLMES CI auto-detect schema + per-PR bundle dir[/-] [+]HOLMES CI auto-detect schema + per-PR bundle dir[/+] on Oct 26, 2025
  4. added
    triage:bad-codeDebt intake that still needs scheduling, closure, or a repo move
    on Jun 24, 2026
  5. flyingrobots commented on Jun 25, 2026

    @flyingrobots
    OwnerAuthor

    Triage decision: close as completed.

    Rationale: The current HOLMES workflow already detects the schema, exposes schema and bundle_dir outputs, passes those outputs through downstream jobs, and regenerates the bundle via the setup action. That satisfies the original intent.

    This is being removed from Wesley's active backlog rather than left in an inbox label.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    choreMaintenance / refactor / toolingciContinuous Integration / workflowsholmesHOLMES scoring + workflowslegend:EVIDENCEEvidence/Holmes/CI/proof workpkg:wesley-holmestriage:bad-codeDebt intake that still needs scheduling, closure, or a repo move

    Projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions