Skip to content

QA run · integration-system (6/14 items consulted) · e4e5c6e3 · 2026-08-17 · 2 PASS / 4 PARTIAL / 0 FAIL / 8 NOT-RUN #9338

Description

@os-zhuang

R3 runner, area 4 of 4. Part of the #9296 wave. No clause failed. Eight items were not reached and are recorded not-run rather than inferred — including the area's new P0, which is called out separately below.

⚠️ Title deviates from the wave's (FULL area) convention on purpose — 6 of 14 items consulted.

Environment fingerprint

Same tree as #9330 / #9332 / #9337: framework e4e5c6e3c608b1b807c83a0d5b734f213eb1a1dd · .objectui-sha 665661ab093263f39f2e660a295ea615dbcee35a · console dist stamp equals pin (check:console-sha ✓) · in-process VerifyStack boots for the dogfood pins, package-local vitest for the rest · 2026-08-17.

Spec provenance: checklist from PR #9309 head fbd1c049 (open, held pending the maintainer), not merged main. Validator (pinned): 190 items (190 active); 30 kinds mapped, 0 waived. Selector area:integration-system → 14 runnable, 0 blocked.

Automated pins (RUNNER rule 6)

pin result
packages/qa/dogfood (3 files, batched) 5/5 tests passed
packages/connectors/connector-mcp/src/mcp-provider.test.ts 13/13 passed
packages/services/service-automation/src/connector-descriptor-audit.test.ts 9/9 passed
packages/services/service-datasource/src/__tests__/{admin-routes,envelope.conformance}.test.ts 54/54 passed (2 files)

Per-clause verdicts

integration-system.connector-stdio-default-deny — rev 2, P1, cli → pass

Pin mcp-provider.test.ts — 13/13. This is the item's sole declared automated.ref and it covers the default-deny posture the item exists for. No unpinned clause remained, so pass rather than partial.

integration-system.connector-descriptor-audit — rev 2, P2, cli → pass

Pin connector-descriptor-audit.test.ts — 9/9, against 3 acceptance / 2 negative clauses. Sole declared ref, fully green.

integration-system.connector-declarative-boot — rev 2, P1, api → partial

Pin showcase-declarative-mcp.dogfood.test.ts — 2/2:

  • "materializes all three generic-executor instances at boot — mcp included, state ready"
  • "dispatches the MCP tool end-to-end through the flow connector_action"

Covers boot materialization and end-to-end dispatch; the remaining acceptance clauses (6 total) were not separately driven → partial. The item's stale-dist trap is structurally ruled out: every package was rebuilt from source in this container before any test ran.

integration-system.webhook-lifecycle — rev 4, P1, mixed → partial

Pin webhook-materialization.dogfood.test.ts — 1/1: "materializes the stack-authored webhook into a sys_webhook row (object→object_name, isActive→active)". That is the authoring→row half only; delivery, retry and the console half of this 6-clause item were not driven → partial.

integration-system.email-template-render — rev 4, P2, mixed → partial

Pin email-template-materialization.dogfood.test.ts — 2/2:

2 of 8 acceptance clauses' worth of surface → partial.

integration-system.datasource-admin-lifecycle — rev 1, P1, api → partial

Pins admin-routes.test.ts + envelope.conformance.test.ts — 54/54 passed, pinning route behaviour and envelope shape. partial is the item's own stated ceiling, not a shortfall of this run: its automated field says the pin "pins route behavior + envelope; the LIVE-mount half is not pinned, drive os dev for it". The live-mount half was not driven, so the dispatcher-vs-hono-route trap this item carries remains open — the pins run against in-process dispatch, which is exactly what that trap warns cannot substitute for a real socket.

⚠️ integration-system.datasource-credential-refusal-matrix — rev 1, P0, mixed → NOT-RUN

New in the R4 sweep, never run, and not reached by this run. Recording it plainly rather than partially: nothing was consulted, so there is no verdict.

This is the most consequential gap across all four of my areas and should be picked up first. Why it needs care, from reading the spec (not from running it):

Not-run (7 others)

No oracle consulted, not inferred: connector-degraded-recovery (P1) · connector-spec-path-no-escape (P2, build) · flow-connector-picker (P2, browser) · job-scheduled-run (P1) · notify-inbox-delivery (P1) · external-datasource-federated-read (P1) · notification-preference-suppression (P2).

One incidental reading relevant to external-datasource-federated-read, from the objectstack verify sweep in #9330: showcase_ext_customer and showcase_ext_order were skipped by the RLS prover with the reason "external read-only object (federated datasource "showcase_external"; no inserts)" — confirming the federated fixture is wired and identifiable. That is context for the next runner, not a verdict on the item.

Coverage honesty

6 of 14 items consulted; no clause failed; 2 pass, 4 partial, 8 not-run. All evidence is server truth (test oracle) from declared automated.ref pins — no clause in this area was hand-driven against a live socket, which is why every mixed item stayed partial and why datasource-admin-lifecycle explicitly retains its live-mount gap.

Links: #9296 (wave) · #9330 (area 1) · #9332 (area 2) · #9337 (area 3) · #9309 (spec provenance) · #8081 (turso encryptionKey scope).

Activity

  1. os-zhuang commented on Aug 18, 2026

    @os-zhuang
    ContributorAuthor

    Close-out — superseded, nothing carried forward. Wave #9296, executed under #9480. This re-judges nothing.

    Supersede check, per item. Every one of the six items consulted here carries an automated.ref, and every one was re-covered by the Tier-1 pin sweep #9401 against the same pins: connector-stdio-default-deny (pass, 13/13), connector-descriptor-audit (pass, 9/9), connector-declarative-boot (partial), webhook-lifecycle (partial), email-template-render (partial), datasource-admin-lifecycle (partial — the live-mount half remains unpinned, exactly the ceiling this record recorded). Two of them are P2, but pinned items were in scope for Tier-1 regardless of priority, so nothing falls through.

    The P0 this record flagged as its most consequential gap was subsequently run. datasource-credential-refusal-matrix (rev 1) was driven by #9334 (R1) and again in full by Tier-2C #9467 — 7 of its 8 clauses pass on #9467's own evidence, including both read doors redacting all planted cleartext, the legacy-alias spellings, and the echoed-mask round-trip. Its clause c7 is an access-control finding, filed as #9391 — existence and clause only, no reproduction anywhere on GitHub. The two false-fail traps this record warned about (turso encryptionKey deliberately write-accepted while read-redacted; the plant-a-row legacy-alias clause) were both honoured there.

    No clause failed here, so nothing is owed to the four-way FAIL disposition.

    Superseded-by: #9401
    Carried-forward: (none — every consulted item was re-derived by a tier run)
    Parked-on: #9296


    Generated by Claude Code

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions