Skip to content

Reject ambiguous and empty retrieval evidence - #2

Merged
suboss87 merged 1 commit into
mainfrom
factory/reject-ambiguous-evidence
Sep 29, 2026
Merged

suboss87 merged 1 commit into
mainfrom
factory/reject-ambiguous-evidence

Conversation

@suboss87

@suboss87 suboss87 commented Sep 29, 2026 •

Copy link
Copy Markdown
Owner

Problem

Reproduced on main15d6607: duplicate authorized_doc_ids JSON fields silently chose the last permission set and produced PASS. Direct evaluate([]) also produced PASS.

Change

Reject duplicate JSON fields with line diagnostics; reject empty/duplicate direct API batches and nonobject cases. Preserve valid iterators and evaluation metrics. Include intentionally invalid fixture and reproduction notes.

Verification

12 unittest tests pass, including both CLI formats returning exit2 and no report for ambiguous permission evidence. Existing clean/regression and stale/corrected SQLite paths remain covered. git diff --check passes.

Scope

Honcho source-oracle integration deferred after bounded source inspection: filtered exact search does not establish independent permission truth. No deployment, novelty, or adoption claim. Parent reviewer will separately inspect this exact commit before any merge.


Devin Review

@suboss87
suboss87 marked this pull request as ready for review September 29, 2026 06:42
@suboss87
suboss87 merged commit cfeb20d into main Sep 29, 2026
2 of 3 checks passed

@devin-ai-integration devin-ai-integration Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no bugs or issues to report.

Devin Review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant