Skip to content
View qa-veritas's full-sized avatar

Block or report qa-veritas

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
qa-veritas/README.md

QA Veritas — AI-Native Verification Engineering

Most people are using AI to write code. I'm exploring how AI can reason about, verify, and operate complex systems.

QA Veritas layer

As systems grow more distributed, the hard part of quality moves up the stack — from asserting on a function's return value to reasoning about a cluster's state, proving a change converged, and explaining why a run failed across nodes. AI agents change the economics of that work. But only if they're built with engineering discipline rather than wired to a model and hoped at.

QA Veritas is a set of small, runnable components — and the writing around them — that together sketch an emerging discipline: AI-Native Verification Engineering. The patterns are vendor-neutral and generic by design. Each one is the smallest honest implementation of an idea, not a framework to adopt.

The thesis: one loop

An agent you can trust to operate a system runs a single loop. Each component below owns one stage of it.

flowchart LR
    M[Memory<br/><i>what is true,<br/>what changed</i>] --> R[Reasoning<br/><i>what happened<br/>and why</i>]
    R --> V[Verification<br/><i>is the desired<br/>state real?</i>]
    V --> A[Action<br/><i>change, recorded<br/>and proven</i>]
    A -->|written back| M
    style M fill:#1f6feb,color:#fff
    style R fill:#8957e5,color:#fff
    style V fill:#2da44e,color:#fff
    style A fill:#bf5700,color:#fff
Loading

Memory + Reasoning + Verification + Action. Remove any one and autonomy stops being safe.

The platform

QA Veritas
├── Resource Ledger   — Memory:        operational truth as a versioned git tree
├── State Triage      — Reasoning:     deterministic triage wrapped around one agent
├── LogLens           — Reasoning:     code-aware evidence — read what the code emitted
├── Intent Verify     — Verification:  declarative intent → observable proof (verified/failed/inconclusive)
├── Runbook Forge     — Runbooks:      procedures derived from verified history, not memory
├── SkillPack         — Skills:        agent capability that loads only when a task needs it
└── Future Agents     — Agents:        narrow operators that compose the above into workflows
Layer Component The idea it proves
Memory Resource Ledger Operate infrastructure from a git tree an agent reads before it acts and writes after.
Reasoning State Triage Parse hard facts deterministically, then let one agent reason — the model never counts.
Reasoning LogLens Correlate every file:line in a log back to the source that emitted it.
Verification Intent Verify Declare desired state; verify it with checks that return verified / failed / inconclusive.
Runbooks Runbook Forge Generate runbooks where every step has actually been performed and verified.
Skills SkillPack Progressive-disclosure capability: cheap metadata always, full instructions on match.
Writing Field notes & essays 20 articles, 8 playbooks, talks, and 9 agent designs behind the platform.

Standalone

Not a stage of the loop above, and not an essay in the writing series.

Project Intent — a dev skill installed into the repo agents are editing. It keeps the intent, and the when and why of each change, so a new chat and the next person's agent do not decide from the code alone. The intent is a JSON Schema.

How the components compose

A worked story uses all of them: a change is checked for feasibility against recorded capacity (Resource Ledger), turned into observable verification (Intent Verify), and journaled — so Runbook Forge can regenerate a trustworthy procedure. When something breaks, State Triage parses the facts and plans the investigation while LogLens shows the code that emitted the failing line. Throughout, the agents doing the work load only the SkillPack skills each task needs.

Principles

  • Determinism around nondeterminism — parse facts with code; reserve the model for judgment, never arithmetic.
  • Read before write — read state, check feasibility, act minimally and reversibly, verify, write back.
  • Verification is the artifact — a change is done when an observable signal confirms it; "inconclusive" is an honest answer.
  • Memory outlives the session — knowledge lives in the repo, not in people.

Start here

New to the platform? Read AI-Native Verification Engineering: The Positioning, then skim State Triage and Resource Ledger — the two crispest ideas, and they run in seconds.

Everything here is generic and vendor-neutral. MIT licensed. — Ajay Singh

Popular repositories Loading

  1. resource-ledger resource-ledger Public

    Operational memory as a versioned git tree. The Memory layer of QA Veritas — AI-Native Verification Engineering.

    Python

  2. state-triage state-triage Public

    Deterministic reasoning around one capable agent — the model never counts. The Reasoning layer of QA Veritas.

    Python

  3. skillpack skillpack Public

    Agent capability that loads only when the task needs it. The Skills layer of QA Veritas.

    Python

  4. loglens loglens Public

    Code-aware log evidence: read what the code emitted, not just the line. The Reasoning layer of QA Veritas.

    Python

  5. runbook-forge runbook-forge Public

    Runbooks derived from verified history, not imagined at design time. The Runbooks layer of QA Veritas.

    Python

  6. intent-verify intent-verify Public

    Declare desired state as intent; prove it with observable checks (verified/failed/inconclusive). The Verification layer of QA Veritas.

    Python