Skip to content

docs: sync remaining 82 hand-written docs with actual implementation (audit pass 2) - #1904

Merged
os-zhuang merged 1 commit into
mainfrom
docs/audit-handwritten-remaining
Jun 15, 2026
Merged

os-zhuang merged 1 commit into
mainfrom
docs/audit-handwritten-remaining

Conversation

@os-zhuang

Copy link
Copy Markdown
Contributor

Finishes the implementation-accuracy audit started in #1866 (which covered 46 docs in getting-started/concepts/guides). This pass covers the remaining 82 hand-written docs — guides (incl. cheatsheets/contracts/metadata/runtime-services), protocol (objectos/objectql/objectui), releases, and the docs index.

What this does

A multi-agent audit read each doc, located the real implementation in packages/, and adversarially verified every finding against the code — a second verifier re-checked each applied fix and repaired over-corrections.

Metric Count
Docs processed 82 / 82
Docs changed 73
Fixes applied 486
Verifier repairs (caught over-corrections) 28
Residual items flagged for follow-up 210

Recurring classes of fix

  • broken-example / inaccurate-api — methods/samples that don't exist or changed: fabricated transaction methods (tx.insert/tx.update), non-existent helpers (definePlugin), wrong package names (@objectstack/services/service-cache → @objectstack/service-cache), ViewFieldSchema → FormFieldSchema, wrong @objectstack/spec subpath imports.
  • fabricated-feature — field-type props absent from the schema (sanitize/allowed_tags/protocols/region/rows), a phantom Workflow metadata type with *.workflow.ts conventions, fabricated CLI scaffold output.
  • naming/enum drift — max_length → maxLength; relationship/complex type lists corrected to real enum values; OWDModel value spellings (public_read/…).
  • security model — FLS non-editable write rejects with PermissionDeniedError (403) rather than silent strip; real PermissionSet over Salesforce-style shapes.
  • outdated paths/env — OS_EMAIL__PROVIDER double-underscore, /v1 REST prefixes, config-resolution precedence and envKey coercion examples.

Verification

  • Navigation-safe: no files moved, frontmatter preserved on every doc.
  • next build compiles all 1113 pages clean (exit 0).
  • Diff is scoped to hand-written docs only — zero references/, zero code touched.

Follow-ups (out of scope here)

Residual items the audit could not confirm against code — plus the observation that committed content/docs/references/ have drifted from spec (16 files regenerate with diffs; 3 newly-added spec types missing entirely) — are recorded in docs/audits/2026-06-handwritten-docs-accuracy-followups.md for a dedicated regenerate-references pass.

🤖 Generated with Claude Code

…(audit pass 2)

Finishes the implementation-accuracy audit started in #1866 (which covered 46
docs in getting-started/concepts/guides). This pass covers the remaining 82
hand-written docs — guides (incl. cheatsheets/contracts/metadata/runtime-services),
protocol (objectos/objectql/objectui), releases, and the docs index.

A multi-agent audit read each doc, located the real implementation in packages/,
and adversarially verified every finding against the code (a second verifier
re-checked each applied fix and repaired over-corrections). This applies 486
verified fixes across 73 docs, plus 28 verifier repairs. Auto-generated
references/ docs (DO-NOT-EDIT, produced from packages/spec) were excluded.

Recurring classes of fix:
- broken-example / inaccurate-api: code samples and method names that don't
  exist or changed — fabricated transaction methods (tx.insert/tx.update),
  non-existent helpers (definePlugin), wrong package names
  (@objectstack/services/service-cache -> @objectstack/service-cache),
  ViewFieldSchema -> FormFieldSchema, wrong @objectstack/spec subpath imports.
- fabricated-feature: field-type props that aren't in the schema
  (sanitize/allowed_tags/protocols/region/rows), a phantom `Workflow` metadata
  type with *.workflow.ts conventions, fabricated CLI scaffold output.
- naming/enum drift: max_length -> maxLength; relationship/complex type lists
  corrected to real enum values; OWDModel value spellings (public_read/...).
- security model: FLS non-editable write rejects with PermissionDeniedError
  (403) rather than silent strip; PermissionSet over Salesforce-style shapes.
- outdated paths/env: OS_EMAIL__PROVIDER double-underscore, /v1 REST prefixes,
  config-resolution precedence and envKey coercion examples.

Navigation-safe: no files moved, frontmatter preserved on every doc.
Verified: `next build` compiles all 1113 pages clean (exit 0).

Residual items the audit could not confirm against code, plus the observation
that committed references/ have drifted from spec, are recorded in
docs/audits/2026-06-handwritten-docs-accuracy-followups.md for a follow-up pass.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@vercel

vercel Bot commented Jun 15, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
spec Ready Ready Preview, Comment Jun 15, 2026 9:12am

Request Review

@github-actions github-actions Bot added documentation Improvements or additions to documentation size/xl labels Jun 15, 2026
@os-zhuang
os-zhuang merged commit c77ac65 into main Jun 15, 2026
13 checks passed
@os-zhuang
os-zhuang deleted the docs/audit-handwritten-remaining branch June 15, 2026 09:15
os-zhuang added a commit that referenced this pull request Jun 15, 2026
…ation (#1906)

* chore(docs): tooling to keep hand-written docs in sync with implementation

Stands up recurring implementation-accuracy verification for the 128 hand-written
docs as the platform evolves, layered cheapest-and-earliest first:

1. scripts/docs-audit/affected-docs.mjs — maps packages/** changes to the
   hand-written docs that reference the affected packages (by npm name / repo
   path), so an audit can be scoped to what actually changed instead of
   re-auditing everything. Supports --all and --json.
2. .github/workflows/docs-drift-check.yml — advisory CI gate: on PRs touching
   packages/**, posts a sticky PR comment listing the docs that reference the
   changed code. Flags drift at the source; never fails the build.
3. .claude/workflows/docs-accuracy-audit.js — the reusable multi-agent audit
   (audit + adversarial verifier per doc), parameterized by args.docs; defaults
   to all hand-written docs. Same pipeline that produced #1866 and #1904.
4. scripts/docs-audit/README.md — how the four parts fit together, including the
   scheduled-routine backstop.

References (content/docs/references/, generated from packages/spec) are out of
scope and handled by a separate regenerate pass.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

* chore: add no-release changeset for docs-drift tooling

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

This branch was successfully deployed

1 active deployment
Preview — 876ecbc9 Deployed Jun 15, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation size/xl

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant