Repository navigation

feat(typelayer)!: validate, coerce and filter through chtypes - #712

Draft

EricAndrechek wants to merge 145 commits into

mainfrom

chtypes-v2

Commits on Oct 1, 2026
- build(chtypes): build, package and release against the chtypes SDK
  
  EricAndrechek
  and
  claude
  committed
  d177545
- docs: describe the chtypes type layer on the multi-tenant text
  
  EricAndrechek
  and
  claude
  committed
  e58d17f
- Merge docs for the chtypes migration into chtypes-v2
  EricAndrechek
  committed
  b4779b2
- feat(policy): resolved row-filter predicates and a typed WHERE renderer
  
  EricAndrechek
  and
  claude
  committed
  e071158
- feat(discovery): refresh hooks before loaded, and the server zone
  
  EricAndrechek
  and
  claude
  committed
  6e1fce2
- feat(typelayer): tenant-keyed chtypes engine with lazy handle pools
  
  EricAndrechek
  and
  claude
  committed
  3f27439
- Merge the Go foundation for the chtypes migration into chtypes-v2
  EricAndrechek
  committed
  443b19a
- feat(api)!: serve /v1/query and pipes through ClickHouse's HTTP interface
  
  EricAndrechek
  and
  claude
  committed
  4995331
- Merge branch 'chtypes-v2' into v2-w3
  EricAndrechek
  committed
  e000751
- feat(typelayer): parse a row under the INSERT column list it was published with
  
  EricAndrechek
  and
  claude
  committed
  6dd65fb
- feat(query): bind integer policy claims through the strict cast
  
  EricAndrechek
  and
  claude
  committed
  35a008e
- feat(config,ingest): chtypes registry key and typelayer insert settings
  
  EricAndrechek
  and
  claude
  committed
  2aa6f7d
- Merge the HTTP read path for the chtypes migration into chtypes-v2
  EricAndrechek
  committed
  e87c9ce
- Merge branch 'chtypes-v2' into v2-w5
  EricAndrechek
  committed
  b02bdd2
- feat(stream): judge row-level security with the type layer, per tenant
  
  EricAndrechek
  and
  claude
  committed
  852d5f8
- Merge the chtypes-backed stream filter into chtypes-v2
  EricAndrechek
  committed
  91e86dc
- feat(ingest)!: judge every body with ClickHouse's own parser
  
  EricAndrechek
  and
  claude
  committed
  0537e89
- Merge branch 'chtypes-v2' into v2-w5
  EricAndrechek
  committed
  3ba7c6e
- Merge branch 'chtypes-v2' into v2-w2
  EricAndrechek
  committed
  6fec76e
- test(e2e)!: pin ClickHouse's own ingest verdicts and exception_code
  
  EricAndrechek
  and
  claude
  committed
  1ceb21d
- Merge the chtypes-judged ingest path into chtypes-v2
  EricAndrechek
  committed
  0499111
- Merge branch 'chtypes-v2' into v2-w5
  EricAndrechek
  committed
  8dcb496
- feat(app): open the type layer in API processes and bind it per tenant
  
  EricAndrechek
  and
  claude
  committed
  a776b2c
- build(chtypes): move to SDK go/v0.5.1 and the ClickHouse 26.8 line
  
  EricAndrechek
  and
  claude
  committed
  df6f93d
- fix(typelayer): set each library's zone through the SDK default
  
  EricAndrechek
  and
  claude
  committed
  3694f5e
- fix(typelayer): compile with ClickHouse's type gates
  
  EricAndrechek
  and
  claude
  committed
  cd1ddd7
- Merge branch 'chtypes-v2' into v2-w1c
  EricAndrechek
  committed
  e1e3404
- test(integration): chtypes on the app harness, with policies and tokens
  
  EricAndrechek
  and
  claude
  committed
  92c6c6e
- Merge SDK go/v0.5.1 and the ClickHouse 26.8 line into chtypes-v2
  EricAndrechek
  committed
  9f78c0b
- Merge branch 'chtypes-v2' into v2-w5
  EricAndrechek
  committed
  2f230f8
- test(ingest): feed DateTime64 the way ClickHouse 26.8 reads a number
  
  EricAndrechek
  and
  claude
  committed
  eb5ba5b
- Merge app wiring, config and the integration suite into chtypes-v2
  EricAndrechek
  committed
  be20317
- refactor: delete the Go-side canonicalizer, row evaluator and compact encoder
  
  EricAndrechek
  and
  claude
  committed
  99a4529
- Merge the old-API sweep into chtypes-v2
  EricAndrechek
  committed
  eb36644
- docs: reconcile docs with the chtypes type layer as landed
  
  EricAndrechek
  and
  claude
  committed
  6a72536
- Merge the docs reconcile pass into chtypes-v2
  EricAndrechek
  committed
  4c9786d
- fix(query): parse timestamp filters in ClickHouse, send in lists as tables
  
  EricAndrechek
  and
  claude
  committed
  c6b0128
- docs(query): timestamp filters parse in ClickHouse; in lists are uncapped
  
  EricAndrechek
  and
  claude
  committed
  3858fb7
- Merge branch 'chtypes-v2' into v2-w3b
  EricAndrechek
  committed
  9a044a0
- docs(api): give the timestamp-filter rule its own paragraph
  
  EricAndrechek
  and
  claude
  committed
  39d3528
- Merge ClickHouse-parsed timestamp filters and external-data in-lists into chtypes-v2
  EricAndrechek
  committed
  f32dd7a
- docs(access-control): timestamp claims take the zone-less form
  
  EricAndrechek
  and
  claude
  committed
  943a828
- test(integration): fit the suite back under its timeout
  
  EricAndrechek
  and
  claude
  committed
  9513fdb
- Merge branch 'chtypes-v2' into v2-integ
  EricAndrechek
  committed
  e2e057e
- test(integration): run internal/api's live filter test in the target
  
  EricAndrechek
  and
  claude
  committed
  6915489
- build(chtypes): move to SDK go/v0.5.2
  
  EricAndrechek
  and
  claude
  committed
  67e2b5d
- fix(discovery): publish refreshes in the order they started
  
  EricAndrechek
  and
  claude
  committed
  d0ba5de
- test(integration): clear gosec's G703 on the settings cleanup
  
  EricAndrechek
  and
  claude
  committed
  2dd4de7
- docs: fix review-round findings across the chtypes docs
  
  EricAndrechek
  and
  claude
  committed
  d02cb78
- test(typelayer): move the test engine helpers into typelayertest
  
  EricAndrechek
  and
  claude
  committed
  5aa1b81
- fix(api): cap query-path connections per pool, not per server
  
  EricAndrechek
  and
  claude
  committed
  db21526
- perf(typelayer): grow a role shape's handle pool under contention
  
  EricAndrechek
  and
  claude
  committed
  3c6d674
- chore(api): note that the 64 MiB response cap covers every query path
  
  EricAndrechek
  and
  claude
  committed
  60862a8
- fix(api): render DateTime as RFC 3339 UTC on every read and stream surface
  
  EricAndrechek
  and
  claude
  committed
  8464208
- fix(sdk): compare timestamps as instants in stream filters and liveQuery
  
  EricAndrechek
  and
  claude
  committed
  a888661
- Merge per-tenant read cap and RFC 3339 UTC rendering
  EricAndrechek
  committed
  3662865
- Merge round-1 docs review fixes
  EricAndrechek
  committed
  b708c1f
- fix(ingest): role shapes keep denied columns, stamp _eq columns, take EPHEMERAL input
  
  EricAndrechek
  and
  claude
  committed
  4aa01e3
- fix(ingest): refuse content after a JSON array body
  
  EricAndrechek
  and
  claude
  committed
  b6035d3
- test(integration): stored rows for denied, stamped and ephemeral columns
  
  EricAndrechek
  and
  claude
  committed
  3c8542a
- Merge round-1 code review fixes (insert column policy, EPHEMERAL, role pools, typelayertest)
  EricAndrechek
  committed
  c88603a
- test(typelayer): use the in-package engine helper
  
  EricAndrechek
  and
  claude
  committed
  330fd09
- docs: match the role-shape, EPHEMERAL, timestamp and read-cap fixes
  
  EricAndrechek
  and
  claude
  committed
  3674b79
- docs: fix round-2 review findings (RFC 3339 examples, wire columns, retryable 500, fetch step)
  
  EricAndrechek
  and
  claude
  committed
  9dde7ed
- docs: tighten EPHEMERAL, timestamp rendering and check-literal claims
  
  EricAndrechek
  and
  claude
  committed
  6221019
- chore: label and coverage-exclude the typelayer package
  
  EricAndrechek
  and
  claude
  committed
  dc9ee8f
- chore: correct comments the type-layer migration left stale
  
  EricAndrechek
  and
  claude
  committed
  eab6e3d
- docs: fix round-3 findings (Nullable nulls, dedupe example, stale mechanisms)
  
  EricAndrechek
  and
  claude
  committed
  9da80ec
- fix(ingest): blank layout newlines after a JSON array's closing bracket
  
  EricAndrechek
  and
  claude
  committed
  0343354
- chore: correct comments contradicted by measurement on 26.8
  
  EricAndrechek
  and
  claude
  committed
  56ba58f
- docs: correct ingest codes, timestamp claims and stale mechanisms
  
  EricAndrechek
  and
  claude
  committed
  4d35acf
- ci: the fetch script takes no --frozen flag; it always fetches frozen
  
  EricAndrechek
  and
  claude
  committed
  4950a59
- docs: make dev OTel endpoint, operator-key scope, ClickHouse statuses
  
  EricAndrechek
  and
  claude
  committed
  289d55a
- perf(typelayer): compile role shapes outside the role cache lock
  
  EricAndrechek
  and
  claude
  committed
  e7215e8
- perf(typelayer): give every handle the whole filter cache budget
  
  EricAndrechek
  and
  claude
  committed
  f367511
- chore: reflow comments left over-long by the last round
  
  EricAndrechek
  and
  claude
  committed
  6cb72bd
- docs: name roweval.go in the stream package and who sets the e2e OTLP endpoint
  
  EricAndrechek
  and
  claude
  committed
  e8ad99a
- docs: show ClickHouse's escaped slashes in raw stream and pipe output
  
  EricAndrechek
  and
  claude
  committed
  f09d96f
- fix(api): leave / unescaped wherever ClickHouse renders JSON
  
  EricAndrechek
  and
  claude
  committed
  417d7b0
- test(stream): pin that an unreadable row is declined, not an error
  
  EricAndrechek
  and
  claude
  committed
  e219066
- docs: who labels each withheld row, and what the type layer holds in memory
  
  EricAndrechek
  and
  claude
  committed
  7ad1be8
- docs: the envelope re-encodes the writer's row without changing any value
  
  EricAndrechek
  and
  claude
  committed
  871c86c
- docs: finish the exact-bytes correction; say what the error reason means
  
  EricAndrechek
  and
  claude
  committed
  241f869
- docs: the last two copies of the exact-bytes claim; untangle the error reason
  
  EricAndrechek
  and
  claude
  committed
  da0c0aa
- docs: a table whose schema cannot compile is unavailable on its own
  
  EricAndrechek
  and
  claude
  committed
  e3c3f14
- docs: every copy of the unavailable claim names all four causes
  
  EricAndrechek
  and
  claude
  committed
  9d8f95a
- fix(policy): resolve row-filter predicates in column order
  
  EricAndrechek
  and
  claude
  committed
  e07e0ce
- refactor(api): inject the ClickHouse HTTP reader instead of a package global
  
  EricAndrechek
  and
  claude
  committed
  53d874e
- test(app): run the package's tests in parallel where they share no globals
  
  EricAndrechek
  and
  claude
  committed
  63d7f45
- Merge the internal/app test-time fix into chtypes-v2
  EricAndrechek
  committed
  741f086
- Merge origin/main (#711) into chtypes-v2
  EricAndrechek
  committed
  755c108
- fix(ingest): decline a body chtypes answers short, never report it short
  
  EricAndrechek
  and
  claude
  committed
  2601574
- docs: correct the type layer's unavailable causes, NaN rendering and literals
  
  EricAndrechek
  and
  claude
  committed
  f0213ee
- Merge branch 'chtypes-v2' into v2-uuid
  EricAndrechek
  committed
  90860b6
- fix(ingest): read BOM- and form-feed-led bodies the way ClickHouse does
  
  EricAndrechek
  and
  claude
  committed
  a318830
Commits on Oct 4, 2026
- feat(typelayer): move the type layer onto chtypes Go SDK v1.0.1
  
  EricAndrechek
  and
  claude
  committed
  24c4adc
- docs(typelayer): name the unknown-zone refusal among the tenant-wide causes
  
  EricAndrechek
  and
  claude
  committed
  d699bcf
- docs: move the type-layer docs to chtypes 1.0
  
  EricAndrechek
  and
  claude
  committed
  0da30f7
- build(chtypes): move the artifact fetch, lock, CI cache and images to chtypes 1.0
  
  EricAndrechek
  and
  claude
  committed
  0b51b43
- Merge branch 'v1-docs' into chtypes-v2
  
  EricAndrechek
  and
  claude
  committed
  7b60408
- docs: fix the chtypes 1.0 review findings
  
  EricAndrechek
  and
  claude
  committed
  e6acc1f
- fix(typelayer): let only a servable tenant set the image zone; refuse an unreadable artifact dir
  
  EricAndrechek
  and
  claude
  committed
  2f14020
- Merge branch 'v1-codefix' into chtypes-v2
  
  EricAndrechek
  and
  claude
  committed
  c224bcf
- Merge branch 'v1-docsfix' into chtypes-v2
  
  EricAndrechek
  and
  claude
  committed
  a0f2d81
- fix(typelayer): pin the artifact-error cause, scan records without oci-layout, embed tzdata
  
  EricAndrechek
  and
  claude
  committed
  be86977
- docs: document the image-zone latch and the remaining review findings
  
  EricAndrechek
  and
  claude
  committed
  acd6a72
- docs: close the round-3 review findings on the image-zone latch and #456
  
  EricAndrechek
  and
  claude
  committed
  513c1dc
- docs: tighten the image-zone and handle wording from the last review
  
  EricAndrechek
  and
  claude
  committed
  7fd3500
Commits on Oct 6, 2026
- build(chtypes): move to chtypes go v1.0.2 and the 20261004.052404 artifact build
  
  EricAndrechek
  and
  claude
  committed
  f1d2b3e
- fix(typelayer): drop the #458 latch from the setup-refusal cause
  
  EricAndrechek
  and
  claude
  committed
  ec1b3a6
- docs: describe the type layer on chtypes 1.0.2
  
  EricAndrechek
  and
  claude
  committed
  522ad2a
- docs(typelayer): cite the upstream issue for the remaining setup latch
  
  EricAndrechek
  and
  claude
  committed
  3bf92db
- test(typelayer): pin that a later tenant in a zone chtypes cannot load is refused per parse
  
  EricAndrechek
  and
  claude
  committed
  c36e7d2
- docs: scope the refused-zone cause to the first open and tighten the 1.0.2 wording
  
  EricAndrechek
  and
  claude
  committed
  6d1dbdb
- docs: scope the later-tenant zone refusal by body format and name its signal
  
  EricAndrechek
  and
  claude
  committed
  30b9a07
- feat(api)!: render NaN and infinities as strings on /v1/query and pipes
  
  EricAndrechek
  and
  claude
  committed
  6a02ef9
- feat(sdk)!: type generated Float columns as number or the nan/inf strings
  
  EricAndrechek
  and
  claude
  committed
  0317182
- Merge origin/main (#729) into chtypes-v2
  
  EricAndrechek
  and
  claude
  committed
  6484ce8
- Merge branch 'v1-nanstrings' into chtypes-v2
  
  EricAndrechek
  and
  claude
  committed
  c63011f
- feat(typelayer): fetch a tenant's chtypes line on its first bind
  
  EricAndrechek
  and
  claude
  committed
  4e6809f
- build: ship the chtypes CLI, not artifacts, and drop chtypes.lock
  
  EricAndrechek
  and
  claude
  committed
  d502f1d
- docs: describe autofetch, the chtypes cache, mirrors and the bundled CLI
  
  EricAndrechek
  and
  claude
  committed
  187f76a
- docs: say how a deployment refreshes its chtypes build, and cite #486/#487
  
  EricAndrechek
  and
  claude
  committed
  337010e
- Merge branch 'v1-artifacts' into chtypes-v2
  
  EricAndrechek
  and
  claude
  committed
  d3b14af
- build(chtypes): move to chtypes go v1.0.3; a failed first open no longer holds the zone
  
  EricAndrechek
  and
  claude
  committed
  67f6d2c
- feat(ingest)!: refuse a body with a malformed record whole, as ClickHouse does
  
  EricAndrechek
  and
  claude
  committed
  8ff492e
- build(chtypes): move to chtypes go v1.0.4 and drop the wrong-line guard
  
  EricAndrechek
  and
  claude
  committed
  8d3ac03
- Merge branch 'v1-sdk103' (chtypes go v1.0.4) into chtypes-v2
  
  EricAndrechek
  and
  claude
  committed
  3afd3c1
- Merge branch 'v1-alignguard' (ClickHouse-native ingest) into chtypes-v2
  EricAndrechek
  committed
  e6c3e71
- fix(ingest): use the server's async inserts and wait for them, instead of forcing synchronous inserts
  
  EricAndrechek
  and
  claude
  committed
  58e15be
- docs: fix the round-7 review findings (artifact model, #468 leftovers, #480 figures, fetch stalls)
  
  EricAndrechek
  and
  claude
  committed
  ecceebb
- fix(ingest): isolate rejected rows with synchronous inserts
  
  EricAndrechek
  and
  claude
  committed
  921b1bb
- Merge branch 'v1-docsfix7' into chtypes-v2
  
  EricAndrechek
  and
  claude
  committed
  b69a5cb
- Merge branch 'v1-asyncinsert' into chtypes-v2
  
  EricAndrechek
  and
  claude
  committed
  d569b0d
- docs: close the round-8 findings (CHECK exception, async-insert cause, changelog framing)
  
  EricAndrechek
  and
  claude
  committed
  fedcb20
- build(chtypes): move to chtypes go v1.1.0 and use its strict cache mode
  
  EricAndrechek
  and
  claude
  committed
  226c9a4
- fix(typelayer): narrow the missing-cache check and pin the cache-unusable cause
  
  EricAndrechek
  and
  claude
  committed
  0e5d733
- docs: shared-handle scaling is fixed in the production chtypes build
  
  EricAndrechek
  and
  claude
  committed
  da5e72b
- docs: close the v1.1.0 review findings (earlier-build figure, cache wording)
  
  EricAndrechek
  and
  claude
  committed
  4339d2e
- Merge origin/main into chtypes-v2
  
  EricAndrechek
  and
  claude
  committed
  aafbce0
- refactor(typelayer): take chtypes cache paths from the SDK and force fetch failures offline
  
  EricAndrechek
  and
  claude
  committed
  04a3826
Commits on Oct 7, 2026
- fix(typelayer): pin cachePaths to the SDK and keep the autofetch pin in the offline tests
  
  EricAndrechek
  and
  claude
  committed
  9d72d8b
- test(typelayer): keep TestCachePaths_MatchesTheSDK out of the real cache
  
  EricAndrechek
  and
  claude
  committed
  47cb96f
- test(typelayer): fail TestCachePaths_MatchesTheSDK before it writes outside the temp dirs
  
  EricAndrechek
  and
  claude
  committed
  43be200
- build(deployments): mount the chtypes cache at /var/cache/chtypes
  
  EricAndrechek
  and
  claude
  committed
  d06d30c

Commits

Commits on Oct 1, 2026

Commits on Oct 4, 2026

Commits on Oct 6, 2026

Commits on Oct 7, 2026