dnr2 #30396

ParkMyCar · 2024-11-08T15:19:36Z

This PR has adequate test coverage / QA involvement has been duly considered. (trigger-ci for additional test/nightly runs)
This PR has an associated up-to-date design doc, is a design doc (template), or is sufficiently small to not require a design.
If this PR evolves an existing $T ⇔ Proto$T mapping (possibly in a backwards-incompatible way), then it is tagged with a T-proto label.
If this PR will require changes to cloud orchestration or tests, there is a companion cloud PR to account for those changes that is tagged with the release-blocker label (example).
If this PR includes major user-facing behavior changes, I have pinged the relevant PM to schedule a changelog post.

* mark all columns as nullable at the Arrow/Parquet level

…gistry

update proto

…alized Views and Continual Tasks, if need be evolve schema

catalog-debug

…ata_type

…same, delete RelationDesc::diff since it's no longer used

This reverts commit 898be32.

…chema registry" This reverts commit 7ee4b01.

ParkMyCar added 18 commits November 5, 2024 11:03

start, all columns nullable

9b457e4

* mark all columns as nullable at the Arrow/Parquet level

implement one time migration for Arrow DataTypes in Persist Schema re…

7ee4b01

…gistry

deprecate all existing schema IDs in Part and Run metadata

898be32

update proto

during bootstrapping of the coordinator, evolve the schema for Materi…

71d3352

…alized Views and Continual Tasks, if need be evolve schema

add schema check to the catalog_upgrade check

3b0e3eb

catalog-debug

regenerate JSON snapshot

0e21500

respond to GitHub feedback, add some more tests

230e71b

replace uses of data_type function with mz_persist_types::columnar::d…

11a68fe

…ata_type

fix build

af4ab87

make Persist no-op for compare_and_evolve_schema if it's exactly the …

762619a

…same, delete RelationDesc::diff since it's no longer used

make columns nested in structs always nullable as well

ec6ef90

have buf ignore state.proto, at least temporarily

0e1feb5

change the test gating

f7c7a37

support recursive nullability changes in backwards compatible

23d5c11

Revert "deprecate all existing schema IDs in Part and Run metadata"

56eda66

This reverts commit 898be32.

Revert "implement one time migration for Arrow DataTypes in Persist S…

0f32a4f

…chema registry" This reverts commit 7ee4b01.

fixes after revert

fc09159

foobar more debug logging

7a1d353

Provide feedback