adapter: update expression cache in response to DDL #34957
Draft
+86
−2
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
So far the expression cache, which is used to speed up envd restarts, is only populated during bootstrap. That means that dataflows that get created are not in the cache the first time envd restarts, only on subsequent restarts, making the expr cache less useful than it could be.
Another motivation for wanting this is that it ensures plan pinning within the same Mz version. This lets us change the order in which dataflows are sequenced, e.g. by moving indexes to the front, without risking compute reconciliation failures due to accidentally changing plans.
Motivation
Tips for reviewer
Checklist
$T ⇔ Proto$Tmapping (possibly in a backwards-incompatible way), then it is tagged with aT-protolabel.