Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Materialize workflow support for reference tables #16787

Merged
merged 14 commits into from
Sep 24, 2024
Merged

Materialize workflow support for reference tables #16787

Changes from 1 commit
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
40e1f4d
Add e2e test for the --reference based Materialize
rohit-nayak-ps Aug 17, 2024
6cdf06f
Add functionality to Materialize for copying reference tables to all …
rohit-nayak-ps Sep 13, 2024
25a5823
Add validations
rohit-nayak-ps Sep 13, 2024
21a2ee1
Revert previously added incorrect e2e test
rohit-nayak-ps Sep 15, 2024
2a6e54e
Workflow should create tables from the source's schema for reference …
rohit-nayak-ps Sep 15, 2024
c28b520
Address Review Comments
rohit-nayak-ps Sep 18, 2024
f718bb8
Add validations at RPC level too for reference table params
rohit-nayak-ps Sep 18, 2024
0ab494f
Fix static check issue
rohit-nayak-ps Sep 20, 2024
4b5d07c
Move cli command to only use --reference-tables
rohit-nayak-ps Sep 23, 2024
0c1cabb
Change e2e test to use --reference-tables
rohit-nayak-ps Sep 23, 2024
f4a9c2d
Update server to use --reference-tables
rohit-nayak-ps Sep 23, 2024
ff0dc06
Self review. Summary doc
rohit-nayak-ps Sep 23, 2024
266aad1
make proto
rohit-nayak-ps Sep 23, 2024
8af9387
Address review comment
rohit-nayak-ps Sep 24, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Address review comment 
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
  • Loading branch information
@rohit-nayak-ps
rohit-nayak-ps committed Sep 24, 2024
commit 8af9387ec3bcaceb0605981604a5d378013a07ef
6 changes: 4 additions & 2 deletions changelog/21.0/21.0.0/summary.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -160,5 +160,7 @@ the workflow is in progress. See https://github.com/vitessio/vitess/pull/16583 f

### <a id="reference-table-materialization"/>Reference Table Materialization

There is a new option in `Materialize` workflows to keep a synced copy of reference tables from the unsharded keyspace
which holds the source of truth for the reference table, to all shards in a sharded keyspace.
There is a new option in [`Materialize` workflows](https://vitess.io/docs/reference/vreplication/materialize/) to keep
a synced copy of [reference or lookup tables](https://vitess.io/docs/reference/vreplication/reference_tables/)
(countries, states, zip_codes, etc) from an unsharded keyspace, which holds the source of truth for the reference
table, to all shards in a sharded keyspace.
Loading