Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support checksum for dumpling #30319

Open
lichunzhu opened this issue Dec 1, 2021 · 1 comment
Open

Support checksum for dumpling #30319

lichunzhu opened this issue Dec 1, 2021 · 1 comment
Labels
component/dumpling This is related to Dumpling of TiDB. type/feature-request Categorizes issue or PR as related to a new feature.

Comments

@lichunzhu
Copy link
Contributor

Feature Request

Is your feature request related to a problem? Please describe:

When dumpling finishes dumping progress, it's hard for us to know whether dumpling dumps data correctly.
Describe the feature you'd like:

Support checksum for dumpling to check whether we dump data correctly.

Describe alternatives you've considered:

Teachability, Documentation, Adoption, Migration Strategy:

@lichunzhu lichunzhu added type/feature-request Categorizes issue or PR as related to a new feature. component/dumpling This is related to Dumpling of TiDB. labels Dec 1, 2021
@lichunzhu
Copy link
Contributor Author

lichunzhu commented Dec 1, 2021

We can do this by computing checksum of the dumped dumpling files and of tidb by SQL:

select *,  bit_xor(concat(a, b)) over (order by a,b RANGE BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING) as checksum from t2 where a < 100 order by a,b;

@kennytm kennytm changed the title Support checksum for dumping Support checksum for dumpling Dec 1, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component/dumpling This is related to Dumpling of TiDB. type/feature-request Categorizes issue or PR as related to a new feature.
Projects
None yet
Development

No branches or pull requests

1 participant