Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: use manifest updates stats in TableData to trigger snapshot #1076

Merged
merged 10 commits into from
Jul 17, 2023

Conversation

Rachelint
Copy link
Contributor

@Rachelint Rachelint commented Jul 14, 2023

Rationale

Now we stats manifest updates of all tables in Manifest to trigger snapshot.
However when snapshot is triggered, it will just do snapshot of latest table storing update.
It is obvious unreasonable...

Worse, this mechanism lead to bug #1075 ...

So In this pr, I place the manifest updates stats into TableData , and each table can only trigger snapshot of itself rather than others.

Detailed Changes

  • Place the manifest updates stats into TableData.
  • Use it to trigger manifest snapshot.

Test Plan

Test by new ut.

@Rachelint Rachelint changed the title feat: use manifest updates stats in TableData to trigger snapshot (WIP)feat: use manifest updates stats in TableData to trigger snapshot Jul 14, 2023
@Rachelint Rachelint changed the title (WIP)feat: use manifest updates stats in TableData to trigger snapshot feat: use manifest updates stats in TableData to trigger snapshot Jul 17, 2023
Copy link
Contributor

@jiacai2050 jiacai2050 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@jiacai2050 jiacai2050 merged commit 838a6fd into apache:main Jul 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants