Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor: recovery in standalone mode #414

Merged
merged 4 commits into from
Dec 23, 2022

Conversation

Rachelint
Copy link
Contributor

Which issue does this PR close?

Closes #413

Rationale for this change

See #413

What changes are included in this PR?

  • modify the VisitorImpl::visit_tables to just collect the table infos.
  • move the actual recovery work to SchemaImpl::open_table.

Are there any user-facing changes?

None.

How does this change test

Test by exist ut.

src/setup.rs Outdated Show resolved Hide resolved
@Rachelint Rachelint force-pushed the refactor-recovery-in-standalone branch from 20b44d8 to 8733961 Compare December 22, 2022 05:34
@Rachelint Rachelint force-pushed the refactor-recovery-in-standalone branch 2 times, most recently from 877e39e to 740b946 Compare December 22, 2022 06:11
@Rachelint Rachelint force-pushed the refactor-recovery-in-standalone branch from 740b946 to 34ebf73 Compare December 22, 2022 06:36
Copy link
Member

@ShiKaiWi ShiKaiWi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ShiKaiWi ShiKaiWi merged commit 4b58bd7 into apache:main Dec 23, 2022
ShiKaiWi added a commit that referenced this pull request Dec 27, 2022
* refactor: separate object store from parquet sst async reader (#503)

* refactor: separate object store from parquet sst async reader

* fix errors in unit tests

* use const FOOTER_LEN

* add GenericResult

* refactor: recovery in standalone mode (#414)

* refactor recovery in standalone mode.

* make getting table infos dynamically.

* define `LocalTablesRecoverer`.

* address CR.

* feat: support parse key partition (#506)

* add key partition parser

* refactor the codes

* add unit test

* fix show create table for partition table

* address CR issues

* supplement the error msg when fail to parse partition key

* fix unit tests

Co-authored-by: CooooolFrog <zuliangwanghust@gmail.com>

* chore: define remote_engine grpc service (#505)

Co-authored-by: kamille <34352236+Rachelint@users.noreply.github.com>

* feat: impl key partition rule (#507)

* impl key partition rule(draft).

* refactor to more extensible and testable version.

* add tests for key partition.

* add df adapter and partition rule's building.

* address CR.

Co-authored-by: WEI Xikai <ShiKaiWi@users.noreply.github.com>
Co-authored-by: kamille <34352236+Rachelint@users.noreply.github.com>
Co-authored-by: CooooolFrog <zuliangwanghust@gmail.com>
Co-authored-by: chunshao.rcs <chunshao.rcs@antgroup.com>
chunshao90 pushed a commit to chunshao90/ceresdb that referenced this pull request May 15, 2023
* refactor recovery in standalone mode.

* make getting table infos dynamically.

* define `LocalTablesRecoverer`.

* address CR.
@Rachelint Rachelint deleted the refactor-recovery-in-standalone branch May 27, 2023 12:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Recovery process in standalone mode may be a bit strange
3 participants