Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: split operations of Cluster and Shard, and serialize operations of Shard #1056

Merged
merged 15 commits into from
Jul 11, 2023

Conversation

Rachelint
Copy link
Contributor

@Rachelint Rachelint commented Jul 7, 2023

Rationale

Close #1053

Now, write operations for shard will be performed parallelly in ceresdb node(e.g. recover, alter tables in shard).
Obviously, those operations should be performed sequentially like what about table.

Detailed Changes

  • introduce Shard like Table.
  • make write operations for shard performing sequentially by adding a mutex.

Test Plan

Test manually.

@Rachelint Rachelint force-pushed the serialize-the-operations-in-shard branch 6 times, most recently from ddf1156 to 6d10e83 Compare July 10, 2023 02:24
cluster/src/shard_set.rs Outdated Show resolved Hide resolved
cluster/src/shard_set.rs Outdated Show resolved Hide resolved
cluster/src/shard_set.rs Outdated Show resolved Hide resolved
cluster/src/lib.rs Outdated Show resolved Hide resolved
cluster/src/shard_set.rs Outdated Show resolved Hide resolved
server/src/grpc/meta_event_service/mod.rs Outdated Show resolved Hide resolved
server/src/grpc/meta_event_service/mod.rs Outdated Show resolved Hide resolved
@Rachelint Rachelint force-pushed the serialize-the-operations-in-shard branch 3 times, most recently from 9bb8116 to 15a6899 Compare July 10, 2023 12:54
@Rachelint Rachelint force-pushed the serialize-the-operations-in-shard branch from 15a6899 to 90a9886 Compare July 10, 2023 13:32
cluster/src/shard_operator.rs Show resolved Hide resolved
cluster/src/shard_set.rs Outdated Show resolved Hide resolved
@Rachelint Rachelint force-pushed the serialize-the-operations-in-shard branch from 78a7de8 to f8c38ed Compare July 11, 2023 02:25
Copy link
Member

@ShiKaiWi ShiKaiWi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Rachelint Rachelint merged commit 6478a83 into apache:main Jul 11, 2023
Rachelint added a commit to Rachelint/ceresdb that referenced this pull request Jul 11, 2023
…ions of `Shard` (apache#1056)

## Rationale
Close apache#1053 

Now, write operations for shard will be performed parallelly in ceresdb
node(e.g. recover, alter tables in shard).
Obviously, those operations should be performed sequentially like what
about table.

## Detailed Changes
+ introduce `Shard` like `Table`.
+ make write operations for shard performing sequentially by adding a
mutex.

## Test Plan
Test manually.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Relation between Cluster and Shard seems messy
2 participants