Skip to content

Diagnostics of overloaded shards #14085

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 4 commits into from
Mar 9, 2025
Merged

Diagnostics of overloaded shards #14085

merged 4 commits into from
Mar 9, 2025

Conversation

anton-bobkov
Copy link
Collaborator

Changelog category

  • Documentation

Additional information

Added an example of how to diagnose overloaded shards

@github-actions github-actions bot added the documentation Improvements or additions to documentation label Jan 31, 2025
@github-actions GitHub Actions
Copy link

github-actions bot commented Jan 31, 2025 •
edited
Loading

⚪ 2025-01-31 14:26:18 UTC Pre-commit check linux-x86_64-release-asan for c6f7ec0 has started.
⚪ 2025-01-31 14:26:25 UTC Artifacts will be uploaded here
⚪ 2025-01-31 14:28:48 UTC ya make is running...
🟢 2025-01-31 14:30:19 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-01-31 14:30:25 UTC Build successful.

@github-actions GitHub Actions
Copy link

✅ Documentation build

Revision built successfully
Revision preview link

@github-actions GitHub Actions
Copy link

github-actions bot commented Jan 31, 2025 •
edited
Loading

⚪ 2025-01-31 14:33:06 UTC Pre-commit check linux-x86_64-relwithdebinfo for c6f7ec0 has started.
⚪ 2025-01-31 14:33:21 UTC Artifacts will be uploaded here
⚪ 2025-01-31 14:35:52 UTC ya make is running...
🟢 2025-01-31 14:35:58 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-01-31 14:36:04 UTC Build successful.

@anton-bobkov anton-bobkov force-pushed the docs-diagnostics-overloaded-shard branch from 5922148 to d5d78f2 Compare February 4, 2025 11:46
@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 4, 2025 •
edited
Loading

⚪ 2025-02-04 11:48:26 UTC Pre-commit check linux-x86_64-release-asan for 59f35af has started.
⚪ 2025-02-04 11:48:55 UTC Artifacts will be uploaded here
⚪ 2025-02-04 11:52:15 UTC ya make is running...
🟢 2025-02-04 11:54:50 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-02-04 11:54:56 UTC Build successful.

@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 4, 2025

✅ Documentation build

Revision built successfully
Revision preview link

@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 4, 2025 •
edited
Loading

⚪ 2025-02-04 11:50:21 UTC Pre-commit check linux-x86_64-relwithdebinfo for 59f35af has started.
⚪ 2025-02-04 11:50:34 UTC Artifacts will be uploaded here
⚪ 2025-02-04 11:53:10 UTC ya make is running...
🟢 2025-02-04 11:54:55 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-02-04 11:55:01 UTC Build successful.

@anton-bobkov anton-bobkov force-pushed the docs-diagnostics-overloaded-shard branch from d5d78f2 to 37a159d Compare February 7, 2025 13:52
@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 7, 2025 •
edited
Loading

⚪ 2025-02-07 13:53:34 UTC Pre-commit check linux-x86_64-relwithdebinfo for e9a90ac has started.
⚪ 2025-02-07 13:53:45 UTC Artifacts will be uploaded here
⚪ 2025-02-07 13:56:22 UTC ya make is running...
🟢 2025-02-07 13:58:00 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-02-07 13:58:06 UTC Build successful.

@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 7, 2025 •
edited
Loading

⚪ 2025-02-07 13:53:53 UTC Pre-commit check linux-x86_64-release-asan for e9a90ac has started.
⚪ 2025-02-07 13:54:07 UTC Artifacts will be uploaded here
⚪ 2025-02-07 13:56:35 UTC ya make is running...
🟢 2025-02-07 13:57:57 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-02-07 13:58:09 UTC Build successful.

@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 7, 2025

✅ Documentation build

Revision built successfully
Revision preview link

@anton-bobkov anton-bobkov force-pushed the docs-diagnostics-overloaded-shard branch from 37a159d to 5743f31 Compare February 9, 2025 12:59
@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 9, 2025 •
edited
Loading

⚪ 2025-02-09 13:03:16 UTC Pre-commit check linux-x86_64-release-asan for 4289283 has started.
⚪ 2025-02-09 13:03:29 UTC Artifacts will be uploaded here
⚪ 2025-02-09 13:06:04 UTC ya make is running...
🟢 2025-02-09 13:07:34 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-02-09 13:07:42 UTC Build successful.

@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 9, 2025 •
edited
Loading

⚪ 2025-02-09 13:03:17 UTC Pre-commit check linux-x86_64-relwithdebinfo for 4289283 has started.
⚪ 2025-02-09 13:03:30 UTC Artifacts will be uploaded here
⚪ 2025-02-09 13:06:07 UTC ya make is running...
🟢 2025-02-09 13:07:33 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-02-09 13:07:40 UTC Build successful.

@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 9, 2025

✅ Documentation build

Revision built successfully
Revision preview link

@anton-bobkov anton-bobkov force-pushed the docs-diagnostics-overloaded-shard branch from 5743f31 to e631249 Compare February 10, 2025 07:30
@github-actions GitHub Actions
Copy link

✅ Documentation build

Revision built successfully
Revision preview link

@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 10, 2025 •
edited
Loading

⚪ 2025-02-10 07:34:05 UTC Pre-commit check linux-x86_64-release-asan for 2c28bcd has started.
⚪ 2025-02-10 07:34:17 UTC Artifacts will be uploaded here
⚪ 2025-02-10 07:36:47 UTC ya make is running...
🟢 2025-02-10 07:38:16 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-02-10 07:38:21 UTC Build successful.

@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 10, 2025 •
edited
Loading

⚪ 2025-02-10 07:34:20 UTC Pre-commit check linux-x86_64-relwithdebinfo for 2c28bcd has started.
⚪ 2025-02-10 07:34:32 UTC Artifacts will be uploaded here
⚪ 2025-02-10 07:37:05 UTC ya make is running...
🟢 2025-02-10 07:38:33 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-02-10 07:38:38 UTC Build successful.

@anton-bobkov anton-bobkov force-pushed the docs-diagnostics-overloaded-shard branch from e631249 to ceed78b Compare February 10, 2025 08:16
@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 10, 2025 •
edited
Loading

⚪ 2025-02-10 08:17:24 UTC Pre-commit check linux-x86_64-relwithdebinfo for e29506d has started.
⚪ 2025-02-10 08:17:30 UTC Artifacts will be uploaded here
⚪ 2025-02-10 08:20:10 UTC ya make is running...
🟢 2025-02-10 08:21:57 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-02-10 08:22:02 UTC Build successful.
⚫ 2025-02-10 08:22:06 UTC Check cancelled

@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 10, 2025 •
edited
Loading

⚪ 2025-02-10 08:17:43 UTC Pre-commit check linux-x86_64-release-asan for e29506d has started.
⚪ 2025-02-10 08:18:34 UTC Artifacts will be uploaded here
⚪ 2025-02-10 08:21:41 UTC ya make is running...
⚫ 2025-02-10 08:22:12 UTC Check cancelled

@github-actions GitHub Actions
Copy link

✅ Documentation build

Revision built successfully
Revision preview link

@anton-bobkov anton-bobkov force-pushed the docs-diagnostics-overloaded-shard branch from ceed78b to 283b0d4 Compare February 10, 2025 08:21
@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 10, 2025 •
edited
Loading

⚪ 2025-02-10 08:23:43 UTC Pre-commit check linux-x86_64-relwithdebinfo for bd7fcb7 has started.
⚪ 2025-02-10 08:23:55 UTC Artifacts will be uploaded here
⚪ 2025-02-10 08:26:26 UTC ya make is running...
🟢 2025-02-10 08:27:58 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-02-10 08:28:03 UTC Build successful.

@github-actions GitHub Actions
Copy link

✅ Documentation build

Revision built successfully
Revision preview link

@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 10, 2025 •
edited
Loading

⚪ 2025-02-10 08:26:10 UTC Pre-commit check linux-x86_64-release-asan for bd7fcb7 has started.
⚪ 2025-02-10 08:26:23 UTC Artifacts will be uploaded here
⚪ 2025-02-10 08:29:02 UTC ya make is running...
🟢 2025-02-10 08:29:08 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-02-10 08:29:13 UTC Build successful.

@anton-bobkov anton-bobkov force-pushed the docs-diagnostics-overloaded-shard branch from 283b0d4 to 9daeab1 Compare February 10, 2025 21:14
@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 10, 2025 •
edited
Loading

⚪ 2025-02-10 21:17:32 UTC Pre-commit check linux-x86_64-release-asan for a7c889b has started.
⚪ 2025-02-10 21:17:44 UTC Artifacts will be uploaded here
⚪ 2025-02-10 21:20:13 UTC ya make is running...
🟢 2025-02-10 21:21:38 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-02-10 21:21:44 UTC Build successful.

@github-actions GitHub Actions
Copy link

✅ Documentation build

Revision built successfully
Revision preview link

@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 11, 2025 •
edited
Loading

⚪ 2025-02-11 12:47:39 UTC Pre-commit check linux-x86_64-relwithdebinfo for 7f61d0e has started.
⚪ 2025-02-11 12:47:52 UTC Artifacts will be uploaded here
⚪ 2025-02-11 12:50:17 UTC ya make is running...
🟢 2025-02-11 12:52:07 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-02-11 12:52:13 UTC Build successful.

@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 11, 2025 •
edited
Loading

⚪ 2025-02-11 12:47:40 UTC Pre-commit check linux-x86_64-release-asan for 7f61d0e has started.
⚪ 2025-02-11 12:47:58 UTC Artifacts will be uploaded here
⚪ 2025-02-11 12:50:13 UTC ya make is running...
🟢 2025-02-11 12:51:39 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-02-11 12:51:46 UTC Build successful.

@anton-bobkov anton-bobkov force-pushed the docs-diagnostics-overloaded-shard branch from 3367de0 to 00499a6 Compare February 11, 2025 12:56
@github-actions GitHub Actions
Copy link

✅ Documentation build

Revision built successfully
Revision preview link

@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 11, 2025 •
edited
Loading

⚪ 2025-02-11 13:00:55 UTC Pre-commit check linux-x86_64-relwithdebinfo for 55e71bc has started.
⚪ 2025-02-11 13:01:43 UTC Artifacts will be uploaded here
⚪ 2025-02-11 13:04:41 UTC ya make is running...
🟢 2025-02-11 13:05:56 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-02-11 13:06:03 UTC Build successful.

@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 11, 2025 •
edited
Loading

⚪ 2025-02-11 13:01:13 UTC Pre-commit check linux-x86_64-release-asan for 55e71bc has started.
⚪ 2025-02-11 13:01:25 UTC Artifacts will be uploaded here
⚪ 2025-02-11 13:03:51 UTC ya make is running...
🟢 2025-02-11 13:05:33 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-02-11 13:05:40 UTC Build successful.

blinkov
blinkov previously requested changes Feb 25, 2025
View reviewed changes
anton-bobkov and others added 2 commits February 25, 2025 11:29
@anton-bobkov @blinkov
Apply suggestions from code review
9277ed2 
Co-authored-by: Ivan Blinkov <ivan@blinkov.ru>
@anton-bobkov @blinkov
Apply suggestions from code review
5306698 
Co-authored-by: Ivan Blinkov <ivan@blinkov.ru>
@github-actions GitHub Actions
Copy link

✅ Documentation build

Revision built successfully
Revision preview link

@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 25, 2025 •
edited
Loading

⚪ 2025-02-25 08:33:49 UTC Pre-commit check linux-x86_64-release-asan for df4cab0 has started.
⚪ 2025-02-25 08:34:17 UTC Artifacts will be uploaded here
⚪ 2025-02-25 08:36:43 UTC ya make is running...
🟢 2025-02-25 08:36:49 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-02-25 08:36:56 UTC Build successful.

@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 25, 2025 •
edited
Loading

⚪ 2025-02-25 08:34:38 UTC Pre-commit check linux-x86_64-relwithdebinfo for df4cab0 has started.
⚪ 2025-02-25 08:34:52 UTC Artifacts will be uploaded here
⚪ 2025-02-25 08:37:13 UTC ya make is running...
🟢 2025-02-25 08:37:19 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-02-25 08:37:25 UTC Build successful.

@github-actions GitHub Actions
Copy link

✅ Documentation build

Revision built successfully
Revision preview link

@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 25, 2025 •
edited
Loading

⚪ 2025-02-25 11:15:04 UTC Pre-commit check linux-x86_64-release-asan for 7e7d6bd has started.
⚪ 2025-02-25 11:15:34 UTC Artifacts will be uploaded here
⚪ 2025-02-25 11:17:57 UTC ya make is running...
🟢 2025-02-25 11:18:03 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-02-25 11:18:10 UTC Build successful.

@github-actions GitHub Actions
Copy link

✅ Documentation build

Revision built successfully
Revision preview link

@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 25, 2025 •
edited
Loading

⚪ 2025-02-25 11:16:38 UTC Pre-commit check linux-x86_64-relwithdebinfo for 7e7d6bd has started.
⚪ 2025-02-25 11:16:52 UTC Artifacts will be uploaded here
⚪ 2025-02-25 11:19:11 UTC ya make is running...
🟢 2025-02-25 11:19:17 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2025-02-25 11:19:23 UTC Build successful.

@blinkov blinkov enabled auto-merge (squash) March 7, 2025 05:44
fomichev3000
fomichev3000 approved these changes Mar 9, 2025
View reviewed changes
Copy link
Member

@fomichev3000 fomichev3000 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  1. See the diagram description очень костыльно смотрится. У нас даже подписи к картинкам нормальных нет?
    Если поискать, то что-то такое находится https://www.docstomarkdown.pro/add-image-captions-to-images-in-jekyll-blog-posts-with-markdown/
  2. Картинка за этой фразой не соответствует действительности. "By inspecting the DataShard and DataShard details sections of the DB overview Grafana dashboard, we can see that after the cluster load increased, one of its data shards became overloaded." Правильная картинка -- следующая через одну.

В остальном формат прикольный!

@blinkov blinkov merged commit 4c3f422 into ydb-platform:main Mar 9, 2025
13 checks passed
@serbel324 serbel324 mentioned this pull request Mar 10, 2025
Merged
@GrigoriyPA GrigoriyPA mentioned this pull request Mar 11, 2025
Merged
@serbel324 serbel324 mentioned this pull request Mar 13, 2025
Merged
@alexnick88 alexnick88 mentioned this pull request Mar 19, 2025
Closed
adameat pushed a commit to adameat/ydb that referenced this pull request Mar 20, 2025
@anton-bobkov @blinkov @adameat
Diagnostics of overloaded shards (ydb-platform#14085)
9792a45 
Co-authored-by: Ivan Blinkov <ivan@ydb.tech>
blinkov added a commit that referenced this pull request Mar 21, 2025
@anton-bobkov @blinkov
Diagnostics of overloaded shards (#14085)
408bed6 
Co-authored-by: Ivan Blinkov <ivan@ydb.tech>
lberserq pushed a commit to lberserq/ydb that referenced this pull request Mar 28, 2025
@anton-bobkov @blinkov
Diagnostics of overloaded shards (ydb-platform#14085)
a3975ca 
Co-authored-by: Ivan Blinkov <ivan@ydb.tech>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@fomichev3000 fomichev3000 fomichev3000 approved these changes

@blinkov blinkov blinkov left review comments

Assignees
No one assigned
Labels
documentation Improvements or additions to documentation
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@anton-bobkov @blinkov @fomichev3000