Topic autopartitioning and topic transactions #7711

nshestakov · 2024-08-13T10:38:24Z

Changelog entry

...

Changelog category

Not for changelog (changelog entry is not required)

Additional information

...

…m#6773)

)

…-platform#7214)

…onsumer to CLI (ydb-platform#6118)

…rm#7379)

…db-platform#7493)

github-actions · 2024-08-13T10:41:09Z

⚪ 2024-08-13 10:41:08 UTC Pre-commit check for 1b8daf5 has started.
⚪ 2024-08-13 10:44:08 UTC Build linux-x86_64-release-asan is running...
⚫ 2024-08-13 10:58:29 UTC Check cancelled

github-actions · 2024-08-13T10:41:20Z

⚪ 2024-08-13 10:41:20 UTC Pre-commit check for 1b8daf5 has started.
⚪ 2024-08-13 10:44:30 UTC Build linux-x86_64-release-clang14 is running...
⚫ 2024-08-13 10:58:35 UTC Check cancelled

github-actions · 2024-08-13T10:43:26Z

⚪ 2024-08-13 10:43:26 UTC Pre-commit check for 1b8daf5 has started.
⚪ 2024-08-13 10:46:25 UTC Build linux-x86_64-relwithdebinfo is running...
⚫ 2024-08-13 10:59:14 UTC Check cancelled

…orm#6449)

… PQ tablet (ydb-platform#6831)

github-actions · 2024-08-13T11:00:45Z

⚪ 2024-08-13 11:00:45 UTC Pre-commit check for 8688e24 has started.
⚪ 2024-08-13 11:03:51 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-08-13 11:45:26 UTC Build successful.

github-actions · 2024-08-13T11:19:12Z

⚪ 2024-08-13 11:19:12 UTC Pre-commit check for 8688e24 has started.
⚪ 2024-08-13 11:22:38 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-08-13 12:24:06 UTC Build successful.
⚪ 2024-08-13 12:24:25 UTC Tests are running...
🔴 2024-08-13 14:36:46 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
76765	63319	0	4	13427	15

github-actions · 2024-08-13T15:04:10Z

⚪ 2024-08-13 15:04:09 UTC Pre-commit check for ea8b2dd has started.
⚪ 2024-08-13 15:07:08 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-08-13 15:13:33 UTC Build successful.

github-actions · 2024-08-13T15:04:30Z

⚪ 2024-08-13 15:04:30 UTC Pre-commit check for ea8b2dd has started.
⚪ 2024-08-13 15:07:35 UTC Build linux-x86_64-release-asan is running...
🟢 2024-08-13 15:57:10 UTC Build successful.
⚪ 2024-08-13 15:57:27 UTC Tests are running...
🔴 2024-08-13 17:07:16 UTC Test run completed, no test results found for commit b686bb7. Please check test log.
⚫ 2024-08-13 17:07:56 UTC Check cancelled

github-actions · 2024-08-13T15:05:18Z

⚪ 2024-08-13 15:05:17 UTC Pre-commit check for ea8b2dd has started.
⚪ 2024-08-13 15:08:17 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-08-13 15:49:12 UTC Build successful.
⚪ 2024-08-13 15:49:28 UTC Tests are running...
🔴 2024-08-13 17:07:17 UTC Test run completed, no test results found for commit b686bb7. Please check test log.
⚫ 2024-08-13 17:08:11 UTC Check cancelled

github-actions · 2024-08-13T18:06:13Z

⚪ 2024-08-13 18:06:13 UTC Pre-commit check for 8e5a0de has started.
⚪ 2024-08-13 18:09:12 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-08-13 18:49:46 UTC Build successful.
⚪ 2024-08-13 18:49:58 UTC Tests are running...
🔴 2024-08-13 21:08:05 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
76762	63321	0	5	13425	11

github-actions · 2024-08-13T18:11:32Z

⚪ 2024-08-13 18:11:32 UTC Pre-commit check for 8e5a0de has started.
⚪ 2024-08-13 18:15:05 UTC Build linux-x86_64-release-asan is running...
🟢 2024-08-13 18:39:12 UTC Build successful.
⚪ 2024-08-13 18:39:24 UTC Tests are running...
🔴 2024-08-13 20:45:35 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
15689	15602	0	25	49	13

github-actions · 2024-08-13T18:12:23Z

⚪ 2024-08-13 18:12:23 UTC Pre-commit check for 8e5a0de has started.
⚪ 2024-08-13 18:15:24 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-08-13 18:22:09 UTC Build successful.

nshestakov and others added 18 commits August 8, 2024 13:32

Fixed rebalancing of reading sessions after restart PQRB (ydb-platfor…

7d5f299

…m#6773)

Fix reading after pqrb restart (ydb-platform#6917)

39c59ef

Add PAUSED strategy for autopartitioning of the topic (ydb-platform#7002

1cc1e36

)

Support paused strategy fo topic autopartitioning (ydb-platform#7026)

945b126

fix operator->(): requirement ptr failed (ydb-platform#7084)

c41028f

fix many scheduled events (ydb-platform#7098)

78f1083

html app (ydb-platform#7118)

0417140

do not send request to PartitionActor after finishing of reading (ydb…

fcba338

…-platform#7214)

Metering for inactive partitions (ydb-platform#7199)

2bdb5db

Fix balancing of large topics (ydb-platform#7317)

821ff9f

fix unused variable

9d926e3

Add few auto partitioning fields to describe and SDK. Add important c…

78bae53

…onsumer to CLI (ydb-platform#6118)

Split the partition if there is only more than 1 producer (ydb-platfo…

b77b512

…rm#7379)

Topics auto partitioning DDL (ydb-platform#6900)

e793d7e

Accurately check database size limit (ydb-platform#7457)

f3e7752

allow max_active_partitions=0 when topic autopartitioning disabled (y…

0bcda8b

…db-platform#7493)

Fix frozen write sessions which wait reserve bytes (ydb-platform#7530)

5fd7a91

fix suspended read session of a topic

7f567a2

nshestakov requested a review from a team as a code owner August 13, 2024 10:38

Alek5andr-Kotov added 8 commits August 13, 2024 10:47

SchemeShard has not received a response from the PQ tablet (ydb-platf…

85cc07c

…orm#6449)

The partition actor did not restore transactions after restarting the…

b987278

… PQ tablet (ydb-platform#6831)

Transaction state after PQ tablet restart (ydb-platform#7015)

d4b2858

Empty user token and KQP topic operations (ydb-platform#7117)

a96d039

Memory leaks (ydb-platform#7375)

174e114

TEvReadSet messages are being sent too often (ydb-platform#7482)

5f95645

Transactions are loaded in chunks (ydb-platform#7549)

8fe44c6

Resharper transactions are hanging (ydb-platform#7676)

143f933

nshestakov changed the title ~~Topic autopartitioning~~ Topic autopartitioning and topic transactions Aug 13, 2024

alexnick88 previously approved these changes Aug 13, 2024

View reviewed changes

nshestakov added 2 commits August 13, 2024 15:00

fix status for direct write

36c7729

fix LockedPartitions without session

b686bb7

nshestakov dismissed alexnick88’s stale review via b686bb7 August 13, 2024 15:00

alexnick88 previously approved these changes Aug 13, 2024

View reviewed changes

fix active partition counter

6b37f37

nshestakov dismissed alexnick88’s stale review via 6b37f37 August 13, 2024 17:06

fomichev3000 approved these changes Aug 14, 2024

View reviewed changes

nshestakov merged commit 3f13bd7 into ydb-platform:stable-24-3-6-logbroker Aug 14, 2024
8 of 12 checks passed

nshestakov deleted the stable-24-3-lbk branch August 14, 2024 07:30

This was referenced Aug 16, 2024

Fix use after move in http_proxy #7884

Closed

fix use after move in http_proxy #7885

Merged

siarheivesialou mentioned this pull request Aug 28, 2024

stable 24 3 6 logbroker add 5 last requests #8389

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Topic autopartitioning and topic transactions #7711

Topic autopartitioning and topic transactions #7711

nshestakov commented Aug 13, 2024

github-actions bot commented Aug 13, 2024 •

edited

Loading

github-actions bot commented Aug 13, 2024 •

edited

Loading

github-actions bot commented Aug 13, 2024 •

edited

Loading

github-actions bot commented Aug 13, 2024 •

edited

Loading

github-actions bot commented Aug 13, 2024 •

edited

Loading

github-actions bot commented Aug 13, 2024 •

edited

Loading

github-actions bot commented Aug 13, 2024 •

edited

Loading

github-actions bot commented Aug 13, 2024 •

edited

Loading

github-actions bot commented Aug 13, 2024 •

edited

Loading

github-actions bot commented Aug 13, 2024 •

edited

Loading

github-actions bot commented Aug 13, 2024 •

edited

Loading

Topic autopartitioning and topic transactions #7711

Topic autopartitioning and topic transactions #7711

Conversation

nshestakov commented Aug 13, 2024

Changelog entry

Changelog category

Additional information

github-actions bot commented Aug 13, 2024 • edited Loading

github-actions bot commented Aug 13, 2024 • edited Loading

github-actions bot commented Aug 13, 2024 • edited Loading

github-actions bot commented Aug 13, 2024 • edited Loading

github-actions bot commented Aug 13, 2024 • edited Loading

github-actions bot commented Aug 13, 2024 • edited Loading

github-actions bot commented Aug 13, 2024 • edited Loading

github-actions bot commented Aug 13, 2024 • edited Loading

github-actions bot commented Aug 13, 2024 • edited Loading

github-actions bot commented Aug 13, 2024 • edited Loading

github-actions bot commented Aug 13, 2024 • edited Loading

github-actions bot commented Aug 13, 2024 •

edited

Loading

github-actions bot commented Aug 13, 2024 •

edited

Loading

github-actions bot commented Aug 13, 2024 •

edited

Loading

github-actions bot commented Aug 13, 2024 •

edited

Loading

github-actions bot commented Aug 13, 2024 •

edited

Loading

github-actions bot commented Aug 13, 2024 •

edited

Loading

github-actions bot commented Aug 13, 2024 •

edited

Loading

github-actions bot commented Aug 13, 2024 •

edited

Loading

github-actions bot commented Aug 13, 2024 •

edited

Loading

github-actions bot commented Aug 13, 2024 •

edited

Loading

github-actions bot commented Aug 13, 2024 •

edited

Loading