Skip to content

Fix cdc heartbeats reporting unconfirmed volatile transactions as resolved KIKIMR-20962 #1473

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

snaury
Copy link
Member

@snaury snaury commented Jan 31, 2024

Changelog entry

Fix cdc heartbeats reporting unconfirmed volatile transactions as resolved.

Changelog category

  • Bugfix

Additional information

Volatile transactions persist changes during execution, but those changes are confirmed or aborted later. When confirmed their pending change records are added to the outgoing queue and send to consumers. Unfortunately heartbeats could mark their global timestamp as resolved before they are actually resolved, and later changes would appear out of order, violating the invariant.

@snaury snaury requested a review from CyberROFL January 31, 2024 12:29
Copy link

github-actions bot commented Jan 31, 2024

2024-01-31 12:31:16 UTC Pre-commit check for b9d7f42 has started.
2024-01-31 12:31:18 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-01-31 12:36:28 UTC Build successful.
2024-01-31 12:36:38 UTC Tests are running...
🟢 2024-01-31 13:52:29 UTC Tests successful.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
60344 51037 0 0 9270 37

@snaury snaury marked this pull request as ready for review January 31, 2024 12:31
Copy link

github-actions bot commented Jan 31, 2024

2024-01-31 12:33:34 UTC Pre-commit check for b9d7f42 has started.
2024-01-31 12:33:35 UTC Build linux-x86_64-release-asan is running...
🟢 2024-01-31 12:38:52 UTC Build successful.
2024-01-31 12:39:02 UTC Tests are running...
🔴 2024-01-31 14:25:18 UTC Some tests failed, follow the links below.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
16035 15876 0 34 83 42

@snaury snaury merged commit a2d8bb5 into ydb-platform:main Jan 31, 2024
@snaury snaury deleted the KIKIMR-20962-heartbeat-out-of-order branch January 31, 2024 14:08
This was referenced Jan 31, 2024
@pavelvelikhov pavelvelikhov mentioned this pull request Feb 3, 2024
@niksaveliev niksaveliev mentioned this pull request Feb 5, 2024
@starlinskiy starlinskiy mentioned this pull request Feb 12, 2024
@vitstn vitstn mentioned this pull request Feb 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants