always delete nodes persistently in hive

[vporyadke]

Changelog entry

fix a bug that could lead to nodes being down when reusing node ids

Changelog category

• Bugfix

Additional information

Backport of #10051

[github-actions]

⚪ 2024-11-05 11:21:27 UTC Pre-commit check for 0c7b1c4 has started.
⚪ 2024-11-05 11:24:08 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-11-05 12:05:59 UTC Build successful.
⚪ 2024-11-05 12:06:16 UTC Tests are running...
🔴 2024-11-05 13:31:36 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
14600	13243	0	14	1303	40

🟡 2024-11-05 13:32:26 UTC ydbd size 8.2 GiB changed* by +982.0 KiB, which is >= 100.0 KiB vs stable-24-3: Warning

ydbd size dash	stable-24-3: 23208c8	merge: 0c7b1c4	diff	diff %
ydbd size	8 856 933 528 Bytes	8 857 939 144 Bytes	+982.0 KiB	+0.011%
ydbd stripped size	483 655 080 Bytes	483 657 704 Bytes	+2.6 KiB	+0.001%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

[github-actions]

⚪ 2024-11-05 11:22:20 UTC Pre-commit check for 0c7b1c4 has started.
⚪ 2024-11-05 11:24:58 UTC Build linux-x86_64-release-asan is running...
🟢 2024-11-05 11:49:41 UTC Build successful.
⚪ 2024-11-05 11:49:56 UTC Tests are running...
🔴 2024-11-05 13:54:31 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
10303	10209	0	24	25	45

🟡 2024-11-05 13:55:15 UTC ydbd size 5.6 GiB changed* by +496.2 KiB, which is >= 100.0 KiB vs stable-24-3: Warning

ydbd size dash	stable-24-3: 23208c8	merge: 0c7b1c4	diff	diff %
ydbd size	5 990 481 528 Bytes	5 990 989 632 Bytes	+496.2 KiB	+0.008%
ydbd stripped size	1 501 498 240 Bytes	1 501 526 080 Bytes	+27.2 KiB	+0.002%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

[github-actions]

⚪ 2024-11-05 11:24:07 UTC Pre-commit check for 0c7b1c4 has started.
⚪ 2024-11-05 11:26:42 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-11-05 11:34:21 UTC Build successful.