YQ-4053 support parallel s3 import

[GrigoriyPA]

Changelog entry

Supported parallel s3 import and fixed write actor hanging

Changelog category

• Improvement

Additional information

[github-actions]

⚪ 2025-01-31 09:59:28 UTC Pre-commit check linux-x86_64-release-asan for 267d2c9 has started.
⚪ 2025-01-31 09:59:40 UTC Artifacts will be uploaded here
⚪ 2025-01-31 10:02:41 UTC ya make is running...
🟡 2025-01-31 11:04:05 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
11116	11034	0	25	20	37

⚪ 2025-01-31 11:05:17 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-01-31 11:17:39 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
117 (only retried tests)	75	0	3	8	31

⚪ 2025-01-31 11:17:51 UTC ya make is running... (failed tests rerun, try 3)
🟢 2025-01-31 11:33:48 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
67 (only retried tests)	38	0	0	3	26

🟢 2025-01-31 11:34:05 UTC Build successful.
🟢 2025-01-31 11:34:35 UTC ydbd size 3.6 GiB changed* by -162.7 KiB, which is <= 0 Bytes vs main: OK

ydbd size dash	main: dcb89a5	merge: 267d2c9	diff	diff %
ydbd size	3 870 408 176 Bytes	3 870 241 528 Bytes	-162.7 KiB	-0.004%
ydbd stripped size	1 353 716 976 Bytes	1 353 718 864 Bytes	+1.8 KiB	+0.000%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

[github-actions]

⚪ 2025-01-31 09:59:29 UTC Pre-commit check linux-x86_64-relwithdebinfo for 267d2c9 has started.
⚪ 2025-01-31 09:59:41 UTC Artifacts will be uploaded here
⚪ 2025-01-31 10:02:50 UTC ya make is running...
🟡 2025-01-31 10:58:08 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
25243	22695	0	3	2418	127

⚪ 2025-01-31 11:00:45 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-01-31 11:14:32 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
194 (only retried tests)	66	0	1	1	126

⚪ 2025-01-31 11:14:41 UTC ya make is running... (failed tests rerun, try 3)
🔴 2025-01-31 11:24:53 UTC Some tests failed, follow the links below.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
184 (only retried tests)	60	0	1	0	123

🟢 2025-01-31 11:25:00 UTC Build successful.
🟢 2025-01-31 11:25:23 UTC ydbd size 2.1 GiB changed* by -42.5 KiB, which is <= 0 Bytes vs main: OK

ydbd size dash	main: 59315fe	merge: 267d2c9	diff	diff %
ydbd size	2 227 464 424 Bytes	2 227 420 928 Bytes	-42.5 KiB	-0.002%
ydbd stripped size	471 399 312 Bytes	471 403 536 Bytes	+4.1 KiB	+0.001%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

[github-actions]

⚪ 2025-01-31 12:05:07 UTC Pre-commit check linux-x86_64-release-asan for fd557f3 has started.
⚪ 2025-01-31 12:05:20 UTC Artifacts will be uploaded here
⚪ 2025-01-31 12:08:09 UTC ya make is running...
🟡 2025-01-31 13:03:15 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
11117	11045	0	29	9	34

⚪ 2025-01-31 13:04:30 UTC ya make is running... (failed tests rerun, try 2)
🟢 2025-01-31 13:16:24 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
119 (only retried tests)	89	0	0	3	27

🟢 2025-01-31 13:16:34 UTC Build successful.
🟢 2025-01-31 13:17:03 UTC ydbd size 3.6 GiB changed* by -170.7 KiB, which is <= 0 Bytes vs main: OK

ydbd size dash	main: 79d9940	merge: fd557f3	diff	diff %
ydbd size	3 870 910 432 Bytes	3 870 735 600 Bytes	-170.7 KiB	-0.005%
ydbd stripped size	1 353 816 496 Bytes	1 353 810 192 Bytes	-6.2 KiB	-0.000%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

[github-actions]

⚪ 2025-01-31 12:05:10 UTC Pre-commit check linux-x86_64-relwithdebinfo for fd557f3 has started.
⚪ 2025-01-31 12:05:22 UTC Artifacts will be uploaded here
⚪ 2025-01-31 12:08:14 UTC ya make is running...
🟡 2025-01-31 13:07:45 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
25244	22659	0	28	2425	132

⚪ 2025-01-31 13:10:30 UTC ya make is running... (failed tests rerun, try 2)
🟢 2025-01-31 13:21:06 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED?
234 (only retried tests)	113	0	0	0	121

🟢 2025-01-31 13:21:16 UTC Build successful.
🟢 2025-01-31 13:21:35 UTC ydbd size 2.1 GiB changed* by -42.6 KiB, which is <= 0 Bytes vs main: OK

ydbd size dash	main: 79d9940	merge: fd557f3	diff	diff %
ydbd size	2 227 718 064 Bytes	2 227 674 440 Bytes	-42.6 KiB	-0.002%
ydbd stripped size	471 433 872 Bytes	471 438 096 Bytes	+4.1 KiB	+0.001%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}