Skip to content

Remove old spilling tmp files #7108

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 14 commits into from
Jul 30, 2024

Conversation

vladl2802
Copy link
Collaborator

Changelog entry

Temporary files that are created during spilling now will be stored in /tmp/spilling-service-tmp/node_<nodeId>_<guid> and will be removed on next SpillingService run.

Changelog category

  • Improvement

Additional information

...

@vladl2802 vladl2802 requested review from a team as code owners July 25, 2024 13:38
Copy link

github-actions bot commented Jul 25, 2024

2024-07-25 13:39:17 UTC Pre-commit check for 2263ccf has started.
2024-07-25 13:41:56 UTC Check linux-x86_64-release-clang14 is running...
🟢 2024-07-25 13:48:17 UTC Build successful.

Copy link

github-actions bot commented Jul 25, 2024

2024-07-25 13:39:48 UTC Pre-commit check for 2263ccf has started.
2024-07-25 13:42:46 UTC Check linux-x86_64-release-asan is running...
🔴 2024-07-25 15:54:05 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
9798 4286 0 4501 644 367

🔴 2024-07-25 15:55:15 UTC Too many tests failed, NOT going to retry
🟢 2024-07-25 15:55:17 UTC Build successful.
🟢 2024-07-25 16:08:40 UTC ydbd size 5.2 GiB changed* by +92.0 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 4d1e99e merge: 2263ccf diff diff %
ydbd size 5 564 200 560 Bytes 5 564 294 728 Bytes +92.0 KiB +0.002%
ydbd stripped size 1 198 212 528 Bytes 1 198 229 168 Bytes +16.2 KiB +0.001%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Jul 25, 2024

2024-07-25 13:41:53 UTC Pre-commit check for 2263ccf has started.
2024-07-25 13:44:50 UTC Check linux-x86_64-relwithdebinfo is running...
🟡 2024-07-25 16:02:05 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
37570 24759 0 6798 5669 344

🔴 2024-07-25 16:05:59 UTC Too many tests failed, NOT going to retry
🟢 2024-07-25 16:06:01 UTC Build successful.
🟢 2024-07-25 16:20:10 UTC ydbd size 8.1 GiB changed* by +96.0 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 4d1e99e merge: 2263ccf diff diff %
ydbd size 8 666 441 640 Bytes 8 666 539 920 Bytes +96.0 KiB +0.001%
ydbd stripped size 471 495 616 Bytes 471 503 680 Bytes +7.9 KiB +0.002%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Jul 26, 2024

2024-07-26 09:10:10 UTC Pre-commit check for 014944a has started.
2024-07-26 09:13:05 UTC Check linux-x86_64-relwithdebinfo is running...
🟡 2024-07-26 11:01:44 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
38442 33152 0 4 5274 12

2024-07-26 11:05:34 UTC Failed tests rerun (try 2) linux-x86_64-relwithdebinfo is running...
🟡 2024-07-26 11:12:51 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
15 (only retried tests) 3 0 4 0 8

2024-07-26 11:16:03 UTC Failed tests rerun (try 3) linux-x86_64-relwithdebinfo is running...
🔴 2024-07-26 11:23:40 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
13 (only retried tests) 1 0 4 0 8

🟢 2024-07-26 11:26:51 UTC Build successful.
🟡 2024-07-26 11:27:26 UTC ydbd size 8.1 GiB changed* by +124.5 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: eb725d9 merge: 014944a diff diff %
ydbd size 8 667 494 928 Bytes 8 667 622 400 Bytes +124.5 KiB +0.001%
ydbd stripped size 471 530 176 Bytes 471 536 000 Bytes +5.7 KiB +0.001%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Jul 26, 2024

2024-07-26 09:10:49 UTC Pre-commit check for 014944a has started.
2024-07-26 09:13:49 UTC Check linux-x86_64-release-clang14 is running...
🟢 2024-07-26 09:19:48 UTC Build successful.

Copy link

github-actions bot commented Jul 26, 2024

2024-07-26 09:13:16 UTC Pre-commit check for 014944a has started.
2024-07-26 09:16:10 UTC Check linux-x86_64-release-asan is running...
🔴 2024-07-26 11:18:40 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
9775 9192 0 84 325 174

🟢 2024-07-26 11:19:41 UTC Build successful.
🟡 2024-07-26 11:20:28 UTC ydbd size 5.2 GiB changed* by +123.4 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: eb725d9 merge: 014944a diff diff %
ydbd size 5 564 723 464 Bytes 5 564 849 848 Bytes +123.4 KiB +0.002%
ydbd stripped size 1 198 281 520 Bytes 1 198 303 248 Bytes +21.2 KiB +0.002%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Jul 28, 2024

2024-07-28 11:51:02 UTC Pre-commit check for dc58d27 has started.
2024-07-28 11:54:37 UTC Check linux-x86_64-release-clang14 is running...
🟢 2024-07-28 12:04:28 UTC Build successful.

Copy link

github-actions bot commented Jul 28, 2024

2024-07-28 11:52:40 UTC Pre-commit check for dc58d27 has started.
2024-07-28 11:55:39 UTC Check linux-x86_64-release-asan is running...
🔴 2024-07-28 14:07:40 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
9762 9179 0 84 327 172

🟢 2024-07-28 14:08:37 UTC Build successful.
🟡 2024-07-28 14:09:33 UTC ydbd size 5.2 GiB changed* by +139.9 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: ae7146c merge: dc58d27 diff diff %
ydbd size 5 568 957 240 Bytes 5 569 100 496 Bytes +139.9 KiB +0.003%
ydbd stripped size 1 198 908 880 Bytes 1 198 936 688 Bytes +27.2 KiB +0.002%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Jul 28, 2024

2024-07-28 11:52:52 UTC Pre-commit check for dc58d27 has started.
2024-07-28 11:55:50 UTC Check linux-x86_64-relwithdebinfo is running...
🟡 2024-07-28 13:48:10 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
38434 33137 0 6 5278 13

2024-07-28 13:52:08 UTC Failed tests rerun (try 2) linux-x86_64-relwithdebinfo is running...
🟡 2024-07-28 14:00:11 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
21 (only retried tests) 9 0 4 0 8

2024-07-28 14:03:23 UTC Failed tests rerun (try 3) linux-x86_64-relwithdebinfo is running...
🔴 2024-07-28 14:11:18 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
13 (only retried tests) 1 0 4 0 8

🟢 2024-07-28 14:14:25 UTC Build successful.
🟡 2024-07-28 14:15:04 UTC ydbd size 8.1 GiB changed* by +131.4 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: ae7146c merge: dc58d27 diff diff %
ydbd size 8 674 427 424 Bytes 8 674 561 936 Bytes +131.4 KiB +0.002%
ydbd stripped size 471 778 752 Bytes 471 785 536 Bytes +6.6 KiB +0.001%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Jul 28, 2024

2024-07-28 14:27:33 UTC Pre-commit check for 5f5e1f4 has started.
2024-07-28 14:30:29 UTC Check linux-x86_64-relwithdebinfo is running...
🟡 2024-07-28 16:21:22 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
38435 33140 0 5 5275 15

2024-07-28 16:25:10 UTC Failed tests rerun (try 2) linux-x86_64-relwithdebinfo is running...
🟡 2024-07-28 16:33:34 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
18 (only retried tests) 5 0 4 0 9

2024-07-28 16:36:52 UTC Failed tests rerun (try 3) linux-x86_64-relwithdebinfo is running...
🔴 2024-07-28 16:44:40 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
14 (only retried tests) 2 0 4 0 8

🟢 2024-07-28 16:47:54 UTC Build successful.
🟡 2024-07-28 16:48:26 UTC ydbd size 8.1 GiB changed* by +131.4 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 4743435 merge: 5f5e1f4 diff diff %
ydbd size 8 674 436 056 Bytes 8 674 570 568 Bytes +131.4 KiB +0.002%
ydbd stripped size 471 779 008 Bytes 471 785 792 Bytes +6.6 KiB +0.001%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Jul 28, 2024

2024-07-28 14:27:38 UTC Pre-commit check for 5f5e1f4 has started.
2024-07-28 14:30:33 UTC Check linux-x86_64-release-asan is running...
🔴 2024-07-28 16:37:14 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
9762 9175 0 90 322 175

🟢 2024-07-28 16:38:12 UTC Build successful.
🟡 2024-07-28 16:39:12 UTC ydbd size 5.2 GiB changed* by +135.9 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 4743435 merge: 5f5e1f4 diff diff %
ydbd size 5 568 970 360 Bytes 5 569 109 520 Bytes +135.9 KiB +0.002%
ydbd stripped size 1 198 914 000 Bytes 1 198 937 712 Bytes +23.2 KiB +0.002%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Jul 28, 2024

2024-07-28 14:27:39 UTC Pre-commit check for 5f5e1f4 has started.
2024-07-28 14:30:44 UTC Check linux-x86_64-release-clang14 is running...
🟢 2024-07-28 14:36:59 UTC Build successful.

Copy link

github-actions bot commented Jul 29, 2024

2024-07-29 10:39:27 UTC Pre-commit check for d291629 has started.
2024-07-29 10:42:43 UTC Check linux-x86_64-relwithdebinfo is running...
2024-07-29 10:44:36 UTC Check cancelled

Copy link

github-actions bot commented Jul 29, 2024

2024-07-29 10:40:36 UTC Pre-commit check for d291629 has started.
2024-07-29 10:43:29 UTC Check linux-x86_64-release-clang14 is running...
2024-07-29 10:44:37 UTC Check cancelled

Copy link

github-actions bot commented Jul 29, 2024

2024-07-29 10:41:04 UTC Pre-commit check for d291629 has started.
2024-07-29 10:43:57 UTC Check linux-x86_64-release-asan is running...
2024-07-29 10:44:36 UTC Check cancelled

Copy link

github-actions bot commented Jul 29, 2024

2024-07-29 10:46:02 UTC Pre-commit check for c8532fe has started.
2024-07-29 10:48:42 UTC Check linux-x86_64-release-clang14 is running...
🟢 2024-07-29 10:56:07 UTC Build successful.

Copy link

github-actions bot commented Jul 29, 2024

2024-07-29 10:46:54 UTC Pre-commit check for c8532fe has started.
2024-07-29 10:49:55 UTC Check linux-x86_64-release-asan is running...
2024-07-29 12:01:59 UTC Check cancelled

Copy link

github-actions bot commented Jul 29, 2024

2024-07-29 10:49:03 UTC Pre-commit check for c8532fe has started.
2024-07-29 10:51:56 UTC Check linux-x86_64-relwithdebinfo is running...
2024-07-29 12:01:59 UTC Check cancelled

Copy link

github-actions bot commented Jul 29, 2024

2024-07-29 12:22:24 UTC Pre-commit check for d89bf4b has started.
2024-07-29 12:25:07 UTC Check linux-x86_64-release-clang14 is running...
🟢 2024-07-29 12:29:25 UTC Build successful.

Copy link

github-actions bot commented Jul 29, 2024

2024-07-29 12:36:09 UTC Pre-commit check for d89bf4b has started.
2024-07-29 12:39:27 UTC Check linux-x86_64-relwithdebinfo is running...
🔴 2024-07-29 14:24:04 UTC Too many tests failed, NOT going to retry
🔴 2024-07-29 14:24:06 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
38431 31946 0 1177 5275 33

🟢 2024-07-29 14:27:47 UTC Build successful.
🟡 2024-07-29 14:29:33 UTC ydbd size 8.1 GiB changed* by +142.4 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 123a335 merge: d89bf4b diff diff %
ydbd size 8 676 391 128 Bytes 8 676 536 968 Bytes +142.4 KiB +0.002%
ydbd stripped size 471 816 800 Bytes 471 824 544 Bytes +7.6 KiB +0.002%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Jul 29, 2024

2024-07-29 12:48:06 UTC Pre-commit check for d89bf4b has started.
2024-07-29 12:51:22 UTC Check linux-x86_64-release-asan is running...
🔴 2024-07-29 15:00:18 UTC Too many tests failed, NOT going to retry
🔴 2024-07-29 15:00:20 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
9774 7598 0 1629 341 206

🟢 2024-07-29 15:01:35 UTC Build successful.
🟡 2024-07-29 15:08:45 UTC ydbd size 5.2 GiB changed* by +162.1 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 123a335 merge: d89bf4b diff diff %
ydbd size 5 569 912 480 Bytes 5 570 078 456 Bytes +162.1 KiB +0.003%
ydbd stripped size 1 199 036 624 Bytes 1 199 072 240 Bytes +34.8 KiB +0.003%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Jul 30, 2024

2024-07-30 11:43:32 UTC Pre-commit check for 93c0cbe has started.
2024-07-30 11:46:24 UTC Check linux-x86_64-relwithdebinfo is running...
2024-07-30 12:31:50 UTC Check cancelled

Copy link

github-actions bot commented Jul 30, 2024

2024-07-30 11:43:38 UTC Pre-commit check for 93c0cbe has started.
2024-07-30 11:46:13 UTC Check linux-x86_64-release-clang14 is running...
🟢 2024-07-30 11:52:05 UTC Build successful.

Copy link

github-actions bot commented Jul 30, 2024

2024-07-30 11:46:14 UTC Pre-commit check for 93c0cbe has started.
2024-07-30 11:49:03 UTC Check linux-x86_64-release-asan is running...
2024-07-30 12:31:42 UTC Check cancelled

Copy link

github-actions bot commented Jul 30, 2024

2024-07-30 12:38:02 UTC Pre-commit check for ecb8993 has started.
2024-07-30 12:41:16 UTC Check linux-x86_64-relwithdebinfo is running...
🟡 2024-07-30 14:35:52 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
38450 33158 0 2 5279 11

2024-07-30 14:39:31 UTC Failed tests rerun (try 2) linux-x86_64-relwithdebinfo is running...
🟢 2024-07-30 14:47:59 UTC Tests successful.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
15 (only retried tests) 6 0 0 1 8

🟢 2024-07-30 14:51:10 UTC Build successful.
🟡 2024-07-30 14:51:40 UTC ydbd size 8.1 GiB changed* by +147.4 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 9d12242 merge: ecb8993 diff diff %
ydbd size 8 678 518 040 Bytes 8 678 668 936 Bytes +147.4 KiB +0.002%
ydbd stripped size 471 879 392 Bytes 471 887 136 Bytes +7.6 KiB +0.002%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Jul 30, 2024

2024-07-30 12:40:01 UTC Pre-commit check for ecb8993 has started.
2024-07-30 12:42:50 UTC Check linux-x86_64-release-clang14 is running...
🟢 2024-07-30 12:48:28 UTC Build successful.

Copy link

github-actions bot commented Jul 30, 2024

2024-07-30 12:46:41 UTC Pre-commit check for ecb8993 has started.
2024-07-30 12:49:38 UTC Check linux-x86_64-release-asan is running...
🔴 2024-07-30 15:04:13 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
9774 9192 0 88 322 172

🟢 2024-07-30 15:05:15 UTC Build successful.
🟡 2024-07-30 15:05:46 UTC ydbd size 5.2 GiB changed* by +165.0 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 9d12242 merge: ecb8993 diff diff %
ydbd size 5 571 069 768 Bytes 5 571 238 736 Bytes +165.0 KiB +0.003%
ydbd stripped size 1 199 213 808 Bytes 1 199 246 352 Bytes +31.8 KiB +0.003%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@lll-phill-lll lll-phill-lll merged commit c0f743d into ydb-platform:main Jul 30, 2024
10 of 12 checks passed
lll-phill-lll pushed a commit to lll-phill-lll/ydb that referenced this pull request Sep 9, 2024
Co-authored-by: Vladislav Lukachik <vladluk@yandex-team.ru>
lll-phill-lll pushed a commit to lll-phill-lll/ydb that referenced this pull request Sep 10, 2024
Co-authored-by: Vladislav Lukachik <vladluk@yandex-team.ru>
lll-phill-lll pushed a commit to lll-phill-lll/ydb that referenced this pull request Sep 11, 2024
Co-authored-by: Vladislav Lukachik <vladluk@yandex-team.ru>
lll-phill-lll pushed a commit that referenced this pull request Sep 12, 2024
Co-authored-by: Vladislav Lukachik <vladluk@yandex-team.ru>
lll-phill-lll pushed a commit to lll-phill-lll/ydb that referenced this pull request Sep 13, 2024
Co-authored-by: Vladislav Lukachik <vladluk@yandex-team.ru>
lll-phill-lll pushed a commit to lll-phill-lll/ydb that referenced this pull request Sep 13, 2024
Co-authored-by: Vladislav Lukachik <vladluk@yandex-team.ru>
lll-phill-lll pushed a commit to lll-phill-lll/ydb that referenced this pull request Sep 15, 2024
Co-authored-by: Vladislav Lukachik <vladluk@yandex-team.ru>
lll-phill-lll pushed a commit to lll-phill-lll/ydb that referenced this pull request Sep 15, 2024
Co-authored-by: Vladislav Lukachik <vladluk@yandex-team.ru>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants