Skip to content

parse and pass streamlookup parameters, YDB part #12548

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

yumkam
Copy link
Collaborator

@yumkam yumkam commented Dec 12, 2024

[includes yql part, but it will disappear from resulting patch once merged on arc side; NOT FOR MERGE before that - done]

Changelog entry

...

Changelog category

  • Not for changelog (changelog entry is not required)

Additional information

...

[includes yql part, but it will disappear from resulting patch once
merged on arc side]
Copy link

github-actions bot commented Dec 12, 2024

2024-12-12 09:54:47 UTC Pre-commit check linux-x86_64-release-asan for 967cc5f has started.
2024-12-12 09:55:20 UTC Artifacts will be uploaded here
2024-12-12 09:58:47 UTC ya make is running...
🔴 2024-12-12 10:02:22 UTC Build failed, see the logs. Also see fail summary

Copy link

github-actions bot commented Dec 12, 2024

2024-12-12 09:55:49 UTC Pre-commit check linux-x86_64-relwithdebinfo for 967cc5f has started.
2024-12-12 09:56:00 UTC Artifacts will be uploaded here
2024-12-12 09:59:00 UTC ya make is running...
🔴 2024-12-12 10:02:17 UTC Build failed, see the logs. Also see fail summary

Copy link

github-actions bot commented Dec 12, 2024

2024-12-12 13:19:17 UTC Pre-commit check linux-x86_64-relwithdebinfo for 771c004 has started.
2024-12-12 13:19:52 UTC Artifacts will be uploaded here
2024-12-12 13:23:30 UTC ya make is running...
🟡 2024-12-12 14:30:58 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
32772 29845 0 1 2810 116

2024-12-12 14:33:55 UTC ya make is running... (failed tests rerun, try 2)
🟢 2024-12-12 14:46:21 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
745 (only retried tests) 637 0 0 0 108

🟢 2024-12-12 14:46:33 UTC Build successful.
🟡 2024-12-12 14:46:51 UTC ydbd size 2.1 GiB changed* by +170.1 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: d78c86c merge: 771c004 diff diff %
ydbd size 2 256 263 536 Bytes 2 256 437 704 Bytes +170.1 KiB +0.008%
ydbd stripped size 483 943 952 Bytes 483 974 224 Bytes +29.6 KiB +0.006%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Dec 12, 2024

2024-12-12 13:21:19 UTC Pre-commit check linux-x86_64-release-asan for 771c004 has started.
2024-12-12 13:21:30 UTC Artifacts will be uploaded here
2024-12-12 13:24:29 UTC ya make is running...
🟡 2024-12-12 14:49:09 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
15345 15189 0 93 17 46

🟢 2024-12-12 14:50:23 UTC Build successful.
🟡 2024-12-12 14:50:51 UTC ydbd size 3.6 GiB changed* by +382.8 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: d78c86c merge: 771c004 diff diff %
ydbd size 3 898 615 992 Bytes 3 899 007 944 Bytes +382.8 KiB +0.010%
ydbd stripped size 1 366 738 000 Bytes 1 366 862 864 Bytes +121.9 KiB +0.009%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Dec 12, 2024

2024-12-12 16:38:20 UTC Pre-commit check linux-x86_64-release-asan for ef91916 has started.
2024-12-12 16:38:52 UTC Artifacts will be uploaded here
2024-12-12 16:42:24 UTC ya make is running...
🟡 2024-12-12 17:47:30 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
15346 15284 0 12 4 46

🟢 2024-12-12 17:48:46 UTC Build successful.
🟡 2024-12-12 17:49:09 UTC ydbd size 3.6 GiB changed* by +384.5 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 46a0f52 merge: ef91916 diff diff %
ydbd size 3 899 037 200 Bytes 3 899 430 944 Bytes +384.5 KiB +0.010%
ydbd stripped size 1 366 820 944 Bytes 1 366 946 448 Bytes +122.6 KiB +0.009%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Dec 12, 2024

2024-12-12 16:38:23 UTC Pre-commit check linux-x86_64-relwithdebinfo for ef91916 has started.
2024-12-12 16:39:03 UTC Artifacts will be uploaded here
2024-12-12 16:42:27 UTC ya make is running...
🟡 2024-12-12 17:42:54 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
32555 29612 0 9 2822 112

2024-12-12 17:45:37 UTC ya make is running... (failed tests rerun, try 2)
🟢 2024-12-12 17:57:07 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
692 (only retried tests) 584 0 0 0 108

🟢 2024-12-12 17:57:16 UTC Build successful.
🟡 2024-12-12 17:57:34 UTC ydbd size 2.1 GiB changed* by +166.5 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 46a0f52 merge: ef91916 diff diff %
ydbd size 2 256 526 456 Bytes 2 256 696 984 Bytes +166.5 KiB +0.008%
ydbd stripped size 483 997 040 Bytes 484 023 344 Bytes +25.7 KiB +0.005%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

if (name == "LeftAny"sv) {
leftAny = true;
continue;
} else if (name == "RightAny"sv) {
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

else избыточен

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Да, но, кмк, в случае исключающих альтернатив, использовать всегда if () {} else if () {} лучше для консистентности. Меняем/переносим continue, и, внезапно, надо менять и следующую строчку (или, хуже, забываем поменять).

if (false) { // Tempoarily change to waring to allow for smooth transition
ctx.AddError(TIssue(ctx.GetPosition(join.Pos()), "Streamlookup: must be LEFT JOIN ANY"));
return {};
} else {
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

else избыточен

Copy link
Collaborator Author

@yumkam yumkam Dec 16, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Аналогично. И тут похожий код в обеих ветках, одинаковый отступ упрощает сравнение.
if () { /* коротко */ return; } else { /* длинно, иначе и вложенно */ } -- да, прямой смысл избавиться от else и уменьшить отступ. В данном случае, кмк, нет. (Тем более, что в будущем это if просто уйдёт)

result.JoinAlgo = EJoinAlgoType::StreamLookupJoin;
auto size = streamlookup->ChildrenSize();
for (decltype(size) i = 1; i < size; ++i) {
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

у тебя же не шаблонный код, не мудри с decltype

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Зато не нужно помнить size -- это int, unsigned, ui32, ui64, size_t,...

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

А хорошо бы помнить, иначе же overflow всякие можешь ловить

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Так наоборот: decltype не даёт сделать несогласованные типы, с которыми может быть overflow. Вот auto (=ui64) + ui32 -- можно и словить.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ну пожалуй действительно в этом случае выровнятся типы. Но все равно не понятно почему такое переусложнение появилось. Тип же ChilderSize определен, почему понадобилось так мучаться с decltype?

Copy link

github-actions bot commented Dec 16, 2024

2024-12-16 10:31:12 UTC Pre-commit check linux-x86_64-release-asan for c3978a1 has started.
2024-12-16 10:31:24 UTC Artifacts will be uploaded here
2024-12-16 10:34:33 UTC ya make is running...
2024-12-16 10:37:54 UTC Check cancelled

Copy link

github-actions bot commented Dec 16, 2024

2024-12-16 10:32:58 UTC Pre-commit check linux-x86_64-relwithdebinfo for c3978a1 has started.
2024-12-16 10:33:10 UTC Artifacts will be uploaded here
2024-12-16 10:36:15 UTC ya make is running...
2024-12-16 10:37:53 UTC Check cancelled

Copy link

github-actions bot commented Dec 16, 2024

2024-12-16 10:39:16 UTC Pre-commit check linux-x86_64-relwithdebinfo for 7a603eb has started.
2024-12-16 10:39:21 UTC Artifacts will be uploaded here
2024-12-16 10:42:23 UTC ya make is running...
🟡 2024-12-16 11:47:03 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
30927 27986 0 1 2824 116

2024-12-16 11:49:37 UTC ya make is running... (failed tests rerun, try 2)
🟢 2024-12-16 12:01:41 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
161 (only retried tests) 51 0 0 1 109

🟢 2024-12-16 12:01:48 UTC Build successful.
🟡 2024-12-16 12:02:07 UTC ydbd size 2.1 GiB changed* by +170.2 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 8efacf9 merge: 7a603eb diff diff %
ydbd size 2 251 952 944 Bytes 2 252 127 200 Bytes +170.2 KiB +0.008%
ydbd stripped size 482 590 992 Bytes 482 621 328 Bytes +29.6 KiB +0.006%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Dec 16, 2024

2024-12-16 10:42:14 UTC Pre-commit check linux-x86_64-release-asan for 7a603eb has started.
2024-12-16 10:42:25 UTC Artifacts will be uploaded here
2024-12-16 10:45:21 UTC ya make is running...
🟡 2024-12-16 11:57:56 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
14012 13950 0 11 4 47

🟢 2024-12-16 11:59:21 UTC Build successful.
🟡 2024-12-16 11:59:44 UTC ydbd size 3.6 GiB changed* by +381.8 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 8efacf9 merge: 7a603eb diff diff %
ydbd size 3 890 892 600 Bytes 3 891 283 528 Bytes +381.8 KiB +0.010%
ydbd stripped size 1 362 201 936 Bytes 1 362 326 864 Bytes +122.0 KiB +0.009%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@yumkam yumkam changed the title [NOT YET FOR MERGE] parse and pass streamlookup parameters, YDB part parse and pass streamlookup parameters, YDB part Dec 16, 2024
Copy link

github-actions bot commented Dec 16, 2024

2024-12-16 14:06:55 UTC Pre-commit check linux-x86_64-relwithdebinfo for 5e13161 has started.
2024-12-16 14:07:07 UTC Artifacts will be uploaded here
2024-12-16 14:10:03 UTC ya make is running...
🟡 2024-12-16 15:20:18 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
30885 27942 0 2 2829 112

2024-12-16 15:23:27 UTC ya make is running... (failed tests rerun, try 2)
🟢 2024-12-16 15:34:47 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
158 (only retried tests) 49 0 0 0 109

🟢 2024-12-16 15:34:55 UTC Build successful.
🟡 2024-12-16 15:35:13 UTC ydbd size 2.1 GiB changed* by +129.1 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 9d8fcc7 merge: 5e13161 diff diff %
ydbd size 2 253 923 824 Bytes 2 254 056 040 Bytes +129.1 KiB +0.006%
ydbd stripped size 482 944 304 Bytes 482 967 472 Bytes +22.6 KiB +0.005%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Dec 16, 2024

2024-12-16 14:06:57 UTC Pre-commit check linux-x86_64-release-asan for 5e13161 has started.
2024-12-16 14:07:09 UTC Artifacts will be uploaded here
2024-12-16 14:10:06 UTC ya make is running...
🟡 2024-12-16 15:28:39 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
13968 13900 0 13 9 46

🟢 2024-12-16 15:30:11 UTC Build successful.
🟡 2024-12-16 15:30:33 UTC ydbd size 3.6 GiB changed* by +305.8 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 9d8fcc7 merge: 5e13161 diff diff %
ydbd size 3 894 501 288 Bytes 3 894 814 464 Bytes +305.8 KiB +0.008%
ydbd stripped size 1 363 332 080 Bytes 1 363 438 000 Bytes +103.4 KiB +0.008%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@yumkam yumkam marked this pull request as ready for review December 20, 2024 13:13
@yumkam yumkam requested review from a team as code owners December 20, 2024 13:13
rvu1024
rvu1024 previously approved these changes Dec 23, 2024
@yumkam yumkam marked this pull request as draft December 23, 2024 18:54
Copy link

github-actions bot commented Dec 24, 2024

2024-12-24 11:26:50 UTC Pre-commit check linux-x86_64-relwithdebinfo for 1e7486e has started.
2024-12-24 11:27:01 UTC Artifacts will be uploaded here
2024-12-24 11:30:05 UTC ya make is running...
🟡 2024-12-24 12:33:06 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
30901 27946 0 5 2831 119

2024-12-24 12:36:16 UTC ya make is running... (failed tests rerun, try 2)
🟢 2024-12-24 12:48:08 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
175 (only retried tests) 63 0 0 0 112

🟢 2024-12-24 12:48:18 UTC Build successful.
🟡 2024-12-24 12:48:38 UTC ydbd size 2.1 GiB changed* by +127.7 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 7cd35f3 merge: 1e7486e diff diff %
ydbd size 2 235 028 664 Bytes 2 235 159 456 Bytes +127.7 KiB +0.006%
ydbd stripped size 477 983 088 Bytes 478 005 680 Bytes +22.1 KiB +0.005%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Dec 24, 2024

2024-12-24 11:27:18 UTC Pre-commit check linux-x86_64-release-asan for 1e7486e has started.
2024-12-24 11:27:29 UTC Artifacts will be uploaded here
2024-12-24 11:30:35 UTC ya make is running...
🟡 2024-12-24 12:40:32 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
14007 13929 0 26 5 47

🟢 2024-12-24 12:41:51 UTC Build successful.
🟡 2024-12-24 12:42:21 UTC ydbd size 3.6 GiB changed* by +307.9 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 7cd35f3 merge: 1e7486e diff diff %
ydbd size 3 865 652 520 Bytes 3 865 967 800 Bytes +307.9 KiB +0.008%
ydbd stripped size 1 350 679 408 Bytes 1 350 786 096 Bytes +104.2 KiB +0.008%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@yumkam yumkam marked this pull request as ready for review December 24, 2024 13:45
Copy link

github-actions bot commented Dec 24, 2024

2024-12-24 13:57:47 UTC Pre-commit check linux-x86_64-release-asan for ff26b56 has started.
2024-12-24 13:58:25 UTC Artifacts will be uploaded here
2024-12-24 14:01:57 UTC ya make is running...
🟡 2024-12-24 15:11:51 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
14018 13929 0 28 11 50

🟢 2024-12-24 15:13:29 UTC Build successful.
🟡 2024-12-24 15:13:53 UTC ydbd size 3.6 GiB changed* by +299.9 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: e432d9c merge: ff26b56 diff diff %
ydbd size 3 866 232 704 Bytes 3 866 539 808 Bytes +299.9 KiB +0.008%
ydbd stripped size 1 350 957 856 Bytes 1 351 056 352 Bytes +96.2 KiB +0.007%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Dec 24, 2024

2024-12-24 13:59:16 UTC Pre-commit check linux-x86_64-relwithdebinfo for ff26b56 has started.
2024-12-24 13:59:28 UTC Artifacts will be uploaded here
2024-12-24 14:02:23 UTC ya make is running...
🟡 2024-12-24 15:02:38 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
30916 27957 0 7 2832 120

2024-12-24 15:05:50 UTC ya make is running... (failed tests rerun, try 2)
🟡 2024-12-24 15:17:49 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
179 (only retried tests) 65 0 2 0 112

Copy link

github-actions bot commented Dec 24, 2024

2024-12-24 15:27:11 UTC Pre-commit check linux-x86_64-relwithdebinfo for 8a50f47 has started.
2024-12-24 15:27:23 UTC Artifacts will be uploaded here
2024-12-24 15:30:28 UTC ya make is running...
🟡 2024-12-24 17:01:08 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
30923 27963 0 3 2831 126

2024-12-24 17:04:54 UTC ya make is running... (failed tests rerun, try 2)
🟢 2024-12-24 17:20:43 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
182 (only retried tests) 64 0 0 0 118

🟢 2024-12-24 17:20:51 UTC Build successful.
🟡 2024-12-24 17:21:11 UTC ydbd size 2.1 GiB changed* by +123.7 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: ed24bb6 merge: 8a50f47 diff diff %
ydbd size 2 235 384 768 Bytes 2 235 511 464 Bytes +123.7 KiB +0.006%
ydbd stripped size 478 084 336 Bytes 478 102 832 Bytes +18.1 KiB +0.004%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Dec 24, 2024

2024-12-24 15:27:33 UTC Pre-commit check linux-x86_64-release-asan for 8a50f47 has started.
2024-12-24 15:27:45 UTC Artifacts will be uploaded here
2024-12-24 15:30:55 UTC ya make is running...
🟡 2024-12-24 17:03:07 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
14027 13925 0 37 14 51

🟢 2024-12-24 17:05:13 UTC Build successful.
🟡 2024-12-24 17:05:36 UTC ydbd size 3.6 GiB changed* by +307.9 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: ed24bb6 merge: 8a50f47 diff diff %
ydbd size 3 866 354 920 Bytes 3 866 670 216 Bytes +307.9 KiB +0.008%
ydbd stripped size 1 351 005 568 Bytes 1 351 112 256 Bytes +104.2 KiB +0.008%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@yumkam yumkam requested a review from dorooleg December 25, 2024 10:27
@yumkam yumkam requested a review from rvu1024 December 25, 2024 15:06
@yumkam yumkam merged commit d4e572d into ydb-platform:main Dec 27, 2024
12 checks passed
yumkam added a commit to yumkam/ydb that referenced this pull request Dec 27, 2024
yumkam added a commit that referenced this pull request Dec 28, 2024
)

Co-authored-by: yumkam7 <yumkam7@yandex-team.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants