[YQL-17174] added spilling library for compute actors #1544

lll-phill-lll · 2024-02-02T08:53:06Z

Changelog entry

...

Changelog category

New feature

Additional information

...

github-actions · 2024-02-02T08:55:46Z

⚪ 2024-02-02 08:55:46 UTC Pre-commit check for 52827d2 has started.
⚪ 2024-02-02 08:55:48 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-02-02 09:01:29 UTC Build successful.
⚪ 2024-02-02 09:01:44 UTC Tests are running...
🟢 2024-02-02 10:38:38 UTC Tests successful.

Test history

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
58838	49527	0	0	9263	48

github-actions · 2024-02-02T08:56:36Z

⚪ 2024-02-02 08:56:36 UTC Pre-commit check for 52827d2 has started.
⚪ 2024-02-02 08:56:38 UTC Build linux-x86_64-release-asan is running...
🟢 2024-02-02 09:03:13 UTC Build successful.
⚪ 2024-02-02 09:03:25 UTC Tests are running...
🔴 2024-02-02 10:44:49 UTC Some tests failed, follow the links below.

Test history

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
14518	14314	0	39	129	36

github-actions · 2024-02-02T14:47:20Z

⚪ 2024-02-02 14:47:19 UTC Pre-commit check for acf0fea has started.
⚪ 2024-02-02 14:47:21 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-02-02 14:53:13 UTC Build successful.
⚪ 2024-02-02 14:53:26 UTC Tests are running...
🔴 2024-02-02 16:30:17 UTC Some tests failed, follow the links below.

Test history

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
58859	49565	0	4	9263	27

github-actions · 2024-02-02T14:48:58Z

⚪ 2024-02-02 14:48:58 UTC Pre-commit check for acf0fea has started.
⚪ 2024-02-02 14:49:01 UTC Build linux-x86_64-release-asan is running...
🟢 2024-02-02 14:55:41 UTC Build successful.
⚪ 2024-02-02 14:55:54 UTC Tests are running...
🔴 2024-02-02 16:30:23 UTC Some tests failed, follow the links below.

Test history

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
14529	14404	0	32	66	27

ydb/library/yql/dq/actors/spilling/compute_storage.cpp

ydb/library/yql/dq/actors/spilling/compute_storage_actor.cpp

ydb/library/yql/minikql/computation/mkql_spiller.h

ydb/library/yql/minikql/computation/mkql_spiller.cpp

ydb/library/yql/dq/actors/spilling/compute_storage_actor.cpp

…s on actor system

github-actions · 2024-02-05T14:42:39Z

⚪ 2024-02-05 14:42:38 UTC Pre-commit check for 7ef360f has started.
⚪ 2024-02-05 14:42:40 UTC Build linux-x86_64-release-asan is running...
🟢 2024-02-05 14:49:08 UTC Build successful.
⚪ 2024-02-05 14:49:19 UTC Tests are running...
🔴 2024-02-05 15:24:21 UTC Test run completed, no test results found for commit f6407e2. Please check build logs.
⚫ 2024-02-05 15:24:24 UTC Check cancelled

github-actions · 2024-02-05T14:44:04Z

⚪ 2024-02-05 14:44:03 UTC Pre-commit check for 7ef360f has started.
⚪ 2024-02-05 14:44:06 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-02-05 14:50:21 UTC Build successful.
⚪ 2024-02-05 14:50:33 UTC Tests are running...
🔴 2024-02-05 15:24:20 UTC Test run completed, no test results found for commit f6407e2. Please check build logs.
⚫ 2024-02-05 15:24:26 UTC Check cancelled

github-actions · 2024-02-05T15:26:22Z

⚪ 2024-02-05 15:26:22 UTC Pre-commit check for 6f6c9dd has started.
⚪ 2024-02-05 15:26:24 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-02-05 15:29:00 UTC Build successful.
⚪ 2024-02-05 15:29:12 UTC Tests are running...
🔴 2024-02-05 15:33:04 UTC Test run completed, no test results found for commit 6921e8b. Please check build logs.
⚫ 2024-02-05 15:33:06 UTC Check cancelled

github-actions · 2024-02-05T15:28:29Z

⚪ 2024-02-05 15:28:29 UTC Pre-commit check for 6f6c9dd has started.
⚪ 2024-02-05 15:28:31 UTC Build linux-x86_64-release-asan is running...
🟢 2024-02-05 15:31:04 UTC Build successful.
⚪ 2024-02-05 15:31:16 UTC Tests are running...
🔴 2024-02-05 15:33:02 UTC Test run completed, no test results found for commit 6921e8b. Please check build logs.
⚫ 2024-02-05 15:33:05 UTC Check cancelled

github-actions · 2024-02-05T15:35:48Z

⚪ 2024-02-05 15:35:48 UTC Pre-commit check for 3f6767c has started.
⚪ 2024-02-05 15:35:50 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-02-05 15:38:24 UTC Build successful.
⚪ 2024-02-05 15:38:33 UTC Tests are running...
🔴 2024-02-05 16:35:40 UTC Test run completed, no test results found for commit 1bd051d. Please check build logs.
⚫ 2024-02-05 16:35:43 UTC Check cancelled

github-actions · 2024-02-05T15:38:09Z

⚪ 2024-02-05 15:38:09 UTC Pre-commit check for 3f6767c has started.
⚪ 2024-02-05 15:38:12 UTC Build linux-x86_64-release-asan is running...
🟢 2024-02-05 15:40:37 UTC Build successful.
⚪ 2024-02-05 15:40:57 UTC Tests are running...
🔴 2024-02-05 16:35:39 UTC Test run completed, no test results found for commit 1bd051d. Please check build logs.
⚫ 2024-02-05 16:35:42 UTC Check cancelled

ydb/library/yql/dq/actors/spilling/compute_storage.cpp

github-actions · 2024-02-05T16:36:57Z

⚪ 2024-02-05 16:36:56 UTC Pre-commit check for 13d3792 has started.
⚪ 2024-02-05 16:36:58 UTC Build linux-x86_64-release-asan is running...
🟢 2024-02-05 16:39:23 UTC Build successful.
⚪ 2024-02-05 16:39:37 UTC Tests are running...
🔴 2024-02-05 18:22:35 UTC Some tests failed, follow the links below.

Test history

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
14549	14417	0	18	72	42

github-actions · 2024-02-05T16:37:05Z

⚪ 2024-02-05 16:37:05 UTC Pre-commit check for 13d3792 has started.
⚪ 2024-02-05 16:37:07 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-02-05 16:40:06 UTC Build successful.
⚪ 2024-02-05 16:40:17 UTC Tests are running...
🔴 2024-02-05 18:14:47 UTC Some tests failed, follow the links below.

Test history

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
58880	49580	0	1	9263	36

[YQL-17174] added spilling library for compute actors

eb285a6

lll-phill-lll requested a review from a team as a code owner February 2, 2024 08:53

github-actions bot added the new-feature label Feb 2, 2024

lll-phill-lll requested a review from Darych February 2, 2024 08:53

Removed unnecessary code

9641b8e

lll-phill-lll requested a review from resetius February 2, 2024 14:46

resetius reviewed Feb 2, 2024

View reviewed changes

ydb/library/yql/dq/actors/spilling/compute_storage.cpp Outdated Show resolved Hide resolved

ydb/library/yql/dq/actors/spilling/compute_storage.cpp Outdated Show resolved Hide resolved

ydb/library/yql/dq/actors/spilling/compute_storage_actor.cpp Outdated Show resolved Hide resolved

Darych reviewed Feb 2, 2024

View reviewed changes

lll-phill-lll requested a review from zverevgeny February 2, 2024 16:33

Refactoring: spiller factory added -> removed dependence of comp_node…

f6407e2

…s on actor system

lll-phill-lll added 3 commits February 5, 2024 18:13

removed unused includes

7988479

some code improvements

fa3416a

fixup

6921e8b

fixup

1bd051d

resetius reviewed Feb 5, 2024

View reviewed changes

ydb/library/yql/dq/actors/spilling/compute_storage.cpp Outdated Show resolved Hide resolved

pr fixes

b92757d

resetius approved these changes Feb 5, 2024

View reviewed changes

Darych approved these changes Feb 7, 2024

View reviewed changes

lll-phill-lll merged commit ba77f6b into ydb-platform:main Feb 8, 2024

vitstn mentioned this pull request Feb 8, 2024

unmute test #1711

Merged

ildar-khisambeev mentioned this pull request Feb 8, 2024

LOGBROKER-8783 bugfix #1713

Merged

vitstn mentioned this pull request Feb 8, 2024

Mark mutable_id for YT writes #1744

Merged

niksaveliev mentioned this pull request Feb 9, 2024

Fix pq writer and few renames #1757

Merged

GrigoriyPA mentioned this pull request Feb 9, 2024

Moved optimizers from yql/providers/dq to yql/dq #1758

Merged

serbel324 mentioned this pull request Feb 9, 2024

Mute Burst Detection tests #1763

Merged

pavelvelikhov mentioned this pull request Feb 9, 2024

Cannonized two plans #1773

Merged

niksaveliev mentioned this pull request Feb 12, 2024

Workload read without consumer and metrics fixes #1792

Merged

starlinskiy mentioned this pull request Feb 12, 2024

runtime dispatching #1800

Closed

vitstn mentioned this pull request Feb 12, 2024

quick fix for column name of select version() #1801

Merged

GrigoriyPA mentioned this pull request Feb 12, 2024

YQ 2786 fix test fq restarts #1810

Merged

vitstn mentioned this pull request Feb 12, 2024

Support of database sys cache #1817

Merged

starlinskiy mentioned this pull request Feb 12, 2024

runtime dispatching (fixed) #1847

Merged

serbel324 mentioned this pull request Feb 13, 2024

Improve some headers #1877

Merged

pavelvelikhov mentioned this pull request Feb 13, 2024

Fixed a problem with simplified plan JSONs #1878

Merged

serbel324 mentioned this pull request Feb 13, 2024

Reintroduce test_helpers for ut_blobstorage #1890

Merged

This was referenced Feb 13, 2024

Case insensivity for pg_catalog tables/cluster, columns. Support of pg_class:relam, and some columns in pg_database & pg_namespace #1893

Merged

fixed pg_get_userbyid function #1936

Merged

support of AnyNonArray type, fixes for array_agg #1958

Merged

pavelvelikhov mentioned this pull request Feb 15, 2024

Fixed a problem with plans in PG ut #1974

Merged

niksaveliev mentioned this pull request Feb 16, 2024

Fix kafka with enabled proxy #2017

Merged

vitstn mentioned this pull request Feb 16, 2024

mock of savepoints #2026

Merged

GrigoriyPA mentioned this pull request Feb 26, 2024

YQ-2898 fix query failed with unknown uncommitted upload issue #2240

Merged

[YQL-17174] added spilling library for compute actors #1544

[YQL-17174] added spilling library for compute actors #1544

Uh oh!

Conversation

lll-phill-lll commented Feb 2, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Changelog entry

Changelog category

Additional information

Uh oh!

github-actions bot commented Feb 2, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Feb 2, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Feb 2, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Feb 2, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

github-actions bot commented Feb 5, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Feb 5, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Feb 5, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Feb 5, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Feb 5, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Feb 5, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

github-actions bot commented Feb 5, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Feb 5, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

lll-phill-lll commented Feb 2, 2024 •

edited

Loading

github-actions bot commented Feb 2, 2024 •

edited

Loading

github-actions bot commented Feb 2, 2024 •

edited

Loading

github-actions bot commented Feb 2, 2024 •

edited

Loading

github-actions bot commented Feb 2, 2024 •

edited

Loading

github-actions bot commented Feb 5, 2024 •

edited

Loading

github-actions bot commented Feb 5, 2024 •

edited

Loading

github-actions bot commented Feb 5, 2024 •

edited

Loading

github-actions bot commented Feb 5, 2024 •

edited

Loading

github-actions bot commented Feb 5, 2024 •

edited

Loading

github-actions bot commented Feb 5, 2024 •

edited

Loading

github-actions bot commented Feb 5, 2024 •

edited

Loading

github-actions bot commented Feb 5, 2024 •

edited

Loading