Add concurrent tiering updates to OLAP scenario test #8262

swalrus1 · 2024-08-26T09:47:34Z

add retries in the test to handle failures on nemesis cluster
update many tables on the same store in parallel
add ADD COLUMN, DROP COLUMN workload
validate that eviction occur

github-actions · 2024-08-26T09:48:50Z

⚪ 2024-08-26 09:48:49 UTC Pre-commit check for 4407743 has started.
⚪ 2024-08-26 09:50:58 UTC Check linux-x86_64-release-asan is running...
🔴 2024-08-26 09:51:52 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
11	8	0	3	0	0

🟢 2024-08-26 09:51:59 UTC Build successful.

github-actions · 2024-08-26T09:49:26Z

⚪ 2024-08-26 09:49:26 UTC Pre-commit check for 4407743 has started.
⚪ 2024-08-26 09:51:45 UTC Check linux-x86_64-relwithdebinfo is running...
🟡 2024-08-26 09:52:33 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
13	10	0	3	0	0

⚪ 2024-08-26 09:52:41 UTC Failed tests rerun (try 2) linux-x86_64-relwithdebinfo is running...
🟡 2024-08-26 09:53:01 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
3 (only retried tests)	0	0	3	0	0

⚪ 2024-08-26 09:53:10 UTC Failed tests rerun (try 3) linux-x86_64-relwithdebinfo is running...
🔴 2024-08-26 09:53:30 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
3 (only retried tests)	0	0	3	0	0

🟢 2024-08-26 09:53:39 UTC Build successful.

github-actions · 2024-08-26T09:50:29Z

⚪ 2024-08-26 09:50:28 UTC Pre-commit check for 4407743 has started.
⚪ 2024-08-26 09:52:42 UTC Check linux-x86_64-release-clang14 is running...
🟢 2024-08-26 09:53:13 UTC Build successful.

github-actions · 2024-08-27T08:22:23Z

⚪ 2024-08-27 08:22:22 UTC Pre-commit check for cd822da has started.
⚪ 2024-08-27 08:24:39 UTC Check linux-x86_64-release-asan is running...
🟢 2024-08-27 08:25:14 UTC Tests successful.

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
11	11	0	0	0	0

🟢 2024-08-27 08:25:21 UTC Build successful.

github-actions · 2024-08-27T08:22:28Z

⚪ 2024-08-27 08:22:27 UTC Pre-commit check for cd822da has started.
⚪ 2024-08-27 08:24:43 UTC Check linux-x86_64-release-clang14 is running...
🟢 2024-08-27 08:25:17 UTC Build successful.

github-actions · 2024-08-27T08:23:08Z

⚪ 2024-08-27 08:23:07 UTC Pre-commit check for cd822da has started.
⚪ 2024-08-27 08:25:28 UTC Check linux-x86_64-relwithdebinfo is running...
🟢 2024-08-27 08:26:08 UTC Tests successful.

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
13	13	0	0	0	0

🟢 2024-08-27 08:26:15 UTC Build successful.

github-actions · 2024-08-27T09:30:04Z

⚪ 2024-08-27 09:30:04 UTC Pre-commit check for 8eb22e7 has started.
⚪ 2024-08-27 09:32:23 UTC Check linux-x86_64-release-clang14 is running...
🟢 2024-08-27 09:33:00 UTC Build successful.

github-actions · 2024-08-27T09:30:30Z

⚪ 2024-08-27 09:30:29 UTC Pre-commit check for 8eb22e7 has started.
⚪ 2024-08-27 09:32:44 UTC Check linux-x86_64-release-asan is running...
🔴 2024-08-27 09:33:28 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
11	10	0	1	0	0

🟢 2024-08-27 09:33:35 UTC Build successful.

github-actions · 2024-08-27T09:32:24Z

⚪ 2024-08-27 09:32:23 UTC Pre-commit check for 8eb22e7 has started.
⚪ 2024-08-27 09:34:41 UTC Check linux-x86_64-relwithdebinfo is running...
🟡 2024-08-27 09:35:28 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
13	12	0	1	0	0

⚪ 2024-08-27 09:35:35 UTC Failed tests rerun (try 2) linux-x86_64-relwithdebinfo is running...
🟡 2024-08-27 09:35:55 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
1 (only retried tests)	0	0	1	0	0

⚪ 2024-08-27 09:36:02 UTC Failed tests rerun (try 3) linux-x86_64-relwithdebinfo is running...
🔴 2024-08-27 09:36:27 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
1 (only retried tests)	0	0	1	0	0

🟢 2024-08-27 09:36:34 UTC Build successful.

github-actions · 2024-08-27T11:19:52Z

⚪ 2024-08-27 11:19:51 UTC Pre-commit check for 4f90373 has started.
⚪ 2024-08-27 11:23:04 UTC Check linux-x86_64-release-asan is running...
🟢 2024-08-27 11:23:39 UTC Tests successful.

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
11	11	0	0	0	0

🟢 2024-08-27 11:23:46 UTC Build successful.

github-actions · 2024-08-27T11:22:02Z

⚪ 2024-08-27 11:22:01 UTC Pre-commit check for 4f90373 has started.
⚪ 2024-08-27 11:24:18 UTC Check linux-x86_64-relwithdebinfo is running...
🟢 2024-08-27 11:24:56 UTC Tests successful.

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
13	13	0	0	0	0

🟢 2024-08-27 11:25:03 UTC Build successful.

github-actions · 2024-08-27T11:22:14Z

⚪ 2024-08-27 11:22:14 UTC Pre-commit check for 4f90373 has started.
⚪ 2024-08-27 11:24:35 UTC Check linux-x86_64-release-clang14 is running...
🟢 2024-08-27 11:25:10 UTC Build successful.

github-actions · 2024-08-27T11:30:57Z

⚪ 2024-08-27 11:30:57 UTC Pre-commit check for f3b5a56 has started.
⚪ 2024-08-27 11:34:20 UTC Check linux-x86_64-relwithdebinfo is running...
🟢 2024-08-27 11:35:04 UTC Tests successful.

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
13	13	0	0	0	0

🟢 2024-08-27 11:35:11 UTC Build successful.

github-actions · 2024-08-27T11:31:25Z

⚪ 2024-08-27 11:31:24 UTC Pre-commit check for f3b5a56 has started.
⚪ 2024-08-27 11:34:53 UTC Check linux-x86_64-release-clang14 is running...
🟢 2024-08-27 11:35:31 UTC Build successful.

github-actions · 2024-08-27T11:38:41Z

⚪ 2024-08-27 11:38:40 UTC Pre-commit check for f3b5a56 has started.
⚪ 2024-08-27 11:42:07 UTC Check linux-x86_64-release-asan is running...
🟢 2024-08-27 11:42:45 UTC Tests successful.

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
11	11	0	0	0	0

🟢 2024-08-27 11:42:52 UTC Build successful.

iddqdex · 2024-08-27T11:39:50Z

ydb/tests/olap/scenario/helpers/scenario_tests_helper.py

@@ -524,6 +550,22 @@ def get_table_rows_count(self, tablename: str, comment: str = '') -> int:
            result_set = self.execute_scan_query(f'SELECT count(*) FROM `{self.get_full_path(tablename)}`')
            return result_set.result_set.rows[0][0]

+    @allure.step('Describe table {path}')
+    def describe_table(self, path: str, settings: ydb.DescribeTableSettings = None) -> List[ydb.SchemeEntry]:


А почему лист? Для одной таблички же один результат

Здесь вообще должен быть другой тип -- я забыл поменять) Исправил, спасибо

github-actions · 2024-08-27T11:50:30Z

⚪ 2024-08-27 11:50:30 UTC Pre-commit check for 84ee747 has started.
⚪ 2024-08-27 11:52:40 UTC Check linux-x86_64-release-clang14 is running...
🟢 2024-08-27 11:53:14 UTC Build successful.

github-actions · 2024-08-27T11:52:38Z

⚪ 2024-08-27 11:52:38 UTC Pre-commit check for 84ee747 has started.
⚪ 2024-08-27 11:56:02 UTC Check linux-x86_64-release-asan is running...
🟢 2024-08-27 11:56:41 UTC Tests successful.

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
11	11	0	0	0	0

🟢 2024-08-27 11:56:48 UTC Build successful.

github-actions · 2024-08-27T11:54:20Z

⚪ 2024-08-27 11:54:19 UTC Pre-commit check for 84ee747 has started.
⚪ 2024-08-27 11:56:30 UTC Check linux-x86_64-relwithdebinfo is running...
🟢 2024-08-27 11:57:07 UTC Tests successful.

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
13	13	0	0	0	0

🟢 2024-08-27 11:57:14 UTC Build successful.

update test

c89db51

swalrus1 mentioned this pull request Aug 26, 2024

"Too many open files" error on tiering in Column shard #8257

Open

swalrus1 added 2 commits August 27, 2024 07:46

improve test

1c36ccf

fix format

cd54408

add retries

daf17b2

swalrus1 added 2 commits August 27, 2024 11:14

fix test on nemesis cluster

f178047

fix format

423caa5

clean up

3235d23

swalrus1 marked this pull request as ready for review August 27, 2024 11:26

iddqdex requested changes Aug 27, 2024

View reviewed changes

post-review

86ce33c

iddqdex approved these changes Aug 27, 2024

View reviewed changes

swalrus1 enabled auto-merge (squash) August 27, 2024 11:50

swalrus1 linked an issue Aug 27, 2024 that may be closed by this pull request

Test altering tiering rules #5668

Closed

swalrus1 merged commit 1c09c5d into ydb-platform:main Aug 27, 2024
12 checks passed

swalrus1 deleted the scenario-test-tiering-add-concurrent-alter-tiering branch August 27, 2024 11:59

rekby pushed a commit to rekby-forks/ydb that referenced this pull request Aug 28, 2024

Add concurrent tiering updates to OLAP scenario test (ydb-platform#8262)

3feef5b

niksaveliev mentioned this pull request Aug 29, 2024

Fix pqv1 max partitions #8485

Merged

This was referenced Aug 30, 2024

fix json map conversion in http proxy #8508

Merged

LOGBROKER 8891 fix not using optional fields in sqs json api properly #8523

Merged

stanislav-shchetinin pushed a commit to stanislav-shchetinin/ydb that referenced this pull request Aug 30, 2024

Add concurrent tiering updates to OLAP scenario test (ydb-platform#8262)

6cb123e

siarheivesialou mentioned this pull request Sep 4, 2024

fix memory leak in ymq proxy #8706

Merged

This was referenced Sep 9, 2024

Fix CLI max partitions default #8944

Merged

Fix reading without consumer from federation #9136

Merged

zverevgeny mentioned this pull request Sep 16, 2024

Integrate latest changes in CS into stable branch #9271

Closed

This was referenced Sep 17, 2024

doc hc api images source #9376

Merged

add viewer query script handlers #9423

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add concurrent tiering updates to OLAP scenario test #8262

Add concurrent tiering updates to OLAP scenario test #8262

swalrus1 commented Aug 26, 2024 •

edited

Loading

github-actions bot commented Aug 26, 2024 •

edited

Loading

github-actions bot commented Aug 26, 2024 •

edited

Loading

github-actions bot commented Aug 26, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

iddqdex Aug 27, 2024

swalrus1 Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

Add concurrent tiering updates to OLAP scenario test #8262

Add concurrent tiering updates to OLAP scenario test #8262

Conversation

swalrus1 commented Aug 26, 2024 • edited Loading

github-actions bot commented Aug 26, 2024 • edited Loading

github-actions bot commented Aug 26, 2024 • edited Loading

github-actions bot commented Aug 26, 2024 • edited Loading

github-actions bot commented Aug 27, 2024 • edited Loading

github-actions bot commented Aug 27, 2024 • edited Loading

github-actions bot commented Aug 27, 2024 • edited Loading

github-actions bot commented Aug 27, 2024 • edited Loading

github-actions bot commented Aug 27, 2024 • edited Loading

github-actions bot commented Aug 27, 2024 • edited Loading

github-actions bot commented Aug 27, 2024 • edited Loading

github-actions bot commented Aug 27, 2024 • edited Loading

github-actions bot commented Aug 27, 2024 • edited Loading

github-actions bot commented Aug 27, 2024 • edited Loading

github-actions bot commented Aug 27, 2024 • edited Loading

github-actions bot commented Aug 27, 2024 • edited Loading

iddqdex Aug 27, 2024

Choose a reason for hiding this comment

swalrus1 Aug 27, 2024 • edited Loading

Choose a reason for hiding this comment

github-actions bot commented Aug 27, 2024 • edited Loading

github-actions bot commented Aug 27, 2024 • edited Loading

github-actions bot commented Aug 27, 2024 • edited Loading

swalrus1 commented Aug 26, 2024 •

edited

Loading

github-actions bot commented Aug 26, 2024 •

edited

Loading

github-actions bot commented Aug 26, 2024 •

edited

Loading

github-actions bot commented Aug 26, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

swalrus1 Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading

github-actions bot commented Aug 27, 2024 •

edited

Loading