Skip to content

YQ-2670 switch generic tests to docker compose #691

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

GrigoriyPA
Copy link
Collaborator

No description provided.

Sleep(TDuration::Seconds(5));
}
}

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Я бы сказал, что для PG тоже нужны ретраи. Во всяком, случае, я наблюдаю такую же проблему в своих тестах на generic provider

Copy link

github-actions bot commented Dec 25, 2023

Note

This is an automated comment that will be appended during run.

🔴 linux-x86_64-release-asan: some tests FAILED for commit 9db6d12.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
15611 15467 0 24 99 21

🔴 linux-x86_64-relwithdebinfo: some tests FAILED for commit 9db6d12.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
59394 50216 0 11 9139 28

}

ui32 GetChPort() {
return FromString<ui32>(GetEnv("RECIPE_CLICKHOUSE_NATIVE_PORT", "1234"));
return 19000;
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why the port is hardcoded? What will happen if several tests that use recipe will be started at the same time?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What will happen if several tests that use recipe will be started at the same time?

We intentionally disable local parallel runs (avoid FORK_SUBTESTS and so on) of tests based on docker-compose recipe because they look broken in ya. For more details, see link in TG channel :)

return pqxx::connection{connectionString};
} catch (const pqxx::broken_connection& e) {
Cerr << "Attempt " << attempt << ": " << e.what() << Endl;
Sleep(TDuration::Seconds(5));
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The same issues as for clickhouse

@@ -0,0 +1,25 @@
version: '3.4'
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We already have a configured file here: https://github.com/ydb-platform/ydb/blob/main/ydb/library/yql/providers/generic/connector/tests/docker-compose.yml

Let's make a reusable recipe from it and use it in both places

The example of making a recipe: https://github.com/ydb-platform/ydb/tree/main/ydb/tests/tools/s3_recipe

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We already have a configured file here: https://github.com/ydb-platform/ydb/blob/main/ydb/library/yql/providers/generic/connector/tests/docker-compose.yml

Let's make a reusable recipe from it and use it in both places

This docker-compose.yml will highly likely split into several parts soon (integration tests will be separated into different directories as well). I'm afraid this will make it impossible to reuse this file in both kinds of tests.

@vitalyisaev2 vitalyisaev2 merged commit d4ad98f into ydb-platform:main Dec 26, 2023
@jepett0 jepett0 mentioned this pull request Dec 28, 2023
@StekPerepolnen StekPerepolnen mentioned this pull request Dec 29, 2023
Closed
adameat pushed a commit to adameat/ydb that referenced this pull request Dec 29, 2023
* Switched KQP generic provider tests to docker-compose

* Fixed retries
This was referenced Jan 3, 2024
This was referenced Jan 11, 2024
@vitstn vitstn mentioned this pull request Feb 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants