Skip to content

Conversation

@rekby
Copy link
Member

@rekby rekby commented Nov 22, 2024

#11005

  • init kafka support
  • add kafka port without tls

Changelog entry

Allow to enable and kafka api port for ydb-local docker image

Changelog category

  • Improvement

Additional information

...

@github-actions
Copy link

github-actions bot commented Nov 22, 2024

2024-11-22 14:33:13 UTC Pre-commit check linux-x86_64-release-asan for ddd46fe has started.
2024-11-22 14:33:24 UTC Artifacts will be uploaded here
2024-11-22 14:33:51 UTC Check cancelled

@github-actions
Copy link

github-actions bot commented Nov 22, 2024

2024-11-22 14:33:14 UTC Pre-commit check linux-x86_64-relwithdebinfo for ddd46fe has started.
2024-11-22 14:33:25 UTC Artifacts will be uploaded here
2024-11-22 14:33:51 UTC Check cancelled

@github-actions
Copy link

github-actions bot commented Nov 22, 2024

2024-11-22 14:38:21 UTC Pre-commit check linux-x86_64-release-asan for 4173cce has started.
2024-11-22 14:38:24 UTC Artifacts will be uploaded here
2024-11-22 14:41:14 UTC ya make is running...
2024-11-22 14:42:42 UTC Check cancelled

@github-actions
Copy link

github-actions bot commented Nov 22, 2024

2024-11-22 14:38:24 UTC Pre-commit check linux-x86_64-relwithdebinfo for 4173cce has started.
2024-11-22 14:38:28 UTC Artifacts will be uploaded here
2024-11-22 14:41:31 UTC ya make is running...
2024-11-22 14:42:45 UTC Check cancelled

@github-actions
Copy link

✅ Documentation build

Revision built successfully
Revision preview link

@rekby rekby force-pushed the 11005-local-kafka-api branch from 47a30db to c9399b1 Compare November 22, 2024 14:42
@github-actions
Copy link

github-actions bot commented Nov 22, 2024

2024-11-22 14:48:30 UTC Pre-commit check linux-x86_64-relwithdebinfo for 999ed05 has started.
2024-11-22 14:48:41 UTC Artifacts will be uploaded here
2024-11-22 14:51:12 UTC ya make is running...
🟡 2024-11-22 15:18:53 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
3952 3841 0 2 36 73

2024-11-22 15:19:20 UTC ya make is running... (failed tests rerun, try 2)
🟡 2024-11-22 15:22:42 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
75 (only retried tests) 1 0 2 0 72

2024-11-22 15:22:50 UTC ya make is running... (failed tests rerun, try 3)
🔴 2024-11-22 15:26:16 UTC Some tests failed, follow the links below.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
74 (only retried tests) 0 0 2 0 72

🟢 2024-11-22 15:26:22 UTC Build successful.
🟡 2024-11-22 15:26:33 UTC ydbd size 2.5 GiB changed* by +286.7 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 0d355e6 merge: 999ed05 diff diff %
ydbd size 2 691 446 096 Bytes 2 691 739 688 Bytes +286.7 KiB +0.011%
ydbd stripped size 482 135 088 Bytes 482 183 088 Bytes +46.9 KiB +0.010%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link

github-actions bot commented Nov 22, 2024

2024-11-22 14:48:30 UTC Pre-commit check linux-x86_64-release-asan for 999ed05 has started.
2024-11-22 14:48:42 UTC Artifacts will be uploaded here
2024-11-22 14:51:19 UTC ya make is running...
🟡 2024-11-22 15:20:08 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
1542 1523 0 5 9 5

🟢 2024-11-22 15:20:20 UTC Build successful.
🟢 2024-11-22 15:20:35 UTC ydbd size 4.9 GiB changed* by +888 Bytes, which is < 100.0 KiB vs main: OK

ydbd size dash main: fb228ee merge: 999ed05 diff diff %
ydbd size 5 285 187 664 Bytes 5 285 188 552 Bytes +888 Bytes +0.000%
ydbd stripped size 1 359 579 888 Bytes 1 359 580 144 Bytes +256 Bytes +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link

github-actions bot commented Nov 25, 2024

2024-11-25 07:29:31 UTC Pre-commit check linux-x86_64-release-asan for 6a0c211 has started.
2024-11-25 07:29:42 UTC Artifacts will be uploaded here
2024-11-25 07:32:13 UTC ya make is running...
🟡 2024-11-25 07:58:45 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
1543 1526 0 6 7 4

🟢 2024-11-25 07:58:58 UTC Build successful.
🟢 2024-11-25 07:59:13 UTC ydbd size 4.9 GiB changed* by -96 Bytes, which is <= 0 Bytes vs main: OK

ydbd size dash main: d07a485 merge: 6a0c211 diff diff %
ydbd size 5 284 305 816 Bytes 5 284 305 720 Bytes -96 Bytes -0.000%
ydbd stripped size 1 359 965 552 Bytes 1 359 965 488 Bytes -64 Bytes -0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link

github-actions bot commented Nov 25, 2024

2024-11-25 07:29:35 UTC Pre-commit check linux-x86_64-relwithdebinfo for 6a0c211 has started.
2024-11-25 07:29:47 UTC Artifacts will be uploaded here
2024-11-25 07:32:26 UTC ya make is running...
🟡 2024-11-25 08:00:44 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
3953 3840 0 2 36 75

2024-11-25 08:01:08 UTC ya make is running... (failed tests rerun, try 2)
🟡 2024-11-25 08:04:33 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
76 (only retried tests) 1 0 2 0 73

2024-11-25 08:04:41 UTC ya make is running... (failed tests rerun, try 3)
🔴 2024-11-25 08:08:09 UTC Some tests failed, follow the links below.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
75 (only retried tests) 0 0 2 0 73

🟢 2024-11-25 08:08:15 UTC Build successful.
🟢 2024-11-25 08:08:27 UTC ydbd size 2.5 GiB changed* by 0 Bytes, which is <= 0 Bytes vs main: OK

ydbd size dash main: d07a485 merge: 6a0c211 diff diff %
ydbd size 2 690 049 400 Bytes 2 690 049 400 Bytes 0 Bytes 0.000%
ydbd stripped size 482 184 656 Bytes 482 184 656 Bytes 0 Bytes 0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link

✅ Documentation build

Revision built successfully
Revision preview link

@github-actions
Copy link

github-actions bot commented Nov 25, 2024

2024-11-25 10:18:59 UTC Pre-commit check linux-x86_64-relwithdebinfo for 490b221 has started.
2024-11-25 10:19:33 UTC Artifacts will be uploaded here
2024-11-25 10:22:49 UTC ya make is running...
🟢 2024-11-25 10:51:08 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
3955 3844 0 0 36 75

🟢 2024-11-25 10:51:30 UTC Build successful.
🟢 2024-11-25 10:51:42 UTC ydbd size 2.5 GiB changed* by +4.3 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 38572a8 merge: 490b221 diff diff %
ydbd size 2 690 049 216 Bytes 2 690 053 656 Bytes +4.3 KiB +0.000%
ydbd stripped size 482 184 656 Bytes 482 185 488 Bytes +832 Bytes +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link

github-actions bot commented Nov 25, 2024

2024-11-25 10:19:12 UTC Pre-commit check linux-x86_64-release-asan for 490b221 has started.
2024-11-25 10:19:25 UTC Artifacts will be uploaded here
2024-11-25 10:21:54 UTC ya make is running...
🟡 2024-11-25 10:48:46 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
1541 1523 0 5 8 5

🟢 2024-11-25 10:49:04 UTC Build successful.
🟢 2024-11-25 10:49:19 UTC ydbd size 4.9 GiB changed* by +13.5 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 8f553e4 merge: 490b221 diff diff %
ydbd size 5 284 305 560 Bytes 5 284 319 408 Bytes +13.5 KiB +0.000%
ydbd stripped size 1 359 965 488 Bytes 1 359 968 496 Bytes +2.9 KiB +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@rekby rekby marked this pull request as ready for review November 25, 2024 10:55
if 'YDB_EXPERIMENTAL_PG' in os.environ:
optionals['pg_compatible_expirement'] = True

if os.environ.get('YDB_KAFKA_API_ENABLED', "0") == "1":
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Чет у вас имхо какие-то проблемы

YDB_HARD_MEMORY_LIMIT_BYTES -- вот тут например для включения надо "просто чтобы была переменная окружения"
YDB_ENABLE_COLUMN_TABLES -- вот тут нужно чтобы "переменная окружения была true"
YDB_KAFKA_API_ENABLED -- вот тут нужно чтобы "переменная окружения была 1"

Я подозреваю, что у всех переменных ноги растут из того же места, если это так, можно ли с этим что-то сделать?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Но если с точки зрения докер контейнера (это же для него делается?) все консистентно, то в рамках текущего ПР можно и забить

@github-actions
Copy link

github-actions bot commented Nov 29, 2024

2024-11-29 11:45:07 UTC Pre-commit check linux-x86_64-relwithdebinfo for 1b03ad9 has started.
2024-11-29 11:45:18 UTC Artifacts will be uploaded here
2024-11-29 11:47:51 UTC ya make is running...
🟢 2024-11-29 12:16:09 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
5017 4905 0 0 36 76

🟢 2024-11-29 12:16:37 UTC Build successful.
🟢 2024-11-29 12:16:48 UTC ydbd size 2.5 GiB changed* by +976 Bytes, which is < 100.0 KiB vs main: OK

ydbd size dash main: b03bee3 merge: 1b03ad9 diff diff %
ydbd size 2 687 159 272 Bytes 2 687 160 248 Bytes +976 Bytes +0.000%
ydbd stripped size 482 300 496 Bytes 482 300 944 Bytes +448 Bytes +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation



def _is_true_string(s):
if s is None:
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Предлагаю не писать так код: лучше когда s имеет определенный тип, а не не пойми что (NoneType или string)

Предлагаю убрать это условие, оно не нужно

@github-actions
Copy link

github-actions bot commented Nov 29, 2024

2024-11-29 11:46:17 UTC Pre-commit check linux-x86_64-release-asan for 1b03ad9 has started.
2024-11-29 11:46:29 UTC Artifacts will be uploaded here
2024-11-29 11:49:01 UTC ya make is running...
🟡 2024-11-29 12:18:54 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
2185 2170 0 4 7 4

🟢 2024-11-29 12:19:09 UTC Build successful.
🟢 2024-11-29 12:19:23 UTC ydbd size 4.9 GiB changed* by +1.0 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 38aef7d merge: 1b03ad9 diff diff %
ydbd size 5 281 729 264 Bytes 5 281 730 320 Bytes +1.0 KiB +0.000%
ydbd stripped size 1 361 445 552 Bytes 1 361 445 936 Bytes +384 Bytes +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

return False

s = s.lower()
return s in ['1', 'true', 'yes']
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Можно еще on добавить как мне кажется

@github-actions
Copy link

github-actions bot commented Dec 2, 2024

2024-12-02 08:27:52 UTC Pre-commit check linux-x86_64-release-asan for 4d75a84 has started.
2024-12-02 08:28:19 UTC Artifacts will be uploaded here
2024-12-02 08:30:31 UTC Check cancelled

@github-actions
Copy link

github-actions bot commented Dec 2, 2024

2024-12-02 08:29:58 UTC Pre-commit check linux-x86_64-relwithdebinfo for 4d75a84 has started.
2024-12-02 08:30:10 UTC Artifacts will be uploaded here
2024-12-02 08:30:31 UTC Check cancelled

@github-actions
Copy link

github-actions bot commented Dec 2, 2024

2024-12-02 08:31:53 UTC Pre-commit check linux-x86_64-relwithdebinfo for 40518ae has started.
2024-12-02 08:31:57 UTC Artifacts will be uploaded here
2024-12-02 08:34:31 UTC ya make is running...
🟢 2024-12-02 09:01:24 UTC Tests successful.

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
5017 4905 0 0 36 76

🟢 2024-12-02 09:01:54 UTC Build successful.
🟢 2024-12-02 09:02:04 UTC ydbd size 2.5 GiB changed* by 0 Bytes, which is <= 0 Bytes vs main: OK

ydbd size dash main: 9bef86a merge: 40518ae diff diff %
ydbd size 2 691 439 344 Bytes 2 691 439 344 Bytes 0 Bytes 0.000%
ydbd stripped size 483 344 080 Bytes 483 344 080 Bytes 0 Bytes 0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@robot-magpie
Copy link

robot-magpie bot commented Dec 2, 2024

@maximyurchuk has triggered the import of a pull request, but it hasn't started. If you are a Yandex employee, you can view the log.

@github-actions
Copy link

github-actions bot commented Dec 2, 2024

2024-12-02 08:34:30 UTC Pre-commit check linux-x86_64-release-asan for 40518ae has started.
2024-12-02 08:34:42 UTC Artifacts will be uploaded here
2024-12-02 08:37:14 UTC ya make is running...
🟡 2024-12-02 09:03:59 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
2185 2169 0 6 6 4

🟢 2024-12-02 09:04:15 UTC Build successful.
🟢 2024-12-02 09:04:30 UTC ydbd size 4.9 GiB changed* by -96 Bytes, which is <= 0 Bytes vs main: OK

ydbd size dash main: 9bef86a merge: 40518ae diff diff %
ydbd size 5 290 521 624 Bytes 5 290 521 528 Bytes -96 Bytes -0.000%
ydbd stripped size 1 364 839 376 Bytes 1 364 839 312 Bytes -64 Bytes -0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@rekby rekby enabled auto-merge (squash) December 2, 2024 08:44
@rekby rekby merged commit fbd9ae2 into ydb-platform:main Dec 2, 2024
10 checks passed
@rekby rekby deleted the 11005-local-kafka-api branch December 3, 2024 08:12
@github-actions
Copy link

github-actions bot commented Jun 3, 2025

🟢 2025-06-03 10:01:54 UTC The validation of the Pull Request description is successful.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants