Kafka example doesn't work

[lkyuchukov]

Preflight checklist

• I could not find a solution in the existing issues, docs, nor discussions.
• I agree to follow this project's Code of Conduct.
• I have read and am following this repository's Contribution Guidelines.
• This issue affects my Ory Network project.
• I have joined the Ory Community Slack.
• I am signed up to the Ory Security Patch Newsletter.

Describe the bug

The Kafka example doesn't work and does not terminate containers.

Reproducing the bug

1. Copy the Kafka example from the examples dir
2. Run it

Relevant log output

2022/10/29 14:44:53 connected to 127.0.0.1:55032
2022/10/29 14:44:53 authentication failed: EOF
2022/10/29 14:44:54 connected to 127.0.0.1:55032
2022/10/29 14:44:54 authentication failed: EOF
2022/10/29 14:44:55 connected to 127.0.0.1:55032
2022/10/29 14:44:55 authenticated: id=109251388718055424, timeout=10000
2022/10/29 14:44:55 re-submitting `0` credentials after reconnect
%6|1667043896.618|FAIL|rdkafka#producer-1| [thrd:localhost:9093/bootstrap]: localhost:9093/bootstrap: Disconnected while requesting ApiVersion: might be caused by incorrect security.protocol configuration (connecting to a SSL listener?) or broker version is < 0.10 (see api.version.request) (after 1ms in state APIVERSION_QUERY)
%6|1667043896.803|FAIL|rdkafka#producer-1| [thrd:localhost:9093/bootstrap]: localhost:9093/bootstrap: Disconnected while requesting ApiVersion: might be caused by incorrect security.protocol configuration (connecting to a SSL listener?) or broker version is < 0.10 (see api.version.request) (after 1ms in state APIVERSION_QUERY, 1 identical error(s) suppressed)
%6|1667043933.044|FAIL|rdkafka#producer-1| [thrd:localhost:9093/bootstrap]: localhost:9093/bootstrap: Disconnected while requesting ApiVersion: might be caused by incorrect security.protocol configuration (connecting to a SSL listener?) or broker version is < 0.10 (see api.version.request) (after 2ms in state APIVERSION_QUERY, 6 identical error(s) suppressed)

Relevant configuration

No response

Version

latest

On which operating system are you observing this issue?

macOS

In which environment are you deploying?

Docker

Additional Context

I am running go1.19.2 on M1 mac with macOS Monterey

[antonprokopovich]

Faced the same issue today while running kafka tests with dockertest and using the same kafka/zookeeper configuration as in the mentioned example

[jerroldgao]

Face the same issue

[jarri-abidi]

it's just faster/less-resource-intensive to use redpanda as a drop-in replacement for kafka in tests.

[2beens]

The issue still happens (in both Ubuntu and MacOS), any progress/hints/suggestions here? 🍻
I assume this is not an issue with dockertest per se, but the configuration of zookeeper and/or the broker, and thus can be solved by kafka gurus most likely.