Official kafka images

[doc-sheet]

Problem Statement

Hello!
Kafka provides official docker images since 3.7.0.

I noticed you use kinda old confluence images (with kafka 3.6) because it used in saas.

Solution Brainstorm

However latest stable kafka is 4.0.0 already.

Would you like to switch to official images at least in github actions for easier upgrade in future?
Or maybe just to test for compatibility with official images.
Maybe even test against both kind of images through action matrix.

I could try to update actions myself in a new PR.

[aldy505]

Would you like to switch to official images at least in github actions for easier upgrade in future?

Probably yes. But it depends on the decision from the infra team. Bear in mind, switching from the confluent/kafka to apache/kafka will be a somewhat breaking change, we need to ensure smooth upgrade with little to no effort.

[doc-sheet]

I switched some time ago, apart from location of scripts (and probably some default paths like logs and conf) there weren't much differences.

e.g.
/usr/bin/kafka-topics -> /opt/kafka/bin/kafka-topics.sh