[v24.1.x] CORE-7000: Node ID/UUID Override

[vbotbuildovich]

Backport #22972 to branch v24.1.x. Note that this issue was created as a placeholder, since the original PR's commit(s) could not be automatically cherry-picked.
Here are the commands to execute:

git checkout v24.1.x
git checkout -b vbotbuildovich/backport-22972-v24.1.x-514
git cherry-pick -x 9cfd280e986fe256d570e5e486b8c54205315a1c dddbe3ec7e3c5d9494dafca6ea5ad896d439b21c 4d573fab182d4768301724bbbdbfd2a66d7c71de d2b85f2d76e7d1aae21da3a817e76af497d3d678 c96f4ae5c08aad29d95f0be3126dc9fb2066976d 951cc773482cd13fce834207dfdf9e7c8e59a9cc afe076ddbdfe0e25665956e25ab9634120310b66 ace0d611d44a313005ba6f56b565087e7c23aad9

git push origin vbotbuildovich/backport-22972-v24.1.x-514
gh pr create \
  --title "[v24.1.x] CORE-7000: Node ID/UUID Override" \
  --base "v24.1.x" \
  --label "kind/backport" \
  --head "vbotbuildovich/backport-22972-v24.1.x-514" \
  --draft \
  --repo "redpanda-data/redpanda" \
  --milestone "v24.1.x-next" \
  --body "Backport of PR https://github.com/redpanda-data/redpanda/pull/22972 "

JIRA Link: [CORE-7671](https://redpandadata.atlassian.net/browse/CORE-7671)

[oleiman]

closed by #23412