Right now, the image caption is part of the image block. It would be nice if the caption was a specialized inner block similar to list items so that it could have block styles registered on it. This might also make it easier to address #19975.

Edit: It looks like this was already tried in a PR, but that PR has no associated issue.