[v24.2.x] avro backwards-compatibility check is too permissive

Backport https://github.com/redpanda-data/redpanda/issues/16649 to branch v24.2.x. Requested by PR https://github.com/redpanda-data/redpanda/pull/24032