When testing DHCP w/ LwM2M client sample which sets CONFIG_NET_APP_MY_IPV4_ADDR="192.0.2.1" to work with QEMU by default, it was noticed that bind was happening on 192.0.2.1 and incoming packets on the DHCP address were being ignored.
We need to rebind anytime IP changes to avoid this.