tls: handle cases where the raw socket is destroyed

tls: handle cases where the raw socket is destroyed #7173