In 24.1.1 RC1 we are loosing a number of peers once we have finished the initial sync

[pinges]

Description

I will attach the graph

Steps to Reproduce (Bug)

1. Start a node using Jenkins using besu_download_url: https://output.circle-artifacts.com/output/job/47cc784b-6347-4f41-a1bf-b5e3fb0eab89/artifacts/0/distributions/besu-24.1.1-SNAPSHOT.tar.gz
   (rest is default, use any network, like holesky, goerli, etc)
2. Wait until intial sync has finished

Expected behavior: number of peers stays stable when sync finishes

Actual behavior: we are loosing up to 60 of our existing peers

Frequency: we are loosing at least some peers, visible in Grafana