Reloading configs in session mode seems to keep the old pool dangling until clients disconnect

To reproduce
Using session mode, open a bunch of client connections, have them be in idle state and then trigger a reload and then try to use the old client connections. 

We encountered checkout failure on clients using the old pools from before the reload even though a new pool should be available.