httpd stops server after second attempt to connect to AP

[hqawasmi]

Description

we have an error when we try to connect to AP to configure a new home network

Steps to Reproduce

1- connect to AP and open on browser 10.10.0.1
2- chose the home network and connect to it
3- turn off the router , to have the disconnected reason 201 , max retries in skconfig , make little to re produce it faster
4- when retries finished , it start AP again
5- step one again , it will be esp will in panic and restart

System Configuration

ESP-IDF v4.2
toolchain 2020r3

• Environment (Operating system, version and so on):
  Ubuntu

[hqawasmi]

I think this is similar to the issue but didn't help espressif/esp-idf#3851 (comment)