similar to https://github.com/crawler-commons/crawler-commons/issues/522 We should take care of it in StormCrawler too.