[BUG] Debug flyteadmin memory spikes #2324
Description
Describe the bug
In certain scenarios, highly parallelized dynamic tasks reporting node execution events lead to huge memory spikes in flyteadmin. We should debug the source of this and fix it.
Expected behavior
Flyteadmin memory consumption should not spike like crazy during the process of workflow execution and associated event updates.
Additional context to reproduce
No response
Screenshots
No response
Are you sure this issue hasn't been raised already?
- Yes
Have you read the Code of Conduct?
- Yes