As a web app Superset can already scale pretty well with just worker concurrency. Currently the worker count is left at the default 1000 and the threads are hardcoded to 20.
It would be nice to have this configurable and/or derived from the CPU limit that is set (something like CPU count *4 = number of threads).
As a web app Superset can already scale pretty well with just worker concurrency. Currently the worker count is left at the default 1000 and the threads are hardcoded to 20.
It would be nice to have this configurable and/or derived from the CPU limit that is set (something like CPU count *4 = number of threads).