Threaded runtime performance

[lhstrh]

We have use cases where unthreaded code still outperforms the threaded code by a considerable margin. We should reduce this gap. If the gap is small enough, we should consider make theaded execution the default, and the number of workers match the number of cores, as is done in the C++ runtime.