[skip ci] Revert "[ci] Default to n=2 for test parallelism (apache#12376)" (apache#12413)

This reverts commit 369e8b2.

There are certain tests that need to be serialized first before this can
merge or else failures like
https://ci.tlcpack.ai/job/tvm/job/main/4040/display/redirect will happen
based on which tests happen to be run together or not

Co-authored-by: driazati <driazati@users.noreply.github.com>

Author: driazati