TST/CI: Reduce number of unnecessary numba tests in groupby ops#42237

jreback merged 1 commit intopandas-dev:masterpandas-dev/pandas:masterfrom

mroeschke:testing/numba_groupbymroeschke/pandas:testing/numba_groupbyCopy head branch name to clipboard