[KYUUBI #4274] [FOLLOWUP] Increase maximum degree of concurrency for mvnd in CI jobs

### _Why are the changes needed?_

- concurrent execution and smart builder is shipped with `mvnd`, but the CI log shows they are not activated
- increase maximum degree of concurrency and utilize `SmartBuilder` feature in `mvnd`. `-Dmvnd.minThreads` is set as fallback and it will be ignored if `--threads` or `-Dmvnd.threads` is used.

#### Before:
(https://github.com/apache/kyuubi/actions/runs/4276652363/jobs/7444896450#step:6:64)
```
[INFO] Build maximum degree of concurrency is 1
```

#### After:
(https://github.com/apache/kyuubi/actions/runs/4279322563/jobs/7449912132#step:8:64)
```
[INFO] Using the SmartBuilder implementation with a thread count of 4
[INFO] Build maximum degree of concurrency is 4
```
(https://github.com/apache/kyuubi/actions/runs/4279322563/jobs/7449912132#step:8:553)
```
[INFO] Segment walltime 13 s, segment projects service time 36 s, effective/maximum degree of concurrency 2.63/4
```

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [x] [Run test](https://kyuubi.readthedocs.io/en/master/develop_tools/testing.html#running-tests) locally before make a pull request

Closes #4420 from bowenliang123/mvnd-smart.

Closes #4274

64f0cc5 [liangbowen] update
391da26 [liangbowen] quite in dep and style jobs
c776356 [liangbowen] use -Dmvnd.minThreads
d10bfb7 [liangbowen] use -Dmvnd.minThreads
f793d2b [liangbowen] warn
bbb929f [liangbowen] quiet
a5e6d49 [liangbowen] logging warn level
3cfbaad [liangbowen] enable quite option and cancel redirect stderr
09442ff [liangbowen] update
ca5f855 [liangbowen] try to redirect stderr
0ebdd18 [liangbowen] set completion and print MAVEN_CLI_OPTS
d3b2c96 [liangbowen] revert explicitly setting `mvnd.noBuffering`
e2eca01 [liangbowen] revert explicitly setting `mvnd.noBuffering`
dba25e3 [liangbowen] explicitly set `mvnd.noBuffering` to false prevent displaying events continuously
b7583f9 [liangbowen] shell
d60ebd0 [liangbowen] change mvnd cache key
2cc576e [liangbowen] dep
bbd6414 [liangbowen] move multithread setting to mvnd's MAVEN_CLI_OPTS
347b58c [liangbowen] increase concurrency for spotless check
15c5519 [liangbowen] increase concurrency

Authored-by: liangbowen <liangbowen@gf.com.cn>
Signed-off-by: liangbowen <liangbowen@gf.com.cn>

Author: bowenliang123

.github/actions/setup-mvnd/action.yaml

@@ -17,6 +17,7 @@
 
 name: 'setup-mvnd'
 description: 'Setup the maven daemon'
+continue-on-error: true
 runs:
   using: composite
   steps:
@@ -26,7 +27,10 @@ runs:
         path: |
           build/maven-mvnd-*
           build/apache-maven-*
-        key: setup-mvnd-${{ runner.os }}-mvnd
+        key: setup-mvnd-${{ runner.os }}
+    - name: Check Maven
+      run: build/mvn -v
+      shell: bash
     - name: Check Mvnd
       run: build/mvnd -v
       shell: bash

.github/workflows/dep.yml

@@ -50,7 +50,7 @@ jobs:
       - name: Check kyuubi modules available
         id: modules-check
         run: >-
-          build/mvnd dependency:resolve validate
+          build/mvnd dependency:resolve validate -q
           -DincludeGroupIds="org.apache.kyuubi" -DincludeScope="compile"
           -Pfast -Denforcer.skip=false
           -pl kyuubi-ctl,kyuubi-server,kyuubi-assembly -am

.github/workflows/style.yml

@@ -54,7 +54,7 @@ jobs:
           cache: 'pip'
       - name: Check kyuubi modules available
         id: modules-check
-        run: build/mvnd dependency:resolve -DincludeGroupIds="org.apache.kyuubi" -DincludeScope="compile" -DexcludeTransitive=true ${{ matrix.profiles }}
+        run: build/mvnd dependency:resolve -DincludeGroupIds="org.apache.kyuubi" -DincludeScope="compile" -DexcludeTransitive=true -q ${{ matrix.profiles }}
         continue-on-error: true
 
       - name: Install
@@ -69,7 +69,7 @@ jobs:
 
       - name: Scalastyle with maven
         id: scalastyle-check
-        run: build/mvnd scalastyle:check ${{ matrix.profiles }}
+        run: build/mvnd scalastyle:check -q ${{ matrix.profiles }}
       - name: Print scalastyle error report
         if: failure() && steps.scalastyle-check.outcome != 'success'
         run: >-
@@ -83,7 +83,7 @@ jobs:
         run: |
           SPOTLESS_BLACK_VERSION=$(build/mvn help:evaluate -Dexpression=spotless.python.black.version -q -DforceStdout)
           pip install black==$SPOTLESS_BLACK_VERSION
-          build/mvnd spotless:check ${{ matrix.profiles }} -Pspotless-python
+          build/mvnd spotless:check -q ${{ matrix.profiles }} -Pspotless-python
       - name: setup npm
         uses: actions/setup-node@v3
         with:

build/mvnd

@@ -25,7 +25,7 @@ _CALLING_DIR="$(pwd)"
 _COMPILE_JVM_OPTS="-Xms2g -Xmx2g -XX:ReservedCodeCacheSize=1g -Xss128m"
 
 if [ "$CI" ]; then
-  export MAVEN_CLI_OPTS="--no-transfer-progress --errors --fail-fast"
+  export MAVEN_CLI_OPTS="-Dmvnd.minThreads=8 --no-transfer-progress --errors --fail-fast -Dstyle.color=always"
 fi
 
 # Installs any application tarball given a URL, the expected tarball name,
@@ -131,4 +131,9 @@ cd "${_CALLING_DIR}"
 export MAVEN_OPTS=${MAVEN_OPTS:-"$_COMPILE_JVM_OPTS"}
 
 echo "Using \`mvnd\` from path: $MVND_BIN" 1>&2
+
+if [ "$MAVEN_CLI_OPTS" != "" ]; then
+  echo "MAVEN_CLI_OPTS=$MAVEN_CLI_OPTS"
+fi
+
 ${MVND_BIN} $MAVEN_CLI_OPTS "$@"