8274-mitigate-gpu-load-check

[yiheng-wang-nv]

Fixes #8274 .

Description

I tried to use A100 with same container to test, but could not reproduce the issue. Therefore, I think here we can do a bit change on the test, and if there are still same issues, I will try to check more.

Types of changes

• Non-breaking change (fix or new feature that would not break existing functionality).
• Breaking change (fix or new feature that would cause existing functionality to change).
• New tests added to cover the changes.
• Integration tests passed locally by running ./runtests.sh -f -u --net --coverage.
• Quick tests passed locally by running ./runtests.sh --quick --unittests --disttests.
• In-line docstrings updated.
• Documentation updated, tested make html command in the docs/ folder.

[KumoLiu]

/build