Fix flaky rpc timeout test #3535

Job	Run time
test-latest-deps	11m 6s
build-lint-test (3.9, ubuntu-latest)	17m 35s
build-lint-test (3.9, windows-latest)	14m 55s
build-lint-test (3.9, macos-arm)	9m 10s
build-lint-test (3.9, ubuntu-arm)	10m 17s
build-lint-test (3.13, ubuntu-latest)	20m 29s
build-lint-test (3.13, windows-latest)	21m 26s
build-lint-test (3.9, macos-intel)	20m 25s
features-tests / test	8m 16s
build-lint-test (3.13, ubuntu-arm)	11m 35s
build-lint-test (3.13, macos-arm)	9m 47s
build-lint-test (3.13, macos-intel)	25m 36s
test-latest-deps	11m 6s
build-lint-test (3.9, ubuntu-arm)	10m 17s
build-lint-test (3.13, ubuntu-latest)	20m 29s
build-lint-test (3.9, ubuntu-latest)	17m 21s
build-lint-test (3.13, macos-intel)	25m 36s
build-lint-test (3.9, macos-arm)	9m 10s
build-lint-test (3.13, macos-arm)	9m 47s
features-tests / test	8m 16s
build-lint-test (3.9, macos-intel)	20m 25s
build-lint-test (3.9, windows-latest)	14m 55s
build-lint-test (3.13, ubuntu-arm)	11m 35s
build-lint-test (3.13, windows-latest)	21m 26s
	6h 1m 0s

Provide feedback