The error of region not found is not properly convert to response

[rleungx]

Bug Report

What did you do?

Run br/lightning tests

What did you expect to see?

Test passed

What did you see instead?

[2023/10/19 07:33:38.050 +00:00] [WARN] [localhelper.go:487] ["wait for scatter region encountered non-retryable error"] [region="{ID=253,startKey=7480000000000000FF6B00000000000000F8,endKey=7480000000000000FF6D00000000000000F8,epoch=\"conf_ver:5 version:63 \",peers=\"id:254 store_id:1 ,id:255 store_id:12 ,id:256 store_id:14 \"}"] [error="failed to get region operator, error type: UNKNOWN, error message: Not Found"] [errorVerbose="failed to get region operator, error type: UNKNOWN, error message: Not Found\ngithub.com/pingcap/tidb/br/pkg/lightning/backend/local.(*Backend).checkRegionScatteredOrReScatter\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/lightning/backend/local/localhelper.go:526\ngithub.com/pingcap/tidb/br/pkg/lightning/backend/local.(*Backend).waitForScatterRegions.func1\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/lightning/backend/local/localhelper.go:480\ngithub.com/pingcap/tidb/br/pkg/utils.WithRetry.func1\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/utils/retry.go:57\ngithub.com/pingcap/tidb/br/pkg/utils.WithRetryV2[...]\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/utils/retry.go:75\ngithub.com/pingcap/tidb/br/pkg/utils.WithRetry\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/utils/retry.go:56\ngithub.com/pingcap/tidb/br/pkg/lightning/backend/local.(*Backend).waitForScatterRegions\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/lightning/backend/local/localhelper.go:477\ngithub.com/pingcap/tidb/br/pkg/lightning/backend/local.(*Backend).SplitAndScatterRegionByRanges\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/lightning/backend/local/localhelper.go:357\ngithub.com/pingcap/tidb/br/pkg/lightning/backend/local.(*Backend).SplitAndScatterRegionInBatches\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/lightning/backend/local/localhelper.go:123\ngithub.com/pingcap/tidb/br/pkg/lightning/backend/local.(*Backend).prepareAndSendJob\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/lightning/backend/local/local.go:1136\ngithub.com/pingcap/tidb/br/pkg/lightning/backend/local.(*Backend).doImport\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/lightning/backend/local/local.go:1683\ngithub.com/pingcap/tidb/br/pkg/lightning/backend/local.(*Backend).ImportEngine\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/lightning/backend/local/local.go:1558\ngithub.com/pingcap/tidb/br/pkg/lightning/backend.(*ClosedEngine).Import\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/lightning/backend/backend.go:365\ngithub.com/pingcap/tidb/br/pkg/lightning/importer.(*TableImporter).importKV\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/lightning/importer/table_import.go:1242\ngithub.com/pingcap/tidb/br/pkg/lightning/importer.(*TableImporter).importEngine\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/lightning/importer/table_import.go:891\ngithub.com/pingcap/tidb/br/pkg/lightning/importer.(*TableImporter).importEngines.func3\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/lightning/importer/table_import.go:504\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1650"]
[2023/10/19 07:33:38.051 +00:00] [INFO] [localhelper.go:362] ["waiting for scattering regions timeout"] [scatterCount=0] [regions=1] [take=619.326<C2><B5>s] [error="failed to get region operator, error type: UNKNOWN, error message: Not Found"] [errorVerbose="failed to get region operator, error type: UNKNOWN, error message: Not Found\ngithub.com/pingcap/tidb/br/pkg/lightning/backend/local.(*Backend).checkRegionScatteredOrReScatter\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/lightning/backend/local/localhelper.go:526\ngithub.com/pingcap/tidb/br/pkg/lightning/backend/local.(*Backend).waitForScatterRegions.func1\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/lightning/backend/local/localhelper.go:480\ngithub.com/pingcap/tidb/br/pkg/utils.WithRetry.func1\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/utils/retry.go:57\ngithub.com/pingcap/tidb/br/pkg/utils.WithRetryV2[...]\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/utils/retry.go:75\ngithub.com/pingcap/tidb/br/pkg/utils.WithRetry\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/utils/retry.go:56\ngithub.com/pingcap/tidb/br/pkg/lightning/backend/local.(*Backend).waitForScatterRegions\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/lightning/backend/local/localhelper.go:477\ngithub.com/pingcap/tidb/br/pkg/lightning/backend/local.(*Backend).SplitAndScatterRegionByRanges\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/lightning/backend/local/localhelper.go:357\ngithub.com/pingcap/tidb/br/pkg/lightning/backend/local.(*Backend).SplitAndScatterRegionInBatches\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/lightning/backend/local/localhelper.go:123\ngithub.com/pingcap/tidb/br/pkg/lightning/backend/local.(*Backend).prepareAndSendJob\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/lightning/backend/local/local.go:1136\ngithub.com/pingcap/tidb/br/pkg/lightning/backend/local.(*Backend).doImport\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/lightning/backend/local/local.go:1683\ngithub.com/pingcap/tidb/br/pkg/lightning/backend/local.(*Backend).ImportEngine\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/lightning/backend/local/local.go:1558\ngithub.com/pingcap/tidb/br/pkg/lightning/backend.(*ClosedEngine).Import\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/lightning/backend/backend.go:365\ngithub.com/pingcap/tidb/br/pkg/lightning/importer.(*TableImporter).importKV\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/lightning/importer/table_import.go:1242\ngithub.com/pingcap/tidb/br/pkg/lightning/importer.(*TableImporter).importEngine\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/lightning/importer/table_import.go:891\ngithub.com/pingcap/tidb/br/pkg/lightning/importer.(*TableImporter).importEngines.func3\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/lightning/importer/table_import.go:504\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1650"]

What version of PD are you using (pd-server -V)?

master