sql: unskip TestRelocateNonVoters

[cockroach-teamcity]

sql.TestRelocateNonVoters failed with artifacts on master @ c95bef097bd4c213c6b5c0c125a9a846c4479d73:

=== RUN   TestRelocateNonVoters
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/b287de7194e17a0386ee1775f0d198ba/logTestRelocateNonVoters288927505
    test_log_scope.go:79: use -show-logs to present logs inline
=== CONT  TestRelocateNonVoters
    multitenant_admin_function_test.go:849: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/b287de7194e17a0386ee1775f0d198ba/logTestRelocateNonVoters288927505
--- FAIL: TestRelocateNonVoters (144.80s)
=== RUN   TestRelocateNonVoters/ALTER_RANGE_RELOCATE_NONVOTERS
    multitenant_admin_function_test.go:91: 
        	Error Trace:	/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2342/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/sql/sql_test_/sql_test.runfiles/com_github_cockroachdb_cockroach/pkg/sql/multitenant_admin_function_test.go:91
        	            				/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2342/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/sql/sql_test_/sql_test.runfiles/com_github_cockroachdb_cockroach/pkg/sql/multitenant_admin_function_test.go:346
        	            				/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2342/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/sql/sql_test_/sql_test.runfiles/com_github_cockroachdb_cockroach/pkg/sql/multitenant_admin_function_test.go:844
        	            				/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2342/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/sql/sql_test_/sql_test.runfiles/com_github_cockroachdb_cockroach/pkg/sql/multitenant_admin_function_test.go:320
        	            				/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2342/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/sql/sql_test_/sql_test.runfiles/com_github_cockroachdb_cockroach/pkg/sql/multitenant_admin_function_test.go:813
        	Error:      	"64" does not contain "58"
        	Test:       	TestRelocateNonVoters/ALTER_RANGE_RELOCATE_NONVOTERS
        	Messages:   	tenant=system query=``ALTER RANGE RELOCATE NONVOTERS FROM 2 TO 1 FOR (SELECT min(range_id) FROM [SHOW RANGES FROM TABLE t]);`` leaseholder=5 replicas=[2 3 4 5] voting_replicas=[3 4 5] non_voting_replicas=[2] fromReplica=2 toReplica=1 row=0 col=0
    --- FAIL: TestRelocateNonVoters/ALTER_RANGE_RELOCATE_NONVOTERS (72.28s)
=== RUN   TestRelocateNonVoters/ALTER_RANGE_x_RELOCATE_NONVOTERS
    multitenant_admin_function_test.go:91: 
        	Error Trace:	/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2342/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/sql/sql_test_/sql_test.runfiles/com_github_cockroachdb_cockroach/pkg/sql/multitenant_admin_function_test.go:91
        	            				/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2342/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/sql/sql_test_/sql_test.runfiles/com_github_cockroachdb_cockroach/pkg/sql/multitenant_admin_function_test.go:346
        	            				/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2342/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/sql/sql_test_/sql_test.runfiles/com_github_cockroachdb_cockroach/pkg/sql/multitenant_admin_function_test.go:844
        	            				/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2342/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/sql/sql_test_/sql_test.runfiles/com_github_cockroachdb_cockroach/pkg/sql/multitenant_admin_function_test.go:321
        	            				/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2342/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/sql/sql_test_/sql_test.runfiles/com_github_cockroachdb_cockroach/pkg/sql/multitenant_admin_function_test.go:813
        	Error:      	"change replicas of r59 failed: descriptor changed: [expected] r59:/Tenant/1{0-1} [(n5,s5):5, (n2,s2):2, (n3,s3):3, (n4,s4):4NON_VOTER, (n1,s1):6NON_VOTER, next=7, gen=12, sticky=1676719080.081503714,0] != [actual] r59:/Tenant/10{-/Table/104} [(n5,s5):5, (n2,s2):2, (n3,s3):3, (n4,s4):4NON_VOTER, next=7, gen=14, sticky=1676719080.081503714,0]" does not contain "ok"
        	Test:       	TestRelocateNonVoters/ALTER_RANGE_x_RELOCATE_NONVOTERS
        	Messages:   	tenant=secondary query=``ALTER RANGE (SELECT min(range_id) FROM [SHOW RANGES FROM TABLE t]) RELOCATE NONVOTERS FROM 4 TO 1;`` leaseholder=5 replicas=[2 3 4 5] voting_replicas=[2 3 5] non_voting_replicas=[4] fromReplica=4 toReplica=1 row=0 col=2
    --- FAIL: TestRelocateNonVoters/ALTER_RANGE_x_RELOCATE_NONVOTERS (72.51s)

Parameters: TAGS=bazel,gss,race

Help

See also: How To Investigate a Go Test Failure (internal)

/cc @cockroachdb/sql-queries

This test on roachdash | Improve this report!

Jira issue: CRDB-24634

[cockroach-teamcity]

sql.TestRelocateNonVoters failed with artifacts on master @ a9d4e7040c538aeaa0e0e049e5525e2569eb364b:

=== RUN   TestRelocateNonVoters
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/b287de7194e17a0386ee1775f0d198ba/logTestRelocateNonVoters618184119
    test_log_scope.go:79: use -show-logs to present logs inline
=== CONT  TestRelocateNonVoters
    multitenant_admin_function_test.go:849: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/b287de7194e17a0386ee1775f0d198ba/logTestRelocateNonVoters618184119
--- FAIL: TestRelocateNonVoters (148.73s)
=== RUN   TestRelocateNonVoters/ALTER_RANGE_RELOCATE_NONVOTERS
    multitenant_admin_function_test.go:91: 
        	Error Trace:	/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3762/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/sql/sql_test_/sql_test.runfiles/com_github_cockroachdb_cockroach/pkg/sql/multitenant_admin_function_test.go:91
        	            				/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3762/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/sql/sql_test_/sql_test.runfiles/com_github_cockroachdb_cockroach/pkg/sql/multitenant_admin_function_test.go:346
        	            				/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3762/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/sql/sql_test_/sql_test.runfiles/com_github_cockroachdb_cockroach/pkg/sql/multitenant_admin_function_test.go:844
        	            				/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3762/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/sql/sql_test_/sql_test.runfiles/com_github_cockroachdb_cockroach/pkg/sql/multitenant_admin_function_test.go:320
        	            				/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3762/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/sql/sql_test_/sql_test.runfiles/com_github_cockroachdb_cockroach/pkg/sql/multitenant_admin_function_test.go:813
        	Error:      	"64" does not contain "58"
        	Test:       	TestRelocateNonVoters/ALTER_RANGE_RELOCATE_NONVOTERS
        	Messages:   	tenant=system query=``ALTER RANGE RELOCATE NONVOTERS FROM 3 TO 1 FOR (SELECT min(range_id) FROM [SHOW RANGES FROM TABLE t]);`` leaseholder=4 replicas=[2 3 4 5] voting_replicas=[2 4 5] non_voting_replicas=[3] fromReplica=3 toReplica=1 row=0 col=0
    --- FAIL: TestRelocateNonVoters/ALTER_RANGE_RELOCATE_NONVOTERS (74.67s)
=== RUN   TestRelocateNonVoters/ALTER_RANGE_x_RELOCATE_NONVOTERS
    multitenant_admin_function_test.go:91: 
        	Error Trace:	/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3762/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/sql/sql_test_/sql_test.runfiles/com_github_cockroachdb_cockroach/pkg/sql/multitenant_admin_function_test.go:91
        	            				/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3762/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/sql/sql_test_/sql_test.runfiles/com_github_cockroachdb_cockroach/pkg/sql/multitenant_admin_function_test.go:346
        	            				/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3762/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/sql/sql_test_/sql_test.runfiles/com_github_cockroachdb_cockroach/pkg/sql/multitenant_admin_function_test.go:844
        	            				/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3762/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/sql/sql_test_/sql_test.runfiles/com_github_cockroachdb_cockroach/pkg/sql/multitenant_admin_function_test.go:320
        	            				/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3762/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/sql/sql_test_/sql_test.runfiles/com_github_cockroachdb_cockroach/pkg/sql/multitenant_admin_function_test.go:813
        	Error:      	"65" does not contain "58"
        	Test:       	TestRelocateNonVoters/ALTER_RANGE_x_RELOCATE_NONVOTERS
        	Messages:   	tenant=system query=``ALTER RANGE (SELECT min(range_id) FROM [SHOW RANGES FROM TABLE t]) RELOCATE NONVOTERS FROM 3 TO 1;`` leaseholder=2 replicas=[2 3 4 5] voting_replicas=[2 4 5] non_voting_replicas=[3] fromReplica=3 toReplica=1 row=0 col=0
    --- FAIL: TestRelocateNonVoters/ALTER_RANGE_x_RELOCATE_NONVOTERS (74.04s)

Parameters: TAGS=bazel,gss,race

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

[DrewKimball]

This didn't reproduce for me after running for 25 minutes under stress.

[rytaft]

cc @ecwall

[mgartner]

Saw this fail again here: https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_BazelEssentialCi/9008712?showRootCauses=true&expandBuildChangesSection=true&expandBuildProblemsSection=true&expandBuildTestsSection=true

I'm going to put up a PR to skip this test until @ecwall has time to investigate.

[mgartner]

Added the GA-blocker label now that the test will be skipped once #98531 merges.