roachtest: failover/chaos/read-write/lease=leader failed

[cockroach-teamcity]

roachtest.failover/chaos/read-write/lease=leader failed with artifacts on master @ 22b262749c502d07ec7ccec5b76abd67c361ae4d:

(assertions.go:363).Fail: 
	Error Trace:	pkg/cmd/roachtest/tests/failover.go:1587
	            				pkg/cmd/roachtest/tests/failover.go:335
	            				pkg/cmd/roachtest/monitor.go:115
	            				external/org_golang_x_sync/errgroup/errgroup.go:78
	            				src/runtime/asm_amd64.s:1695
	Error:      	Received unexpected error:
	            	pq: internal error while retrieving user account memberships: operation "get-user-session" timed out after 10.003s (given timeout 10s): internal error while retrieving user account: get auth info error: interrupted during singleflight acquire-lease:1: context deadline exceeded
	Test:       	failover/chaos/read-write/lease=leader
(require.go:1357).NoError: FailNow called
(monitor.go:149).Wait: monitor failure: monitor user task failed: t.Fatal() was called
(cluster.go:2485).Run: context canceled
(cluster.go:2485).Run: context canceled
(cluster.go:2485).Run: context canceled
(cluster.go:2485).Run: context canceled
test artifacts and logs in: /artifacts/failover/chaos/read-write/lease=leader/run_1

Parameters:

• arch=amd64
• cloud=gce
• coverageBuild=false
• cpu=2
• encrypted=false
• fs=ext4
• localSSD=false
• metamorphicBufferedSender=false
• runtimeAssertionsBuild=false
• ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

/cc @cockroachdb/kv-triage

This test on roachdash | Improve this report!

Jira issue: CRDB-47850

[tbg]

I investigated sibling test #141480 (comment). Unsure if this failure is the same, but superficially looks that way. Will wait for more nightlies to see if there are repeat failures.

[cockroach-teamcity]

roachtest.failover/chaos/read-write/lease=leader failed with artifacts on master @ 67a82bfc09766413d7f8ae8edb10035940b94c7e:

(assertions.go:363).Fail: 
	Error Trace:	pkg/cmd/roachtest/tests/failover.go:1587
	            				pkg/cmd/roachtest/tests/failover.go:335
	            				pkg/cmd/roachtest/monitor.go:115
	            				external/org_golang_x_sync/errgroup/errgroup.go:78
	            				src/runtime/asm_amd64.s:1695
	Error:      	Received unexpected error:
	            	pq: internal error while retrieving user account memberships: operation "get-user-session" timed out after 10.001s (given timeout 10s): internal error while retrieving user account: get auth info error: interrupted during singleflight acquire-lease:1: context deadline exceeded
	Test:       	failover/chaos/read-write/lease=leader
(require.go:1357).NoError: FailNow called
(monitor.go:149).Wait: monitor failure: monitor user task failed: t.Fatal() was called
(cluster.go:2486).Run: context canceled
(cluster.go:2486).Run: context canceled
(cluster.go:2486).Run: context canceled
(cluster.go:2486).Run: context canceled
test artifacts and logs in: /artifacts/failover/chaos/read-write/lease=leader/run_1

Parameters:

• arch=amd64
• cloud=gce
• coverageBuild=false
• cpu=2
• encrypted=false
• fs=ext4
• localSSD=false
• metamorphicBufferedSender=false
• runtimeAssertionsBuild=false
• ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

[cockroach-teamcity]

roachtest.failover/chaos/read-write/lease=leader failed with artifacts on master @ 34e34c2d5b9598441b935f03a794277e9329a256:

(assertions.go:363).Fail: 
	Error Trace:	pkg/cmd/roachtest/tests/failover.go:1631
	            				pkg/cmd/roachtest/tests/failover.go:335
	            				pkg/cmd/roachtest/monitor.go:115
	            				external/org_golang_x_sync/errgroup/errgroup.go:78
	            				src/runtime/asm_amd64.s:1695
	Error:      	Received unexpected error:
	            	pq: internal error while retrieving user account memberships: operation "get-user-session" timed out after 10s (given timeout 10s): internal error while retrieving user account: get auth info error: interrupted during singleflight acquire-lease:1: context deadline exceeded
	Test:       	failover/chaos/read-write/lease=leader
(require.go:1357).NoError: FailNow called
(monitor.go:149).Wait: monitor failure: monitor user task failed: t.Fatal() was called
(cluster.go:2486).Run: context canceled
(cluster.go:2486).Run: context canceled
(cluster.go:2486).Run: context canceled
(cluster.go:2486).Run: context canceled
test artifacts and logs in: /artifacts/failover/chaos/read-write/lease=leader/run_1

Parameters:

• arch=amd64
• cloud=gce
• coverageBuild=false
• cpu=2
• encrypted=false
• fs=ext4
• localSSD=false
• metamorphicBufferedSender=false
• runtimeAssertionsBuild=false
• ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

[cockroach-teamcity]

roachtest.failover/chaos/read-write/lease=leader failed with artifacts on master @ 34e34c2d5b9598441b935f03a794277e9329a256:

(assertions.go:363).Fail: 
	Error Trace:	pkg/cmd/roachtest/tests/failover.go:1587
	            				pkg/cmd/roachtest/tests/failover.go:335
	            				pkg/cmd/roachtest/monitor.go:115
	            				external/org_golang_x_sync/errgroup/errgroup.go:78
	            				src/runtime/asm_amd64.s:1695
	Error:      	Received unexpected error:
	            	pq: internal error while retrieving user account memberships: operation "get-user-session" timed out after 10s (given timeout 10s): internal error while retrieving user account: get auth info error: interrupted during singleflight acquire-lease:1: context deadline exceeded
	Test:       	failover/chaos/read-write/lease=leader
(require.go:1357).NoError: FailNow called
(monitor.go:149).Wait: monitor failure: monitor user task failed: t.Fatal() was called
(cluster.go:2486).Run: context canceled
(cluster.go:2486).Run: context canceled
(cluster.go:2486).Run: context canceled
(cluster.go:2486).Run: context canceled
test artifacts and logs in: /artifacts/failover/chaos/read-write/lease=leader/cpu_arch=arm64/run_1

Parameters:

• arch=arm64
• cloud=gce
• coverageBuild=false
• cpu=2
• encrypted=false
• fs=ext4
• localSSD=false
• metamorphicBufferedSender=false
• runtimeAssertionsBuild=false
• ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

[cockroach-teamcity]

roachtest.failover/chaos/read-write/lease=leader failed with artifacts on master @ f3193fa36f11d583dd7e7ba505a89e7e309996aa:

(assertions.go:363).Fail: 
	Error Trace:	pkg/cmd/roachtest/tests/failover.go:1631
	            				pkg/cmd/roachtest/tests/failover.go:335
	            				pkg/cmd/roachtest/monitor.go:115
	            				external/org_golang_x_sync/errgroup/errgroup.go:78
	            				src/runtime/asm_amd64.s:1695
	Error:      	Received unexpected error:
	            	pq: internal error while retrieving user account memberships: operation "get-user-session" timed out after 10s (given timeout 10s): internal error while retrieving user account: get auth info error: interrupted during singleflight acquire-lease:1: context deadline exceeded
	Test:       	failover/chaos/read-write/lease=leader
(require.go:1357).NoError: FailNow called
(monitor.go:149).Wait: monitor failure: monitor user task failed: t.Fatal() was called
(cluster.go:2486).Run: context canceled
(cluster.go:2486).Run: context canceled
(cluster.go:2486).Run: context canceled
(cluster.go:2486).Run: context canceled
test artifacts and logs in: /artifacts/failover/chaos/read-write/lease=leader/run_1

Parameters:

• arch=amd64
• cloud=gce
• coverageBuild=false
• cpu=2
• encrypted=false
• fs=ext4
• localSSD=false
• metamorphicBufferedSender=false
• runtimeAssertionsBuild=false
• ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

[cockroach-teamcity]

roachtest.failover/chaos/read-write/lease=leader failed with artifacts on master @ 954761451e68c1c5db5fbe0f336225955dad1075:

(assertions.go:363).Fail: 
	Error Trace:	pkg/cmd/roachtest/tests/failover.go:1631
	            				pkg/cmd/roachtest/tests/failover.go:335
	            				pkg/cmd/roachtest/monitor.go:115
	            				external/org_golang_x_sync/errgroup/errgroup.go:78
	            				src/runtime/asm_amd64.s:1695
	Error:      	Received unexpected error:
	            	pq: internal error while retrieving user account memberships: operation "get-user-session" timed out after 10s (given timeout 10s): internal error while retrieving user account: get auth info error: interrupted during singleflight acquire-lease:1: context deadline exceeded
	Test:       	failover/chaos/read-write/lease=leader
(require.go:1357).NoError: FailNow called
(monitor.go:149).Wait: monitor failure: monitor user task failed: t.Fatal() was called
(cluster.go:2490).Run: context canceled
(cluster.go:2490).Run: context canceled
(cluster.go:2490).Run: context canceled
(cluster.go:2490).Run: context canceled
test artifacts and logs in: /artifacts/failover/chaos/read-write/lease=leader/run_1

Parameters:

• arch=amd64
• cloud=gce
• coverageBuild=false
• cpu=2
• encrypted=false
• fs=ext4
• localSSD=false
• metamorphicBufferedSender=true
• runtimeAssertionsBuild=false
• ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!