Skip to content

Bazel CI Flaky src.test.shell.bazel.remote.remote_execution_test test_credential_helper_clear_cache  #22940

Open
@sgowroji

Description

CI: https://buildkite.com/bazel/bazel-bazel/builds/28488#01907594-eead-4a8b-a7e1-75d18feed18c

Platform: MacOS

Logs:

/private/var/tmp/_bazel_buildkite/be47b0f997ba5145e48264e150e01eea/sandbox/darwin-sandbox/9257/execroot/_main/bazel-out/darwin_x86_64-fastbuild/bin/src/test/shell/bazel/remote/remote_execution_test.runfiles/_main/src/test/shell/bazel/remote/remote_utils.sh: line 47: 55461 Killed: 9               "${REMOTE_WORKER}" --singlejar --jvm_flag=-Djava.library.path="${native_lib}" --work_path="${work_path}" --cas_path="${cas_path}" --listen_port=${worker_port} --pid_file="${pid_file}" "$@" >&$TEST_log
-- Test log: -----------------------------------------------------------
Jul 02, 2024 10:45:15 PM com.google.devtools.build.lib.actions.LocalHostCapacity getNewLocalHostCapacity
INFO: Determined local resources: RAM=65536MB, CPU=36.0
240702 22:45:15.787:I 1 [com.google.devtools.build.remote.worker.RemoteWorker.startServer] Starting gRPC server on port 59142
Exception in thread "main" java.io.IOException: Failed to bind to address 0.0.0.0/0.0.0.0:59142
	at io.grpc.netty.NettyServer.start(NettyServer.java:328)
	at io.grpc.internal.ServerImpl.start(ServerImpl.java:183)
	at io.grpc.internal.ServerImpl.start(ServerImpl.java:92)
	at com.google.devtools.build.remote.worker.RemoteWorker.startServer(RemoteWorker.java:220)
	at com.google.devtools.build.remote.worker.RemoteWorker.main(RemoteWorker.java:313)
Caused by: java.net.BindException: Address already in use
	at java.base/sun.nio.ch.Net.bind0(Native Method)
	at java.base/sun.nio.ch.Net.bind(Net.java:565)
	at java.base/sun.nio.ch.ServerSocketChannelImpl.netBind(ServerSocketChannelImpl.java:344)
	at java.base/sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:301)
	at io.netty.channel.socket.nio.NioServerSocketChannel.doBind(NioServerSocketChannel.java:141)
	at io.netty.channel.AbstractChannel$AbstractUnsafe.bind(AbstractChannel.java:562)
	at io.netty.channel.DefaultChannelPipeline$HeadContext.bind(DefaultChannelPipeline.java:1334)
	at io.netty.channel.AbstractChannelHandlerContext.invokeBind(AbstractChannelHandlerContext.java:600)
	at io.netty.channel.AbstractChannelHandlerContext.bind(AbstractChannelHandlerContext.java:579)
	at io.netty.channel.DefaultChannelPipeline.bind(DefaultChannelPipeline.java:973)
	at io.netty.channel.AbstractChannel.bind(AbstractChannel.java:260)
	at io.netty.bootstrap.AbstractBootstrap$2.run(AbstractBootstrap.java:356)
	at io.netty.util.concurrent.AbstractEventExecutor.runTask(AbstractEventExecutor.java:174)
	at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:167)
	at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:470)
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:569)
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997)
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
	at java.base/java.lang.Thread.run(Thread.java:1583)
------------------------------------------------------------------------
test_credential_helper_clear_cache FAILED: Timed out waiting for remote worker to start..
/private/var/tmp/_bazel_buildkite/be47b0f997ba5145e48264e150e01eea/sandbox/darwin-sandbox/9257/execroot/_main/bazel-out/darwin_x86_64-fastbuild/bin/src/test/shell/bazel/remote/remote_execution_test.runfiles/_main/src/test/shell/bazel/remote/remote_utils.sh:43: in call to start_worker
/private/var/tmp/_bazel_buildkite/be47b0f997ba5145e48264e150e01eea/sandbox/darwin-sandbox/9257/execroot/_main/bazel-out/darwin_x86_64-fastbuild/bin/src/test/shell/bazel/remote/remote_execution_test.runfiles/_main/src/test/shell/bazel/remote/remote_execution_test:94: in call to setup_credential_helper_test
/private/var/tmp/_bazel_buildkite/be47b0f997ba5145e48264e150e01eea/sandbox/darwin-sandbox/9257/execroot/_main/bazel-out/darwin_x86_64-fastbuild/bin/src/test/shell/bazel/remote/remote_execution_test.runfiles/_main/src/test/shell/bazel/remote/remote_execution_test:159: in call to test_credential_helper_clear_cache

Tear down:

INFO[remote_execution_test 2024-07-02 22:45:47 (+0000)] Cleaning up workspace

Testcase Details :

BAZELCI_TASK=macos TEST_TARGET=//src/test/shell/bazel/remote:remote_execution_test 

TEST_NAME=test_credential_helper_clear_cache  bazel test //src/test/shell/bazel/remote:remote_execution_test --test_filter=test_credential_helper_clear_cache 

CC Greenteam @meteorcloudy

Metadata

Assignees

No one assigned

    Labels

    P3We're not considering working on this, but happy to review a PR. (No assignee)breakageteam-Remote-ExecIssues and PRs for the Execution (Remote) teamtype: bug

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions