Skip to content

gilknocker: Timed out waiting for sampling thread #8034

Open
@crusaderky

Description

@crusaderky

I just got a random test failure:
https://github.com/dask/distributed/actions/runs/5650756106/job/15307671812?pr=8032


C:\Miniconda3\envs\dask-distributed\Lib\contextlib.py:81: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
C:\Miniconda3\envs\dask-distributed\Lib\contextlib.py:81: in inner
    return func(*args, **kwds)
distributed\utils_test.py:1100: in test_func
    return _run_and_close_tornado(async_fn_outer)
distributed\utils_test.py:378: in _run_and_close_tornado
    return asyncio_run(inner_fn(), loop_factory=get_loop_factory())
distributed\compatibility.py:204: in asyncio_run
    return runner.run(main)
C:\Miniconda3\envs\dask-distributed\Lib\asyncio\runners.py:118: in run
    return self._loop.run_until_complete(task)
C:\Miniconda3\envs\dask-distributed\Lib\asyncio\base_events.py:653: in run_until_complete
    return future.result()
distributed\utils_test.py:375: in inner_fn
    return await async_fn(*args, **kwargs)
distributed\utils_test.py:1097: in async_fn_outer
    return await utils_wait_for(async_fn(), timeout=timeout * 2)
distributed\utils.py:1922: in wait_for
    return await fut
distributed\utils_test.py:997: in async_fn
    async with _cluster_factory() as (s, workers), _client_factory(
C:\Miniconda3\envs\dask-distributed\Lib\contextlib.py:211: in __aexit__
    await anext(self.gen)
distributed\utils_test.py:991: in _cluster_factory
    await end_cluster(s, workers)
distributed\utils_test.py:857: in end_cluster
    await asyncio.gather(*(end_worker(w) for w in workers))
distributed\utils_test.py:855: in end_worker
    await w.close()
distributed\utils.py:803: in wrapper
    return await func(*args, **kwargs)
distributed\worker.py:1641: in close
    self.stop()
distributed\core.py:668: in stop
    self.monitor.close()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

self = <SystemMonitor: cpu: 0 memory: 173 MB fds: N/A>

    def close(self) -> None:
        if self.monitor_gil_contention:
>           self._gilknocker.stop()
E           UserWarning: Timed out waiting for sampling thread.

Metadata

Metadata

Assignees

Labels

flaky testIntermittent failures on CI.testsUnit tests and/or continuous integration

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions