Closed
Description
dask.distributed
is very verbose with its logging, which is a good thing; however, for newer users (especially those unfamiliar with dask distributed), this can be scary. We could potentially silence all logs that are not "CRITICAL" level by default, with a kwarg that allows this to be toggled during development.
Another set of logs come from dangling connections / streams and tend to look like:
tornado.iostream.StreamClosedError: Stream is closed
...
distributed.comm.core.CommClosedError: in <closed TCP>: ConnectionResetError: [Errno 54] Connection reset by peer
...
these are innocuous but annoying; it would be a good research task to dig into this and see if we can find the source, for our own peace of mind that we clean up our processes appropriately.
cc: @joshmeek
Metadata
Metadata
Assignees
Labels
No labels
Activity