2026-03-23 11:31:26,666 - distributed.worker - ERROR - Worker stream died during communication: tcp://172.21.159.197:36005 Traceback (most recent call last): File "/opt/conda/lib/python3.10/site-packages/tornado/iostream.py", line 869, in _read_to_buffer bytes_read = self.read_from_fd(buf) File "/opt/conda/lib/python3.10/site-packages/tornado/iostream.py", line 1138, in read_from_fd return self.socket.recv_into(buf, len(buf)) ConnectionResetError: [Errno 104] Connection reset by peer The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/opt/conda/lib/python3.10/site-packages/distributed/worker.py", line 2066, in gather_dep response = await get_data_from_worker( File "/opt/conda/lib/python3.10/site-packages/distributed/worker.py", line 2892, in get_data_from_worker response = await send_recv( File "/opt/conda/lib/python3.10/site-packages/distributed/core.py", line 1024, in send_recv response = await comm.read(deserializers=deserializers) File "/opt/conda/lib/python3.10/site-packages/distributed/comm/tcp.py", line 241, in read convert_stream_closed_error(self, e) File "/opt/conda/lib/python3.10/site-packages/distributed/comm/tcp.py", line 142, in convert_stream_closed_error raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc distributed.comm.core.CommClosedError: in <TCP (closed) Ephemeral Worker->Worker for gather local=tcp://172.21.159.214:42684 remote=tcp://172.21.159.197:36005>: ConnectionResetError: [Errno 104] Connection reset by peer
2026-03-23 10:31:43,282 - distributed.worker - WARNING - Compute Failed Key: shuffle-barrier-81589855895266a87906be2af5b4fc8a Function: shuffle_barrier args: ('81589855895266a87906be2af5b4fc8a', [264, 264, 264, 264, 264, 264, 264, 264, 264, 264, 264, 264, 264, 264, 264, 264]) kwargs: {} Exception: "RuntimeError('shuffle_barrier failed during shuffle 81589855895266a87906be2af5b4fc8a')"
2026-03-23 09:20:37,766 - distributed.worker - WARNING - Compute Failed Key: ('lambda-d4d71d4d1e6c775923b9bcf16e8083eb', 13) Function: subgraph_callable-a5f980d0-0fd0-4cd0-a502-935caba6 args: ( schema_version ... point_in_WGS84 1071 1 ... POINT Z (50.14150 53.20116 0.00000) [1 rows x 17 columns]) kwargs: {} Exception: "ValueError('Found array with 1 sample(s) (shape=(1, 1)) while a minimum of 2 is required by AgglomerativeClustering.')"
2026-03-23 07:15:02,509 - distributed.worker - INFO - -------------------------------------------------
2026-03-23 07:15:02,508 - distributed.worker - INFO - Registered to: tcp://dask-scheduler:8786
2026-03-23 07:15:01,218 - distributed.worker - INFO - -------------------------------------------------
2026-03-23 07:15:01,218 - distributed.worker - INFO - Local Directory: /tmp/dask-worker-space/worker-er6ltlka
2026-03-23 07:15:01,218 - distributed.worker - INFO - Memory: 3.73 GiB
2026-03-23 07:15:01,218 - distributed.worker - INFO - Threads: 1
2026-03-23 07:15:01,218 - distributed.worker - INFO - -------------------------------------------------
2026-03-23 07:15:01,218 - distributed.worker - INFO - Waiting to connect to: tcp://dask-scheduler:8786
2026-03-23 07:15:01,218 - distributed.worker - INFO - dashboard at: 172.21.159.214:8790
2026-03-23 07:15:01,218 - distributed.worker - INFO - Listening to: tcp://172.21.159.214:45267
2026-03-23 07:15:01,217 - distributed.worker - INFO - Start worker at: tcp://172.21.159.214:45267