2025-12-06 01:00:37,443 - distributed.worker - WARNING - Compute Failed Key: ('shuffle-p2p-d1ae0c101f210d7c5f8ea8c7dc3cf426', 3) Function: shuffle_unpack args: ('8f4adf35dc92d235c8357c5e96d5cfa6', 3, 21309) kwargs: {} Exception: "RuntimeError('shuffle_unpack failed during shuffle 8f4adf35dc92d235c8357c5e96d5cfa6')"

2025-12-05 19:00:25,362 - distributed.worker - WARNING - Compute Failed Key: ('shuffle-p2p-9270f973ad2e83734eab55b4347e70bb', 3) Function: shuffle_unpack args: ('96a1e233ed5b7bc19a76f4ed3d570b08', 3, 21227) kwargs: {} Exception: "RuntimeError('shuffle_unpack failed during shuffle 96a1e233ed5b7bc19a76f4ed3d570b08')"

2025-12-05 08:01:04,453 - distributed.worker - ERROR - Exception during execution of task ('hash-join-ccaa8528e53722d0f9b96e687eadf4c4', 3). Traceback (most recent call last): File "/opt/conda/lib/python3.10/site-packages/distributed/worker.py", line 2382, in _prepare_args_for_execution data[k] = self.data[k] File "/opt/conda/lib/python3.10/site-packages/distributed/spill.py", line 226, in __getitem__ return super().__getitem__(key) File "/opt/conda/lib/python3.10/site-packages/zict/buffer.py", line 108, in __getitem__ raise KeyError(key) KeyError: 'shuffle-barrier-17a1cf67b44c34916e03ab4aac157de9' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/conda/lib/python3.10/site-packages/distributed/worker.py", line 2259, in execute args2, kwargs2 = self._prepare_args_for_execution(ts, args, kwargs) File "/opt/conda/lib/python3.10/site-packages/distributed/worker.py", line 2386, in _prepare_args_for_execution data[k] = Actor(type(self.state.actors[k]), self.address, k, self) KeyError: 'shuffle-barrier-17a1cf67b44c34916e03ab4aac157de9'

2025-12-05 07:03:41,126 - distributed.worker - INFO - -------------------------------------------------

2025-12-05 07:03:41,125 - distributed.worker - INFO - Registered to: tcp://dask-scheduler:8786

2025-12-05 07:03:40,704 - distributed.worker - INFO - -------------------------------------------------

2025-12-05 07:03:40,704 - distributed.worker - INFO - Local Directory: /tmp/dask-worker-space/worker-q2s_r6oe

2025-12-05 07:03:40,704 - distributed.worker - INFO - Memory: 3.73 GiB

2025-12-05 07:03:40,704 - distributed.worker - INFO - Threads: 1

2025-12-05 07:03:40,704 - distributed.worker - INFO - -------------------------------------------------

2025-12-05 07:03:40,704 - distributed.worker - INFO - Waiting to connect to: tcp://dask-scheduler:8786

2025-12-05 07:03:40,703 - distributed.worker - INFO - dashboard at: 172.21.12.197:8790

2025-12-05 07:03:40,703 - distributed.worker - INFO - Listening to: tcp://172.21.12.197:39833

2025-12-05 07:03:40,703 - distributed.worker - INFO - Start worker at: tcp://172.21.12.197:39833