2025-12-06 01:00:37,450 - distributed.worker - WARNING - Compute Failed Key: ('shuffle-p2p-d1ae0c101f210d7c5f8ea8c7dc3cf426', 13) Function: shuffle_unpack args: ('8f4adf35dc92d235c8357c5e96d5cfa6', 13, 21309) kwargs: {} Exception: "RuntimeError('shuffle_unpack failed during shuffle 8f4adf35dc92d235c8357c5e96d5cfa6')"

2025-12-05 13:20:32,060 - distributed.worker - ERROR - Exception during execution of task ('assign-85d164f98716a34ec38e1f7e22494803', 12). Traceback (most recent call last): File "/opt/conda/lib/python3.10/site-packages/distributed/worker.py", line 2382, in _prepare_args_for_execution data[k] = self.data[k] File "/opt/conda/lib/python3.10/site-packages/distributed/spill.py", line 226, in __getitem__ return super().__getitem__(key) File "/opt/conda/lib/python3.10/site-packages/zict/buffer.py", line 108, in __getitem__ raise KeyError(key) KeyError: "('simple-shuffle-36c715d0606173039c0e0f3fa539403e', 12)" During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/conda/lib/python3.10/site-packages/distributed/worker.py", line 2259, in execute args2, kwargs2 = self._prepare_args_for_execution(ts, args, kwargs) File "/opt/conda/lib/python3.10/site-packages/distributed/worker.py", line 2386, in _prepare_args_for_execution data[k] = Actor(type(self.state.actors[k]), self.address, k, self) KeyError: "('simple-shuffle-36c715d0606173039c0e0f3fa539403e', 12)"

2025-12-05 08:03:45,259 - distributed.worker - INFO - -------------------------------------------------

2025-12-05 08:03:45,259 - distributed.worker - INFO - Registered to: tcp://dask-scheduler:8786

2025-12-05 08:03:44,777 - distributed.worker - INFO - -------------------------------------------------

2025-12-05 08:03:44,777 - distributed.worker - INFO - Local Directory: /tmp/dask-worker-space/worker-ja9gxy0x

2025-12-05 08:03:44,777 - distributed.worker - INFO - Memory: 3.73 GiB

2025-12-05 08:03:44,777 - distributed.worker - INFO - Threads: 1

2025-12-05 08:03:44,777 - distributed.worker - INFO - -------------------------------------------------

2025-12-05 08:03:44,777 - distributed.worker - INFO - Waiting to connect to: tcp://dask-scheduler:8786

2025-12-05 08:03:44,776 - distributed.worker - INFO - dashboard at: 172.21.25.24:8790

2025-12-05 08:03:44,776 - distributed.worker - INFO - Listening to: tcp://172.21.25.24:35179

2025-12-05 08:03:44,776 - distributed.worker - INFO - Start worker at: tcp://172.21.25.24:35179