2025-12-06 01:00:50,928 - distributed.worker - WARNING - Compute Failed Key: ('shuffle-p2p-86bd619d06d55badca637dddcb6987c5', 14) Function: shuffle_unpack args: ('d4f2bcb88bd283c797b0c8a2e03a2799', 14, 21324) kwargs: {} Exception: "RuntimeError('shuffle_unpack failed during shuffle d4f2bcb88bd283c797b0c8a2e03a2799')"

2025-12-06 01:00:42,111 - distributed.worker - WARNING - Compute Failed Key: ('shuffle-p2p-9b0ee56ac071c0b9d77dc56cc7cb3c54', 14) Function: shuffle_unpack args: ('3d9e1529a4b4519387e33a6566423ca2', 14, 21314) kwargs: {} Exception: "RuntimeError('shuffle_unpack failed during shuffle 3d9e1529a4b4519387e33a6566423ca2')"

2025-12-06 01:00:37,491 - distributed.worker - ERROR - Exception during execution of task ('getitem-0d51c5c3085c0ba9edb097d16d739d58', 14). Traceback (most recent call last): File "/opt/conda/lib/python3.10/site-packages/distributed/worker.py", line 2382, in _prepare_args_for_execution data[k] = self.data[k] File "/opt/conda/lib/python3.10/site-packages/distributed/spill.py", line 226, in __getitem__ return super().__getitem__(key) File "/opt/conda/lib/python3.10/site-packages/zict/buffer.py", line 108, in __getitem__ raise KeyError(key) KeyError: "('sort_values-bdda57bd97c8c52389757ffcf83e58e9', 14)" During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/conda/lib/python3.10/site-packages/distributed/worker.py", line 2259, in execute args2, kwargs2 = self._prepare_args_for_execution(ts, args, kwargs) File "/opt/conda/lib/python3.10/site-packages/distributed/worker.py", line 2386, in _prepare_args_for_execution data[k] = Actor(type(self.state.actors[k]), self.address, k, self) KeyError: "('sort_values-bdda57bd97c8c52389757ffcf83e58e9', 14)"

2025-12-05 08:03:43,393 - distributed.worker - INFO - -------------------------------------------------

2025-12-05 08:03:43,393 - distributed.worker - INFO - Registered to: tcp://dask-scheduler:8786

2025-12-05 08:03:42,818 - distributed.worker - INFO - -------------------------------------------------

2025-12-05 08:03:42,818 - distributed.worker - INFO - Local Directory: /tmp/dask-worker-space/worker-1cgcn5z0

2025-12-05 08:03:42,818 - distributed.worker - INFO - Memory: 3.73 GiB

2025-12-05 08:03:42,818 - distributed.worker - INFO - Threads: 1

2025-12-05 08:03:42,818 - distributed.worker - INFO - -------------------------------------------------

2025-12-05 08:03:42,818 - distributed.worker - INFO - Waiting to connect to: tcp://dask-scheduler:8786

2025-12-05 08:03:42,818 - distributed.worker - INFO - dashboard at: 172.21.25.6:8790

2025-12-05 08:03:42,818 - distributed.worker - INFO - Listening to: tcp://172.21.25.6:45169

2025-12-05 08:03:42,818 - distributed.worker - INFO - Start worker at: tcp://172.21.25.6:45169