2025-12-06 01:00:50,962 - distributed.worker - ERROR - Exception during execution of task ('getitem-4666b7d07d275f8a11daf51fab14efeb', 0). Traceback (most recent call last): File "/opt/conda/lib/python3.10/site-packages/distributed/worker.py", line 2382, in _prepare_args_for_execution data[k] = self.data[k] File "/opt/conda/lib/python3.10/site-packages/distributed/spill.py", line 226, in __getitem__ return super().__getitem__(key) File "/opt/conda/lib/python3.10/site-packages/zict/buffer.py", line 108, in __getitem__ raise KeyError(key) KeyError: "('shuffle-p2p-86bd619d06d55badca637dddcb6987c5', 0)" During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/conda/lib/python3.10/site-packages/distributed/worker.py", line 2259, in execute args2, kwargs2 = self._prepare_args_for_execution(ts, args, kwargs) File "/opt/conda/lib/python3.10/site-packages/distributed/worker.py", line 2386, in _prepare_args_for_execution data[k] = Actor(type(self.state.actors[k]), self.address, k, self) KeyError: "('shuffle-p2p-86bd619d06d55badca637dddcb6987c5', 0)"
2025-12-05 12:50:25,250 - distributed.worker - WARNING - Compute Failed Key: ('assign-7976d0369d518ba530f0de94fbdd515f', 6) Function: subgraph_callable-ede0cdf2-651c-4f8f-a3d6-92e4d8a2 args: ( source_id geometry 380 2794848614 POINT Z (443368.279 5895888.754 0.000)) kwargs: {} Exception: "GEOSException('IllegalArgumentException: point array must contain 0 or >1 elements\\n')"
2025-12-05 06:31:00,225 - distributed.worker - WARNING - Compute Failed Key: ('hash-join-7da5c100c2b4ab75ce0a4c70e132b1b0', 2) Function: merge_unpack args: ('ee85854fb99849da5f75fbca0487f836', '70c4a4c5654ad0cd9e2fad0d73fce6d1', 2, 20317, 20321, 'inner', 'hashed_source_and_date', 'hashed_source_and_date', <distributed.protocol.serialize.Serialized object at 0x7f12031b3580>, ['_x', '_y']) kwargs: {} Exception: "RuntimeError('Worker tcp://172.21.12.191:43191 left during active shuffle ee85854fb99849da5f75fbca0487f836')"
2025-12-04 08:33:33,668 - distributed.worker - INFO - -------------------------------------------------
2025-12-04 08:33:33,668 - distributed.worker - INFO - Registered to: tcp://dask-scheduler:8786
2025-12-04 08:33:33,225 - distributed.worker - INFO - -------------------------------------------------
2025-12-04 08:33:33,225 - distributed.worker - INFO - Local Directory: /tmp/dask-worker-space/worker-3evk860j
2025-12-04 08:33:33,225 - distributed.worker - INFO - Memory: 3.73 GiB
2025-12-04 08:33:33,225 - distributed.worker - INFO - Threads: 1
2025-12-04 08:33:33,225 - distributed.worker - INFO - -------------------------------------------------
2025-12-04 08:33:33,225 - distributed.worker - INFO - Waiting to connect to: tcp://dask-scheduler:8786
2025-12-04 08:33:33,225 - distributed.worker - INFO - dashboard at: 172.21.12.150:8790
2025-12-04 08:33:33,225 - distributed.worker - INFO - Listening to: tcp://172.21.12.150:39969
2025-12-04 08:33:33,225 - distributed.worker - INFO - Start worker at: tcp://172.21.12.150:39969