2026-01-19 15:02:55,071 - distributed.worker - WARNING - Compute Failed Key: ('hash-join-transfer-9d367886730c1a6f221942d84c750289', 4) Function: merge_transfer args: ( schema_version detector_id ... date_diff_ms __hash_partition 0 1 2794848467 ... 620.0 4 1 1 2794848467 ... 599.0 4 2 1 2794848514 ... 529.0 4 3 1 2794848514 ... 500.0 4 4 1 2794848514 ... 508.0 4 ... ... ... ... ... ... 1690553 1 2794848516 ... 123.0 4 1690554 1 2794848509 ... 596.0 4 1690555 1 2794848509 ... 203.0 4 1690556 1 2794848509 ... 204.0 4 1690557 1 2794848509 ... 203.0 4 [1690558 rows x 28 columns], '9d367886730c1a6f221942d84c750289', 4, 16) kwargs: {} Exception: "RuntimeError('shuffle_transfer failed during shuffle 9d367886730c1a6f221942d84c750289')"
2026-01-19 15:02:50,820 - distributed.worker.memory - WARNING - Unmanaged memory use is high. This may indicate a memory leak or the memory may not be released to the OS; see https://distributed.dask.org/en/latest/worker-memory.html#memory-not-released-back-to-the-os for more information. -- Unmanaged memory: 2.28 GiB -- Worker memory limit: 3.73 GiB
2026-01-19 15:02:39,092 - distributed.worker.memory - WARNING - Unmanaged memory use is high. This may indicate a memory leak or the memory may not be released to the OS; see https://distributed.dask.org/en/latest/worker-memory.html#memory-not-released-back-to-the-os for more information. -- Unmanaged memory: 2.42 GiB -- Worker memory limit: 3.73 GiB
2026-01-18 03:03:10,711 - distributed.worker - INFO - -------------------------------------------------
2026-01-18 03:03:10,711 - distributed.worker - INFO - Registered to: tcp://dask-scheduler:8786
2026-01-18 03:03:10,259 - distributed.worker - INFO - -------------------------------------------------
2026-01-18 03:03:10,259 - distributed.worker - INFO - Local Directory: /tmp/dask-worker-space/worker-r6hxont5
2026-01-18 03:03:10,259 - distributed.worker - INFO - Memory: 3.73 GiB
2026-01-18 03:03:10,259 - distributed.worker - INFO - Threads: 1
2026-01-18 03:03:10,259 - distributed.worker - INFO - -------------------------------------------------
2026-01-18 03:03:10,259 - distributed.worker - INFO - Waiting to connect to: tcp://dask-scheduler:8786
2026-01-18 03:03:10,259 - distributed.worker - INFO - dashboard at: 172.21.151.136:8790
2026-01-18 03:03:10,259 - distributed.worker - INFO - Listening to: tcp://172.21.151.136:46861
2026-01-18 03:03:10,258 - distributed.worker - INFO - Start worker at: tcp://172.21.151.136:46861