2026-01-21 03:50:36,467 - distributed.scheduler - INFO - Close client connection: Client-429f5ac2-f67c-11f0-8001-d684c398e257

2026-01-21 03:50:36,467 - distributed.scheduler - INFO - Remove client Client-429f5ac2-f67c-11f0-8001-d684c398e257

2026-01-21 03:50:36,466 - distributed.scheduler - INFO - Remove client Client-429f5ac2-f67c-11f0-8001-d684c398e257

2026-01-21 03:50:00,302 - distributed.scheduler - INFO - Receive client connection: Client-429f5ac2-f67c-11f0-8001-d684c398e257

2026-01-21 03:41:34,786 - distributed.scheduler - INFO - Close client connection: Client-fff1a6e5-f67a-11f0-8001-d684c398e257

2026-01-21 03:41:34,785 - distributed.scheduler - INFO - Remove client Client-fff1a6e5-f67a-11f0-8001-d684c398e257

2026-01-21 03:41:34,785 - distributed.scheduler - INFO - Remove client Client-fff1a6e5-f67a-11f0-8001-d684c398e257

2026-01-21 03:40:58,923 - distributed.scheduler - INFO - Receive client connection: Client-fff1a6e5-f67a-11f0-8001-d684c398e257

2026-01-21 03:32:09,645 - distributed.scheduler - INFO - Close client connection: Client-5118a9f1-f624-11f0-8001-d684c398e257

2026-01-21 03:32:09,645 - distributed.scheduler - INFO - Close client connection: Client-b79528a1-f625-11f0-8001-d684c398e257

2026-01-21 03:32:09,645 - distributed.scheduler - INFO - Close client connection: Client-1e1e26c0-f627-11f0-8001-d684c398e257

2026-01-21 03:32:09,645 - distributed.scheduler - INFO - Close client connection: Client-eb1fe4d5-f629-11f0-8001-d684c398e257

2026-01-21 03:32:09,645 - distributed.scheduler - INFO - Close client connection: Client-84a050a6-f628-11f0-8001-d684c398e257

2026-01-21 03:32:09,645 - distributed.scheduler - INFO - Close client connection: Client-51941e9f-f62b-11f0-8001-d684c398e257

2026-01-21 03:32:09,645 - distributed.scheduler - INFO - Close client connection: Client-b8151ff5-f62c-11f0-8001-d684c398e257

2026-01-21 03:32:09,645 - distributed.scheduler - INFO - Close client connection: Client-1e91e7a5-f62e-11f0-8001-d684c398e257

2026-01-21 03:32:09,645 - distributed.scheduler - INFO - Close client connection: Client-850f7822-f62f-11f0-8001-d684c398e257

2026-01-21 03:32:09,645 - distributed.scheduler - INFO - Close client connection: Client-eb8ecdfb-f630-11f0-8001-d684c398e257

2026-01-21 03:32:09,645 - distributed.scheduler - INFO - Close client connection: Client-b87a9e26-f633-11f0-8001-d684c398e257

2026-01-21 03:32:09,645 - distributed.scheduler - INFO - Close client connection: Client-520b8d1f-f632-11f0-8001-d684c398e257

2026-01-21 03:32:09,645 - distributed.scheduler - INFO - Close client connection: Client-856e7507-f636-11f0-8001-d684c398e257

2026-01-21 03:32:09,644 - distributed.scheduler - INFO - Close client connection: Client-1ef8320b-f635-11f0-8001-d684c398e257

2026-01-21 03:32:09,644 - distributed.scheduler - INFO - Close client connection: Client-ebe300cd-f637-11f0-8001-d684c398e257

2026-01-21 03:32:09,644 - distributed.scheduler - INFO - Close client connection: Client-52634022-f639-11f0-8001-d684c398e257

2026-01-21 03:32:09,644 - distributed.scheduler - INFO - Close client connection: Client-b8f59e3a-f63a-11f0-8001-d684c398e257

2026-01-21 03:32:09,644 - distributed.scheduler - INFO - Close client connection: Client-1f676ecf-f63c-11f0-8001-d684c398e257

2026-01-21 03:32:09,644 - distributed.scheduler - INFO - Close client connection: Client-85f76639-f63d-11f0-8001-d684c398e257

2026-01-21 03:32:09,644 - distributed.scheduler - INFO - Close client connection: Client-ec83fe70-f63e-11f0-8001-d684c398e257

2026-01-21 03:32:09,644 - distributed.scheduler - INFO - Close client connection: Client-53084f72-f640-11f0-8001-d684c398e257

2026-01-21 03:32:09,644 - distributed.scheduler - INFO - Close client connection: Client-b98faaea-f641-11f0-8001-d684c398e257

2026-01-21 03:32:09,644 - distributed.scheduler - INFO - Close client connection: Client-fc2f1739-f642-11f0-8001-d684c398e257

2026-01-21 03:32:09,643 - distributed.scheduler - INFO - Close client connection: Client-62ba4601-f644-11f0-8001-d684c398e257

2026-01-21 03:32:09,643 - distributed.scheduler - INFO - Close client connection: Client-c930c4bc-f645-11f0-8001-d684c398e257

2026-01-21 03:32:09,643 - distributed.scheduler - INFO - Close client connection: Client-2fa9d7c4-f647-11f0-8001-d684c398e257

2026-01-21 03:32:09,643 - distributed.scheduler - INFO - Close client connection: Client-961e2cb4-f648-11f0-8001-d684c398e257

2026-01-21 03:32:09,643 - distributed.scheduler - INFO - Close client connection: Client-fc9ce18a-f649-11f0-8001-d684c398e257

2026-01-21 03:32:09,643 - distributed.scheduler - INFO - Close client connection: Client-631e5520-f64b-11f0-8001-d684c398e257

2026-01-21 03:32:09,643 - distributed.scheduler - INFO - Close client connection: Client-c997e9ed-f64c-11f0-8001-d684c398e257

2026-01-21 03:32:09,642 - distributed.scheduler - INFO - Close client connection: Client-301c4d8e-f64e-11f0-8001-d684c398e257

2026-01-21 03:32:09,642 - distributed.scheduler - INFO - Close client connection: Client-9688fc1c-f64f-11f0-8001-d684c398e257

2026-01-21 03:32:09,642 - distributed.scheduler - INFO - Close client connection: Client-fcea9651-f650-11f0-8001-d684c398e257

2026-01-21 03:32:09,642 - distributed.scheduler - INFO - Close client connection: Client-636bfdef-f652-11f0-8001-d684c398e257

2026-01-21 03:32:09,642 - distributed.scheduler - INFO - Close client connection: Client-307298b8-f655-11f0-8001-d684c398e257

2026-01-21 03:32:09,642 - distributed.scheduler - INFO - Close client connection: Client-c9ee6f04-f653-11f0-8001-d684c398e257

2026-01-21 03:32:09,642 - distributed.scheduler - INFO - Close client connection: Client-96f43e35-f656-11f0-8001-d684c398e257

2026-01-21 03:32:09,642 - distributed.scheduler - INFO - Close client connection: Client-fd6d318f-f657-11f0-8001-d684c398e257

2026-01-21 03:32:09,642 - distributed.scheduler - INFO - Close client connection: Client-63e64d7a-f659-11f0-8001-d684c398e257

2026-01-21 03:32:09,642 - distributed.scheduler - INFO - Close client connection: Client-ca66451d-f65a-11f0-8001-d684c398e257

2026-01-21 03:32:09,642 - distributed.scheduler - INFO - Close client connection: Client-30f399ec-f65c-11f0-8001-d684c398e257

2026-01-21 03:32:09,642 - distributed.scheduler - INFO - Close client connection: Client-97782a6d-f65d-11f0-8001-d684c398e257

2026-01-21 03:32:09,641 - distributed.scheduler - INFO - Close client connection: Client-3181c928-f663-11f0-8001-d684c398e257

2026-01-21 03:32:09,641 - distributed.scheduler - INFO - Close client connection: Client-fdfbf056-f65e-11f0-8001-d684c398e257

2026-01-21 03:32:09,641 - distributed.scheduler - INFO - Close client connection: Client-647fddd1-f660-11f0-8001-d684c398e257

2026-01-21 03:32:09,641 - distributed.scheduler - INFO - Close client connection: Client-cb075f12-f661-11f0-8001-d684c398e257

2026-01-21 03:32:09,641 - distributed.scheduler - INFO - Close client connection: Client-97fdef50-f664-11f0-8001-d684c398e257

2026-01-21 03:32:09,641 - distributed.scheduler - INFO - Close client connection: Client-fe7aba6f-f665-11f0-8001-d684c398e257

2026-01-21 03:32:09,641 - distributed.scheduler - INFO - Close client connection: Client-64f3e302-f667-11f0-8001-d684c398e257

2026-01-21 03:32:09,641 - distributed.scheduler - INFO - Close client connection: Client-cb71624b-f668-11f0-8001-d684c398e257

2026-01-21 03:32:09,641 - distributed.scheduler - INFO - Close client connection: Client-31fbd108-f66a-11f0-8001-d684c398e257

2026-01-21 03:32:09,641 - distributed.scheduler - INFO - Close client connection: Client-988a53c8-f66b-11f0-8001-d684c398e257

2026-01-21 03:32:09,641 - distributed.scheduler - INFO - Close client connection: Client-fef19f98-f66c-11f0-8001-d684c398e257

2026-01-21 03:32:09,640 - distributed.scheduler - INFO - Close client connection: Client-cbe2d35c-f66f-11f0-8001-d684c398e257

2026-01-21 03:32:09,640 - distributed.scheduler - INFO - Close client connection: Client-6566d0fa-f66e-11f0-8001-d684c398e257

2026-01-21 03:32:09,640 - distributed.scheduler - INFO - Close client connection: Client-325af581-f671-11f0-8001-d684c398e257

2026-01-21 03:32:09,640 - distributed.scheduler - INFO - Close client connection: Client-98e775cd-f672-11f0-8001-d684c398e257

2026-01-21 03:32:09,640 - distributed.scheduler - INFO - Close client connection: Client-ff74cc2d-f673-11f0-8001-d684c398e257

2026-01-21 03:32:09,638 - distributed.scheduler - INFO - Close client connection: Client-65ea74b9-f675-11f0-8001-d684c398e257

2026-01-21 03:32:09,638 - distributed.scheduler - INFO - Close client connection: Client-cc6dfb02-f676-11f0-8001-d684c398e257

2026-01-21 03:32:09,638 - distributed.scheduler - INFO - Close client connection: Client-32ea8325-f678-11f0-8001-d684c398e257

2026-01-21 03:32:09,637 - distributed.scheduler - INFO - Remove client Client-5118a9f1-f624-11f0-8001-d684c398e257

2026-01-21 03:32:09,636 - distributed.scheduler - INFO - Remove client Client-b79528a1-f625-11f0-8001-d684c398e257

2026-01-21 03:32:09,636 - distributed.scheduler - INFO - Remove client Client-1e1e26c0-f627-11f0-8001-d684c398e257

2026-01-21 03:32:09,636 - distributed.scheduler - INFO - Remove client Client-eb1fe4d5-f629-11f0-8001-d684c398e257

2026-01-21 03:32:09,636 - distributed.scheduler - INFO - Remove client Client-84a050a6-f628-11f0-8001-d684c398e257

2026-01-21 03:32:09,636 - distributed.scheduler - INFO - Remove client Client-51941e9f-f62b-11f0-8001-d684c398e257

2026-01-21 03:32:09,635 - distributed.scheduler - INFO - Remove client Client-b8151ff5-f62c-11f0-8001-d684c398e257

2026-01-21 03:32:09,635 - distributed.scheduler - INFO - Remove client Client-1e91e7a5-f62e-11f0-8001-d684c398e257

2026-01-21 03:32:09,635 - distributed.scheduler - INFO - Remove client Client-850f7822-f62f-11f0-8001-d684c398e257

2026-01-21 03:32:09,634 - distributed.scheduler - INFO - Remove client Client-eb8ecdfb-f630-11f0-8001-d684c398e257

2026-01-21 03:32:09,634 - distributed.scheduler - INFO - Remove client Client-b87a9e26-f633-11f0-8001-d684c398e257

2026-01-21 03:32:09,634 - distributed.scheduler - INFO - Remove client Client-520b8d1f-f632-11f0-8001-d684c398e257

2026-01-21 03:32:09,634 - distributed.scheduler - INFO - Remove client Client-856e7507-f636-11f0-8001-d684c398e257

2026-01-21 03:32:09,633 - distributed.scheduler - INFO - Remove client Client-1ef8320b-f635-11f0-8001-d684c398e257

2026-01-21 03:32:09,633 - distributed.scheduler - INFO - Remove client Client-ebe300cd-f637-11f0-8001-d684c398e257

2026-01-21 03:32:09,633 - distributed.scheduler - INFO - Remove client Client-52634022-f639-11f0-8001-d684c398e257

2026-01-21 03:32:09,633 - distributed.scheduler - INFO - Remove client Client-b8f59e3a-f63a-11f0-8001-d684c398e257

2026-01-21 03:32:09,633 - distributed.scheduler - INFO - Remove client Client-1f676ecf-f63c-11f0-8001-d684c398e257

2026-01-21 03:32:09,632 - distributed.scheduler - INFO - Remove client Client-85f76639-f63d-11f0-8001-d684c398e257

2026-01-21 03:32:09,632 - distributed.scheduler - INFO - Remove client Client-ec83fe70-f63e-11f0-8001-d684c398e257

2026-01-21 03:32:09,632 - distributed.scheduler - INFO - Remove client Client-53084f72-f640-11f0-8001-d684c398e257

2026-01-21 03:32:09,631 - distributed.scheduler - INFO - Remove client Client-b98faaea-f641-11f0-8001-d684c398e257

2026-01-21 03:32:09,631 - distributed.scheduler - INFO - Remove client Client-fc2f1739-f642-11f0-8001-d684c398e257

2026-01-21 03:32:09,625 - distributed.scheduler - INFO - Remove client Client-62ba4601-f644-11f0-8001-d684c398e257

2026-01-21 03:32:09,625 - distributed.scheduler - INFO - Remove client Client-c930c4bc-f645-11f0-8001-d684c398e257

2026-01-21 03:32:09,625 - distributed.scheduler - INFO - Remove client Client-2fa9d7c4-f647-11f0-8001-d684c398e257

2026-01-21 03:32:09,624 - distributed.scheduler - INFO - Remove client Client-961e2cb4-f648-11f0-8001-d684c398e257

2026-01-21 03:32:09,624 - distributed.scheduler - INFO - Remove client Client-fc9ce18a-f649-11f0-8001-d684c398e257

2026-01-21 03:32:09,624 - distributed.scheduler - INFO - Remove client Client-631e5520-f64b-11f0-8001-d684c398e257

2026-01-21 03:32:09,623 - distributed.scheduler - INFO - Remove client Client-c997e9ed-f64c-11f0-8001-d684c398e257

2026-01-21 03:32:09,623 - distributed.scheduler - INFO - Remove client Client-301c4d8e-f64e-11f0-8001-d684c398e257

2026-01-21 03:32:09,623 - distributed.scheduler - INFO - Remove client Client-9688fc1c-f64f-11f0-8001-d684c398e257

2026-01-21 03:32:09,622 - distributed.scheduler - INFO - Remove client Client-fcea9651-f650-11f0-8001-d684c398e257

2026-01-21 03:32:09,622 - distributed.scheduler - INFO - Remove client Client-636bfdef-f652-11f0-8001-d684c398e257

2026-01-21 03:32:09,622 - distributed.scheduler - INFO - Remove client Client-307298b8-f655-11f0-8001-d684c398e257

2026-01-21 03:32:09,621 - distributed.scheduler - INFO - Remove client Client-c9ee6f04-f653-11f0-8001-d684c398e257

2026-01-21 03:32:09,621 - distributed.scheduler - INFO - Remove client Client-96f43e35-f656-11f0-8001-d684c398e257

2026-01-21 03:32:09,620 - distributed.scheduler - INFO - Remove client Client-fd6d318f-f657-11f0-8001-d684c398e257

2026-01-21 03:32:09,620 - distributed.scheduler - INFO - Remove client Client-63e64d7a-f659-11f0-8001-d684c398e257

2026-01-21 03:32:09,619 - distributed.scheduler - INFO - Remove client Client-ca66451d-f65a-11f0-8001-d684c398e257

2026-01-21 03:32:09,619 - distributed.scheduler - INFO - Remove client Client-30f399ec-f65c-11f0-8001-d684c398e257

2026-01-21 03:32:09,618 - distributed.scheduler - INFO - Remove client Client-97782a6d-f65d-11f0-8001-d684c398e257

2026-01-21 03:32:09,618 - distributed.scheduler - INFO - Remove client Client-3181c928-f663-11f0-8001-d684c398e257

2026-01-21 03:32:09,617 - distributed.scheduler - INFO - Remove client Client-fdfbf056-f65e-11f0-8001-d684c398e257

2026-01-21 03:32:09,617 - distributed.scheduler - INFO - Remove client Client-647fddd1-f660-11f0-8001-d684c398e257

2026-01-21 03:32:09,616 - distributed.scheduler - INFO - Remove client Client-cb075f12-f661-11f0-8001-d684c398e257

2026-01-21 03:32:09,616 - distributed.scheduler - INFO - Remove client Client-97fdef50-f664-11f0-8001-d684c398e257

2026-01-21 03:32:09,616 - distributed.scheduler - INFO - Remove client Client-fe7aba6f-f665-11f0-8001-d684c398e257

2026-01-21 03:32:09,615 - distributed.scheduler - INFO - Remove client Client-64f3e302-f667-11f0-8001-d684c398e257

2026-01-21 03:32:09,615 - distributed.scheduler - INFO - Remove client Client-cb71624b-f668-11f0-8001-d684c398e257

2026-01-21 03:32:09,614 - distributed.scheduler - INFO - Remove client Client-31fbd108-f66a-11f0-8001-d684c398e257

2026-01-21 03:32:09,614 - distributed.scheduler - INFO - Remove client Client-988a53c8-f66b-11f0-8001-d684c398e257

2026-01-21 03:32:09,613 - distributed.scheduler - INFO - Remove client Client-fef19f98-f66c-11f0-8001-d684c398e257

2026-01-21 03:32:09,613 - distributed.scheduler - INFO - Remove client Client-cbe2d35c-f66f-11f0-8001-d684c398e257

2026-01-21 03:32:09,612 - distributed.scheduler - INFO - Remove client Client-6566d0fa-f66e-11f0-8001-d684c398e257

2026-01-21 03:32:09,612 - distributed.scheduler - INFO - Remove client Client-325af581-f671-11f0-8001-d684c398e257

2026-01-21 03:32:09,611 - distributed.scheduler - INFO - Remove client Client-98e775cd-f672-11f0-8001-d684c398e257

2026-01-21 03:32:09,610 - distributed.scheduler - INFO - Remove client Client-ff74cc2d-f673-11f0-8001-d684c398e257

2026-01-21 03:32:09,599 - distributed.scheduler - INFO - Remove client Client-65ea74b9-f675-11f0-8001-d684c398e257

2026-01-21 03:32:09,598 - distributed.scheduler - INFO - Remove client Client-cc6dfb02-f676-11f0-8001-d684c398e257

2026-01-21 03:32:09,597 - distributed.scheduler - INFO - Remove client Client-32ea8325-f678-11f0-8001-d684c398e257

2026-01-21 03:32:08,750 - distributed.scheduler - INFO - Close client connection: Client-9972777f-f679-11f0-8001-d684c398e257

2026-01-21 03:32:08,749 - distributed.scheduler - INFO - Remove client Client-9972777f-f679-11f0-8001-d684c398e257

2026-01-21 03:32:08,748 - distributed.scheduler - INFO - Remove client Client-9972777f-f679-11f0-8001-d684c398e257

2026-01-21 03:30:57,462 - distributed.scheduler - INFO - Receive client connection: Client-9972777f-f679-11f0-8001-d684c398e257

2026-01-21 03:20:55,950 - distributed.scheduler - INFO - Receive client connection: Client-32ea8325-f678-11f0-8001-d684c398e257

2026-01-21 03:10:54,504 - distributed.scheduler - INFO - Receive client connection: Client-cc6dfb02-f676-11f0-8001-d684c398e257

2026-01-21 03:00:53,020 - distributed.scheduler - INFO - Receive client connection: Client-65ea74b9-f675-11f0-8001-d684c398e257

2026-01-21 02:50:51,629 - distributed.scheduler - INFO - Receive client connection: Client-ff74cc2d-f673-11f0-8001-d684c398e257

2026-01-21 02:40:50,073 - distributed.scheduler - INFO - Receive client connection: Client-98e775cd-f672-11f0-8001-d684c398e257

2026-01-21 02:30:48,525 - distributed.scheduler - INFO - Receive client connection: Client-325af581-f671-11f0-8001-d684c398e257

2026-01-21 02:20:47,112 - distributed.scheduler - INFO - Receive client connection: Client-cbe2d35c-f66f-11f0-8001-d684c398e257

2026-01-21 02:10:45,673 - distributed.scheduler - INFO - Receive client connection: Client-6566d0fa-f66e-11f0-8001-d684c398e257

2026-01-21 02:00:44,284 - distributed.scheduler - INFO - Receive client connection: Client-fef19f98-f66c-11f0-8001-d684c398e257

2026-01-21 01:50:42,992 - distributed.scheduler - INFO - Receive client connection: Client-988a53c8-f66b-11f0-8001-d684c398e257

2026-01-21 01:40:41,439 - distributed.scheduler - INFO - Receive client connection: Client-31fbd108-f66a-11f0-8001-d684c398e257

2026-01-21 01:30:39,893 - distributed.scheduler - INFO - Receive client connection: Client-cb71624b-f668-11f0-8001-d684c398e257

2026-01-21 01:20:38,449 - distributed.scheduler - INFO - Receive client connection: Client-64f3e302-f667-11f0-8001-d684c398e257

2026-01-21 01:10:37,024 - distributed.scheduler - INFO - Receive client connection: Client-fe7aba6f-f665-11f0-8001-d684c398e257

2026-01-21 01:00:35,587 - distributed.scheduler - INFO - Receive client connection: Client-97fdef50-f664-11f0-8001-d684c398e257

2026-01-21 00:50:34,143 - distributed.scheduler - INFO - Receive client connection: Client-3181c928-f663-11f0-8001-d684c398e257

2026-01-21 00:40:32,725 - distributed.scheduler - INFO - Receive client connection: Client-cb075f12-f661-11f0-8001-d684c398e257

2026-01-21 00:30:31,212 - distributed.scheduler - INFO - Receive client connection: Client-647fddd1-f660-11f0-8001-d684c398e257

2026-01-21 00:20:29,725 - distributed.scheduler - INFO - Receive client connection: Client-fdfbf056-f65e-11f0-8001-d684c398e257

2026-01-21 00:10:28,232 - distributed.scheduler - INFO - Receive client connection: Client-97782a6d-f65d-11f0-8001-d684c398e257

2026-01-21 00:00:26,752 - distributed.scheduler - INFO - Receive client connection: Client-30f399ec-f65c-11f0-8001-d684c398e257

2026-01-20 23:50:25,188 - distributed.scheduler - INFO - Receive client connection: Client-ca66451d-f65a-11f0-8001-d684c398e257

2026-01-20 23:40:23,730 - distributed.scheduler - INFO - Receive client connection: Client-63e64d7a-f659-11f0-8001-d684c398e257

2026-01-20 23:30:22,308 - distributed.scheduler - INFO - Receive client connection: Client-fd6d318f-f657-11f0-8001-d684c398e257

2026-01-20 23:20:20,939 - distributed.scheduler - INFO - Receive client connection: Client-96f43e35-f656-11f0-8001-d684c398e257

2026-01-20 23:10:19,415 - distributed.scheduler - INFO - Receive client connection: Client-307298b8-f655-11f0-8001-d684c398e257

2026-01-20 23:00:17,933 - distributed.scheduler - INFO - Receive client connection: Client-c9ee6f04-f653-11f0-8001-d684c398e257

2026-01-20 22:50:16,444 - distributed.scheduler - INFO - Receive client connection: Client-636bfdef-f652-11f0-8001-d684c398e257

2026-01-20 22:40:14,969 - distributed.scheduler - INFO - Receive client connection: Client-fcea9651-f650-11f0-8001-d684c398e257

2026-01-20 22:30:13,702 - distributed.scheduler - INFO - Receive client connection: Client-9688fc1c-f64f-11f0-8001-d684c398e257

2026-01-20 22:20:12,374 - distributed.scheduler - INFO - Receive client connection: Client-301c4d8e-f64e-11f0-8001-d684c398e257

2026-01-20 22:10:10,883 - distributed.scheduler - INFO - Receive client connection: Client-c997e9ed-f64c-11f0-8001-d684c398e257

2026-01-20 22:00:09,458 - distributed.scheduler - INFO - Receive client connection: Client-631e5520-f64b-11f0-8001-d684c398e257

2026-01-20 21:50:07,988 - distributed.scheduler - INFO - Receive client connection: Client-fc9ce18a-f649-11f0-8001-d684c398e257

2026-01-20 21:40:06,537 - distributed.scheduler - INFO - Receive client connection: Client-961e2cb4-f648-11f0-8001-d684c398e257

2026-01-20 21:30:05,145 - distributed.scheduler - INFO - Receive client connection: Client-2fa9d7c4-f647-11f0-8001-d684c398e257

2026-01-20 21:20:03,728 - distributed.scheduler - INFO - Receive client connection: Client-c930c4bc-f645-11f0-8001-d684c398e257

2026-01-20 21:10:02,329 - distributed.scheduler - INFO - Receive client connection: Client-62ba4601-f644-11f0-8001-d684c398e257

2026-01-20 21:00:00,787 - distributed.scheduler - INFO - Receive client connection: Client-fc2f1739-f642-11f0-8001-d684c398e257

2026-01-20 20:50:59,521 - distributed.scheduler - INFO - Receive client connection: Client-b98faaea-f641-11f0-8001-d684c398e257

2026-01-20 20:40:58,010 - distributed.scheduler - INFO - Receive client connection: Client-53084f72-f640-11f0-8001-d684c398e257

2026-01-20 20:30:56,524 - distributed.scheduler - INFO - Receive client connection: Client-ec83fe70-f63e-11f0-8001-d684c398e257

2026-01-20 20:20:54,974 - distributed.scheduler - INFO - Receive client connection: Client-85f76639-f63d-11f0-8001-d684c398e257

2026-01-20 20:10:53,404 - distributed.scheduler - INFO - Receive client connection: Client-1f676ecf-f63c-11f0-8001-d684c398e257

2026-01-20 20:00:52,030 - distributed.scheduler - INFO - Receive client connection: Client-b8f59e3a-f63a-11f0-8001-d684c398e257

2026-01-20 19:50:50,453 - distributed.scheduler - INFO - Receive client connection: Client-52634022-f639-11f0-8001-d684c398e257

2026-01-20 19:40:48,987 - distributed.scheduler - INFO - Receive client connection: Client-ebe300cd-f637-11f0-8001-d684c398e257

2026-01-20 19:30:47,596 - distributed.scheduler - INFO - Receive client connection: Client-856e7507-f636-11f0-8001-d684c398e257

2026-01-20 19:20:46,197 - distributed.scheduler - INFO - Receive client connection: Client-1ef8320b-f635-11f0-8001-d684c398e257

2026-01-20 19:10:44,746 - distributed.scheduler - INFO - Receive client connection: Client-b87a9e26-f633-11f0-8001-d684c398e257

2026-01-20 19:00:48,785 - distributed.scheduler - ERROR - Shut down workers that don't have promised key: [], ('len-agg-a69406de6ecc3c8fd3e6faa83c8565f8', 0) NoneType: None

2026-01-20 19:00:48,784 - distributed.scheduler - ERROR - Couldn't gather keys {"('len-agg-a69406de6ecc3c8fd3e6faa83c8565f8', 0)": []} state: ['waiting'] workers: [] NoneType: None

2026-01-20 19:00:43,394 - distributed.scheduler - INFO - Receive client connection: Client-520b8d1f-f632-11f0-8001-d684c398e257

2026-01-20 18:50:41,955 - distributed.scheduler - INFO - Receive client connection: Client-eb8ecdfb-f630-11f0-8001-d684c398e257

2026-01-20 18:40:40,497 - distributed.scheduler - INFO - Receive client connection: Client-850f7822-f62f-11f0-8001-d684c398e257

2026-01-20 18:30:39,050 - distributed.scheduler - INFO - Receive client connection: Client-1e91e7a5-f62e-11f0-8001-d684c398e257

2026-01-20 18:20:37,606 - distributed.scheduler - INFO - Receive client connection: Client-b8151ff5-f62c-11f0-8001-d684c398e257

2026-01-20 18:10:36,146 - distributed.scheduler - INFO - Receive client connection: Client-51941e9f-f62b-11f0-8001-d684c398e257

2026-01-20 18:00:34,748 - distributed.scheduler - INFO - Receive client connection: Client-eb1fe4d5-f629-11f0-8001-d684c398e257

2026-01-20 17:50:33,292 - distributed.scheduler - INFO - Receive client connection: Client-84a050a6-f628-11f0-8001-d684c398e257

2026-01-20 17:40:31,814 - distributed.scheduler - INFO - Receive client connection: Client-1e1e26c0-f627-11f0-8001-d684c398e257

2026-01-20 17:30:30,293 - distributed.scheduler - INFO - Receive client connection: Client-b79528a1-f625-11f0-8001-d684c398e257

2026-01-20 17:20:28,862 - distributed.scheduler - INFO - Receive client connection: Client-5118a9f1-f624-11f0-8001-d684c398e257

2026-01-20 17:11:08,802 - distributed.scheduler - INFO - Close client connection: Client-ea8d0649-f622-11f0-8001-d684c398e257

2026-01-20 17:11:08,801 - distributed.scheduler - INFO - Remove client Client-ea8d0649-f622-11f0-8001-d684c398e257

2026-01-20 17:11:08,800 - distributed.scheduler - INFO - Remove client Client-ea8d0649-f622-11f0-8001-d684c398e257

2026-01-20 17:10:27,323 - distributed.scheduler - INFO - Receive client connection: Client-ea8d0649-f622-11f0-8001-d684c398e257

2026-01-20 17:01:42,243 - distributed.scheduler - INFO - Close client connection: Client-840c52bb-f621-11f0-8001-d684c398e257

2026-01-20 17:01:42,242 - distributed.scheduler - INFO - Remove client Client-840c52bb-f621-11f0-8001-d684c398e257

2026-01-20 17:01:42,240 - distributed.scheduler - INFO - Remove client Client-840c52bb-f621-11f0-8001-d684c398e257

2026-01-20 17:00:25,851 - distributed.scheduler - INFO - Receive client connection: Client-840c52bb-f621-11f0-8001-d684c398e257

2026-01-20 16:51:03,909 - distributed.scheduler - INFO - Close client connection: Client-1d985529-f620-11f0-8001-d684c398e257

2026-01-20 16:51:03,907 - distributed.scheduler - INFO - Remove client Client-1d985529-f620-11f0-8001-d684c398e257

2026-01-20 16:51:03,906 - distributed.scheduler - INFO - Remove client Client-1d985529-f620-11f0-8001-d684c398e257

2026-01-20 16:50:24,471 - distributed.scheduler - INFO - Receive client connection: Client-1d985529-f620-11f0-8001-d684c398e257

2026-01-20 16:41:06,138 - distributed.scheduler - INFO - Close client connection: Client-b71765e2-f61e-11f0-8001-d684c398e257

2026-01-20 16:41:06,137 - distributed.scheduler - INFO - Remove client Client-b71765e2-f61e-11f0-8001-d684c398e257

2026-01-20 16:41:06,135 - distributed.scheduler - INFO - Remove client Client-b71765e2-f61e-11f0-8001-d684c398e257

2026-01-20 16:40:22,999 - distributed.scheduler - INFO - Receive client connection: Client-b71765e2-f61e-11f0-8001-d684c398e257

2026-01-20 16:31:47,079 - distributed.scheduler - INFO - Close client connection: Client-5094b03e-f61d-11f0-8001-d684c398e257

2026-01-20 16:31:47,078 - distributed.scheduler - INFO - Remove client Client-5094b03e-f61d-11f0-8001-d684c398e257

2026-01-20 16:31:47,077 - distributed.scheduler - INFO - Remove client Client-5094b03e-f61d-11f0-8001-d684c398e257

2026-01-20 16:30:21,529 - distributed.scheduler - INFO - Receive client connection: Client-5094b03e-f61d-11f0-8001-d684c398e257

2026-01-20 16:21:04,598 - distributed.scheduler - INFO - Close client connection: Client-ea0b598f-f61b-11f0-8001-d684c398e257

2026-01-20 16:21:04,598 - distributed.scheduler - INFO - Remove client Client-ea0b598f-f61b-11f0-8001-d684c398e257

2026-01-20 16:21:04,597 - distributed.scheduler - INFO - Remove client Client-ea0b598f-f61b-11f0-8001-d684c398e257

2026-01-20 16:20:19,993 - distributed.scheduler - INFO - Receive client connection: Client-ea0b598f-f61b-11f0-8001-d684c398e257

2026-01-20 16:11:03,933 - distributed.scheduler - INFO - Close client connection: Client-8393b8ea-f61a-11f0-8001-d684c398e257

2026-01-20 16:11:03,931 - distributed.scheduler - INFO - Remove client Client-8393b8ea-f61a-11f0-8001-d684c398e257

2026-01-20 16:11:03,930 - distributed.scheduler - INFO - Remove client Client-8393b8ea-f61a-11f0-8001-d684c398e257

2026-01-20 16:10:18,593 - distributed.scheduler - INFO - Receive client connection: Client-8393b8ea-f61a-11f0-8001-d684c398e257

2026-01-20 16:01:34,430 - distributed.scheduler - INFO - Close client connection: Client-1d120693-f619-11f0-8001-d684c398e257

2026-01-20 16:01:34,430 - distributed.scheduler - INFO - Remove client Client-1d120693-f619-11f0-8001-d684c398e257

2026-01-20 16:01:34,429 - distributed.scheduler - INFO - Remove client Client-1d120693-f619-11f0-8001-d684c398e257

2026-01-20 16:00:17,096 - distributed.scheduler - INFO - Receive client connection: Client-1d120693-f619-11f0-8001-d684c398e257

2026-01-20 15:51:04,712 - distributed.scheduler - INFO - Close client connection: Client-1ccfb02c-f612-11f0-8001-d684c398e257

2026-01-20 15:51:04,712 - distributed.scheduler - INFO - Close client connection: Client-834bca8d-f613-11f0-8001-d684c398e257

2026-01-20 15:51:04,712 - distributed.scheduler - INFO - Close client connection: Client-e9c8dbb6-f614-11f0-8001-d684c398e257

2026-01-20 15:51:04,711 - distributed.scheduler - INFO - Close client connection: Client-502fd0e3-f616-11f0-8001-d684c398e257

2026-01-20 15:51:04,711 - distributed.scheduler - INFO - Remove client Client-1ccfb02c-f612-11f0-8001-d684c398e257

2026-01-20 15:51:04,711 - distributed.scheduler - INFO - Remove client Client-834bca8d-f613-11f0-8001-d684c398e257

2026-01-20 15:51:04,710 - distributed.scheduler - INFO - Remove client Client-e9c8dbb6-f614-11f0-8001-d684c398e257

2026-01-20 15:51:04,710 - distributed.scheduler - INFO - Remove client Client-502fd0e3-f616-11f0-8001-d684c398e257

2026-01-20 15:51:03,934 - distributed.scheduler - INFO - Close client connection: Client-b69214c8-f617-11f0-8001-d684c398e257

2026-01-20 15:51:03,931 - distributed.scheduler - INFO - Remove client Client-b69214c8-f617-11f0-8001-d684c398e257

2026-01-20 15:51:03,929 - distributed.scheduler - INFO - Remove client Client-b69214c8-f617-11f0-8001-d684c398e257

2026-01-20 15:50:15,639 - distributed.scheduler - INFO - Receive client connection: Client-b69214c8-f617-11f0-8001-d684c398e257

2026-01-20 15:40:14,371 - distributed.scheduler - INFO - Receive client connection: Client-502fd0e3-f616-11f0-8001-d684c398e257

2026-01-20 15:30:13,071 - distributed.scheduler - INFO - Receive client connection: Client-e9c8dbb6-f614-11f0-8001-d684c398e257

2026-01-20 15:20:11,630 - distributed.scheduler - INFO - Receive client connection: Client-834bca8d-f613-11f0-8001-d684c398e257

2026-01-20 15:10:10,202 - distributed.scheduler - INFO - Receive client connection: Client-1ccfb02c-f612-11f0-8001-d684c398e257

2026-01-20 15:01:27,046 - distributed.scheduler - INFO - Close client connection: Client-b654d0de-f610-11f0-8001-d684c398e257

2026-01-20 15:01:27,045 - distributed.scheduler - INFO - Remove client Client-b654d0de-f610-11f0-8001-d684c398e257

2026-01-20 15:01:27,044 - distributed.scheduler - INFO - Remove client Client-b654d0de-f610-11f0-8001-d684c398e257

2026-01-20 15:00:08,768 - distributed.scheduler - INFO - Receive client connection: Client-b654d0de-f610-11f0-8001-d684c398e257

2026-01-20 14:50:47,391 - distributed.scheduler - INFO - Close client connection: Client-4ff0fd5e-f60f-11f0-8001-d684c398e257

2026-01-20 14:50:47,389 - distributed.scheduler - INFO - Remove client Client-4ff0fd5e-f60f-11f0-8001-d684c398e257

2026-01-20 14:50:47,387 - distributed.scheduler - INFO - Remove client Client-4ff0fd5e-f60f-11f0-8001-d684c398e257

2026-01-20 14:50:07,495 - distributed.scheduler - INFO - Receive client connection: Client-4ff0fd5e-f60f-11f0-8001-d684c398e257

2026-01-20 14:40:51,532 - distributed.scheduler - INFO - Close client connection: Client-e971af52-f60d-11f0-8001-d684c398e257

2026-01-20 14:40:51,531 - distributed.scheduler - INFO - Remove client Client-e971af52-f60d-11f0-8001-d684c398e257

2026-01-20 14:40:51,530 - distributed.scheduler - INFO - Remove client Client-e971af52-f60d-11f0-8001-d684c398e257

2026-01-20 14:40:06,034 - distributed.scheduler - INFO - Receive client connection: Client-e971af52-f60d-11f0-8001-d684c398e257

2026-01-20 14:31:16,900 - distributed.scheduler - INFO - Close client connection: Client-82f6d55a-f60c-11f0-8001-d684c398e257

2026-01-20 14:31:16,899 - distributed.scheduler - INFO - Remove client Client-82f6d55a-f60c-11f0-8001-d684c398e257

2026-01-20 14:31:16,897 - distributed.scheduler - INFO - Remove client Client-82f6d55a-f60c-11f0-8001-d684c398e257

2026-01-20 14:30:04,602 - distributed.scheduler - INFO - Receive client connection: Client-82f6d55a-f60c-11f0-8001-d684c398e257

2026-01-20 14:20:43,534 - distributed.scheduler - INFO - Close client connection: Client-1c753d0e-f60b-11f0-8001-d684c398e257

2026-01-20 14:20:43,533 - distributed.scheduler - INFO - Remove client Client-1c753d0e-f60b-11f0-8001-d684c398e257

2026-01-20 14:20:43,533 - distributed.scheduler - INFO - Remove client Client-1c753d0e-f60b-11f0-8001-d684c398e257

2026-01-20 14:20:03,132 - distributed.scheduler - INFO - Receive client connection: Client-1c753d0e-f60b-11f0-8001-d684c398e257

2026-01-20 14:10:38,311 - distributed.scheduler - INFO - Close client connection: Client-b5e636ff-f609-11f0-8001-d684c398e257

2026-01-20 14:10:38,311 - distributed.scheduler - INFO - Remove client Client-b5e636ff-f609-11f0-8001-d684c398e257

2026-01-20 14:10:38,310 - distributed.scheduler - INFO - Remove client Client-b5e636ff-f609-11f0-8001-d684c398e257

2026-01-20 14:10:01,571 - distributed.scheduler - INFO - Receive client connection: Client-b5e636ff-f609-11f0-8001-d684c398e257

2026-01-20 14:01:05,931 - distributed.scheduler - INFO - Close client connection: Client-4f651a6a-f608-11f0-8001-d684c398e257

2026-01-20 14:01:05,927 - distributed.scheduler - INFO - Remove client Client-4f651a6a-f608-11f0-8001-d684c398e257

2026-01-20 14:01:05,926 - distributed.scheduler - INFO - Remove client Client-4f651a6a-f608-11f0-8001-d684c398e257

2026-01-20 14:00:00,098 - distributed.scheduler - INFO - Receive client connection: Client-4f651a6a-f608-11f0-8001-d684c398e257

2026-01-20 13:51:32,374 - distributed.scheduler - INFO - Close client connection: Client-0cca28a4-f607-11f0-8001-d684c398e257

2026-01-20 13:51:32,372 - distributed.scheduler - INFO - Remove client Client-0cca28a4-f607-11f0-8001-d684c398e257

2026-01-20 13:51:32,371 - distributed.scheduler - INFO - Remove client Client-0cca28a4-f607-11f0-8001-d684c398e257

2026-01-20 13:50:58,856 - distributed.scheduler - INFO - Receive client connection: Client-0cca28a4-f607-11f0-8001-d684c398e257

2026-01-20 13:41:32,683 - distributed.scheduler - INFO - Close client connection: Client-a64b311e-f605-11f0-8001-d684c398e257

2026-01-20 13:41:32,682 - distributed.scheduler - INFO - Remove client Client-a64b311e-f605-11f0-8001-d684c398e257

2026-01-20 13:41:32,681 - distributed.scheduler - INFO - Remove client Client-a64b311e-f605-11f0-8001-d684c398e257

2026-01-20 13:40:57,399 - distributed.scheduler - INFO - Receive client connection: Client-a64b311e-f605-11f0-8001-d684c398e257

2026-01-20 13:32:05,248 - distributed.scheduler - INFO - Close client connection: Client-3fcd227e-f604-11f0-8001-d684c398e257

2026-01-20 13:32:05,247 - distributed.scheduler - INFO - Remove client Client-3fcd227e-f604-11f0-8001-d684c398e257

2026-01-20 13:32:05,246 - distributed.scheduler - INFO - Remove client Client-3fcd227e-f604-11f0-8001-d684c398e257

2026-01-20 13:30:55,952 - distributed.scheduler - INFO - Receive client connection: Client-3fcd227e-f604-11f0-8001-d684c398e257

2026-01-20 13:21:30,684 - distributed.scheduler - INFO - Close client connection: Client-726ce105-f5fa-11f0-8001-d684c398e257

2026-01-20 13:21:30,684 - distributed.scheduler - INFO - Close client connection: Client-3f65b6c6-f5fd-11f0-8001-d684c398e257

2026-01-20 13:21:30,684 - distributed.scheduler - INFO - Close client connection: Client-0bf2f573-f5f9-11f0-8001-d684c398e257

2026-01-20 13:21:30,684 - distributed.scheduler - INFO - Close client connection: Client-a5e1fead-f5fe-11f0-8001-d684c398e257

2026-01-20 13:21:30,683 - distributed.scheduler - INFO - Close client connection: Client-d8e18e19-f5fb-11f0-8001-d684c398e257

2026-01-20 13:21:30,683 - distributed.scheduler - INFO - Close client connection: Client-72cd7f3e-f601-11f0-8001-d684c398e257

2026-01-20 13:21:30,683 - distributed.scheduler - INFO - Close client connection: Client-0c63d9a6-f600-11f0-8001-d684c398e257

2026-01-20 13:21:30,681 - distributed.scheduler - INFO - Remove client Client-726ce105-f5fa-11f0-8001-d684c398e257

2026-01-20 13:21:30,679 - distributed.scheduler - INFO - Remove client Client-3f65b6c6-f5fd-11f0-8001-d684c398e257

2026-01-20 13:21:30,679 - distributed.scheduler - INFO - Remove client Client-0bf2f573-f5f9-11f0-8001-d684c398e257

2026-01-20 13:21:30,678 - distributed.scheduler - INFO - Remove client Client-a5e1fead-f5fe-11f0-8001-d684c398e257

2026-01-20 13:21:30,677 - distributed.scheduler - INFO - Remove client Client-d8e18e19-f5fb-11f0-8001-d684c398e257

2026-01-20 13:21:30,677 - distributed.scheduler - INFO - Remove client Client-72cd7f3e-f601-11f0-8001-d684c398e257

2026-01-20 13:21:30,676 - distributed.scheduler - INFO - Remove client Client-0c63d9a6-f600-11f0-8001-d684c398e257

2026-01-20 13:21:29,852 - distributed.scheduler - INFO - Close client connection: Client-d94c48f1-f602-11f0-8001-d684c398e257

2026-01-20 13:21:29,851 - distributed.scheduler - INFO - Remove client Client-d94c48f1-f602-11f0-8001-d684c398e257

2026-01-20 13:21:29,851 - distributed.scheduler - INFO - Remove client Client-d94c48f1-f602-11f0-8001-d684c398e257

2026-01-20 13:20:54,473 - distributed.scheduler - INFO - Receive client connection: Client-d94c48f1-f602-11f0-8001-d684c398e257

2026-01-20 13:10:53,018 - distributed.scheduler - INFO - Receive client connection: Client-72cd7f3e-f601-11f0-8001-d684c398e257

2026-01-20 13:00:51,700 - distributed.scheduler - INFO - Receive client connection: Client-0c63d9a6-f600-11f0-8001-d684c398e257

2026-01-20 12:50:50,229 - distributed.scheduler - INFO - Receive client connection: Client-a5e1fead-f5fe-11f0-8001-d684c398e257

2026-01-20 12:40:48,786 - distributed.scheduler - INFO - Receive client connection: Client-3f65b6c6-f5fd-11f0-8001-d684c398e257

2026-01-20 12:30:47,294 - distributed.scheduler - INFO - Receive client connection: Client-d8e18e19-f5fb-11f0-8001-d684c398e257

2026-01-20 12:20:45,904 - distributed.scheduler - INFO - Receive client connection: Client-726ce105-f5fa-11f0-8001-d684c398e257

2026-01-20 12:10:44,487 - distributed.scheduler - INFO - Receive client connection: Client-0bf2f573-f5f9-11f0-8001-d684c398e257

2026-01-20 12:02:02,125 - distributed.scheduler - INFO - Close client connection: Client-a57c9bbd-f5f7-11f0-8001-d684c398e257

2026-01-20 12:02:02,123 - distributed.scheduler - INFO - Remove client Client-a57c9bbd-f5f7-11f0-8001-d684c398e257

2026-01-20 12:02:02,121 - distributed.scheduler - INFO - Remove client Client-a57c9bbd-f5f7-11f0-8001-d684c398e257

2026-01-20 12:00:43,089 - distributed.scheduler - INFO - Receive client connection: Client-a57c9bbd-f5f7-11f0-8001-d684c398e257

2026-01-20 11:51:27,751 - distributed.scheduler - INFO - Close client connection: Client-3efd4372-f5f6-11f0-8001-d684c398e257

2026-01-20 11:51:27,750 - distributed.scheduler - INFO - Remove client Client-3efd4372-f5f6-11f0-8001-d684c398e257

2026-01-20 11:51:27,748 - distributed.scheduler - INFO - Remove client Client-3efd4372-f5f6-11f0-8001-d684c398e257

2026-01-20 11:50:41,635 - distributed.scheduler - INFO - Receive client connection: Client-3efd4372-f5f6-11f0-8001-d684c398e257

2026-01-20 11:41:24,282 - distributed.scheduler - INFO - Close client connection: Client-d885b91e-f5f4-11f0-8001-d684c398e257

2026-01-20 11:41:24,281 - distributed.scheduler - INFO - Remove client Client-d885b91e-f5f4-11f0-8001-d684c398e257

2026-01-20 11:41:24,279 - distributed.scheduler - INFO - Remove client Client-d885b91e-f5f4-11f0-8001-d684c398e257

2026-01-20 11:40:40,225 - distributed.scheduler - INFO - Receive client connection: Client-d885b91e-f5f4-11f0-8001-d684c398e257

2026-01-20 11:31:59,809 - distributed.scheduler - INFO - Close client connection: Client-7207b96f-f5f3-11f0-8001-d684c398e257

2026-01-20 11:31:59,808 - distributed.scheduler - INFO - Remove client Client-7207b96f-f5f3-11f0-8001-d684c398e257

2026-01-20 11:31:59,806 - distributed.scheduler - INFO - Remove client Client-7207b96f-f5f3-11f0-8001-d684c398e257

2026-01-20 11:30:38,769 - distributed.scheduler - INFO - Receive client connection: Client-7207b96f-f5f3-11f0-8001-d684c398e257

2026-01-20 11:21:25,286 - distributed.scheduler - INFO - Close client connection: Client-0b83de34-f5f2-11f0-8001-d684c398e257

2026-01-20 11:21:25,286 - distributed.scheduler - INFO - Remove client Client-0b83de34-f5f2-11f0-8001-d684c398e257

2026-01-20 11:21:25,284 - distributed.scheduler - INFO - Remove client Client-0b83de34-f5f2-11f0-8001-d684c398e257

2026-01-20 11:20:37,286 - distributed.scheduler - INFO - Receive client connection: Client-0b83de34-f5f2-11f0-8001-d684c398e257

2026-01-20 11:11:20,122 - distributed.scheduler - INFO - Close client connection: Client-a4ff4020-f5f0-11f0-8001-d684c398e257

2026-01-20 11:11:20,121 - distributed.scheduler - INFO - Remove client Client-a4ff4020-f5f0-11f0-8001-d684c398e257

2026-01-20 11:11:20,119 - distributed.scheduler - INFO - Remove client Client-a4ff4020-f5f0-11f0-8001-d684c398e257

2026-01-20 11:10:35,786 - distributed.scheduler - INFO - Receive client connection: Client-a4ff4020-f5f0-11f0-8001-d684c398e257

2026-01-20 11:01:54,696 - distributed.scheduler - INFO - Close client connection: Client-3e8c7f11-f5ef-11f0-8001-d684c398e257

2026-01-20 11:01:54,694 - distributed.scheduler - INFO - Remove client Client-3e8c7f11-f5ef-11f0-8001-d684c398e257

2026-01-20 11:01:54,692 - distributed.scheduler - INFO - Remove client Client-3e8c7f11-f5ef-11f0-8001-d684c398e257

2026-01-20 11:00:34,415 - distributed.scheduler - INFO - Receive client connection: Client-3e8c7f11-f5ef-11f0-8001-d684c398e257

2026-01-20 10:51:15,310 - distributed.scheduler - INFO - Close client connection: Client-d812aeac-f5ed-11f0-8001-d684c398e257

2026-01-20 10:51:15,309 - distributed.scheduler - INFO - Remove client Client-d812aeac-f5ed-11f0-8001-d684c398e257

2026-01-20 10:51:15,308 - distributed.scheduler - INFO - Remove client Client-d812aeac-f5ed-11f0-8001-d684c398e257

2026-01-20 10:50:32,994 - distributed.scheduler - INFO - Receive client connection: Client-d812aeac-f5ed-11f0-8001-d684c398e257

2026-01-20 10:41:13,355 - distributed.scheduler - INFO - Close client connection: Client-718ecd20-f5ec-11f0-8001-d684c398e257

2026-01-20 10:41:13,354 - distributed.scheduler - INFO - Remove client Client-718ecd20-f5ec-11f0-8001-d684c398e257

2026-01-20 10:41:13,352 - distributed.scheduler - INFO - Remove client Client-718ecd20-f5ec-11f0-8001-d684c398e257

2026-01-20 10:40:31,498 - distributed.scheduler - INFO - Receive client connection: Client-718ecd20-f5ec-11f0-8001-d684c398e257

2026-01-20 10:31:42,523 - distributed.scheduler - INFO - Close client connection: Client-0b0b0fac-f5eb-11f0-8001-d684c398e257

2026-01-20 10:31:42,522 - distributed.scheduler - INFO - Remove client Client-0b0b0fac-f5eb-11f0-8001-d684c398e257

2026-01-20 10:31:42,520 - distributed.scheduler - INFO - Remove client Client-0b0b0fac-f5eb-11f0-8001-d684c398e257

2026-01-20 10:30:30,011 - distributed.scheduler - INFO - Receive client connection: Client-0b0b0fac-f5eb-11f0-8001-d684c398e257

2026-01-20 10:21:03,130 - distributed.scheduler - INFO - Close client connection: Client-a47f90f8-f5e9-11f0-8001-d684c398e257

2026-01-20 10:21:03,129 - distributed.scheduler - INFO - Remove client Client-a47f90f8-f5e9-11f0-8001-d684c398e257

2026-01-20 10:21:03,128 - distributed.scheduler - INFO - Remove client Client-a47f90f8-f5e9-11f0-8001-d684c398e257

2026-01-20 10:20:28,476 - distributed.scheduler - INFO - Receive client connection: Client-a47f90f8-f5e9-11f0-8001-d684c398e257

2026-01-20 10:11:08,550 - distributed.scheduler - INFO - Close client connection: Client-3e14b468-f5e8-11f0-8001-d684c398e257

2026-01-20 10:11:08,550 - distributed.scheduler - INFO - Remove client Client-3e14b468-f5e8-11f0-8001-d684c398e257

2026-01-20 10:11:08,548 - distributed.scheduler - INFO - Remove client Client-3e14b468-f5e8-11f0-8001-d684c398e257

2026-01-20 10:10:27,154 - distributed.scheduler - INFO - Receive client connection: Client-3e14b468-f5e8-11f0-8001-d684c398e257

2026-01-20 10:01:39,464 - distributed.scheduler - INFO - Close client connection: Client-d79ea3a7-f5e6-11f0-8001-d684c398e257

2026-01-20 10:01:39,463 - distributed.scheduler - INFO - Remove client Client-d79ea3a7-f5e6-11f0-8001-d684c398e257

2026-01-20 10:01:39,461 - distributed.scheduler - INFO - Remove client Client-d79ea3a7-f5e6-11f0-8001-d684c398e257

2026-01-20 10:00:25,754 - distributed.scheduler - INFO - Receive client connection: Client-d79ea3a7-f5e6-11f0-8001-d684c398e257

2026-01-20 09:51:05,142 - distributed.scheduler - INFO - Close client connection: Client-713c5bc5-f5e5-11f0-8001-d684c398e257

2026-01-20 09:51:05,142 - distributed.scheduler - INFO - Remove client Client-713c5bc5-f5e5-11f0-8001-d684c398e257

2026-01-20 09:51:05,140 - distributed.scheduler - INFO - Remove client Client-713c5bc5-f5e5-11f0-8001-d684c398e257

2026-01-20 09:50:24,488 - distributed.scheduler - INFO - Receive client connection: Client-713c5bc5-f5e5-11f0-8001-d684c398e257

2026-01-20 09:41:05,312 - distributed.scheduler - INFO - Close client connection: Client-0ac7a3cb-f5e4-11f0-8001-d684c398e257

2026-01-20 09:41:05,311 - distributed.scheduler - INFO - Remove client Client-0ac7a3cb-f5e4-11f0-8001-d684c398e257

2026-01-20 09:41:05,309 - distributed.scheduler - INFO - Remove client Client-0ac7a3cb-f5e4-11f0-8001-d684c398e257

2026-01-20 09:40:23,085 - distributed.scheduler - INFO - Receive client connection: Client-0ac7a3cb-f5e4-11f0-8001-d684c398e257

2026-01-20 09:31:36,487 - distributed.scheduler - INFO - Close client connection: Client-a45d064b-f5e2-11f0-8001-d684c398e257

2026-01-20 09:31:36,486 - distributed.scheduler - INFO - Remove client Client-a45d064b-f5e2-11f0-8001-d684c398e257

2026-01-20 09:31:36,484 - distributed.scheduler - INFO - Remove client Client-a45d064b-f5e2-11f0-8001-d684c398e257

2026-01-20 09:30:21,776 - distributed.scheduler - INFO - Receive client connection: Client-a45d064b-f5e2-11f0-8001-d684c398e257

2026-01-20 09:21:01,891 - distributed.scheduler - INFO - Close client connection: Client-3de027a5-f5e1-11f0-8001-d684c398e257

2026-01-20 09:21:01,890 - distributed.scheduler - INFO - Remove client Client-3de027a5-f5e1-11f0-8001-d684c398e257

2026-01-20 09:21:01,888 - distributed.scheduler - INFO - Remove client Client-3de027a5-f5e1-11f0-8001-d684c398e257

2026-01-20 09:20:20,337 - distributed.scheduler - INFO - Receive client connection: Client-3de027a5-f5e1-11f0-8001-d684c398e257

2026-01-20 09:11:02,371 - distributed.scheduler - INFO - Close client connection: Client-d76c4fbb-f5df-11f0-8001-d684c398e257

2026-01-20 09:11:02,369 - distributed.scheduler - INFO - Remove client Client-d76c4fbb-f5df-11f0-8001-d684c398e257

2026-01-20 09:11:02,368 - distributed.scheduler - INFO - Remove client Client-d76c4fbb-f5df-11f0-8001-d684c398e257

2026-01-20 09:10:18,947 - distributed.scheduler - INFO - Receive client connection: Client-d76c4fbb-f5df-11f0-8001-d684c398e257

2026-01-20 09:01:33,902 - distributed.scheduler - INFO - Close client connection: Client-70e9ac23-f5de-11f0-8001-d684c398e257

2026-01-20 09:01:33,902 - distributed.scheduler - INFO - Remove client Client-70e9ac23-f5de-11f0-8001-d684c398e257

2026-01-20 09:01:33,900 - distributed.scheduler - INFO - Remove client Client-70e9ac23-f5de-11f0-8001-d684c398e257

2026-01-20 09:00:17,467 - distributed.scheduler - INFO - Receive client connection: Client-70e9ac23-f5de-11f0-8001-d684c398e257

2026-01-20 08:51:02,570 - distributed.scheduler - INFO - Close client connection: Client-0a7dab87-f5dd-11f0-8001-d684c398e257

2026-01-20 08:51:02,569 - distributed.scheduler - INFO - Remove client Client-0a7dab87-f5dd-11f0-8001-d684c398e257

2026-01-20 08:51:02,568 - distributed.scheduler - INFO - Remove client Client-0a7dab87-f5dd-11f0-8001-d684c398e257

2026-01-20 08:50:16,137 - distributed.scheduler - INFO - Receive client connection: Client-0a7dab87-f5dd-11f0-8001-d684c398e257

2026-01-20 08:40:59,945 - distributed.scheduler - INFO - Close client connection: Client-a40a267f-f5db-11f0-8001-d684c398e257

2026-01-20 08:40:59,944 - distributed.scheduler - INFO - Remove client Client-a40a267f-f5db-11f0-8001-d684c398e257

2026-01-20 08:40:59,942 - distributed.scheduler - INFO - Remove client Client-a40a267f-f5db-11f0-8001-d684c398e257

2026-01-20 08:40:14,748 - distributed.scheduler - INFO - Receive client connection: Client-a40a267f-f5db-11f0-8001-d684c398e257

2026-01-20 08:31:32,740 - distributed.scheduler - INFO - Close client connection: Client-3d9cee65-f5da-11f0-8001-d684c398e257

2026-01-20 08:31:32,739 - distributed.scheduler - INFO - Remove client Client-3d9cee65-f5da-11f0-8001-d684c398e257

2026-01-20 08:31:32,737 - distributed.scheduler - INFO - Remove client Client-3d9cee65-f5da-11f0-8001-d684c398e257

2026-01-20 08:30:13,406 - distributed.scheduler - INFO - Receive client connection: Client-3d9cee65-f5da-11f0-8001-d684c398e257

2026-01-20 08:20:55,130 - distributed.scheduler - INFO - Close client connection: Client-d7153200-f5d8-11f0-8001-d684c398e257

2026-01-20 08:20:55,128 - distributed.scheduler - INFO - Remove client Client-d7153200-f5d8-11f0-8001-d684c398e257

2026-01-20 08:20:55,126 - distributed.scheduler - INFO - Remove client Client-d7153200-f5d8-11f0-8001-d684c398e257

2026-01-20 08:20:11,901 - distributed.scheduler - INFO - Receive client connection: Client-d7153200-f5d8-11f0-8001-d684c398e257

2026-01-20 08:10:54,139 - distributed.scheduler - INFO - Close client connection: Client-709b1f51-f5d7-11f0-8001-d684c398e257

2026-01-20 08:10:54,138 - distributed.scheduler - INFO - Remove client Client-709b1f51-f5d7-11f0-8001-d684c398e257

2026-01-20 08:10:54,136 - distributed.scheduler - INFO - Remove client Client-709b1f51-f5d7-11f0-8001-d684c398e257

2026-01-20 08:10:10,478 - distributed.scheduler - INFO - Receive client connection: Client-709b1f51-f5d7-11f0-8001-d684c398e257

2026-01-20 08:01:26,548 - distributed.scheduler - INFO - Close client connection: Client-0a321b81-f5d6-11f0-8001-d684c398e257

2026-01-20 08:01:26,547 - distributed.scheduler - INFO - Remove client Client-0a321b81-f5d6-11f0-8001-d684c398e257

2026-01-20 08:01:26,545 - distributed.scheduler - INFO - Remove client Client-0a321b81-f5d6-11f0-8001-d684c398e257

2026-01-20 08:00:09,166 - distributed.scheduler - INFO - Receive client connection: Client-0a321b81-f5d6-11f0-8001-d684c398e257

2026-01-20 07:50:50,456 - distributed.scheduler - INFO - Close client connection: Client-a3b43d6a-f5d4-11f0-8001-d684c398e257

2026-01-20 07:50:50,455 - distributed.scheduler - INFO - Remove client Client-a3b43d6a-f5d4-11f0-8001-d684c398e257

2026-01-20 07:50:50,453 - distributed.scheduler - INFO - Remove client Client-a3b43d6a-f5d4-11f0-8001-d684c398e257

2026-01-20 07:50:07,716 - distributed.scheduler - INFO - Receive client connection: Client-a3b43d6a-f5d4-11f0-8001-d684c398e257

2026-01-20 07:40:48,678 - distributed.scheduler - INFO - Close client connection: Client-3d2d9488-f5d3-11f0-8001-d684c398e257

2026-01-20 07:40:48,677 - distributed.scheduler - INFO - Remove client Client-3d2d9488-f5d3-11f0-8001-d684c398e257

2026-01-20 07:40:48,675 - distributed.scheduler - INFO - Remove client Client-3d2d9488-f5d3-11f0-8001-d684c398e257

2026-01-20 07:40:06,208 - distributed.scheduler - INFO - Receive client connection: Client-3d2d9488-f5d3-11f0-8001-d684c398e257

2026-01-20 07:31:21,085 - distributed.scheduler - INFO - Close client connection: Client-d6ae8176-f5d1-11f0-8001-d684c398e257

2026-01-20 07:31:21,084 - distributed.scheduler - INFO - Remove client Client-d6ae8176-f5d1-11f0-8001-d684c398e257

2026-01-20 07:31:21,082 - distributed.scheduler - INFO - Remove client Client-d6ae8176-f5d1-11f0-8001-d684c398e257

2026-01-20 07:30:04,747 - distributed.scheduler - INFO - Receive client connection: Client-d6ae8176-f5d1-11f0-8001-d684c398e257

2026-01-20 07:20:47,209 - distributed.scheduler - INFO - Close client connection: Client-70296aac-f5d0-11f0-8001-d684c398e257

2026-01-20 07:20:47,208 - distributed.scheduler - INFO - Remove client Client-70296aac-f5d0-11f0-8001-d684c398e257

2026-01-20 07:20:47,206 - distributed.scheduler - INFO - Remove client Client-70296aac-f5d0-11f0-8001-d684c398e257

2026-01-20 07:20:03,249 - distributed.scheduler - INFO - Receive client connection: Client-70296aac-f5d0-11f0-8001-d684c398e257

2026-01-20 07:10:44,801 - distributed.scheduler - INFO - Close client connection: Client-09a17fe2-f5cf-11f0-8001-d684c398e257

2026-01-20 07:10:44,800 - distributed.scheduler - INFO - Remove client Client-09a17fe2-f5cf-11f0-8001-d684c398e257

2026-01-20 07:10:44,798 - distributed.scheduler - INFO - Remove client Client-09a17fe2-f5cf-11f0-8001-d684c398e257

2026-01-20 07:10:01,750 - distributed.scheduler - INFO - Receive client connection: Client-09a17fe2-f5cf-11f0-8001-d684c398e257

2026-01-20 07:01:18,803 - distributed.scheduler - INFO - Close client connection: Client-a31137d3-f5cd-11f0-8001-d684c398e257

2026-01-20 07:01:18,801 - distributed.scheduler - INFO - Remove client Client-a31137d3-f5cd-11f0-8001-d684c398e257

2026-01-20 07:01:18,800 - distributed.scheduler - INFO - Remove client Client-a31137d3-f5cd-11f0-8001-d684c398e257

2026-01-20 07:00:00,161 - distributed.scheduler - INFO - Receive client connection: Client-a31137d3-f5cd-11f0-8001-d684c398e257

2026-01-20 06:51:44,149 - distributed.scheduler - INFO - Close client connection: Client-60678b6c-f5cc-11f0-8001-d684c398e257

2026-01-20 06:51:44,147 - distributed.scheduler - INFO - Remove client Client-60678b6c-f5cc-11f0-8001-d684c398e257

2026-01-20 06:51:44,146 - distributed.scheduler - INFO - Remove client Client-60678b6c-f5cc-11f0-8001-d684c398e257

2026-01-20 06:50:58,828 - distributed.scheduler - INFO - Receive client connection: Client-60678b6c-f5cc-11f0-8001-d684c398e257

2026-01-20 06:41:41,207 - distributed.scheduler - INFO - Close client connection: Client-f9ed25ea-f5ca-11f0-8001-d684c398e257

2026-01-20 06:41:41,206 - distributed.scheduler - INFO - Remove client Client-f9ed25ea-f5ca-11f0-8001-d684c398e257

2026-01-20 06:41:41,204 - distributed.scheduler - INFO - Remove client Client-f9ed25ea-f5ca-11f0-8001-d684c398e257

2026-01-20 06:40:57,407 - distributed.scheduler - INFO - Receive client connection: Client-f9ed25ea-f5ca-11f0-8001-d684c398e257

2026-01-20 06:32:17,811 - distributed.scheduler - INFO - Close client connection: Client-93714ee0-f5c9-11f0-8001-d684c398e257

2026-01-20 06:32:17,810 - distributed.scheduler - INFO - Remove client Client-93714ee0-f5c9-11f0-8001-d684c398e257

2026-01-20 06:32:17,808 - distributed.scheduler - INFO - Remove client Client-93714ee0-f5c9-11f0-8001-d684c398e257

2026-01-20 06:30:55,970 - distributed.scheduler - INFO - Receive client connection: Client-93714ee0-f5c9-11f0-8001-d684c398e257

2026-01-20 06:21:39,915 - distributed.scheduler - INFO - Close client connection: Client-2cf05f62-f5c8-11f0-8001-d684c398e257

2026-01-20 06:21:39,914 - distributed.scheduler - INFO - Remove client Client-2cf05f62-f5c8-11f0-8001-d684c398e257

2026-01-20 06:21:39,912 - distributed.scheduler - INFO - Remove client Client-2cf05f62-f5c8-11f0-8001-d684c398e257

2026-01-20 06:20:54,497 - distributed.scheduler - INFO - Receive client connection: Client-2cf05f62-f5c8-11f0-8001-d684c398e257

2026-01-20 06:11:41,613 - distributed.scheduler - INFO - Close client connection: Client-c673f994-f5c6-11f0-8001-d684c398e257

2026-01-20 06:11:41,612 - distributed.scheduler - INFO - Remove client Client-c673f994-f5c6-11f0-8001-d684c398e257

2026-01-20 06:11:41,610 - distributed.scheduler - INFO - Remove client Client-c673f994-f5c6-11f0-8001-d684c398e257

2026-01-20 06:10:53,064 - distributed.scheduler - INFO - Receive client connection: Client-c673f994-f5c6-11f0-8001-d684c398e257

2026-01-20 06:02:14,251 - distributed.scheduler - INFO - Close client connection: Client-6004e029-f5c5-11f0-8001-d684c398e257

2026-01-20 06:02:14,249 - distributed.scheduler - INFO - Remove client Client-6004e029-f5c5-11f0-8001-d684c398e257

2026-01-20 06:02:14,248 - distributed.scheduler - INFO - Remove client Client-6004e029-f5c5-11f0-8001-d684c398e257

2026-01-20 06:00:59,188 - distributed.scheduler - ERROR - Shut down workers that don't have promised key: [], ('len-agg-f7edab6d263737e8ae84ebc80c89fb38', 0) NoneType: None

2026-01-20 06:00:59,188 - distributed.scheduler - ERROR - Couldn't gather keys {"('len-agg-f7edab6d263737e8ae84ebc80c89fb38', 0)": []} state: ['waiting'] workers: [] NoneType: None

2026-01-20 06:00:51,740 - distributed.scheduler - INFO - Receive client connection: Client-6004e029-f5c5-11f0-8001-d684c398e257

2026-01-20 05:51:40,298 - distributed.scheduler - INFO - Close client connection: Client-f97f973b-f5c3-11f0-8001-d684c398e257

2026-01-20 05:51:40,297 - distributed.scheduler - INFO - Remove client Client-f97f973b-f5c3-11f0-8001-d684c398e257

2026-01-20 05:51:40,295 - distributed.scheduler - INFO - Remove client Client-f97f973b-f5c3-11f0-8001-d684c398e257

2026-01-20 05:50:50,210 - distributed.scheduler - INFO - Receive client connection: Client-f97f973b-f5c3-11f0-8001-d684c398e257

2026-01-20 05:41:37,087 - distributed.scheduler - INFO - Close client connection: Client-92fc7259-f5c2-11f0-8001-d684c398e257

2026-01-20 05:41:37,086 - distributed.scheduler - INFO - Remove client Client-92fc7259-f5c2-11f0-8001-d684c398e257

2026-01-20 05:41:37,085 - distributed.scheduler - INFO - Remove client Client-92fc7259-f5c2-11f0-8001-d684c398e257

2026-01-20 05:40:48,723 - distributed.scheduler - INFO - Receive client connection: Client-92fc7259-f5c2-11f0-8001-d684c398e257

2026-01-20 05:32:07,338 - distributed.scheduler - INFO - Close client connection: Client-2c8ab9de-f5c1-11f0-8001-d684c398e257

2026-01-20 05:32:07,337 - distributed.scheduler - INFO - Remove client Client-2c8ab9de-f5c1-11f0-8001-d684c398e257

2026-01-20 05:32:07,336 - distributed.scheduler - INFO - Remove client Client-2c8ab9de-f5c1-11f0-8001-d684c398e257

2026-01-20 05:30:47,357 - distributed.scheduler - INFO - Receive client connection: Client-2c8ab9de-f5c1-11f0-8001-d684c398e257

2026-01-20 05:21:26,018 - distributed.scheduler - INFO - Close client connection: Client-c61cde40-f5bf-11f0-8001-d684c398e257

2026-01-20 05:21:26,016 - distributed.scheduler - INFO - Remove client Client-c61cde40-f5bf-11f0-8001-d684c398e257

2026-01-20 05:21:26,015 - distributed.scheduler - INFO - Remove client Client-c61cde40-f5bf-11f0-8001-d684c398e257

2026-01-20 05:20:46,011 - distributed.scheduler - INFO - Receive client connection: Client-c61cde40-f5bf-11f0-8001-d684c398e257

2026-01-20 05:11:27,248 - distributed.scheduler - INFO - Close client connection: Client-5fafa166-f5be-11f0-8001-d684c398e257

2026-01-20 05:11:27,247 - distributed.scheduler - INFO - Remove client Client-5fafa166-f5be-11f0-8001-d684c398e257

2026-01-20 05:11:27,246 - distributed.scheduler - INFO - Remove client Client-5fafa166-f5be-11f0-8001-d684c398e257

2026-01-20 05:10:44,666 - distributed.scheduler - INFO - Receive client connection: Client-5fafa166-f5be-11f0-8001-d684c398e257

2026-01-20 05:01:57,271 - distributed.scheduler - INFO - Close client connection: Client-f9356072-f5bc-11f0-8001-d684c398e257

2026-01-20 05:01:57,270 - distributed.scheduler - INFO - Remove client Client-f9356072-f5bc-11f0-8001-d684c398e257

2026-01-20 05:01:57,268 - distributed.scheduler - INFO - Remove client Client-f9356072-f5bc-11f0-8001-d684c398e257

2026-01-20 05:00:43,239 - distributed.scheduler - INFO - Receive client connection: Client-f9356072-f5bc-11f0-8001-d684c398e257

2026-01-20 04:51:23,128 - distributed.scheduler - INFO - Close client connection: Client-92bac3b1-f5bb-11f0-8001-d684c398e257

2026-01-20 04:51:23,127 - distributed.scheduler - INFO - Remove client Client-92bac3b1-f5bb-11f0-8001-d684c398e257

2026-01-20 04:51:23,126 - distributed.scheduler - INFO - Remove client Client-92bac3b1-f5bb-11f0-8001-d684c398e257

2026-01-20 04:50:41,817 - distributed.scheduler - INFO - Receive client connection: Client-92bac3b1-f5bb-11f0-8001-d684c398e257

2026-01-20 04:41:18,780 - distributed.scheduler - INFO - Close client connection: Client-2c41bd94-f5ba-11f0-8001-d684c398e257

2026-01-20 04:41:18,779 - distributed.scheduler - INFO - Remove client Client-2c41bd94-f5ba-11f0-8001-d684c398e257

2026-01-20 04:41:18,778 - distributed.scheduler - INFO - Remove client Client-2c41bd94-f5ba-11f0-8001-d684c398e257

2026-01-20 04:40:40,417 - distributed.scheduler - INFO - Receive client connection: Client-2c41bd94-f5ba-11f0-8001-d684c398e257

2026-01-20 04:31:51,326 - distributed.scheduler - INFO - Close client connection: Client-c5bc22f0-f5b8-11f0-8001-d684c398e257

2026-01-20 04:31:51,326 - distributed.scheduler - INFO - Remove client Client-c5bc22f0-f5b8-11f0-8001-d684c398e257

2026-01-20 04:31:51,325 - distributed.scheduler - INFO - Remove client Client-c5bc22f0-f5b8-11f0-8001-d684c398e257

2026-01-20 04:30:46,380 - distributed.scheduler - ERROR - Shut down workers that don't have promised key: [], ('len-agg-690670f6df352f25793de0413f73c8f4', 0) NoneType: None

2026-01-20 04:30:46,380 - distributed.scheduler - ERROR - Couldn't gather keys {"('len-agg-690670f6df352f25793de0413f73c8f4', 0)": []} state: ['waiting'] workers: [] NoneType: None

2026-01-20 04:30:38,900 - distributed.scheduler - INFO - Receive client connection: Client-c5bc22f0-f5b8-11f0-8001-d684c398e257

2026-01-20 04:21:15,012 - distributed.scheduler - INFO - Close client connection: Client-5f47c953-f5b7-11f0-8001-d684c398e257

2026-01-20 04:21:15,010 - distributed.scheduler - INFO - Remove client Client-5f47c953-f5b7-11f0-8001-d684c398e257

2026-01-20 04:21:15,009 - distributed.scheduler - INFO - Remove client Client-5f47c953-f5b7-11f0-8001-d684c398e257

2026-01-20 04:20:37,510 - distributed.scheduler - INFO - Receive client connection: Client-5f47c953-f5b7-11f0-8001-d684c398e257

2026-01-20 04:11:11,689 - distributed.scheduler - INFO - Close client connection: Client-f8c7e105-f5b5-11f0-8001-d684c398e257

2026-01-20 04:11:11,688 - distributed.scheduler - INFO - Remove client Client-f8c7e105-f5b5-11f0-8001-d684c398e257

2026-01-20 04:11:11,687 - distributed.scheduler - INFO - Remove client Client-f8c7e105-f5b5-11f0-8001-d684c398e257

2026-01-20 04:10:36,052 - distributed.scheduler - INFO - Receive client connection: Client-f8c7e105-f5b5-11f0-8001-d684c398e257

2026-01-20 04:01:45,317 - distributed.scheduler - INFO - Close client connection: Client-924af959-f5b4-11f0-8001-d684c398e257

2026-01-20 04:01:45,317 - distributed.scheduler - INFO - Remove client Client-924af959-f5b4-11f0-8001-d684c398e257

2026-01-20 04:01:45,316 - distributed.scheduler - INFO - Remove client Client-924af959-f5b4-11f0-8001-d684c398e257

2026-01-20 04:00:34,606 - distributed.scheduler - INFO - Receive client connection: Client-924af959-f5b4-11f0-8001-d684c398e257

2026-01-20 03:51:12,175 - distributed.scheduler - INFO - Close client connection: Client-b23ccf11-f575-11f0-8001-d684c398e257

2026-01-20 03:51:12,175 - distributed.scheduler - INFO - Close client connection: Client-18caeb78-f577-11f0-8001-d684c398e257

2026-01-20 03:51:12,175 - distributed.scheduler - INFO - Close client connection: Client-7f4fae4f-f578-11f0-8001-d684c398e257

2026-01-20 03:51:12,175 - distributed.scheduler - INFO - Close client connection: Client-e5cca766-f579-11f0-8001-d684c398e257

2026-01-20 03:51:12,174 - distributed.scheduler - INFO - Close client connection: Client-4c4b2458-f57b-11f0-8001-d684c398e257

2026-01-20 03:51:12,174 - distributed.scheduler - INFO - Close client connection: Client-b2cc2e8b-f57c-11f0-8001-d684c398e257

2026-01-20 03:51:12,174 - distributed.scheduler - INFO - Close client connection: Client-19544ce6-f57e-11f0-8001-d684c398e257

2026-01-20 03:51:12,174 - distributed.scheduler - INFO - Close client connection: Client-7fd6e7cb-f57f-11f0-8001-d684c398e257

2026-01-20 03:51:12,174 - distributed.scheduler - INFO - Close client connection: Client-e6516924-f580-11f0-8001-d684c398e257

2026-01-20 03:51:12,174 - distributed.scheduler - INFO - Close client connection: Client-4ccf99f3-f582-11f0-8001-d684c398e257

2026-01-20 03:51:12,174 - distributed.scheduler - INFO - Close client connection: Client-b33e7472-f583-11f0-8001-d684c398e257

2026-01-20 03:51:12,174 - distributed.scheduler - INFO - Close client connection: Client-19af9550-f585-11f0-8001-d684c398e257

2026-01-20 03:51:12,173 - distributed.scheduler - INFO - Close client connection: Client-80221cbd-f586-11f0-8001-d684c398e257

2026-01-20 03:51:12,173 - distributed.scheduler - INFO - Close client connection: Client-e69f6174-f587-11f0-8001-d684c398e257

2026-01-20 03:51:12,173 - distributed.scheduler - INFO - Close client connection: Client-4d17672c-f589-11f0-8001-d684c398e257

2026-01-20 03:51:12,173 - distributed.scheduler - INFO - Close client connection: Client-b38e3992-f58a-11f0-8001-d684c398e257

2026-01-20 03:51:12,173 - distributed.scheduler - INFO - Close client connection: Client-1a0155f6-f58c-11f0-8001-d684c398e257

2026-01-20 03:51:12,173 - distributed.scheduler - INFO - Close client connection: Client-8078cafb-f58d-11f0-8001-d684c398e257

2026-01-20 03:51:12,173 - distributed.scheduler - INFO - Close client connection: Client-e6e8c447-f58e-11f0-8001-d684c398e257

2026-01-20 03:51:12,173 - distributed.scheduler - INFO - Close client connection: Client-4d64f4d1-f590-11f0-8001-d684c398e257

2026-01-20 03:51:12,173 - distributed.scheduler - INFO - Close client connection: Client-b3f4257c-f591-11f0-8001-d684c398e257

2026-01-20 03:51:12,173 - distributed.scheduler - INFO - Close client connection: Client-1a790188-f593-11f0-8001-d684c398e257

2026-01-20 03:51:12,172 - distributed.scheduler - INFO - Close client connection: Client-c3aba8d6-f595-11f0-8001-d684c398e257

2026-01-20 03:51:12,172 - distributed.scheduler - INFO - Close client connection: Client-632b7314-f594-11f0-8001-d684c398e257

2026-01-20 03:51:12,172 - distributed.scheduler - INFO - Close client connection: Client-2a293bf1-f597-11f0-8001-d684c398e257

2026-01-20 03:51:12,172 - distributed.scheduler - INFO - Close client connection: Client-90a8c804-f598-11f0-8001-d684c398e257

2026-01-20 03:51:12,172 - distributed.scheduler - INFO - Close client connection: Client-f7174de4-f599-11f0-8001-d684c398e257

2026-01-20 03:51:12,172 - distributed.scheduler - INFO - Close client connection: Client-5d98806f-f59b-11f0-8001-d684c398e257

2026-01-20 03:51:12,172 - distributed.scheduler - INFO - Close client connection: Client-c41e73ec-f59c-11f0-8001-d684c398e257

2026-01-20 03:51:12,171 - distributed.scheduler - INFO - Close client connection: Client-2a8ad34b-f59e-11f0-8001-d684c398e257

2026-01-20 03:51:12,171 - distributed.scheduler - INFO - Close client connection: Client-91082af9-f59f-11f0-8001-d684c398e257

2026-01-20 03:51:12,171 - distributed.scheduler - INFO - Close client connection: Client-f76c8734-f5a0-11f0-8001-d684c398e257

2026-01-20 03:51:12,171 - distributed.scheduler - INFO - Close client connection: Client-5ddfdbb0-f5a2-11f0-8001-d684c398e257

2026-01-20 03:51:12,170 - distributed.scheduler - INFO - Close client connection: Client-c4853016-f5a3-11f0-8001-d684c398e257

2026-01-20 03:51:12,170 - distributed.scheduler - INFO - Close client connection: Client-2af83808-f5a5-11f0-8001-d684c398e257

2026-01-20 03:51:12,170 - distributed.scheduler - INFO - Close client connection: Client-91690880-f5a6-11f0-8001-d684c398e257

2026-01-20 03:51:12,170 - distributed.scheduler - INFO - Close client connection: Client-f7df74d0-f5a7-11f0-8001-d684c398e257

2026-01-20 03:51:12,170 - distributed.scheduler - INFO - Close client connection: Client-5e564fe2-f5a9-11f0-8001-d684c398e257

2026-01-20 03:51:12,170 - distributed.scheduler - INFO - Close client connection: Client-c4e35a4d-f5aa-11f0-8001-d684c398e257

2026-01-20 03:51:12,170 - distributed.scheduler - INFO - Close client connection: Client-2b5abe8e-f5ac-11f0-8001-d684c398e257

2026-01-20 03:51:12,170 - distributed.scheduler - INFO - Close client connection: Client-91e1e168-f5ad-11f0-8001-d684c398e257

2026-01-20 03:51:12,170 - distributed.scheduler - INFO - Close client connection: Client-f8639b45-f5ae-11f0-8001-d684c398e257

2026-01-20 03:51:12,169 - distributed.scheduler - INFO - Close client connection: Client-5ee2bf28-f5b0-11f0-8001-d684c398e257

2026-01-20 03:51:12,167 - distributed.scheduler - INFO - Close client connection: Client-c5514706-f5b1-11f0-8001-d684c398e257

2026-01-20 03:51:12,167 - distributed.scheduler - INFO - Remove client Client-b23ccf11-f575-11f0-8001-d684c398e257

2026-01-20 03:51:12,167 - distributed.scheduler - INFO - Remove client Client-18caeb78-f577-11f0-8001-d684c398e257

2026-01-20 03:51:12,167 - distributed.scheduler - INFO - Remove client Client-7f4fae4f-f578-11f0-8001-d684c398e257

2026-01-20 03:51:12,166 - distributed.scheduler - INFO - Remove client Client-e5cca766-f579-11f0-8001-d684c398e257

2026-01-20 03:51:12,166 - distributed.scheduler - INFO - Remove client Client-4c4b2458-f57b-11f0-8001-d684c398e257

2026-01-20 03:51:12,166 - distributed.scheduler - INFO - Remove client Client-b2cc2e8b-f57c-11f0-8001-d684c398e257

2026-01-20 03:51:12,166 - distributed.scheduler - INFO - Remove client Client-19544ce6-f57e-11f0-8001-d684c398e257

2026-01-20 03:51:12,165 - distributed.scheduler - INFO - Remove client Client-7fd6e7cb-f57f-11f0-8001-d684c398e257

2026-01-20 03:51:12,165 - distributed.scheduler - INFO - Remove client Client-e6516924-f580-11f0-8001-d684c398e257

2026-01-20 03:51:12,165 - distributed.scheduler - INFO - Remove client Client-4ccf99f3-f582-11f0-8001-d684c398e257

2026-01-20 03:51:12,165 - distributed.scheduler - INFO - Remove client Client-b33e7472-f583-11f0-8001-d684c398e257

2026-01-20 03:51:12,164 - distributed.scheduler - INFO - Remove client Client-19af9550-f585-11f0-8001-d684c398e257

2026-01-20 03:51:12,164 - distributed.scheduler - INFO - Remove client Client-80221cbd-f586-11f0-8001-d684c398e257

2026-01-20 03:51:12,164 - distributed.scheduler - INFO - Remove client Client-e69f6174-f587-11f0-8001-d684c398e257

2026-01-20 03:51:12,164 - distributed.scheduler - INFO - Remove client Client-4d17672c-f589-11f0-8001-d684c398e257

2026-01-20 03:51:12,163 - distributed.scheduler - INFO - Remove client Client-b38e3992-f58a-11f0-8001-d684c398e257

2026-01-20 03:51:12,163 - distributed.scheduler - INFO - Remove client Client-1a0155f6-f58c-11f0-8001-d684c398e257

2026-01-20 03:51:12,163 - distributed.scheduler - INFO - Remove client Client-8078cafb-f58d-11f0-8001-d684c398e257

2026-01-20 03:51:12,162 - distributed.scheduler - INFO - Remove client Client-e6e8c447-f58e-11f0-8001-d684c398e257

2026-01-20 03:51:12,162 - distributed.scheduler - INFO - Remove client Client-4d64f4d1-f590-11f0-8001-d684c398e257

2026-01-20 03:51:12,162 - distributed.scheduler - INFO - Remove client Client-b3f4257c-f591-11f0-8001-d684c398e257

2026-01-20 03:51:12,161 - distributed.scheduler - INFO - Remove client Client-1a790188-f593-11f0-8001-d684c398e257

2026-01-20 03:51:12,161 - distributed.scheduler - INFO - Remove client Client-c3aba8d6-f595-11f0-8001-d684c398e257

2026-01-20 03:51:12,161 - distributed.scheduler - INFO - Remove client Client-632b7314-f594-11f0-8001-d684c398e257

2026-01-20 03:51:12,160 - distributed.scheduler - INFO - Remove client Client-2a293bf1-f597-11f0-8001-d684c398e257

2026-01-20 03:51:12,160 - distributed.scheduler - INFO - Remove client Client-90a8c804-f598-11f0-8001-d684c398e257

2026-01-20 03:51:12,159 - distributed.scheduler - INFO - Remove client Client-f7174de4-f599-11f0-8001-d684c398e257

2026-01-20 03:51:12,158 - distributed.scheduler - INFO - Remove client Client-5d98806f-f59b-11f0-8001-d684c398e257

2026-01-20 03:51:12,155 - distributed.scheduler - INFO - Remove client Client-c41e73ec-f59c-11f0-8001-d684c398e257

2026-01-20 03:51:12,148 - distributed.scheduler - INFO - Remove client Client-2a8ad34b-f59e-11f0-8001-d684c398e257

2026-01-20 03:51:12,147 - distributed.scheduler - INFO - Remove client Client-91082af9-f59f-11f0-8001-d684c398e257

2026-01-20 03:51:12,147 - distributed.scheduler - INFO - Remove client Client-f76c8734-f5a0-11f0-8001-d684c398e257

2026-01-20 03:51:12,146 - distributed.scheduler - INFO - Remove client Client-5ddfdbb0-f5a2-11f0-8001-d684c398e257

2026-01-20 03:51:12,146 - distributed.scheduler - INFO - Remove client Client-c4853016-f5a3-11f0-8001-d684c398e257

2026-01-20 03:51:12,145 - distributed.scheduler - INFO - Remove client Client-2af83808-f5a5-11f0-8001-d684c398e257

2026-01-20 03:51:12,145 - distributed.scheduler - INFO - Remove client Client-91690880-f5a6-11f0-8001-d684c398e257

2026-01-20 03:51:12,144 - distributed.scheduler - INFO - Remove client Client-f7df74d0-f5a7-11f0-8001-d684c398e257

2026-01-20 03:51:12,144 - distributed.scheduler - INFO - Remove client Client-5e564fe2-f5a9-11f0-8001-d684c398e257

2026-01-20 03:51:12,143 - distributed.scheduler - INFO - Remove client Client-c4e35a4d-f5aa-11f0-8001-d684c398e257

2026-01-20 03:51:12,142 - distributed.scheduler - INFO - Remove client Client-2b5abe8e-f5ac-11f0-8001-d684c398e257

2026-01-20 03:51:12,142 - distributed.scheduler - INFO - Remove client Client-91e1e168-f5ad-11f0-8001-d684c398e257

2026-01-20 03:51:12,141 - distributed.scheduler - INFO - Remove client Client-f8639b45-f5ae-11f0-8001-d684c398e257

2026-01-20 03:51:12,140 - distributed.scheduler - INFO - Remove client Client-5ee2bf28-f5b0-11f0-8001-d684c398e257

2026-01-20 03:51:12,133 - distributed.scheduler - INFO - Remove client Client-c5514706-f5b1-11f0-8001-d684c398e257

2026-01-20 03:51:11,213 - distributed.scheduler - INFO - Close client connection: Client-2bc6ec0a-f5b3-11f0-8001-d684c398e257

2026-01-20 03:51:11,212 - distributed.scheduler - INFO - Remove client Client-2bc6ec0a-f5b3-11f0-8001-d684c398e257

2026-01-20 03:51:11,211 - distributed.scheduler - INFO - Remove client Client-2bc6ec0a-f5b3-11f0-8001-d684c398e257

2026-01-20 03:50:33,107 - distributed.scheduler - INFO - Receive client connection: Client-2bc6ec0a-f5b3-11f0-8001-d684c398e257

2026-01-20 03:40:31,746 - distributed.scheduler - INFO - Receive client connection: Client-c5514706-f5b1-11f0-8001-d684c398e257

2026-01-20 03:30:30,378 - distributed.scheduler - INFO - Receive client connection: Client-5ee2bf28-f5b0-11f0-8001-d684c398e257

2026-01-20 03:20:28,913 - distributed.scheduler - INFO - Receive client connection: Client-f8639b45-f5ae-11f0-8001-d684c398e257

2026-01-20 03:10:27,440 - distributed.scheduler - INFO - Receive client connection: Client-91e1e168-f5ad-11f0-8001-d684c398e257

2026-01-20 03:00:25,935 - distributed.scheduler - INFO - Receive client connection: Client-2b5abe8e-f5ac-11f0-8001-d684c398e257

2026-01-20 02:50:24,515 - distributed.scheduler - INFO - Receive client connection: Client-c4e35a4d-f5aa-11f0-8001-d684c398e257

2026-01-20 02:40:22,973 - distributed.scheduler - INFO - Receive client connection: Client-5e564fe2-f5a9-11f0-8001-d684c398e257

2026-01-20 02:30:21,569 - distributed.scheduler - INFO - Receive client connection: Client-f7df74d0-f5a7-11f0-8001-d684c398e257

2026-01-20 02:20:20,173 - distributed.scheduler - INFO - Receive client connection: Client-91690880-f5a6-11f0-8001-d684c398e257

2026-01-20 02:10:18,804 - distributed.scheduler - INFO - Receive client connection: Client-2af83808-f5a5-11f0-8001-d684c398e257

2026-01-20 02:00:17,430 - distributed.scheduler - INFO - Receive client connection: Client-c4853016-f5a3-11f0-8001-d684c398e257

2026-01-20 01:50:15,730 - distributed.scheduler - INFO - Receive client connection: Client-5ddfdbb0-f5a2-11f0-8001-d684c398e257

2026-01-20 01:40:14,340 - distributed.scheduler - INFO - Receive client connection: Client-f76c8734-f5a0-11f0-8001-d684c398e257

2026-01-20 01:30:13,055 - distributed.scheduler - INFO - Receive client connection: Client-91082af9-f59f-11f0-8001-d684c398e257

2026-01-20 01:20:11,606 - distributed.scheduler - INFO - Receive client connection: Client-2a8ad34b-f59e-11f0-8001-d684c398e257

2026-01-20 01:10:10,301 - distributed.scheduler - INFO - Receive client connection: Client-c41e73ec-f59c-11f0-8001-d684c398e257

2026-01-20 01:00:08,776 - distributed.scheduler - INFO - Receive client connection: Client-5d98806f-f59b-11f0-8001-d684c398e257

2026-01-20 00:50:07,301 - distributed.scheduler - INFO - Receive client connection: Client-f7174de4-f599-11f0-8001-d684c398e257

2026-01-20 00:40:05,948 - distributed.scheduler - INFO - Receive client connection: Client-90a8c804-f598-11f0-8001-d684c398e257

2026-01-20 00:30:04,486 - distributed.scheduler - INFO - Receive client connection: Client-2a293bf1-f597-11f0-8001-d684c398e257

2026-01-20 00:20:03,039 - distributed.scheduler - INFO - Receive client connection: Client-c3aba8d6-f595-11f0-8001-d684c398e257

2026-01-20 00:10:11,640 - distributed.scheduler - INFO - Receive client connection: Client-632b7314-f594-11f0-8001-d684c398e257

2026-01-20 00:01:00,185 - distributed.scheduler - INFO - Receive client connection: Client-1a790188-f593-11f0-8001-d684c398e257

2026-01-19 23:50:58,691 - distributed.scheduler - INFO - Receive client connection: Client-b3f4257c-f591-11f0-8001-d684c398e257

2026-01-19 23:40:57,126 - distributed.scheduler - INFO - Receive client connection: Client-4d64f4d1-f590-11f0-8001-d684c398e257

2026-01-19 23:30:55,681 - distributed.scheduler - INFO - Receive client connection: Client-e6e8c447-f58e-11f0-8001-d684c398e257

2026-01-19 23:20:54,333 - distributed.scheduler - INFO - Receive client connection: Client-8078cafb-f58d-11f0-8001-d684c398e257

2026-01-19 23:10:52,917 - distributed.scheduler - INFO - Receive client connection: Client-1a0155f6-f58c-11f0-8001-d684c398e257

2026-01-19 23:00:51,543 - distributed.scheduler - INFO - Receive client connection: Client-b38e3992-f58a-11f0-8001-d684c398e257

2026-01-19 22:50:50,138 - distributed.scheduler - INFO - Receive client connection: Client-4d17672c-f589-11f0-8001-d684c398e257

2026-01-19 22:40:48,730 - distributed.scheduler - INFO - Receive client connection: Client-e69f6174-f587-11f0-8001-d684c398e257

2026-01-19 22:30:47,289 - distributed.scheduler - INFO - Receive client connection: Client-80221cbd-f586-11f0-8001-d684c398e257

2026-01-19 22:20:45,907 - distributed.scheduler - INFO - Receive client connection: Client-19af9550-f585-11f0-8001-d684c398e257

2026-01-19 22:10:44,543 - distributed.scheduler - INFO - Receive client connection: Client-b33e7472-f583-11f0-8001-d684c398e257

2026-01-19 22:00:43,186 - distributed.scheduler - INFO - Receive client connection: Client-4ccf99f3-f582-11f0-8001-d684c398e257

2026-01-19 21:50:41,738 - distributed.scheduler - INFO - Receive client connection: Client-e6516924-f580-11f0-8001-d684c398e257

2026-01-19 21:40:40,312 - distributed.scheduler - INFO - Receive client connection: Client-7fd6e7cb-f57f-11f0-8001-d684c398e257

2026-01-19 21:30:38,834 - distributed.scheduler - INFO - Receive client connection: Client-19544ce6-f57e-11f0-8001-d684c398e257

2026-01-19 21:20:37,314 - distributed.scheduler - INFO - Receive client connection: Client-b2cc2e8b-f57c-11f0-8001-d684c398e257

2026-01-19 21:10:35,855 - distributed.scheduler - INFO - Receive client connection: Client-4c4b2458-f57b-11f0-8001-d684c398e257

2026-01-19 21:00:34,393 - distributed.scheduler - INFO - Receive client connection: Client-e5cca766-f579-11f0-8001-d684c398e257

2026-01-19 20:50:32,951 - distributed.scheduler - INFO - Receive client connection: Client-7f4fae4f-f578-11f0-8001-d684c398e257

2026-01-19 20:40:31,458 - distributed.scheduler - INFO - Receive client connection: Client-18caeb78-f577-11f0-8001-d684c398e257

2026-01-19 20:30:29,909 - distributed.scheduler - INFO - Receive client connection: Client-b23ccf11-f575-11f0-8001-d684c398e257

2026-01-19 20:21:00,347 - distributed.scheduler - INFO - Close client connection: Client-4baf1802-f574-11f0-8001-d684c398e257

2026-01-19 20:21:00,346 - distributed.scheduler - INFO - Remove client Client-4baf1802-f574-11f0-8001-d684c398e257

2026-01-19 20:21:00,345 - distributed.scheduler - INFO - Remove client Client-4baf1802-f574-11f0-8001-d684c398e257

2026-01-19 20:20:28,357 - distributed.scheduler - INFO - Receive client connection: Client-4baf1802-f574-11f0-8001-d684c398e257

2026-01-19 20:10:59,085 - distributed.scheduler - INFO - Close client connection: Client-e52cde0e-f572-11f0-8001-d684c398e257

2026-01-19 20:10:59,084 - distributed.scheduler - INFO - Remove client Client-e52cde0e-f572-11f0-8001-d684c398e257

2026-01-19 20:10:59,082 - distributed.scheduler - INFO - Remove client Client-e52cde0e-f572-11f0-8001-d684c398e257

2026-01-19 20:10:26,928 - distributed.scheduler - INFO - Receive client connection: Client-e52cde0e-f572-11f0-8001-d684c398e257

2026-01-19 20:01:25,534 - distributed.scheduler - INFO - Close client connection: Client-7e9a1a5d-f571-11f0-8001-d684c398e257

2026-01-19 20:01:25,533 - distributed.scheduler - INFO - Remove client Client-7e9a1a5d-f571-11f0-8001-d684c398e257

2026-01-19 20:01:25,531 - distributed.scheduler - INFO - Remove client Client-7e9a1a5d-f571-11f0-8001-d684c398e257

2026-01-19 20:00:25,294 - distributed.scheduler - INFO - Receive client connection: Client-7e9a1a5d-f571-11f0-8001-d684c398e257

2026-01-19 19:50:56,013 - distributed.scheduler - INFO - Close client connection: Client-182cd1da-f570-11f0-8001-d684c398e257

2026-01-19 19:50:56,012 - distributed.scheduler - INFO - Remove client Client-182cd1da-f570-11f0-8001-d684c398e257

2026-01-19 19:50:56,010 - distributed.scheduler - INFO - Remove client Client-182cd1da-f570-11f0-8001-d684c398e257

2026-01-19 19:50:23,953 - distributed.scheduler - INFO - Receive client connection: Client-182cd1da-f570-11f0-8001-d684c398e257

2026-01-19 19:41:01,223 - distributed.scheduler - INFO - Close client connection: Client-b1b5b36b-f56e-11f0-8001-d684c398e257

2026-01-19 19:41:01,221 - distributed.scheduler - INFO - Remove client Client-b1b5b36b-f56e-11f0-8001-d684c398e257

2026-01-19 19:41:01,220 - distributed.scheduler - INFO - Remove client Client-b1b5b36b-f56e-11f0-8001-d684c398e257

2026-01-19 19:40:22,545 - distributed.scheduler - INFO - Receive client connection: Client-b1b5b36b-f56e-11f0-8001-d684c398e257

2026-01-19 19:31:29,348 - distributed.scheduler - INFO - Close client connection: Client-176de6c3-f562-11f0-8001-d684c398e257

2026-01-19 19:31:29,348 - distributed.scheduler - INFO - Close client connection: Client-4ae4b6df-f566-11f0-8001-d684c398e257

2026-01-19 19:31:29,348 - distributed.scheduler - INFO - Close client connection: Client-7df12c97-f563-11f0-8001-d684c398e257

2026-01-19 19:31:29,347 - distributed.scheduler - INFO - Close client connection: Client-b1584471-f567-11f0-8001-d684c398e257

2026-01-19 19:31:29,347 - distributed.scheduler - INFO - Close client connection: Client-7e4cfc9b-f56a-11f0-8001-d684c398e257

2026-01-19 19:31:29,347 - distributed.scheduler - INFO - Close client connection: Client-e46f55e5-f564-11f0-8001-d684c398e257

2026-01-19 19:31:29,346 - distributed.scheduler - INFO - Close client connection: Client-17e077e9-f569-11f0-8001-d684c398e257

2026-01-19 19:31:29,346 - distributed.scheduler - INFO - Close client connection: Client-e4cbf458-f56b-11f0-8001-d684c398e257

2026-01-19 19:31:29,343 - distributed.scheduler - INFO - Remove client Client-176de6c3-f562-11f0-8001-d684c398e257

2026-01-19 19:31:29,343 - distributed.scheduler - INFO - Remove client Client-4ae4b6df-f566-11f0-8001-d684c398e257

2026-01-19 19:31:29,342 - distributed.scheduler - INFO - Remove client Client-7df12c97-f563-11f0-8001-d684c398e257

2026-01-19 19:31:29,341 - distributed.scheduler - INFO - Remove client Client-b1584471-f567-11f0-8001-d684c398e257

2026-01-19 19:31:29,341 - distributed.scheduler - INFO - Remove client Client-7e4cfc9b-f56a-11f0-8001-d684c398e257

2026-01-19 19:31:29,340 - distributed.scheduler - INFO - Remove client Client-e46f55e5-f564-11f0-8001-d684c398e257

2026-01-19 19:31:29,339 - distributed.scheduler - INFO - Remove client Client-17e077e9-f569-11f0-8001-d684c398e257

2026-01-19 19:31:29,338 - distributed.scheduler - INFO - Remove client Client-e4cbf458-f56b-11f0-8001-d684c398e257

2026-01-19 19:31:28,539 - distributed.scheduler - INFO - Close client connection: Client-4b403d0a-f56d-11f0-8001-d684c398e257

2026-01-19 19:31:28,537 - distributed.scheduler - INFO - Remove client Client-4b403d0a-f56d-11f0-8001-d684c398e257

2026-01-19 19:31:28,536 - distributed.scheduler - INFO - Remove client Client-4b403d0a-f56d-11f0-8001-d684c398e257

2026-01-19 19:30:21,144 - distributed.scheduler - INFO - Receive client connection: Client-4b403d0a-f56d-11f0-8001-d684c398e257

2026-01-19 19:20:19,760 - distributed.scheduler - INFO - Receive client connection: Client-e4cbf458-f56b-11f0-8001-d684c398e257

2026-01-19 19:10:18,296 - distributed.scheduler - INFO - Receive client connection: Client-7e4cfc9b-f56a-11f0-8001-d684c398e257

2026-01-19 19:00:16,964 - distributed.scheduler - INFO - Receive client connection: Client-17e077e9-f569-11f0-8001-d684c398e257

2026-01-19 18:50:15,450 - distributed.scheduler - INFO - Receive client connection: Client-b1584471-f567-11f0-8001-d684c398e257

2026-01-19 18:40:14,064 - distributed.scheduler - INFO - Receive client connection: Client-4ae4b6df-f566-11f0-8001-d684c398e257

2026-01-19 18:30:12,672 - distributed.scheduler - INFO - Receive client connection: Client-e46f55e5-f564-11f0-8001-d684c398e257

2026-01-19 18:20:11,221 - distributed.scheduler - INFO - Receive client connection: Client-7df12c97-f563-11f0-8001-d684c398e257

2026-01-19 18:10:09,761 - distributed.scheduler - INFO - Receive client connection: Client-176de6c3-f562-11f0-8001-d684c398e257

2026-01-19 18:01:17,500 - distributed.scheduler - INFO - Close client connection: Client-b0f02ce7-f560-11f0-8001-d684c398e257

2026-01-19 18:01:17,500 - distributed.scheduler - INFO - Remove client Client-b0f02ce7-f560-11f0-8001-d684c398e257

2026-01-19 18:01:17,499 - distributed.scheduler - INFO - Remove client Client-b0f02ce7-f560-11f0-8001-d684c398e257

2026-01-19 18:00:12,261 - distributed.scheduler - INFO - Receive client connection: Client-worker-b34f77d5-f560-11f0-842b-fa70b2057bbc

2026-01-19 18:00:08,296 - distributed.scheduler - INFO - Receive client connection: Client-b0f02ce7-f560-11f0-8001-d684c398e257

2026-01-19 17:50:48,337 - distributed.scheduler - INFO - Close client connection: Client-4a697583-f55f-11f0-8001-d684c398e257

2026-01-19 17:50:48,336 - distributed.scheduler - INFO - Remove client Client-4a697583-f55f-11f0-8001-d684c398e257

2026-01-19 17:50:48,334 - distributed.scheduler - INFO - Remove client Client-4a697583-f55f-11f0-8001-d684c398e257

2026-01-19 17:50:06,788 - distributed.scheduler - INFO - Receive client connection: Client-4a697583-f55f-11f0-8001-d684c398e257

2026-01-19 17:40:43,765 - distributed.scheduler - INFO - Close client connection: Client-e3e1df38-f55d-11f0-8001-d684c398e257

2026-01-19 17:40:43,764 - distributed.scheduler - INFO - Remove client Client-e3e1df38-f55d-11f0-8001-d684c398e257

2026-01-19 17:40:43,762 - distributed.scheduler - INFO - Remove client Client-e3e1df38-f55d-11f0-8001-d684c398e257

2026-01-19 17:40:05,280 - distributed.scheduler - INFO - Receive client connection: Client-e3e1df38-f55d-11f0-8001-d684c398e257

2026-01-19 17:31:15,920 - distributed.scheduler - INFO - Close client connection: Client-7d689fd5-f55c-11f0-8001-d684c398e257

2026-01-19 17:31:15,919 - distributed.scheduler - INFO - Remove client Client-7d689fd5-f55c-11f0-8001-d684c398e257

2026-01-19 17:31:15,917 - distributed.scheduler - INFO - Remove client Client-7d689fd5-f55c-11f0-8001-d684c398e257

2026-01-19 17:30:03,855 - distributed.scheduler - INFO - Receive client connection: Client-7d689fd5-f55c-11f0-8001-d684c398e257

2026-01-19 17:20:41,145 - distributed.scheduler - INFO - Close client connection: Client-16e9a332-f55b-11f0-8001-d684c398e257

2026-01-19 17:20:41,144 - distributed.scheduler - INFO - Remove client Client-16e9a332-f55b-11f0-8001-d684c398e257

2026-01-19 17:20:41,142 - distributed.scheduler - INFO - Remove client Client-16e9a332-f55b-11f0-8001-d684c398e257

2026-01-19 17:20:02,404 - distributed.scheduler - INFO - Receive client connection: Client-16e9a332-f55b-11f0-8001-d684c398e257

2026-01-19 17:10:59,708 - distributed.scheduler - INFO - Close client connection: Client-d3c2d9b4-f552-11f0-8001-d684c398e257

2026-01-19 17:10:59,708 - distributed.scheduler - INFO - Close client connection: Client-3a3afb20-f554-11f0-8001-d684c398e257

2026-01-19 17:10:59,707 - distributed.scheduler - INFO - Close client connection: Client-0731d9fd-f557-11f0-8001-d684c398e257

2026-01-19 17:10:59,707 - distributed.scheduler - INFO - Close client connection: Client-a0af88a5-f555-11f0-8001-d684c398e257

2026-01-19 17:10:59,707 - distributed.scheduler - INFO - Close client connection: Client-6dad6b10-f558-11f0-8001-d684c398e257

2026-01-19 17:10:59,705 - distributed.scheduler - INFO - Remove client Client-d3c2d9b4-f552-11f0-8001-d684c398e257

2026-01-19 17:10:59,705 - distributed.scheduler - INFO - Remove client Client-3a3afb20-f554-11f0-8001-d684c398e257

2026-01-19 17:10:59,704 - distributed.scheduler - INFO - Remove client Client-0731d9fd-f557-11f0-8001-d684c398e257

2026-01-19 17:10:59,703 - distributed.scheduler - INFO - Remove client Client-a0af88a5-f555-11f0-8001-d684c398e257

2026-01-19 17:10:59,702 - distributed.scheduler - INFO - Remove client Client-6dad6b10-f558-11f0-8001-d684c398e257

2026-01-19 17:10:58,807 - distributed.scheduler - INFO - Close client connection: Client-bf4ff0a3-f559-11f0-8001-d684c398e257

2026-01-19 17:10:58,806 - distributed.scheduler - INFO - Remove client Client-bf4ff0a3-f559-11f0-8001-d684c398e257

2026-01-19 17:10:58,804 - distributed.scheduler - INFO - Remove client Client-bf4ff0a3-f559-11f0-8001-d684c398e257

2026-01-19 17:10:25,930 - distributed.scheduler - INFO - Receive client connection: Client-bf4ff0a3-f559-11f0-8001-d684c398e257

2026-01-19 17:01:05,514 - distributed.scheduler - ERROR - Shut down workers that don't have promised key: [], ('len-agg-46d04bf75f1617a5ca9aa49b99ba96cc', 0) NoneType: None

2026-01-19 17:01:05,513 - distributed.scheduler - ERROR - Couldn't gather keys {"('len-agg-46d04bf75f1617a5ca9aa49b99ba96cc', 0)": []} state: ['waiting'] workers: [] NoneType: None

2026-01-19 17:00:59,469 - distributed.scheduler - INFO - Receive client connection: Client-6dad6b10-f558-11f0-8001-d684c398e257

2026-01-19 16:50:58,037 - distributed.scheduler - INFO - Receive client connection: Client-0731d9fd-f557-11f0-8001-d684c398e257

2026-01-19 16:40:56,560 - distributed.scheduler - INFO - Receive client connection: Client-a0af88a5-f555-11f0-8001-d684c398e257

2026-01-19 16:30:59,675 - distributed.scheduler - INFO - Receive client connection: Client-worker-3ce44c3e-f554-11f0-8343-123d2a42b3d6

2026-01-19 16:30:55,171 - distributed.scheduler - INFO - Receive client connection: Client-3a3afb20-f554-11f0-8001-d684c398e257

2026-01-19 16:20:53,769 - distributed.scheduler - INFO - Receive client connection: Client-d3c2d9b4-f552-11f0-8001-d684c398e257

2026-01-19 16:11:33,938 - distributed.scheduler - INFO - Close client connection: Client-6d434d1b-f551-11f0-8001-d684c398e257

2026-01-19 16:11:33,938 - distributed.scheduler - INFO - Remove client Client-6d434d1b-f551-11f0-8001-d684c398e257

2026-01-19 16:11:33,937 - distributed.scheduler - INFO - Remove client Client-6d434d1b-f551-11f0-8001-d684c398e257

2026-01-19 16:10:52,309 - distributed.scheduler - INFO - Receive client connection: Client-6d434d1b-f551-11f0-8001-d684c398e257

2026-01-19 16:02:06,835 - distributed.scheduler - INFO - Close client connection: Client-06be909d-f550-11f0-8001-d684c398e257

2026-01-19 16:02:06,834 - distributed.scheduler - INFO - Remove client Client-06be909d-f550-11f0-8001-d684c398e257

2026-01-19 16:02:06,833 - distributed.scheduler - INFO - Remove client Client-06be909d-f550-11f0-8001-d684c398e257

2026-01-19 16:00:55,575 - distributed.scheduler - INFO - Receive client connection: Client-worker-0997389f-f550-11f0-835a-e6b3e8b2508c

2026-01-19 16:00:50,815 - distributed.scheduler - INFO - Receive client connection: Client-06be909d-f550-11f0-8001-d684c398e257

2026-01-19 15:51:31,359 - distributed.scheduler - INFO - Close client connection: Client-a03f6a8a-f54e-11f0-8001-d684c398e257

2026-01-19 15:51:31,350 - distributed.scheduler - INFO - Remove client Client-a03f6a8a-f54e-11f0-8001-d684c398e257

2026-01-19 15:51:31,349 - distributed.scheduler - INFO - Remove client Client-a03f6a8a-f54e-11f0-8001-d684c398e257

2026-01-19 15:50:49,354 - distributed.scheduler - INFO - Receive client connection: Client-a03f6a8a-f54e-11f0-8001-d684c398e257

2026-01-19 15:41:31,534 - distributed.scheduler - INFO - Close client connection: Client-39c47fc7-f54d-11f0-8001-d684c398e257

2026-01-19 15:41:31,533 - distributed.scheduler - INFO - Remove client Client-39c47fc7-f54d-11f0-8001-d684c398e257

2026-01-19 15:41:31,531 - distributed.scheduler - INFO - Remove client Client-39c47fc7-f54d-11f0-8001-d684c398e257

2026-01-19 15:40:47,924 - distributed.scheduler - INFO - Receive client connection: Client-39c47fc7-f54d-11f0-8001-d684c398e257

2026-01-19 15:32:04,013 - distributed.scheduler - INFO - Close client connection: Client-d3453dea-f54b-11f0-8001-d684c398e257

2026-01-19 15:32:04,012 - distributed.scheduler - INFO - Remove client Client-d3453dea-f54b-11f0-8001-d684c398e257

2026-01-19 15:32:04,011 - distributed.scheduler - INFO - Remove client Client-d3453dea-f54b-11f0-8001-d684c398e257

2026-01-19 15:30:46,465 - distributed.scheduler - INFO - Receive client connection: Client-d3453dea-f54b-11f0-8001-d684c398e257

2026-01-19 15:21:30,169 - distributed.scheduler - INFO - Close client connection: Client-9fe7675c-f547-11f0-8001-d684c398e257

2026-01-19 15:21:30,168 - distributed.scheduler - INFO - Close client connection: Client-065d2e71-f549-11f0-8001-d684c398e257

2026-01-19 15:21:30,167 - distributed.scheduler - INFO - Remove client Client-9fe7675c-f547-11f0-8001-d684c398e257

2026-01-19 15:21:30,166 - distributed.scheduler - INFO - Remove client Client-065d2e71-f549-11f0-8001-d684c398e257

2026-01-19 15:21:29,314 - distributed.scheduler - INFO - Close client connection: Client-6cc65d18-f54a-11f0-8001-d684c398e257

2026-01-19 15:21:29,313 - distributed.scheduler - INFO - Remove client Client-6cc65d18-f54a-11f0-8001-d684c398e257

2026-01-19 15:21:29,311 - distributed.scheduler - INFO - Remove client Client-6cc65d18-f54a-11f0-8001-d684c398e257

2026-01-19 15:20:44,996 - distributed.scheduler - INFO - Receive client connection: Client-6cc65d18-f54a-11f0-8001-d684c398e257

2026-01-19 15:10:43,681 - distributed.scheduler - INFO - Receive client connection: Client-065d2e71-f549-11f0-8001-d684c398e257

2026-01-19 15:03:23,170 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:46065 failed: OSError: Timed out trying to connect to tcp://172.21.12.250:46065 after 30 s

2026-01-19 15:03:23,096 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:34751 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.250:46065 after 30 s')

2026-01-19 15:03:23,092 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:41119 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.250:46065 after 30 s')

2026-01-19 15:03:23,090 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:40415 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.250:46065 after 30 s')

2026-01-19 15:03:23,089 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:34539 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.250:46065 after 30 s')

2026-01-19 15:03:23,079 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:42711 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.250:46065 after 30 s')

2026-01-19 15:03:23,052 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:44951 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.250:46065 after 30 s')

2026-01-19 15:03:22,999 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:33971 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.250:46065 after 30 s')

2026-01-19 15:03:22,986 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:33649 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.250:46065 after 30 s')

2026-01-19 15:03:22,958 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:33329 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.250:46065 after 30 s')

2026-01-19 15:02:54,800 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.244:45931

2026-01-19 15:02:54,799 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.244:45931', status: running, memory: 0, processing: 0>

2026-01-19 15:02:54,526 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:41715 failed: Exception: KeyError('db5a10064d534ca37a757b32b7c9f12c')

2026-01-19 15:02:54,386 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:41381 failed: Exception: KeyError('db5a10064d534ca37a757b32b7c9f12c')

2026-01-19 15:02:54,230 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:46861 failed: Exception: KeyError('db5a10064d534ca37a757b32b7c9f12c')

2026-01-19 15:02:53,815 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:40197 failed: OSError: Timed out during handshake while connecting to tcp://172.21.12.244:40197 after 30 s

2026-01-19 15:02:53,809 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.244:40197', status: closed, memory: 0, processing: 0>

2026-01-19 15:02:53,743 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.250:35113

2026-01-19 15:02:53,740 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.250:35113', status: running, memory: 0, processing: 0>

2026-01-19 15:02:52,852 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.250:46065', status: closed, memory: 0, processing: 0>

2026-01-19 15:02:39,460 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.244:40197

2026-01-19 15:02:39,459 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.244:40197', status: closed, memory: 0, processing: 0>

2026-01-19 15:02:39,319 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.250:46065

2026-01-19 15:02:39,317 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.250:46065', status: closed, memory: 0, processing: 0>

2026-01-19 15:02:38,548 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.244:42621', status: closed, memory: 0, processing: 0>

2026-01-19 15:02:38,445 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.250:35639', status: closed, memory: 0, processing: 0>

2026-01-19 15:02:23,464 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.244:42621

2026-01-19 15:02:23,463 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.244:42621', status: closed, memory: 0, processing: 0>

2026-01-19 15:02:22,761 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.250:35639

2026-01-19 15:02:22,759 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.250:35639', status: closed, memory: 0, processing: 0>

2026-01-19 15:02:22,613 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.244:45111', status: closed, memory: 0, processing: 0>

2026-01-19 15:02:21,856 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.250:43187', status: closed, memory: 0, processing: 0>

2026-01-19 15:02:02,975 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.244:45111

2026-01-19 15:02:02,974 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.244:45111', status: closed, memory: 0, processing: 0>

2026-01-19 15:02:02,411 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.250:43187

2026-01-19 15:02:02,409 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.250:43187', status: closed, memory: 0, processing: 0>

2026-01-19 15:02:01,970 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.244:40521', status: closed, memory: 0, processing: 0>

2026-01-19 15:02:01,465 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.250:40435', status: closed, memory: 0, processing: 0>

2026-01-19 15:01:31,378 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.244:40521

2026-01-19 15:01:31,377 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.244:40521', status: closed, memory: 0, processing: 0>

2026-01-19 15:01:31,375 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.250:40435

2026-01-19 15:01:31,375 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.250:40435', status: closed, memory: 0, processing: 0>

2026-01-19 15:01:29,791 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.244:45345', status: closed, memory: 0, processing: 0>

2026-01-19 15:01:29,575 - distributed.scheduler - INFO - Close client connection: Client-worker-f8dbde48-f222-11f0-8143-123d2a42b3d6

2026-01-19 15:01:29,555 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.250:35843', status: closed, memory: 0, processing: 0>

2026-01-19 15:01:29,554 - distributed.scheduler - INFO - Remove client Client-worker-f8dbde48-f222-11f0-8143-123d2a42b3d6

2026-01-19 15:00:42,299 - distributed.scheduler - INFO - Receive client connection: Client-9fe7675c-f547-11f0-8001-d684c398e257

2026-01-19 14:51:22,531 - distributed.scheduler - INFO - Close client connection: Client-39632b9b-f546-11f0-8001-d684c398e257

2026-01-19 14:51:22,530 - distributed.scheduler - INFO - Remove client Client-39632b9b-f546-11f0-8001-d684c398e257

2026-01-19 14:51:22,528 - distributed.scheduler - INFO - Remove client Client-39632b9b-f546-11f0-8001-d684c398e257

2026-01-19 14:50:40,809 - distributed.scheduler - INFO - Receive client connection: Client-39632b9b-f546-11f0-8001-d684c398e257

2026-01-19 14:41:21,876 - distributed.scheduler - INFO - Close client connection: Client-d2dede55-f544-11f0-8001-d684c398e257

2026-01-19 14:41:21,874 - distributed.scheduler - INFO - Remove client Client-d2dede55-f544-11f0-8001-d684c398e257

2026-01-19 14:41:21,873 - distributed.scheduler - INFO - Remove client Client-d2dede55-f544-11f0-8001-d684c398e257

2026-01-19 14:40:39,316 - distributed.scheduler - INFO - Receive client connection: Client-d2dede55-f544-11f0-8001-d684c398e257

2026-01-19 14:31:52,013 - distributed.scheduler - INFO - Close client connection: Client-6c638ea7-f543-11f0-8001-d684c398e257

2026-01-19 14:31:52,012 - distributed.scheduler - INFO - Remove client Client-6c638ea7-f543-11f0-8001-d684c398e257

2026-01-19 14:31:52,010 - distributed.scheduler - INFO - Remove client Client-6c638ea7-f543-11f0-8001-d684c398e257

2026-01-19 14:30:43,598 - distributed.scheduler - INFO - Receive client connection: Client-worker-6fac2b7a-f543-11f0-8316-a2be1fdf94d6

2026-01-19 14:30:37,887 - distributed.scheduler - INFO - Receive client connection: Client-6c638ea7-f543-11f0-8001-d684c398e257

2026-01-19 14:21:12,032 - distributed.scheduler - INFO - Close client connection: Client-05e7869a-f542-11f0-8001-d684c398e257

2026-01-19 14:21:12,030 - distributed.scheduler - INFO - Remove client Client-05e7869a-f542-11f0-8001-d684c398e257

2026-01-19 14:21:12,030 - distributed.scheduler - INFO - Remove client Client-05e7869a-f542-11f0-8001-d684c398e257

2026-01-19 14:20:36,449 - distributed.scheduler - INFO - Receive client connection: Client-05e7869a-f542-11f0-8001-d684c398e257

2026-01-19 14:11:10,115 - distributed.scheduler - INFO - Close client connection: Client-9f70f19c-f540-11f0-8001-d684c398e257

2026-01-19 14:11:10,114 - distributed.scheduler - INFO - Remove client Client-9f70f19c-f540-11f0-8001-d684c398e257

2026-01-19 14:11:10,113 - distributed.scheduler - INFO - Remove client Client-9f70f19c-f540-11f0-8001-d684c398e257

2026-01-19 14:10:35,067 - distributed.scheduler - INFO - Receive client connection: Client-9f70f19c-f540-11f0-8001-d684c398e257

2026-01-19 14:01:45,729 - distributed.scheduler - INFO - Close client connection: Client-38f3c7c8-f53f-11f0-8001-d684c398e257

2026-01-19 14:01:45,728 - distributed.scheduler - INFO - Remove client Client-38f3c7c8-f53f-11f0-8001-d684c398e257

2026-01-19 14:01:45,727 - distributed.scheduler - INFO - Remove client Client-38f3c7c8-f53f-11f0-8001-d684c398e257

2026-01-19 14:00:33,601 - distributed.scheduler - INFO - Receive client connection: Client-38f3c7c8-f53f-11f0-8001-d684c398e257

2026-01-19 13:51:07,748 - distributed.scheduler - INFO - Close client connection: Client-d2718d41-f53d-11f0-8001-d684c398e257

2026-01-19 13:51:07,747 - distributed.scheduler - INFO - Remove client Client-d2718d41-f53d-11f0-8001-d684c398e257

2026-01-19 13:51:07,746 - distributed.scheduler - INFO - Remove client Client-d2718d41-f53d-11f0-8001-d684c398e257

2026-01-19 13:50:32,127 - distributed.scheduler - INFO - Receive client connection: Client-d2718d41-f53d-11f0-8001-d684c398e257

2026-01-19 13:41:04,560 - distributed.scheduler - INFO - Close client connection: Client-6c01f225-f53c-11f0-8001-d684c398e257

2026-01-19 13:41:04,559 - distributed.scheduler - INFO - Remove client Client-6c01f225-f53c-11f0-8001-d684c398e257

2026-01-19 13:41:04,558 - distributed.scheduler - INFO - Remove client Client-6c01f225-f53c-11f0-8001-d684c398e257

2026-01-19 13:40:30,769 - distributed.scheduler - INFO - Receive client connection: Client-6c01f225-f53c-11f0-8001-d684c398e257

2026-01-19 13:31:41,415 - distributed.scheduler - INFO - Close client connection: Client-05864216-f53b-11f0-8001-d684c398e257

2026-01-19 13:31:41,414 - distributed.scheduler - INFO - Remove client Client-05864216-f53b-11f0-8001-d684c398e257

2026-01-19 13:31:41,413 - distributed.scheduler - INFO - Remove client Client-05864216-f53b-11f0-8001-d684c398e257

2026-01-19 13:30:34,049 - distributed.scheduler - INFO - Receive client connection: Client-worker-084fb6cc-f53b-11f0-83bb-b2b90c3ada4d

2026-01-19 13:30:29,337 - distributed.scheduler - INFO - Receive client connection: Client-05864216-f53b-11f0-8001-d684c398e257

2026-01-19 13:21:07,760 - distributed.scheduler - INFO - Close client connection: Client-9efa0b46-f539-11f0-8001-d684c398e257

2026-01-19 13:21:07,759 - distributed.scheduler - INFO - Remove client Client-9efa0b46-f539-11f0-8001-d684c398e257

2026-01-19 13:21:07,757 - distributed.scheduler - INFO - Remove client Client-9efa0b46-f539-11f0-8001-d684c398e257

2026-01-19 13:20:27,822 - distributed.scheduler - INFO - Receive client connection: Client-9efa0b46-f539-11f0-8001-d684c398e257

2026-01-19 13:11:07,397 - distributed.scheduler - INFO - Close client connection: Client-3881f598-f538-11f0-8001-d684c398e257

2026-01-19 13:11:07,396 - distributed.scheduler - INFO - Remove client Client-3881f598-f538-11f0-8001-d684c398e257

2026-01-19 13:11:07,394 - distributed.scheduler - INFO - Remove client Client-3881f598-f538-11f0-8001-d684c398e257

2026-01-19 13:10:26,381 - distributed.scheduler - INFO - Receive client connection: Client-3881f598-f538-11f0-8001-d684c398e257

2026-01-19 13:01:38,841 - distributed.scheduler - INFO - Close client connection: Client-d1fc1e75-f536-11f0-8001-d684c398e257

2026-01-19 13:01:38,840 - distributed.scheduler - INFO - Remove client Client-d1fc1e75-f536-11f0-8001-d684c398e257

2026-01-19 13:01:38,838 - distributed.scheduler - INFO - Remove client Client-d1fc1e75-f536-11f0-8001-d684c398e257

2026-01-19 13:00:29,048 - distributed.scheduler - INFO - Receive client connection: Client-worker-d476fd2e-f536-11f0-8305-42992fa4ff5e

2026-01-19 13:00:24,874 - distributed.scheduler - INFO - Receive client connection: Client-d1fc1e75-f536-11f0-8001-d684c398e257

2026-01-19 12:51:02,702 - distributed.scheduler - INFO - Close client connection: Client-6b7782a1-f535-11f0-8001-d684c398e257

2026-01-19 12:51:02,701 - distributed.scheduler - INFO - Remove client Client-6b7782a1-f535-11f0-8001-d684c398e257

2026-01-19 12:51:02,699 - distributed.scheduler - INFO - Remove client Client-6b7782a1-f535-11f0-8001-d684c398e257

2026-01-19 12:50:23,385 - distributed.scheduler - INFO - Receive client connection: Client-6b7782a1-f535-11f0-8001-d684c398e257

2026-01-19 12:41:04,357 - distributed.scheduler - INFO - Close client connection: Client-0502db31-f534-11f0-8001-d684c398e257

2026-01-19 12:41:04,354 - distributed.scheduler - INFO - Remove client Client-0502db31-f534-11f0-8001-d684c398e257

2026-01-19 12:41:04,352 - distributed.scheduler - INFO - Remove client Client-0502db31-f534-11f0-8001-d684c398e257

2026-01-19 12:40:21,994 - distributed.scheduler - INFO - Receive client connection: Client-0502db31-f534-11f0-8001-d684c398e257

2026-01-19 12:31:44,187 - distributed.scheduler - INFO - Close client connection: Client-9e7f675a-f532-11f0-8001-d684c398e257

2026-01-19 12:31:44,186 - distributed.scheduler - INFO - Remove client Client-9e7f675a-f532-11f0-8001-d684c398e257

2026-01-19 12:31:44,184 - distributed.scheduler - INFO - Remove client Client-9e7f675a-f532-11f0-8001-d684c398e257

2026-01-19 12:31:30,238 - distributed.scheduler - INFO - Receive client connection: Client-worker-c810e9fb-f532-11f0-82dd-76b515aac91e

2026-01-19 12:31:06,610 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.188:41715

2026-01-19 12:31:06,609 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.188:41715', status: running, memory: 0, processing: 0>

2026-01-19 12:31:06,559 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.159:34751

2026-01-19 12:31:06,557 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.159:34751', status: running, memory: 0, processing: 0>

2026-01-19 12:31:06,168 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.244:45345

2026-01-19 12:31:06,166 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.244:45345', status: closed, memory: 0, processing: 0>

2026-01-19 12:31:06,106 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.159.211:41463

2026-01-19 12:31:06,105 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.159.211:41463', status: running, memory: 0, processing: 0>

2026-01-19 12:31:05,961 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.247:34539

2026-01-19 12:31:05,960 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.247:34539', status: running, memory: 0, processing: 0>

2026-01-19 12:31:05,901 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.37:41029

2026-01-19 12:31:05,901 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.37:41029', status: running, memory: 0, processing: 0>

2026-01-19 12:31:05,741 - distributed.scheduler - ERROR - Shut down workers that don't have promised key: [], run-c3db19238b2d99a7ebbf1eb72e859957 NoneType: None

2026-01-19 12:31:05,741 - distributed.scheduler - ERROR - Shut down workers that don't have promised key: ['tcp://172.21.151.159:35235'], run-f109db49b2a78ddfd3c33a0c73518b5b NoneType: None

2026-01-19 12:31:05,741 - distributed.scheduler - ERROR - Shut down workers that don't have promised key: ['tcp://172.21.151.188:37283'], run-e656e5efab44403161d8dd0209f1074a NoneType: None

2026-01-19 12:31:05,739 - distributed.scheduler - ERROR - Couldn't gather keys {'run-e656e5efab44403161d8dd0209f1074a': ['tcp://172.21.151.188:37283'], 'run-f109db49b2a78ddfd3c33a0c73518b5b': ['tcp://172.21.151.159:35235'], 'run-c3db19238b2d99a7ebbf1eb72e859957': []} state: ['processing', 'processing', 'processing'] workers: ['tcp://172.21.151.159:35235', 'tcp://172.21.151.188:37283'] NoneType: None

2026-01-19 12:31:05,733 - distributed.scheduler - INFO - Close client connection: Client-worker-2a899064-f212-11f0-8163-76b515aac91e

2026-01-19 12:31:05,731 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.188:37283', status: closed, memory: 0, processing: 0>

2026-01-19 12:31:05,730 - distributed.scheduler - INFO - Remove client Client-worker-2a899064-f212-11f0-8163-76b515aac91e

2026-01-19 12:31:05,555 - distributed.scheduler - INFO - Close client connection: Client-worker-1f0d55ff-f294-11f0-8234-b2b90c3ada4d

2026-01-19 12:31:05,545 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.159:35235', status: closed, memory: 0, processing: 0>

2026-01-19 12:31:05,543 - distributed.scheduler - INFO - Remove client Client-worker-1f0d55ff-f294-11f0-8234-b2b90c3ada4d

2026-01-19 12:31:05,204 - distributed.scheduler - INFO - Close client connection: Client-worker-1f6ea300-f461-11f0-82fb-fa70b2057bbc

2026-01-19 12:31:05,202 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.244:42213', status: closed, memory: 0, processing: 0>

2026-01-19 12:31:05,201 - distributed.scheduler - INFO - Remove client Client-worker-1f6ea300-f461-11f0-82fb-fa70b2057bbc

2026-01-19 12:31:05,193 - distributed.scheduler - INFO - Close client connection: Client-worker-90d445cd-f21a-11f0-8163-42992fa4ff5e

2026-01-19 12:31:05,190 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.159.211:33779', status: closed, memory: 0, processing: 0>

2026-01-19 12:31:05,188 - distributed.scheduler - INFO - Remove client Client-worker-90d445cd-f21a-11f0-8163-42992fa4ff5e

2026-01-19 12:31:05,033 - distributed.scheduler - INFO - Close client connection: Client-worker-5e63ce38-f216-11f0-815e-a2be1fdf94d6

2026-01-19 12:31:05,025 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.247:33153', status: closed, memory: 0, processing: 0>

2026-01-19 12:31:05,024 - distributed.scheduler - INFO - Remove client Client-worker-5e63ce38-f216-11f0-815e-a2be1fdf94d6

2026-01-19 12:31:04,980 - distributed.scheduler - INFO - Close client connection: Client-worker-f6a4c69c-f20d-11f0-81e9-e6b3e8b2508c

2026-01-19 12:31:04,977 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.37:44341', status: closed, memory: 0, processing: 0>

2026-01-19 12:31:04,976 - distributed.scheduler - INFO - Remove client Client-worker-f6a4c69c-f20d-11f0-81e9-e6b3e8b2508c

2026-01-19 12:30:20,503 - distributed.scheduler - INFO - Receive client connection: Client-9e7f675a-f532-11f0-8001-d684c398e257

2026-01-19 12:21:03,622 - distributed.scheduler - INFO - Close client connection: Client-048781c7-f52d-11f0-8001-d684c398e257

2026-01-19 12:21:03,621 - distributed.scheduler - INFO - Close client connection: Client-6b07548a-f52e-11f0-8001-d684c398e257

2026-01-19 12:21:03,621 - distributed.scheduler - INFO - Close client connection: Client-d17b7bc1-f52f-11f0-8001-d684c398e257

2026-01-19 12:21:03,620 - distributed.scheduler - INFO - Remove client Client-048781c7-f52d-11f0-8001-d684c398e257

2026-01-19 12:21:03,619 - distributed.scheduler - INFO - Remove client Client-6b07548a-f52e-11f0-8001-d684c398e257

2026-01-19 12:21:03,618 - distributed.scheduler - INFO - Remove client Client-d17b7bc1-f52f-11f0-8001-d684c398e257

2026-01-19 12:21:02,968 - distributed.scheduler - INFO - Close client connection: Client-3802c7fd-f531-11f0-8001-d684c398e257

2026-01-19 12:21:02,966 - distributed.scheduler - INFO - Remove client Client-3802c7fd-f531-11f0-8001-d684c398e257

2026-01-19 12:21:02,965 - distributed.scheduler - INFO - Remove client Client-3802c7fd-f531-11f0-8001-d684c398e257

2026-01-19 12:20:19,061 - distributed.scheduler - INFO - Receive client connection: Client-3802c7fd-f531-11f0-8001-d684c398e257

2026-01-19 12:10:17,548 - distributed.scheduler - INFO - Receive client connection: Client-d17b7bc1-f52f-11f0-8001-d684c398e257

2026-01-19 12:00:16,163 - distributed.scheduler - INFO - Receive client connection: Client-6b07548a-f52e-11f0-8001-d684c398e257

2026-01-19 11:50:14,700 - distributed.scheduler - INFO - Receive client connection: Client-048781c7-f52d-11f0-8001-d684c398e257

2026-01-19 11:40:50,600 - distributed.scheduler - INFO - Close client connection: Client-9e1b1bbb-f52b-11f0-8001-d684c398e257

2026-01-19 11:40:50,599 - distributed.scheduler - INFO - Remove client Client-9e1b1bbb-f52b-11f0-8001-d684c398e257

2026-01-19 11:40:50,598 - distributed.scheduler - INFO - Remove client Client-9e1b1bbb-f52b-11f0-8001-d684c398e257

2026-01-19 11:40:13,368 - distributed.scheduler - INFO - Receive client connection: Client-9e1b1bbb-f52b-11f0-8001-d684c398e257

2026-01-19 11:31:23,168 - distributed.scheduler - INFO - Close client connection: Client-379e2da9-f52a-11f0-8001-d684c398e257

2026-01-19 11:31:23,168 - distributed.scheduler - INFO - Remove client Client-379e2da9-f52a-11f0-8001-d684c398e257

2026-01-19 11:31:23,167 - distributed.scheduler - INFO - Remove client Client-379e2da9-f52a-11f0-8001-d684c398e257

2026-01-19 11:30:11,933 - distributed.scheduler - INFO - Receive client connection: Client-379e2da9-f52a-11f0-8001-d684c398e257

2026-01-19 11:20:47,909 - distributed.scheduler - INFO - Close client connection: Client-d11e8f6d-f528-11f0-8001-d684c398e257

2026-01-19 11:20:47,908 - distributed.scheduler - INFO - Remove client Client-d11e8f6d-f528-11f0-8001-d684c398e257

2026-01-19 11:20:47,907 - distributed.scheduler - INFO - Remove client Client-d11e8f6d-f528-11f0-8001-d684c398e257

2026-01-19 11:20:10,472 - distributed.scheduler - INFO - Receive client connection: Client-d11e8f6d-f528-11f0-8001-d684c398e257

2026-01-19 11:10:41,986 - distributed.scheduler - INFO - Close client connection: Client-6a943696-f527-11f0-8001-d684c398e257

2026-01-19 11:10:41,986 - distributed.scheduler - INFO - Remove client Client-6a943696-f527-11f0-8001-d684c398e257

2026-01-19 11:10:41,985 - distributed.scheduler - INFO - Remove client Client-6a943696-f527-11f0-8001-d684c398e257

2026-01-19 11:10:08,949 - distributed.scheduler - INFO - Receive client connection: Client-6a943696-f527-11f0-8001-d684c398e257

2026-01-19 11:01:18,429 - distributed.scheduler - INFO - Close client connection: Client-041b037d-f526-11f0-8001-d684c398e257

2026-01-19 11:01:18,425 - distributed.scheduler - INFO - Remove client Client-041b037d-f526-11f0-8001-d684c398e257

2026-01-19 11:01:18,424 - distributed.scheduler - INFO - Remove client Client-041b037d-f526-11f0-8001-d684c398e257

2026-01-19 11:00:07,519 - distributed.scheduler - INFO - Receive client connection: Client-041b037d-f526-11f0-8001-d684c398e257

2026-01-19 10:50:44,322 - distributed.scheduler - INFO - Close client connection: Client-d0a38fad-f521-11f0-8001-d684c398e257

2026-01-19 10:50:44,322 - distributed.scheduler - INFO - Close client connection: Client-371ce16b-f523-11f0-8001-d684c398e257

2026-01-19 10:50:44,321 - distributed.scheduler - INFO - Remove client Client-d0a38fad-f521-11f0-8001-d684c398e257

2026-01-19 10:50:44,320 - distributed.scheduler - INFO - Remove client Client-371ce16b-f523-11f0-8001-d684c398e257

2026-01-19 10:50:43,542 - distributed.scheduler - INFO - Close client connection: Client-9d93b3b2-f524-11f0-8001-d684c398e257

2026-01-19 10:50:43,540 - distributed.scheduler - INFO - Remove client Client-9d93b3b2-f524-11f0-8001-d684c398e257

2026-01-19 10:50:43,539 - distributed.scheduler - INFO - Remove client Client-9d93b3b2-f524-11f0-8001-d684c398e257

2026-01-19 10:50:06,002 - distributed.scheduler - INFO - Receive client connection: Client-9d93b3b2-f524-11f0-8001-d684c398e257

2026-01-19 10:40:04,595 - distributed.scheduler - INFO - Receive client connection: Client-371ce16b-f523-11f0-8001-d684c398e257

2026-01-19 10:30:03,185 - distributed.scheduler - INFO - Receive client connection: Client-d0a38fad-f521-11f0-8001-d684c398e257

2026-01-19 10:20:32,822 - distributed.scheduler - INFO - Close client connection: Client-6a1e2cff-f520-11f0-8001-d684c398e257

2026-01-19 10:20:32,821 - distributed.scheduler - INFO - Remove client Client-6a1e2cff-f520-11f0-8001-d684c398e257

2026-01-19 10:20:32,820 - distributed.scheduler - INFO - Remove client Client-6a1e2cff-f520-11f0-8001-d684c398e257

2026-01-19 10:20:01,689 - distributed.scheduler - INFO - Receive client connection: Client-6a1e2cff-f520-11f0-8001-d684c398e257

2026-01-19 10:10:30,169 - distributed.scheduler - INFO - Close client connection: Client-05f4f852-f51f-11f0-8001-d684c398e257

2026-01-19 10:10:30,167 - distributed.scheduler - INFO - Remove client Client-05f4f852-f51f-11f0-8001-d684c398e257

2026-01-19 10:10:30,166 - distributed.scheduler - INFO - Remove client Client-05f4f852-f51f-11f0-8001-d684c398e257

2026-01-19 10:10:04,153 - distributed.scheduler - INFO - Receive client connection: Client-05f4f852-f51f-11f0-8001-d684c398e257

2026-01-19 10:01:48,613 - distributed.scheduler - INFO - Close client connection: Client-c0ee556a-f51d-11f0-8001-d684c398e257

2026-01-19 10:01:48,612 - distributed.scheduler - INFO - Remove client Client-c0ee556a-f51d-11f0-8001-d684c398e257

2026-01-19 10:01:48,610 - distributed.scheduler - INFO - Remove client Client-c0ee556a-f51d-11f0-8001-d684c398e257

2026-01-19 10:00:58,838 - distributed.scheduler - INFO - Receive client connection: Client-c0ee556a-f51d-11f0-8001-d684c398e257

2026-01-19 09:51:28,498 - distributed.scheduler - INFO - Close client connection: Client-5a717039-f51c-11f0-8001-d684c398e257

2026-01-19 09:51:28,496 - distributed.scheduler - INFO - Remove client Client-5a717039-f51c-11f0-8001-d684c398e257

2026-01-19 09:51:28,493 - distributed.scheduler - INFO - Remove client Client-5a717039-f51c-11f0-8001-d684c398e257

2026-01-19 09:50:57,400 - distributed.scheduler - INFO - Receive client connection: Client-5a717039-f51c-11f0-8001-d684c398e257

2026-01-19 09:41:28,053 - distributed.scheduler - INFO - Close client connection: Client-f3f4dedc-f51a-11f0-8001-d684c398e257

2026-01-19 09:41:28,051 - distributed.scheduler - INFO - Remove client Client-f3f4dedc-f51a-11f0-8001-d684c398e257

2026-01-19 09:41:28,050 - distributed.scheduler - INFO - Remove client Client-f3f4dedc-f51a-11f0-8001-d684c398e257

2026-01-19 09:40:55,962 - distributed.scheduler - INFO - Receive client connection: Client-f3f4dedc-f51a-11f0-8001-d684c398e257

2026-01-19 09:31:50,262 - distributed.scheduler - INFO - Close client connection: Client-268f0a5d-f511-11f0-8001-d684c398e257

2026-01-19 09:31:50,262 - distributed.scheduler - INFO - Close client connection: Client-8d09be6f-f512-11f0-8001-d684c398e257

2026-01-19 09:31:50,262 - distributed.scheduler - INFO - Close client connection: Client-f38ffa60-f513-11f0-8001-d684c398e257

2026-01-19 09:31:50,261 - distributed.scheduler - INFO - Close client connection: Client-5a0ecc8e-f515-11f0-8001-d684c398e257

2026-01-19 09:31:50,261 - distributed.scheduler - INFO - Close client connection: Client-c09218e5-f516-11f0-8001-d684c398e257

2026-01-19 09:31:50,261 - distributed.scheduler - INFO - Close client connection: Client-27070e6e-f518-11f0-8001-d684c398e257

2026-01-19 09:31:50,259 - distributed.scheduler - INFO - Remove client Client-268f0a5d-f511-11f0-8001-d684c398e257

2026-01-19 09:31:50,258 - distributed.scheduler - INFO - Remove client Client-8d09be6f-f512-11f0-8001-d684c398e257

2026-01-19 09:31:50,257 - distributed.scheduler - INFO - Remove client Client-f38ffa60-f513-11f0-8001-d684c398e257

2026-01-19 09:31:50,256 - distributed.scheduler - INFO - Remove client Client-5a0ecc8e-f515-11f0-8001-d684c398e257

2026-01-19 09:31:50,256 - distributed.scheduler - INFO - Remove client Client-c09218e5-f516-11f0-8001-d684c398e257

2026-01-19 09:31:50,254 - distributed.scheduler - INFO - Remove client Client-27070e6e-f518-11f0-8001-d684c398e257

2026-01-19 09:31:49,444 - distributed.scheduler - INFO - Close client connection: Client-8d7b6c9a-f519-11f0-8001-d684c398e257

2026-01-19 09:31:49,443 - distributed.scheduler - INFO - Remove client Client-8d7b6c9a-f519-11f0-8001-d684c398e257

2026-01-19 09:31:49,441 - distributed.scheduler - INFO - Remove client Client-8d7b6c9a-f519-11f0-8001-d684c398e257

2026-01-19 09:30:54,536 - distributed.scheduler - INFO - Receive client connection: Client-8d7b6c9a-f519-11f0-8001-d684c398e257

2026-01-19 09:20:53,143 - distributed.scheduler - INFO - Receive client connection: Client-27070e6e-f518-11f0-8001-d684c398e257

2026-01-19 09:10:51,753 - distributed.scheduler - INFO - Receive client connection: Client-c09218e5-f516-11f0-8001-d684c398e257

2026-01-19 09:00:50,309 - distributed.scheduler - INFO - Receive client connection: Client-5a0ecc8e-f515-11f0-8001-d684c398e257

2026-01-19 08:50:48,820 - distributed.scheduler - INFO - Receive client connection: Client-f38ffa60-f513-11f0-8001-d684c398e257

2026-01-19 08:40:47,313 - distributed.scheduler - INFO - Receive client connection: Client-8d09be6f-f512-11f0-8001-d684c398e257

2026-01-19 08:30:45,890 - distributed.scheduler - INFO - Receive client connection: Client-268f0a5d-f511-11f0-8001-d684c398e257

2026-01-19 08:21:17,379 - distributed.scheduler - INFO - Close client connection: Client-c015d8eb-f50f-11f0-8001-d684c398e257

2026-01-19 08:21:17,378 - distributed.scheduler - INFO - Remove client Client-c015d8eb-f50f-11f0-8001-d684c398e257

2026-01-19 08:21:17,377 - distributed.scheduler - INFO - Remove client Client-c015d8eb-f50f-11f0-8001-d684c398e257

2026-01-19 08:20:44,474 - distributed.scheduler - INFO - Receive client connection: Client-c015d8eb-f50f-11f0-8001-d684c398e257

2026-01-19 08:11:17,719 - distributed.scheduler - INFO - Close client connection: Client-59aab161-f50e-11f0-8001-d684c398e257

2026-01-19 08:11:17,718 - distributed.scheduler - INFO - Remove client Client-59aab161-f50e-11f0-8001-d684c398e257

2026-01-19 08:11:17,716 - distributed.scheduler - INFO - Remove client Client-59aab161-f50e-11f0-8001-d684c398e257

2026-01-19 08:10:43,147 - distributed.scheduler - INFO - Receive client connection: Client-59aab161-f50e-11f0-8001-d684c398e257

2026-01-19 08:01:37,781 - distributed.scheduler - INFO - Close client connection: Client-f32872f8-f50c-11f0-8001-d684c398e257

2026-01-19 08:01:37,780 - distributed.scheduler - INFO - Remove client Client-f32872f8-f50c-11f0-8001-d684c398e257

2026-01-19 08:01:37,779 - distributed.scheduler - INFO - Remove client Client-f32872f8-f50c-11f0-8001-d684c398e257

2026-01-19 08:00:41,666 - distributed.scheduler - INFO - Receive client connection: Client-f32872f8-f50c-11f0-8001-d684c398e257

2026-01-19 07:51:15,441 - distributed.scheduler - INFO - Close client connection: Client-8ca966ae-f50b-11f0-8001-d684c398e257

2026-01-19 07:51:15,439 - distributed.scheduler - INFO - Remove client Client-8ca966ae-f50b-11f0-8001-d684c398e257

2026-01-19 07:51:15,438 - distributed.scheduler - INFO - Remove client Client-8ca966ae-f50b-11f0-8001-d684c398e257

2026-01-19 07:50:40,220 - distributed.scheduler - INFO - Receive client connection: Client-8ca966ae-f50b-11f0-8001-d684c398e257

2026-01-19 07:41:13,127 - distributed.scheduler - INFO - Close client connection: Client-26361a13-f50a-11f0-8001-d684c398e257

2026-01-19 07:41:13,126 - distributed.scheduler - INFO - Remove client Client-26361a13-f50a-11f0-8001-d684c398e257

2026-01-19 07:41:13,124 - distributed.scheduler - INFO - Remove client Client-26361a13-f50a-11f0-8001-d684c398e257

2026-01-19 07:40:38,833 - distributed.scheduler - INFO - Receive client connection: Client-26361a13-f50a-11f0-8001-d684c398e257

2026-01-19 07:31:34,340 - distributed.scheduler - INFO - Close client connection: Client-bfa87a8a-f508-11f0-8001-d684c398e257

2026-01-19 07:31:34,339 - distributed.scheduler - INFO - Remove client Client-bfa87a8a-f508-11f0-8001-d684c398e257

2026-01-19 07:31:34,337 - distributed.scheduler - INFO - Remove client Client-bfa87a8a-f508-11f0-8001-d684c398e257

2026-01-19 07:30:37,279 - distributed.scheduler - INFO - Receive client connection: Client-bfa87a8a-f508-11f0-8001-d684c398e257

2026-01-19 07:21:11,550 - distributed.scheduler - INFO - Close client connection: Client-5923e1fb-f507-11f0-8001-d684c398e257

2026-01-19 07:21:11,549 - distributed.scheduler - INFO - Remove client Client-5923e1fb-f507-11f0-8001-d684c398e257

2026-01-19 07:21:11,547 - distributed.scheduler - INFO - Remove client Client-5923e1fb-f507-11f0-8001-d684c398e257

2026-01-19 07:20:35,785 - distributed.scheduler - INFO - Receive client connection: Client-5923e1fb-f507-11f0-8001-d684c398e257

2026-01-19 07:11:09,970 - distributed.scheduler - INFO - Close client connection: Client-f2a4691e-f505-11f0-8001-d684c398e257

2026-01-19 07:11:09,968 - distributed.scheduler - INFO - Remove client Client-f2a4691e-f505-11f0-8001-d684c398e257

2026-01-19 07:11:09,966 - distributed.scheduler - INFO - Remove client Client-f2a4691e-f505-11f0-8001-d684c398e257

2026-01-19 07:10:34,325 - distributed.scheduler - INFO - Receive client connection: Client-f2a4691e-f505-11f0-8001-d684c398e257

2026-01-19 07:01:34,157 - distributed.scheduler - INFO - Close client connection: Client-be0f5717-f4f3-11f0-8001-d684c398e257

2026-01-19 07:01:34,157 - distributed.scheduler - INFO - Close client connection: Client-2492f35e-f4f5-11f0-8001-d684c398e257

2026-01-19 07:01:34,157 - distributed.scheduler - INFO - Close client connection: Client-8b084b44-f4f6-11f0-8001-d684c398e257

2026-01-19 07:01:34,156 - distributed.scheduler - INFO - Close client connection: Client-f180fa10-f4f7-11f0-8001-d684c398e257

2026-01-19 07:01:34,156 - distributed.scheduler - INFO - Close client connection: Client-5827a34e-f4f9-11f0-8001-d684c398e257

2026-01-19 07:01:34,156 - distributed.scheduler - INFO - Close client connection: Client-bea32a01-f4fa-11f0-8001-d684c398e257

2026-01-19 07:01:34,156 - distributed.scheduler - INFO - Close client connection: Client-8b9e6978-f4fd-11f0-8001-d684c398e257

2026-01-19 07:01:34,155 - distributed.scheduler - INFO - Close client connection: Client-251e5a38-f4fc-11f0-8001-d684c398e257

2026-01-19 07:01:34,155 - distributed.scheduler - INFO - Close client connection: Client-f20ec9e6-f4fe-11f0-8001-d684c398e257

2026-01-19 07:01:34,154 - distributed.scheduler - INFO - Close client connection: Client-58914cee-f500-11f0-8001-d684c398e257

2026-01-19 07:01:34,154 - distributed.scheduler - INFO - Close client connection: Client-bf103e5f-f501-11f0-8001-d684c398e257

2026-01-19 07:01:34,153 - distributed.scheduler - INFO - Close client connection: Client-2597d541-f503-11f0-8001-d684c398e257

2026-01-19 07:01:34,152 - distributed.scheduler - INFO - Remove client Client-be0f5717-f4f3-11f0-8001-d684c398e257

2026-01-19 07:01:34,151 - distributed.scheduler - INFO - Remove client Client-2492f35e-f4f5-11f0-8001-d684c398e257

2026-01-19 07:01:34,150 - distributed.scheduler - INFO - Remove client Client-8b084b44-f4f6-11f0-8001-d684c398e257

2026-01-19 07:01:34,150 - distributed.scheduler - INFO - Remove client Client-f180fa10-f4f7-11f0-8001-d684c398e257

2026-01-19 07:01:34,149 - distributed.scheduler - INFO - Remove client Client-5827a34e-f4f9-11f0-8001-d684c398e257

2026-01-19 07:01:34,147 - distributed.scheduler - INFO - Remove client Client-bea32a01-f4fa-11f0-8001-d684c398e257

2026-01-19 07:01:34,146 - distributed.scheduler - INFO - Remove client Client-8b9e6978-f4fd-11f0-8001-d684c398e257

2026-01-19 07:01:34,146 - distributed.scheduler - INFO - Remove client Client-251e5a38-f4fc-11f0-8001-d684c398e257

2026-01-19 07:01:34,145 - distributed.scheduler - INFO - Remove client Client-f20ec9e6-f4fe-11f0-8001-d684c398e257

2026-01-19 07:01:34,138 - distributed.scheduler - INFO - Remove client Client-58914cee-f500-11f0-8001-d684c398e257

2026-01-19 07:01:34,138 - distributed.scheduler - INFO - Remove client Client-bf103e5f-f501-11f0-8001-d684c398e257

2026-01-19 07:01:34,137 - distributed.scheduler - INFO - Remove client Client-2597d541-f503-11f0-8001-d684c398e257

2026-01-19 07:01:33,619 - distributed.scheduler - INFO - Close client connection: Client-8c2464da-f504-11f0-8001-d684c398e257

2026-01-19 07:01:33,618 - distributed.scheduler - INFO - Remove client Client-8c2464da-f504-11f0-8001-d684c398e257

2026-01-19 07:01:33,616 - distributed.scheduler - INFO - Remove client Client-8c2464da-f504-11f0-8001-d684c398e257

2026-01-19 07:00:32,859 - distributed.scheduler - INFO - Receive client connection: Client-8c2464da-f504-11f0-8001-d684c398e257

2026-01-19 06:50:31,313 - distributed.scheduler - INFO - Receive client connection: Client-2597d541-f503-11f0-8001-d684c398e257

2026-01-19 06:40:29,797 - distributed.scheduler - INFO - Receive client connection: Client-bf103e5f-f501-11f0-8001-d684c398e257

2026-01-19 06:30:28,343 - distributed.scheduler - INFO - Receive client connection: Client-58914cee-f500-11f0-8001-d684c398e257

2026-01-19 06:20:26,864 - distributed.scheduler - INFO - Receive client connection: Client-f20ec9e6-f4fe-11f0-8001-d684c398e257

2026-01-19 06:10:25,497 - distributed.scheduler - INFO - Receive client connection: Client-8b9e6978-f4fd-11f0-8001-d684c398e257

2026-01-19 06:00:24,034 - distributed.scheduler - INFO - Receive client connection: Client-251e5a38-f4fc-11f0-8001-d684c398e257

2026-01-19 05:50:22,609 - distributed.scheduler - INFO - Receive client connection: Client-bea32a01-f4fa-11f0-8001-d684c398e257

2026-01-19 05:40:21,173 - distributed.scheduler - INFO - Receive client connection: Client-5827a34e-f4f9-11f0-8001-d684c398e257

2026-01-19 05:32:58,346 - distributed.scheduler - INFO - Receive client connection: Client-worker-503657f4-f4f8-11f0-82d9-a217f266f416

2026-01-19 05:32:56,198 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:39501 failed: OSError: Timed out trying to connect to tcp://172.21.159.228:39501 after 30 s

2026-01-19 05:32:56,190 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:41381 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.228:39501 after 30 s')

2026-01-19 05:32:56,067 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:35235 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.228:39501 after 30 s')

2026-01-19 05:32:56,062 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:35843 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.228:39501 after 30 s')

2026-01-19 05:32:56,061 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:37283 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.228:39501 after 30 s')

2026-01-19 05:32:56,060 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:46861 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.228:39501 after 30 s')

2026-01-19 05:32:56,051 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:42711 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.228:39501 after 30 s')

2026-01-19 05:32:56,043 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:33779 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.228:39501 after 30 s')

2026-01-19 05:32:56,042 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:44951 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.228:39501 after 30 s')

2026-01-19 05:32:56,029 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:33971 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.228:39501 after 30 s')

2026-01-19 05:32:26,718 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.159.228:41119

2026-01-19 05:32:26,715 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.159.228:41119', status: running, memory: 0, processing: 0>

2026-01-19 05:32:25,889 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.159.228:39501', status: closed, memory: 0, processing: 0>

2026-01-19 05:32:05,185 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:46489 failed: OSError: Timed out trying to connect to tcp://172.21.159.228:46489 after 30 s

2026-01-19 05:32:05,142 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:41381 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.228:46489 after 30 s')

2026-01-19 05:32:05,105 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:44951 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.228:46489 after 30 s')

2026-01-19 05:32:05,087 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:33153 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.228:46489 after 30 s')

2026-01-19 05:32:05,038 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:33649 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.228:46489 after 30 s')

2026-01-19 05:32:05,034 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:42213 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.228:46489 after 30 s')

2026-01-19 05:32:05,031 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:42711 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.228:46489 after 30 s')

2026-01-19 05:32:05,029 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:33329 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.228:46489 after 30 s')

2026-01-19 05:32:05,028 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:44341 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.228:46489 after 30 s')

2026-01-19 05:32:05,028 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:35235 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.228:46489 after 30 s')

2026-01-19 05:32:05,027 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:33779 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.228:46489 after 30 s')

2026-01-19 05:32:05,000 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:35843 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.228:46489 after 30 s')

2026-01-19 05:32:04,976 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:46861 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.228:46489 after 30 s')

2026-01-19 05:31:35,691 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.159.228:39501

2026-01-19 05:31:35,690 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.159.228:39501', status: closed, memory: 0, processing: 0>

2026-01-19 05:31:34,865 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.159.228:46489', status: closed, memory: 0, processing: 0>

2026-01-19 05:31:21,375 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:46861 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.228:35277 after 30 s')

2026-01-19 05:31:21,075 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:35277 failed: OSError: Timed out trying to connect to tcp://172.21.159.228:35277 after 30 s

2026-01-19 05:31:20,994 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:33153 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.228:35277 after 30 s')

2026-01-19 05:31:20,848 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:35843 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.228:35277 after 30 s')

2026-01-19 05:30:51,059 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.159.228:46489

2026-01-19 05:30:51,056 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.159.228:46489', status: closed, memory: 0, processing: 0>

2026-01-19 05:30:50,235 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.159.228:35277', status: closed, memory: 0, processing: 0>

2026-01-19 05:30:50,203 - distributed.scheduler - INFO - Close client connection: Client-worker-b9e3e7e8-f46d-11f0-825d-a217f266f416

2026-01-19 05:30:50,200 - distributed.scheduler - INFO - Remove client Client-worker-b9e3e7e8-f46d-11f0-825d-a217f266f416

2026-01-19 05:30:19,456 - distributed.scheduler - INFO - Receive client connection: Client-f180fa10-f4f7-11f0-8001-d684c398e257

2026-01-19 05:20:18,035 - distributed.scheduler - INFO - Receive client connection: Client-8b084b44-f4f6-11f0-8001-d684c398e257

2026-01-19 05:10:16,644 - distributed.scheduler - INFO - Receive client connection: Client-2492f35e-f4f5-11f0-8001-d684c398e257

2026-01-19 05:00:15,163 - distributed.scheduler - INFO - Receive client connection: Client-be0f5717-f4f3-11f0-8001-d684c398e257

2026-01-19 04:50:47,153 - distributed.scheduler - INFO - Close client connection: Client-57a1140e-f4f2-11f0-8001-d684c398e257

2026-01-19 04:50:47,151 - distributed.scheduler - INFO - Remove client Client-57a1140e-f4f2-11f0-8001-d684c398e257

2026-01-19 04:50:47,150 - distributed.scheduler - INFO - Remove client Client-57a1140e-f4f2-11f0-8001-d684c398e257

2026-01-19 04:50:13,809 - distributed.scheduler - INFO - Receive client connection: Client-57a1140e-f4f2-11f0-8001-d684c398e257

2026-01-19 04:40:43,480 - distributed.scheduler - INFO - Close client connection: Client-f123b5bd-f4f0-11f0-8001-d684c398e257

2026-01-19 04:40:43,479 - distributed.scheduler - INFO - Remove client Client-f123b5bd-f4f0-11f0-8001-d684c398e257

2026-01-19 04:40:43,477 - distributed.scheduler - INFO - Remove client Client-f123b5bd-f4f0-11f0-8001-d684c398e257

2026-01-19 04:40:12,376 - distributed.scheduler - INFO - Receive client connection: Client-f123b5bd-f4f0-11f0-8001-d684c398e257

2026-01-19 04:30:56,814 - distributed.scheduler - INFO - Close client connection: Client-8a9b1544-f4ef-11f0-8001-d684c398e257

2026-01-19 04:30:56,813 - distributed.scheduler - INFO - Remove client Client-8a9b1544-f4ef-11f0-8001-d684c398e257

2026-01-19 04:30:56,811 - distributed.scheduler - INFO - Remove client Client-8a9b1544-f4ef-11f0-8001-d684c398e257

2026-01-19 04:30:10,858 - distributed.scheduler - INFO - Receive client connection: Client-8a9b1544-f4ef-11f0-8001-d684c398e257

2026-01-19 04:20:40,495 - distributed.scheduler - INFO - Close client connection: Client-240987df-f4ee-11f0-8001-d684c398e257

2026-01-19 04:20:40,494 - distributed.scheduler - INFO - Remove client Client-240987df-f4ee-11f0-8001-d684c398e257

2026-01-19 04:20:40,492 - distributed.scheduler - INFO - Remove client Client-240987df-f4ee-11f0-8001-d684c398e257

2026-01-19 04:20:09,279 - distributed.scheduler - INFO - Receive client connection: Client-240987df-f4ee-11f0-8001-d684c398e257

2026-01-19 04:10:40,187 - distributed.scheduler - INFO - Close client connection: Client-bd7f4dd4-f4ec-11f0-8001-d684c398e257

2026-01-19 04:10:40,186 - distributed.scheduler - INFO - Remove client Client-bd7f4dd4-f4ec-11f0-8001-d684c398e257

2026-01-19 04:10:40,184 - distributed.scheduler - INFO - Remove client Client-bd7f4dd4-f4ec-11f0-8001-d684c398e257

2026-01-19 04:10:07,751 - distributed.scheduler - INFO - Receive client connection: Client-bd7f4dd4-f4ec-11f0-8001-d684c398e257

2026-01-19 04:01:03,856 - distributed.scheduler - INFO - Close client connection: Client-3258abc5-f49d-11f0-8001-d684c398e257

2026-01-19 04:01:03,856 - distributed.scheduler - INFO - Close client connection: Client-98cebe1a-f49e-11f0-8001-d684c398e257

2026-01-19 04:01:03,856 - distributed.scheduler - INFO - Close client connection: Client-ff48c97e-f49f-11f0-8001-d684c398e257

2026-01-19 04:01:03,856 - distributed.scheduler - INFO - Close client connection: Client-65c24ea8-f4a1-11f0-8001-d684c398e257

2026-01-19 04:01:03,856 - distributed.scheduler - INFO - Close client connection: Client-cc3ea249-f4a2-11f0-8001-d684c398e257

2026-01-19 04:01:03,856 - distributed.scheduler - INFO - Close client connection: Client-32cdaa4a-f4a4-11f0-8001-d684c398e257

2026-01-19 04:01:03,855 - distributed.scheduler - INFO - Close client connection: Client-995d0835-f4a5-11f0-8001-d684c398e257

2026-01-19 04:01:03,855 - distributed.scheduler - INFO - Close client connection: Client-ffe57bfd-f4a6-11f0-8001-d684c398e257

2026-01-19 04:01:03,855 - distributed.scheduler - INFO - Close client connection: Client-666d7801-f4a8-11f0-8001-d684c398e257

2026-01-19 04:01:03,855 - distributed.scheduler - INFO - Close client connection: Client-ccf4a89a-f4a9-11f0-8001-d684c398e257

2026-01-19 04:01:03,855 - distributed.scheduler - INFO - Close client connection: Client-33759dd4-f4ab-11f0-8001-d684c398e257

2026-01-19 04:01:03,855 - distributed.scheduler - INFO - Close client connection: Client-761b8785-f4ac-11f0-8001-d684c398e257

2026-01-19 04:01:03,855 - distributed.scheduler - INFO - Close client connection: Client-dc9e72d7-f4ad-11f0-8001-d684c398e257

2026-01-19 04:01:03,855 - distributed.scheduler - INFO - Close client connection: Client-10168f05-f4b2-11f0-8001-d684c398e257

2026-01-19 04:01:03,855 - distributed.scheduler - INFO - Close client connection: Client-431b94d4-f4af-11f0-8001-d684c398e257

2026-01-19 04:01:03,855 - distributed.scheduler - INFO - Close client connection: Client-a99b2ee7-f4b0-11f0-8001-d684c398e257

2026-01-19 04:01:03,855 - distributed.scheduler - INFO - Close client connection: Client-769663ee-f4b3-11f0-8001-d684c398e257

2026-01-19 04:01:03,855 - distributed.scheduler - INFO - Close client connection: Client-dd2210a5-f4b4-11f0-8001-d684c398e257

2026-01-19 04:01:03,855 - distributed.scheduler - INFO - Close client connection: Client-43a638b1-f4b6-11f0-8001-d684c398e257

2026-01-19 04:01:03,854 - distributed.scheduler - INFO - Close client connection: Client-aa1c9dfb-f4b7-11f0-8001-d684c398e257

2026-01-19 04:01:03,854 - distributed.scheduler - INFO - Close client connection: Client-109f676b-f4b9-11f0-8001-d684c398e257

2026-01-19 04:01:03,854 - distributed.scheduler - INFO - Close client connection: Client-770b162f-f4ba-11f0-8001-d684c398e257

2026-01-19 04:01:03,854 - distributed.scheduler - INFO - Close client connection: Client-dd884c25-f4bb-11f0-8001-d684c398e257

2026-01-19 04:01:03,853 - distributed.scheduler - INFO - Close client connection: Client-4405cc8b-f4bd-11f0-8001-d684c398e257

2026-01-19 04:01:03,853 - distributed.scheduler - INFO - Close client connection: Client-aa84ab0a-f4be-11f0-8001-d684c398e257

2026-01-19 04:01:03,853 - distributed.scheduler - INFO - Close client connection: Client-10f97ec0-f4c0-11f0-8001-d684c398e257

2026-01-19 04:01:03,853 - distributed.scheduler - INFO - Close client connection: Client-ddf35cf4-f4c2-11f0-8001-d684c398e257

2026-01-19 04:01:03,853 - distributed.scheduler - INFO - Close client connection: Client-777c9afd-f4c1-11f0-8001-d684c398e257

2026-01-19 04:01:03,853 - distributed.scheduler - INFO - Close client connection: Client-44772743-f4c4-11f0-8001-d684c398e257

2026-01-19 04:01:03,853 - distributed.scheduler - INFO - Close client connection: Client-aaf882d8-f4c5-11f0-8001-d684c398e257

2026-01-19 04:01:03,853 - distributed.scheduler - INFO - Close client connection: Client-117cdf4e-f4c7-11f0-8001-d684c398e257

2026-01-19 04:01:03,853 - distributed.scheduler - INFO - Close client connection: Client-78289e14-f4c8-11f0-8001-d684c398e257

2026-01-19 04:01:03,853 - distributed.scheduler - INFO - Close client connection: Client-deb12893-f4c9-11f0-8001-d684c398e257

2026-01-19 04:01:03,853 - distributed.scheduler - INFO - Close client connection: Client-4530ebef-f4cb-11f0-8001-d684c398e257

2026-01-19 04:01:03,853 - distributed.scheduler - INFO - Close client connection: Client-abae12eb-f4cc-11f0-8001-d684c398e257

2026-01-19 04:01:03,853 - distributed.scheduler - INFO - Close client connection: Client-12261755-f4ce-11f0-8001-d684c398e257

2026-01-19 04:01:03,853 - distributed.scheduler - INFO - Close client connection: Client-78b09d61-f4cf-11f0-8001-d684c398e257

2026-01-19 04:01:03,852 - distributed.scheduler - INFO - Close client connection: Client-df3d9e70-f4d0-11f0-8001-d684c398e257

2026-01-19 04:01:03,852 - distributed.scheduler - INFO - Close client connection: Client-45cc511f-f4d2-11f0-8001-d684c398e257

2026-01-19 04:01:03,852 - distributed.scheduler - INFO - Close client connection: Client-12dcddf1-f4d5-11f0-8001-d684c398e257

2026-01-19 04:01:03,852 - distributed.scheduler - INFO - Close client connection: Client-ac59ca88-f4d3-11f0-8001-d684c398e257

2026-01-19 04:01:03,852 - distributed.scheduler - INFO - Close client connection: Client-79490334-f4d6-11f0-8001-d684c398e257

2026-01-19 04:01:03,852 - distributed.scheduler - INFO - Close client connection: Client-acc2674b-f4da-11f0-8001-d684c398e257

2026-01-19 04:01:03,852 - distributed.scheduler - INFO - Close client connection: Client-dfcc924a-f4d7-11f0-8001-d684c398e257

2026-01-19 04:01:03,852 - distributed.scheduler - INFO - Close client connection: Client-46402833-f4d9-11f0-8001-d684c398e257

2026-01-19 04:01:03,852 - distributed.scheduler - INFO - Close client connection: Client-79cb8b4a-f4dd-11f0-8001-d684c398e257

2026-01-19 04:01:03,852 - distributed.scheduler - INFO - Close client connection: Client-134af889-f4dc-11f0-8001-d684c398e257

2026-01-19 04:01:03,852 - distributed.scheduler - INFO - Close client connection: Client-e041bbd9-f4de-11f0-8001-d684c398e257

2026-01-19 04:01:03,852 - distributed.scheduler - INFO - Close client connection: Client-13c75752-f4e3-11f0-8001-d684c398e257

2026-01-19 04:01:03,851 - distributed.scheduler - INFO - Close client connection: Client-ad44c087-f4e1-11f0-8001-d684c398e257

2026-01-19 04:01:03,851 - distributed.scheduler - INFO - Close client connection: Client-46c95823-f4e0-11f0-8001-d684c398e257

2026-01-19 04:01:03,851 - distributed.scheduler - INFO - Close client connection: Client-7a55124a-f4e4-11f0-8001-d684c398e257

2026-01-19 04:01:03,851 - distributed.scheduler - INFO - Close client connection: Client-bd0219ef-f4e5-11f0-8001-d684c398e257

2026-01-19 04:01:03,851 - distributed.scheduler - INFO - Close client connection: Client-2394e6d5-f4e7-11f0-8001-d684c398e257

2026-01-19 04:01:03,849 - distributed.scheduler - INFO - Close client connection: Client-8a08e5f5-f4e8-11f0-8001-d684c398e257

2026-01-19 04:01:03,849 - distributed.scheduler - INFO - Close client connection: Client-f07fe142-f4e9-11f0-8001-d684c398e257

2026-01-19 04:01:03,849 - distributed.scheduler - INFO - Remove client Client-3258abc5-f49d-11f0-8001-d684c398e257

2026-01-19 04:01:03,849 - distributed.scheduler - INFO - Remove client Client-98cebe1a-f49e-11f0-8001-d684c398e257

2026-01-19 04:01:03,849 - distributed.scheduler - INFO - Remove client Client-ff48c97e-f49f-11f0-8001-d684c398e257

2026-01-19 04:01:03,848 - distributed.scheduler - INFO - Remove client Client-65c24ea8-f4a1-11f0-8001-d684c398e257

2026-01-19 04:01:03,848 - distributed.scheduler - INFO - Remove client Client-cc3ea249-f4a2-11f0-8001-d684c398e257

2026-01-19 04:01:03,848 - distributed.scheduler - INFO - Remove client Client-32cdaa4a-f4a4-11f0-8001-d684c398e257

2026-01-19 04:01:03,848 - distributed.scheduler - INFO - Remove client Client-995d0835-f4a5-11f0-8001-d684c398e257

2026-01-19 04:01:03,847 - distributed.scheduler - INFO - Remove client Client-ffe57bfd-f4a6-11f0-8001-d684c398e257

2026-01-19 04:01:03,847 - distributed.scheduler - INFO - Remove client Client-666d7801-f4a8-11f0-8001-d684c398e257

2026-01-19 04:01:03,847 - distributed.scheduler - INFO - Remove client Client-ccf4a89a-f4a9-11f0-8001-d684c398e257

2026-01-19 04:01:03,847 - distributed.scheduler - INFO - Remove client Client-33759dd4-f4ab-11f0-8001-d684c398e257

2026-01-19 04:01:03,846 - distributed.scheduler - INFO - Remove client Client-761b8785-f4ac-11f0-8001-d684c398e257

2026-01-19 04:01:03,846 - distributed.scheduler - INFO - Remove client Client-dc9e72d7-f4ad-11f0-8001-d684c398e257

2026-01-19 04:01:03,846 - distributed.scheduler - INFO - Remove client Client-10168f05-f4b2-11f0-8001-d684c398e257

2026-01-19 04:01:03,846 - distributed.scheduler - INFO - Remove client Client-431b94d4-f4af-11f0-8001-d684c398e257

2026-01-19 04:01:03,845 - distributed.scheduler - INFO - Remove client Client-a99b2ee7-f4b0-11f0-8001-d684c398e257

2026-01-19 04:01:03,845 - distributed.scheduler - INFO - Remove client Client-769663ee-f4b3-11f0-8001-d684c398e257

2026-01-19 04:01:03,845 - distributed.scheduler - INFO - Remove client Client-dd2210a5-f4b4-11f0-8001-d684c398e257

2026-01-19 04:01:03,844 - distributed.scheduler - INFO - Remove client Client-43a638b1-f4b6-11f0-8001-d684c398e257

2026-01-19 04:01:03,844 - distributed.scheduler - INFO - Remove client Client-aa1c9dfb-f4b7-11f0-8001-d684c398e257

2026-01-19 04:01:03,844 - distributed.scheduler - INFO - Remove client Client-109f676b-f4b9-11f0-8001-d684c398e257

2026-01-19 04:01:03,844 - distributed.scheduler - INFO - Remove client Client-770b162f-f4ba-11f0-8001-d684c398e257

2026-01-19 04:01:03,843 - distributed.scheduler - INFO - Remove client Client-dd884c25-f4bb-11f0-8001-d684c398e257

2026-01-19 04:01:03,838 - distributed.scheduler - INFO - Remove client Client-4405cc8b-f4bd-11f0-8001-d684c398e257

2026-01-19 04:01:03,838 - distributed.scheduler - INFO - Remove client Client-aa84ab0a-f4be-11f0-8001-d684c398e257

2026-01-19 04:01:03,837 - distributed.scheduler - INFO - Remove client Client-10f97ec0-f4c0-11f0-8001-d684c398e257

2026-01-19 04:01:03,837 - distributed.scheduler - INFO - Remove client Client-ddf35cf4-f4c2-11f0-8001-d684c398e257

2026-01-19 04:01:03,837 - distributed.scheduler - INFO - Remove client Client-777c9afd-f4c1-11f0-8001-d684c398e257

2026-01-19 04:01:03,836 - distributed.scheduler - INFO - Remove client Client-44772743-f4c4-11f0-8001-d684c398e257

2026-01-19 04:01:03,836 - distributed.scheduler - INFO - Remove client Client-aaf882d8-f4c5-11f0-8001-d684c398e257

2026-01-19 04:01:03,835 - distributed.scheduler - INFO - Remove client Client-117cdf4e-f4c7-11f0-8001-d684c398e257

2026-01-19 04:01:03,835 - distributed.scheduler - INFO - Remove client Client-78289e14-f4c8-11f0-8001-d684c398e257

2026-01-19 04:01:03,834 - distributed.scheduler - INFO - Remove client Client-deb12893-f4c9-11f0-8001-d684c398e257

2026-01-19 04:01:03,834 - distributed.scheduler - INFO - Remove client Client-4530ebef-f4cb-11f0-8001-d684c398e257

2026-01-19 04:01:03,834 - distributed.scheduler - INFO - Remove client Client-abae12eb-f4cc-11f0-8001-d684c398e257

2026-01-19 04:01:03,833 - distributed.scheduler - INFO - Remove client Client-12261755-f4ce-11f0-8001-d684c398e257

2026-01-19 04:01:03,833 - distributed.scheduler - INFO - Remove client Client-78b09d61-f4cf-11f0-8001-d684c398e257

2026-01-19 04:01:03,832 - distributed.scheduler - INFO - Remove client Client-df3d9e70-f4d0-11f0-8001-d684c398e257

2026-01-19 04:01:03,832 - distributed.scheduler - INFO - Remove client Client-45cc511f-f4d2-11f0-8001-d684c398e257

2026-01-19 04:01:03,832 - distributed.scheduler - INFO - Remove client Client-12dcddf1-f4d5-11f0-8001-d684c398e257

2026-01-19 04:01:03,831 - distributed.scheduler - INFO - Remove client Client-ac59ca88-f4d3-11f0-8001-d684c398e257

2026-01-19 04:01:03,831 - distributed.scheduler - INFO - Remove client Client-79490334-f4d6-11f0-8001-d684c398e257

2026-01-19 04:01:03,831 - distributed.scheduler - INFO - Remove client Client-acc2674b-f4da-11f0-8001-d684c398e257

2026-01-19 04:01:03,830 - distributed.scheduler - INFO - Remove client Client-dfcc924a-f4d7-11f0-8001-d684c398e257

2026-01-19 04:01:03,830 - distributed.scheduler - INFO - Remove client Client-46402833-f4d9-11f0-8001-d684c398e257

2026-01-19 04:01:03,829 - distributed.scheduler - INFO - Remove client Client-79cb8b4a-f4dd-11f0-8001-d684c398e257

2026-01-19 04:01:03,829 - distributed.scheduler - INFO - Remove client Client-134af889-f4dc-11f0-8001-d684c398e257

2026-01-19 04:01:03,828 - distributed.scheduler - INFO - Remove client Client-e041bbd9-f4de-11f0-8001-d684c398e257

2026-01-19 04:01:03,828 - distributed.scheduler - INFO - Remove client Client-13c75752-f4e3-11f0-8001-d684c398e257

2026-01-19 04:01:03,828 - distributed.scheduler - INFO - Remove client Client-ad44c087-f4e1-11f0-8001-d684c398e257

2026-01-19 04:01:03,827 - distributed.scheduler - INFO - Remove client Client-46c95823-f4e0-11f0-8001-d684c398e257

2026-01-19 04:01:03,826 - distributed.scheduler - INFO - Remove client Client-7a55124a-f4e4-11f0-8001-d684c398e257

2026-01-19 04:01:03,826 - distributed.scheduler - INFO - Remove client Client-bd0219ef-f4e5-11f0-8001-d684c398e257

2026-01-19 04:01:03,825 - distributed.scheduler - INFO - Remove client Client-2394e6d5-f4e7-11f0-8001-d684c398e257

2026-01-19 04:01:03,813 - distributed.scheduler - INFO - Remove client Client-8a08e5f5-f4e8-11f0-8001-d684c398e257

2026-01-19 04:01:03,812 - distributed.scheduler - INFO - Remove client Client-f07fe142-f4e9-11f0-8001-d684c398e257

2026-01-19 04:01:02,999 - distributed.scheduler - INFO - Close client connection: Client-5702bc02-f4eb-11f0-8001-d684c398e257

2026-01-19 04:01:02,999 - distributed.scheduler - INFO - Remove client Client-5702bc02-f4eb-11f0-8001-d684c398e257

2026-01-19 04:01:02,997 - distributed.scheduler - INFO - Remove client Client-5702bc02-f4eb-11f0-8001-d684c398e257

2026-01-19 04:00:06,296 - distributed.scheduler - INFO - Receive client connection: Client-5702bc02-f4eb-11f0-8001-d684c398e257

2026-01-19 03:50:04,817 - distributed.scheduler - INFO - Receive client connection: Client-f07fe142-f4e9-11f0-8001-d684c398e257

2026-01-19 03:40:03,413 - distributed.scheduler - INFO - Receive client connection: Client-8a08e5f5-f4e8-11f0-8001-d684c398e257

2026-01-19 03:30:02,035 - distributed.scheduler - INFO - Receive client connection: Client-2394e6d5-f4e7-11f0-8001-d684c398e257

2026-01-19 03:20:00,446 - distributed.scheduler - INFO - Receive client connection: Client-bd0219ef-f4e5-11f0-8001-d684c398e257

2026-01-19 03:10:59,110 - distributed.scheduler - INFO - Receive client connection: Client-7a55124a-f4e4-11f0-8001-d684c398e257

2026-01-19 03:00:57,529 - distributed.scheduler - INFO - Receive client connection: Client-13c75752-f4e3-11f0-8001-d684c398e257

2026-01-19 02:50:56,044 - distributed.scheduler - INFO - Receive client connection: Client-ad44c087-f4e1-11f0-8001-d684c398e257

2026-01-19 02:40:54,618 - distributed.scheduler - INFO - Receive client connection: Client-46c95823-f4e0-11f0-8001-d684c398e257

2026-01-19 02:30:53,098 - distributed.scheduler - INFO - Receive client connection: Client-e041bbd9-f4de-11f0-8001-d684c398e257

2026-01-19 02:20:51,700 - distributed.scheduler - INFO - Receive client connection: Client-79cb8b4a-f4dd-11f0-8001-d684c398e257

2026-01-19 02:10:50,235 - distributed.scheduler - INFO - Receive client connection: Client-134af889-f4dc-11f0-8001-d684c398e257

2026-01-19 02:00:48,713 - distributed.scheduler - INFO - Receive client connection: Client-acc2674b-f4da-11f0-8001-d684c398e257

2026-01-19 01:50:47,286 - distributed.scheduler - INFO - Receive client connection: Client-46402833-f4d9-11f0-8001-d684c398e257

2026-01-19 01:40:45,853 - distributed.scheduler - INFO - Receive client connection: Client-dfcc924a-f4d7-11f0-8001-d684c398e257

2026-01-19 01:30:44,370 - distributed.scheduler - INFO - Receive client connection: Client-79490334-f4d6-11f0-8001-d684c398e257

2026-01-19 01:20:43,035 - distributed.scheduler - INFO - Receive client connection: Client-12dcddf1-f4d5-11f0-8001-d684c398e257

2026-01-19 01:10:41,558 - distributed.scheduler - INFO - Receive client connection: Client-ac59ca88-f4d3-11f0-8001-d684c398e257

2026-01-19 01:00:40,010 - distributed.scheduler - INFO - Receive client connection: Client-45cc511f-f4d2-11f0-8001-d684c398e257

2026-01-19 00:50:38,445 - distributed.scheduler - INFO - Receive client connection: Client-df3d9e70-f4d0-11f0-8001-d684c398e257

2026-01-19 00:40:36,908 - distributed.scheduler - INFO - Receive client connection: Client-78b09d61-f4cf-11f0-8001-d684c398e257

2026-01-19 00:30:35,356 - distributed.scheduler - INFO - Receive client connection: Client-12261755-f4ce-11f0-8001-d684c398e257

2026-01-19 00:20:33,953 - distributed.scheduler - INFO - Receive client connection: Client-abae12eb-f4cc-11f0-8001-d684c398e257

2026-01-19 00:10:32,505 - distributed.scheduler - INFO - Receive client connection: Client-4530ebef-f4cb-11f0-8001-d684c398e257

2026-01-19 00:00:31,044 - distributed.scheduler - INFO - Receive client connection: Client-deb12893-f4c9-11f0-8001-d684c398e257

2026-01-18 23:50:29,528 - distributed.scheduler - INFO - Receive client connection: Client-78289e14-f4c8-11f0-8001-d684c398e257

2026-01-18 23:40:27,791 - distributed.scheduler - INFO - Receive client connection: Client-117cdf4e-f4c7-11f0-8001-d684c398e257

2026-01-18 23:30:26,285 - distributed.scheduler - INFO - Receive client connection: Client-aaf882d8-f4c5-11f0-8001-d684c398e257

2026-01-18 23:20:24,812 - distributed.scheduler - INFO - Receive client connection: Client-44772743-f4c4-11f0-8001-d684c398e257

2026-01-18 23:10:23,326 - distributed.scheduler - INFO - Receive client connection: Client-ddf35cf4-f4c2-11f0-8001-d684c398e257

2026-01-18 23:00:21,933 - distributed.scheduler - INFO - Receive client connection: Client-777c9afd-f4c1-11f0-8001-d684c398e257

2026-01-18 22:50:20,444 - distributed.scheduler - INFO - Receive client connection: Client-10f97ec0-f4c0-11f0-8001-d684c398e257

2026-01-18 22:40:19,049 - distributed.scheduler - INFO - Receive client connection: Client-aa84ab0a-f4be-11f0-8001-d684c398e257

2026-01-18 22:30:17,596 - distributed.scheduler - INFO - Receive client connection: Client-4405cc8b-f4bd-11f0-8001-d684c398e257

2026-01-18 22:20:16,149 - distributed.scheduler - INFO - Receive client connection: Client-dd884c25-f4bb-11f0-8001-d684c398e257

2026-01-18 22:10:14,699 - distributed.scheduler - INFO - Receive client connection: Client-770b162f-f4ba-11f0-8001-d684c398e257

2026-01-18 22:00:13,364 - distributed.scheduler - INFO - Receive client connection: Client-109f676b-f4b9-11f0-8001-d684c398e257

2026-01-18 21:50:11,889 - distributed.scheduler - INFO - Receive client connection: Client-aa1c9dfb-f4b7-11f0-8001-d684c398e257

2026-01-18 21:40:10,496 - distributed.scheduler - INFO - Receive client connection: Client-43a638b1-f4b6-11f0-8001-d684c398e257

2026-01-18 21:30:08,998 - distributed.scheduler - INFO - Receive client connection: Client-dd2210a5-f4b4-11f0-8001-d684c398e257

2026-01-18 21:20:07,461 - distributed.scheduler - INFO - Receive client connection: Client-769663ee-f4b3-11f0-8001-d684c398e257

2026-01-18 21:10:05,991 - distributed.scheduler - INFO - Receive client connection: Client-10168f05-f4b2-11f0-8001-d684c398e257

2026-01-18 21:00:04,561 - distributed.scheduler - INFO - Receive client connection: Client-a99b2ee7-f4b0-11f0-8001-d684c398e257

2026-01-18 20:50:03,104 - distributed.scheduler - INFO - Receive client connection: Client-431b94d4-f4af-11f0-8001-d684c398e257

2026-01-18 20:40:01,658 - distributed.scheduler - INFO - Receive client connection: Client-dc9e72d7-f4ad-11f0-8001-d684c398e257

2026-01-18 20:30:00,179 - distributed.scheduler - INFO - Receive client connection: Client-761b8785-f4ac-11f0-8001-d684c398e257

2026-01-18 20:20:58,859 - distributed.scheduler - INFO - Receive client connection: Client-33759dd4-f4ab-11f0-8001-d684c398e257

2026-01-18 20:10:57,394 - distributed.scheduler - INFO - Receive client connection: Client-ccf4a89a-f4a9-11f0-8001-d684c398e257

2026-01-18 20:00:55,880 - distributed.scheduler - INFO - Receive client connection: Client-666d7801-f4a8-11f0-8001-d684c398e257

2026-01-18 19:50:54,370 - distributed.scheduler - INFO - Receive client connection: Client-ffe57bfd-f4a6-11f0-8001-d684c398e257

2026-01-18 19:40:52,853 - distributed.scheduler - INFO - Receive client connection: Client-995d0835-f4a5-11f0-8001-d684c398e257

2026-01-18 19:30:51,284 - distributed.scheduler - INFO - Receive client connection: Client-32cdaa4a-f4a4-11f0-8001-d684c398e257

2026-01-18 19:20:49,723 - distributed.scheduler - INFO - Receive client connection: Client-cc3ea249-f4a2-11f0-8001-d684c398e257

2026-01-18 19:10:48,283 - distributed.scheduler - INFO - Receive client connection: Client-65c24ea8-f4a1-11f0-8001-d684c398e257

2026-01-18 19:00:46,867 - distributed.scheduler - INFO - Receive client connection: Client-ff48c97e-f49f-11f0-8001-d684c398e257

2026-01-18 18:50:45,443 - distributed.scheduler - INFO - Receive client connection: Client-98cebe1a-f49e-11f0-8001-d684c398e257

2026-01-18 18:40:44,046 - distributed.scheduler - INFO - Receive client connection: Client-3258abc5-f49d-11f0-8001-d684c398e257

2026-01-18 18:31:33,133 - distributed.scheduler - INFO - Close client connection: Client-cbdf9d5b-f49b-11f0-8001-d684c398e257

2026-01-18 18:31:33,132 - distributed.scheduler - INFO - Remove client Client-cbdf9d5b-f49b-11f0-8001-d684c398e257

2026-01-18 18:31:33,130 - distributed.scheduler - INFO - Remove client Client-cbdf9d5b-f49b-11f0-8001-d684c398e257

2026-01-18 18:30:42,634 - distributed.scheduler - INFO - Receive client connection: Client-cbdf9d5b-f49b-11f0-8001-d684c398e257

2026-01-18 18:21:14,513 - distributed.scheduler - INFO - Close client connection: Client-6564ad0a-f49a-11f0-8001-d684c398e257

2026-01-18 18:21:14,510 - distributed.scheduler - INFO - Remove client Client-6564ad0a-f49a-11f0-8001-d684c398e257

2026-01-18 18:21:14,508 - distributed.scheduler - INFO - Remove client Client-6564ad0a-f49a-11f0-8001-d684c398e257

2026-01-18 18:20:41,198 - distributed.scheduler - INFO - Receive client connection: Client-6564ad0a-f49a-11f0-8001-d684c398e257

2026-01-18 18:11:10,405 - distributed.scheduler - INFO - Close client connection: Client-fef29155-f498-11f0-8001-d684c398e257

2026-01-18 18:11:10,404 - distributed.scheduler - INFO - Remove client Client-fef29155-f498-11f0-8001-d684c398e257

2026-01-18 18:11:10,402 - distributed.scheduler - INFO - Remove client Client-fef29155-f498-11f0-8001-d684c398e257

2026-01-18 18:10:39,830 - distributed.scheduler - INFO - Receive client connection: Client-fef29155-f498-11f0-8001-d684c398e257

2026-01-18 18:01:27,889 - distributed.scheduler - INFO - Close client connection: Client-98797ca0-f497-11f0-8001-d684c398e257

2026-01-18 18:01:27,888 - distributed.scheduler - INFO - Remove client Client-98797ca0-f497-11f0-8001-d684c398e257

2026-01-18 18:01:27,886 - distributed.scheduler - INFO - Remove client Client-98797ca0-f497-11f0-8001-d684c398e257

2026-01-18 18:00:38,414 - distributed.scheduler - INFO - Receive client connection: Client-98797ca0-f497-11f0-8001-d684c398e257

2026-01-18 17:51:07,143 - distributed.scheduler - INFO - Close client connection: Client-31f4fb51-f496-11f0-8001-d684c398e257

2026-01-18 17:51:07,142 - distributed.scheduler - INFO - Remove client Client-31f4fb51-f496-11f0-8001-d684c398e257

2026-01-18 17:51:07,140 - distributed.scheduler - INFO - Remove client Client-31f4fb51-f496-11f0-8001-d684c398e257

2026-01-18 17:50:36,929 - distributed.scheduler - INFO - Receive client connection: Client-31f4fb51-f496-11f0-8001-d684c398e257

2026-01-18 17:41:07,485 - distributed.scheduler - INFO - Close client connection: Client-642d0469-f48c-11f0-8001-d684c398e257

2026-01-18 17:41:07,485 - distributed.scheduler - INFO - Close client connection: Client-cabb2a12-f48d-11f0-8001-d684c398e257

2026-01-18 17:41:07,484 - distributed.scheduler - INFO - Close client connection: Client-97caa681-f490-11f0-8001-d684c398e257

2026-01-18 17:41:07,484 - distributed.scheduler - INFO - Close client connection: Client-31419740-f48f-11f0-8001-d684c398e257

2026-01-18 17:41:07,484 - distributed.scheduler - INFO - Close client connection: Client-fe69508c-f491-11f0-8001-d684c398e257

2026-01-18 17:41:07,483 - distributed.scheduler - INFO - Close client connection: Client-6507c207-f493-11f0-8001-d684c398e257

2026-01-18 17:41:07,481 - distributed.scheduler - INFO - Remove client Client-642d0469-f48c-11f0-8001-d684c398e257

2026-01-18 17:41:07,480 - distributed.scheduler - INFO - Remove client Client-cabb2a12-f48d-11f0-8001-d684c398e257

2026-01-18 17:41:07,479 - distributed.scheduler - INFO - Remove client Client-97caa681-f490-11f0-8001-d684c398e257

2026-01-18 17:41:07,479 - distributed.scheduler - INFO - Remove client Client-31419740-f48f-11f0-8001-d684c398e257

2026-01-18 17:41:07,478 - distributed.scheduler - INFO - Remove client Client-fe69508c-f491-11f0-8001-d684c398e257

2026-01-18 17:41:07,474 - distributed.scheduler - INFO - Remove client Client-6507c207-f493-11f0-8001-d684c398e257

2026-01-18 17:41:06,840 - distributed.scheduler - INFO - Close client connection: Client-cb7e3356-f494-11f0-8001-d684c398e257

2026-01-18 17:41:06,836 - distributed.scheduler - INFO - Remove client Client-cb7e3356-f494-11f0-8001-d684c398e257

2026-01-18 17:41:06,834 - distributed.scheduler - INFO - Remove client Client-cb7e3356-f494-11f0-8001-d684c398e257

2026-01-18 17:40:35,507 - distributed.scheduler - INFO - Receive client connection: Client-cb7e3356-f494-11f0-8001-d684c398e257

2026-01-18 17:30:34,118 - distributed.scheduler - INFO - Receive client connection: Client-6507c207-f493-11f0-8001-d684c398e257

2026-01-18 17:20:32,442 - distributed.scheduler - INFO - Receive client connection: Client-fe69508c-f491-11f0-8001-d684c398e257

2026-01-18 17:10:30,778 - distributed.scheduler - INFO - Receive client connection: Client-97caa681-f490-11f0-8001-d684c398e257

2026-01-18 17:00:29,260 - distributed.scheduler - INFO - Receive client connection: Client-31419740-f48f-11f0-8001-d684c398e257

2026-01-18 16:50:27,751 - distributed.scheduler - INFO - Receive client connection: Client-cabb2a12-f48d-11f0-8001-d684c398e257

2026-01-18 16:40:26,206 - distributed.scheduler - INFO - Receive client connection: Client-642d0469-f48c-11f0-8001-d684c398e257

2026-01-18 16:31:18,277 - distributed.scheduler - INFO - Close client connection: Client-fda0fbb4-f48a-11f0-8001-d684c398e257

2026-01-18 16:31:18,275 - distributed.scheduler - INFO - Remove client Client-fda0fbb4-f48a-11f0-8001-d684c398e257

2026-01-18 16:31:18,273 - distributed.scheduler - INFO - Remove client Client-fda0fbb4-f48a-11f0-8001-d684c398e257

2026-01-18 16:30:24,665 - distributed.scheduler - INFO - Receive client connection: Client-fda0fbb4-f48a-11f0-8001-d684c398e257

2026-01-18 16:20:52,449 - distributed.scheduler - INFO - Close client connection: Client-971ed11c-f489-11f0-8001-d684c398e257

2026-01-18 16:20:52,448 - distributed.scheduler - INFO - Remove client Client-971ed11c-f489-11f0-8001-d684c398e257

2026-01-18 16:20:52,446 - distributed.scheduler - INFO - Remove client Client-971ed11c-f489-11f0-8001-d684c398e257

2026-01-18 16:20:23,188 - distributed.scheduler - INFO - Receive client connection: Client-971ed11c-f489-11f0-8001-d684c398e257

2026-01-18 16:10:53,092 - distributed.scheduler - INFO - Close client connection: Client-3096d673-f488-11f0-8001-d684c398e257

2026-01-18 16:10:53,091 - distributed.scheduler - INFO - Remove client Client-3096d673-f488-11f0-8001-d684c398e257

2026-01-18 16:10:53,089 - distributed.scheduler - INFO - Remove client Client-3096d673-f488-11f0-8001-d684c398e257

2026-01-18 16:10:21,670 - distributed.scheduler - INFO - Receive client connection: Client-3096d673-f488-11f0-8001-d684c398e257

2026-01-18 16:01:13,263 - distributed.scheduler - INFO - Close client connection: Client-ca10f918-f486-11f0-8001-d684c398e257

2026-01-18 16:01:13,262 - distributed.scheduler - INFO - Remove client Client-ca10f918-f486-11f0-8001-d684c398e257

2026-01-18 16:01:13,260 - distributed.scheduler - INFO - Remove client Client-ca10f918-f486-11f0-8001-d684c398e257

2026-01-18 16:00:20,171 - distributed.scheduler - INFO - Receive client connection: Client-ca10f918-f486-11f0-8001-d684c398e257

2026-01-18 15:50:52,004 - distributed.scheduler - INFO - Close client connection: Client-639de5c3-f485-11f0-8001-d684c398e257

2026-01-18 15:50:52,003 - distributed.scheduler - INFO - Remove client Client-639de5c3-f485-11f0-8001-d684c398e257

2026-01-18 15:50:52,001 - distributed.scheduler - INFO - Remove client Client-639de5c3-f485-11f0-8001-d684c398e257

2026-01-18 15:50:18,792 - distributed.scheduler - INFO - Receive client connection: Client-639de5c3-f485-11f0-8001-d684c398e257

2026-01-18 15:40:50,625 - distributed.scheduler - INFO - Close client connection: Client-fd1dcf31-f483-11f0-8001-d684c398e257

2026-01-18 15:40:50,624 - distributed.scheduler - INFO - Remove client Client-fd1dcf31-f483-11f0-8001-d684c398e257

2026-01-18 15:40:50,623 - distributed.scheduler - INFO - Remove client Client-fd1dcf31-f483-11f0-8001-d684c398e257

2026-01-18 15:40:17,320 - distributed.scheduler - INFO - Receive client connection: Client-fd1dcf31-f483-11f0-8001-d684c398e257

2026-01-18 15:31:10,965 - distributed.scheduler - INFO - Close client connection: Client-96a7fc64-f482-11f0-8001-d684c398e257

2026-01-18 15:31:10,963 - distributed.scheduler - INFO - Remove client Client-96a7fc64-f482-11f0-8001-d684c398e257

2026-01-18 15:31:10,962 - distributed.scheduler - INFO - Remove client Client-96a7fc64-f482-11f0-8001-d684c398e257

2026-01-18 15:30:15,929 - distributed.scheduler - INFO - Receive client connection: Client-96a7fc64-f482-11f0-8001-d684c398e257

2026-01-18 15:20:47,371 - distributed.scheduler - INFO - Close client connection: Client-3035e5c1-f481-11f0-8001-d684c398e257

2026-01-18 15:20:47,370 - distributed.scheduler - INFO - Remove client Client-3035e5c1-f481-11f0-8001-d684c398e257

2026-01-18 15:20:47,368 - distributed.scheduler - INFO - Remove client Client-3035e5c1-f481-11f0-8001-d684c398e257

2026-01-18 15:20:14,561 - distributed.scheduler - INFO - Receive client connection: Client-3035e5c1-f481-11f0-8001-d684c398e257

2026-01-18 15:10:46,367 - distributed.scheduler - INFO - Close client connection: Client-c9cf3ccc-f47f-11f0-8001-d684c398e257

2026-01-18 15:10:46,366 - distributed.scheduler - INFO - Remove client Client-c9cf3ccc-f47f-11f0-8001-d684c398e257

2026-01-18 15:10:46,365 - distributed.scheduler - INFO - Remove client Client-c9cf3ccc-f47f-11f0-8001-d684c398e257

2026-01-18 15:10:13,253 - distributed.scheduler - INFO - Receive client connection: Client-c9cf3ccc-f47f-11f0-8001-d684c398e257

2026-01-18 15:01:07,321 - distributed.scheduler - INFO - Close client connection: Client-6356ad03-f47e-11f0-8001-d684c398e257

2026-01-18 15:01:07,320 - distributed.scheduler - INFO - Remove client Client-6356ad03-f47e-11f0-8001-d684c398e257

2026-01-18 15:01:07,319 - distributed.scheduler - INFO - Remove client Client-6356ad03-f47e-11f0-8001-d684c398e257

2026-01-18 15:00:17,100 - distributed.scheduler - ERROR - Shut down workers that don't have promised key: [], ('len-agg-f793a2a80faebedf4bf06b931c31589b', 0) NoneType: None

2026-01-18 15:00:17,100 - distributed.scheduler - ERROR - Couldn't gather keys {"('len-agg-f793a2a80faebedf4bf06b931c31589b', 0)": []} state: [None] workers: [] NoneType: None

2026-01-18 15:00:11,846 - distributed.scheduler - INFO - Receive client connection: Client-6356ad03-f47e-11f0-8001-d684c398e257

2026-01-18 14:50:43,370 - distributed.scheduler - INFO - Close client connection: Client-fcc501f6-f47c-11f0-8001-d684c398e257

2026-01-18 14:50:43,369 - distributed.scheduler - INFO - Remove client Client-fcc501f6-f47c-11f0-8001-d684c398e257

2026-01-18 14:50:43,367 - distributed.scheduler - INFO - Remove client Client-fcc501f6-f47c-11f0-8001-d684c398e257

2026-01-18 14:50:10,310 - distributed.scheduler - INFO - Receive client connection: Client-fcc501f6-f47c-11f0-8001-d684c398e257

2026-01-18 14:40:41,282 - distributed.scheduler - INFO - Close client connection: Client-962f4b4c-f47b-11f0-8001-d684c398e257

2026-01-18 14:40:41,280 - distributed.scheduler - INFO - Remove client Client-962f4b4c-f47b-11f0-8001-d684c398e257

2026-01-18 14:40:41,278 - distributed.scheduler - INFO - Remove client Client-962f4b4c-f47b-11f0-8001-d684c398e257

2026-01-18 14:40:08,662 - distributed.scheduler - INFO - Receive client connection: Client-962f4b4c-f47b-11f0-8001-d684c398e257

2026-01-18 14:30:56,734 - distributed.scheduler - INFO - Close client connection: Client-2fb1b520-f47a-11f0-8001-d684c398e257

2026-01-18 14:30:56,733 - distributed.scheduler - INFO - Remove client Client-2fb1b520-f47a-11f0-8001-d684c398e257

2026-01-18 14:30:56,732 - distributed.scheduler - INFO - Remove client Client-2fb1b520-f47a-11f0-8001-d684c398e257

2026-01-18 14:30:07,215 - distributed.scheduler - INFO - Receive client connection: Client-2fb1b520-f47a-11f0-8001-d684c398e257

2026-01-18 14:20:36,029 - distributed.scheduler - INFO - Close client connection: Client-c92ec492-f478-11f0-8001-d684c398e257

2026-01-18 14:20:36,029 - distributed.scheduler - INFO - Remove client Client-c92ec492-f478-11f0-8001-d684c398e257

2026-01-18 14:20:36,028 - distributed.scheduler - INFO - Remove client Client-c92ec492-f478-11f0-8001-d684c398e257

2026-01-18 14:20:05,729 - distributed.scheduler - INFO - Receive client connection: Client-c92ec492-f478-11f0-8001-d684c398e257

2026-01-18 14:10:35,292 - distributed.scheduler - INFO - Close client connection: Client-62b0a0ee-f477-11f0-8001-d684c398e257

2026-01-18 14:10:35,291 - distributed.scheduler - INFO - Remove client Client-62b0a0ee-f477-11f0-8001-d684c398e257

2026-01-18 14:10:35,289 - distributed.scheduler - INFO - Remove client Client-62b0a0ee-f477-11f0-8001-d684c398e257

2026-01-18 14:10:04,278 - distributed.scheduler - INFO - Receive client connection: Client-62b0a0ee-f477-11f0-8001-d684c398e257

2026-01-18 14:00:54,231 - distributed.scheduler - INFO - Close client connection: Client-e95b0d3d-f440-11f0-8001-d684c398e257

2026-01-18 14:00:54,230 - distributed.scheduler - INFO - Close client connection: Client-4fe5795c-f442-11f0-8001-d684c398e257

2026-01-18 14:00:54,230 - distributed.scheduler - INFO - Close client connection: Client-b659963f-f443-11f0-8001-d684c398e257

2026-01-18 14:00:54,230 - distributed.scheduler - INFO - Close client connection: Client-b6aa5616-f44a-11f0-8001-d684c398e257

2026-01-18 14:00:54,229 - distributed.scheduler - INFO - Close client connection: Client-1cdc61db-f445-11f0-8001-d684c398e257

2026-01-18 14:00:54,229 - distributed.scheduler - INFO - Close client connection: Client-8347c06f-f446-11f0-8001-d684c398e257

2026-01-18 14:00:54,229 - distributed.scheduler - INFO - Close client connection: Client-e9b4b508-f447-11f0-8001-d684c398e257

2026-01-18 14:00:54,228 - distributed.scheduler - INFO - Close client connection: Client-5033b4ed-f449-11f0-8001-d684c398e257

2026-01-18 14:00:54,228 - distributed.scheduler - INFO - Close client connection: Client-83a6dbf4-f44d-11f0-8001-d684c398e257

2026-01-18 14:00:54,227 - distributed.scheduler - INFO - Close client connection: Client-1d2ef8a6-f44c-11f0-8001-d684c398e257

2026-01-18 14:00:54,227 - distributed.scheduler - INFO - Close client connection: Client-ea29f05d-f44e-11f0-8001-d684c398e257

2026-01-18 14:00:54,227 - distributed.scheduler - INFO - Close client connection: Client-50a14423-f450-11f0-8001-d684c398e257

2026-01-18 14:00:54,227 - distributed.scheduler - INFO - Close client connection: Client-b72138c3-f451-11f0-8001-d684c398e257

2026-01-18 14:00:54,227 - distributed.scheduler - INFO - Close client connection: Client-1d955659-f453-11f0-8001-d684c398e257

2026-01-18 14:00:54,227 - distributed.scheduler - INFO - Close client connection: Client-84233a1f-f454-11f0-8001-d684c398e257

2026-01-18 14:00:54,227 - distributed.scheduler - INFO - Close client connection: Client-eaab95d5-f455-11f0-8001-d684c398e257

2026-01-18 14:00:54,226 - distributed.scheduler - INFO - Close client connection: Client-51204276-f457-11f0-8001-d684c398e257

2026-01-18 14:00:54,226 - distributed.scheduler - INFO - Close client connection: Client-b784735b-f458-11f0-8001-d684c398e257

2026-01-18 14:00:54,226 - distributed.scheduler - INFO - Close client connection: Client-1e04f002-f45a-11f0-8001-d684c398e257

2026-01-18 14:00:54,226 - distributed.scheduler - INFO - Close client connection: Client-8481c80e-f45b-11f0-8001-d684c398e257

2026-01-18 14:00:54,226 - distributed.scheduler - INFO - Close client connection: Client-518dd2c7-f45e-11f0-8001-d684c398e257

2026-01-18 14:00:54,226 - distributed.scheduler - INFO - Close client connection: Client-eb0a3832-f45c-11f0-8001-d684c398e257

2026-01-18 14:00:54,226 - distributed.scheduler - INFO - Close client connection: Client-8513d689-f462-11f0-8001-d684c398e257

2026-01-18 14:00:54,225 - distributed.scheduler - INFO - Close client connection: Client-b80eccd7-f45f-11f0-8001-d684c398e257

2026-01-18 14:00:54,225 - distributed.scheduler - INFO - Close client connection: Client-1e92d89a-f461-11f0-8001-d684c398e257

2026-01-18 14:00:54,225 - distributed.scheduler - INFO - Close client connection: Client-eb7ed714-f463-11f0-8001-d684c398e257

2026-01-18 14:00:54,225 - distributed.scheduler - INFO - Close client connection: Client-51e411f2-f465-11f0-8001-d684c398e257

2026-01-18 14:00:54,225 - distributed.scheduler - INFO - Close client connection: Client-b86583af-f466-11f0-8001-d684c398e257

2026-01-18 14:00:54,225 - distributed.scheduler - INFO - Close client connection: Client-1edb48c9-f468-11f0-8001-d684c398e257

2026-01-18 14:00:54,225 - distributed.scheduler - INFO - Close client connection: Client-ebebb0ee-f46a-11f0-8001-d684c398e257

2026-01-18 14:00:54,225 - distributed.scheduler - INFO - Close client connection: Client-b8cd6738-f46d-11f0-8001-d684c398e257

2026-01-18 14:00:54,224 - distributed.scheduler - INFO - Close client connection: Client-525eeef2-f46c-11f0-8001-d684c398e257

2026-01-18 14:00:54,224 - distributed.scheduler - INFO - Close client connection: Client-85672752-f469-11f0-8001-d684c398e257

2026-01-18 14:00:54,224 - distributed.scheduler - INFO - Close client connection: Client-1f536ee5-f46f-11f0-8001-d684c398e257

2026-01-18 14:00:54,224 - distributed.scheduler - INFO - Close client connection: Client-ec5c6767-f471-11f0-8001-d684c398e257

2026-01-18 14:00:54,223 - distributed.scheduler - INFO - Close client connection: Client-52dd635d-f473-11f0-8001-d684c398e257

2026-01-18 14:00:54,223 - distributed.scheduler - INFO - Close client connection: Client-85d26e4b-f470-11f0-8001-d684c398e257

2026-01-18 14:00:54,223 - distributed.scheduler - INFO - Close client connection: Client-95968469-f474-11f0-8001-d684c398e257

2026-01-18 14:00:54,220 - distributed.scheduler - INFO - Remove client Client-e95b0d3d-f440-11f0-8001-d684c398e257

2026-01-18 14:00:54,219 - distributed.scheduler - INFO - Remove client Client-4fe5795c-f442-11f0-8001-d684c398e257

2026-01-18 14:00:54,219 - distributed.scheduler - INFO - Remove client Client-b659963f-f443-11f0-8001-d684c398e257

2026-01-18 14:00:54,219 - distributed.scheduler - INFO - Remove client Client-b6aa5616-f44a-11f0-8001-d684c398e257

2026-01-18 14:00:54,218 - distributed.scheduler - INFO - Remove client Client-1cdc61db-f445-11f0-8001-d684c398e257

2026-01-18 14:00:54,218 - distributed.scheduler - INFO - Remove client Client-8347c06f-f446-11f0-8001-d684c398e257

2026-01-18 14:00:54,218 - distributed.scheduler - INFO - Remove client Client-e9b4b508-f447-11f0-8001-d684c398e257

2026-01-18 14:00:54,217 - distributed.scheduler - INFO - Remove client Client-5033b4ed-f449-11f0-8001-d684c398e257

2026-01-18 14:00:54,217 - distributed.scheduler - INFO - Remove client Client-83a6dbf4-f44d-11f0-8001-d684c398e257

2026-01-18 14:00:54,217 - distributed.scheduler - INFO - Remove client Client-1d2ef8a6-f44c-11f0-8001-d684c398e257

2026-01-18 14:00:54,216 - distributed.scheduler - INFO - Remove client Client-ea29f05d-f44e-11f0-8001-d684c398e257

2026-01-18 14:00:54,216 - distributed.scheduler - INFO - Remove client Client-50a14423-f450-11f0-8001-d684c398e257

2026-01-18 14:00:54,216 - distributed.scheduler - INFO - Remove client Client-b72138c3-f451-11f0-8001-d684c398e257

2026-01-18 14:00:54,215 - distributed.scheduler - INFO - Remove client Client-1d955659-f453-11f0-8001-d684c398e257

2026-01-18 14:00:54,214 - distributed.scheduler - INFO - Remove client Client-84233a1f-f454-11f0-8001-d684c398e257

2026-01-18 14:00:54,214 - distributed.scheduler - INFO - Remove client Client-eaab95d5-f455-11f0-8001-d684c398e257

2026-01-18 14:00:54,213 - distributed.scheduler - INFO - Remove client Client-51204276-f457-11f0-8001-d684c398e257

2026-01-18 14:00:54,213 - distributed.scheduler - INFO - Remove client Client-b784735b-f458-11f0-8001-d684c398e257

2026-01-18 14:00:54,213 - distributed.scheduler - INFO - Remove client Client-1e04f002-f45a-11f0-8001-d684c398e257

2026-01-18 14:00:54,212 - distributed.scheduler - INFO - Remove client Client-8481c80e-f45b-11f0-8001-d684c398e257

2026-01-18 14:00:54,212 - distributed.scheduler - INFO - Remove client Client-518dd2c7-f45e-11f0-8001-d684c398e257

2026-01-18 14:00:54,212 - distributed.scheduler - INFO - Remove client Client-eb0a3832-f45c-11f0-8001-d684c398e257

2026-01-18 14:00:54,211 - distributed.scheduler - INFO - Remove client Client-8513d689-f462-11f0-8001-d684c398e257

2026-01-18 14:00:54,211 - distributed.scheduler - INFO - Remove client Client-b80eccd7-f45f-11f0-8001-d684c398e257

2026-01-18 14:00:54,210 - distributed.scheduler - INFO - Remove client Client-1e92d89a-f461-11f0-8001-d684c398e257

2026-01-18 14:00:54,209 - distributed.scheduler - INFO - Remove client Client-eb7ed714-f463-11f0-8001-d684c398e257

2026-01-18 14:00:54,209 - distributed.scheduler - INFO - Remove client Client-51e411f2-f465-11f0-8001-d684c398e257

2026-01-18 14:00:54,208 - distributed.scheduler - INFO - Remove client Client-b86583af-f466-11f0-8001-d684c398e257

2026-01-18 14:00:54,208 - distributed.scheduler - INFO - Remove client Client-1edb48c9-f468-11f0-8001-d684c398e257

2026-01-18 14:00:54,207 - distributed.scheduler - INFO - Remove client Client-ebebb0ee-f46a-11f0-8001-d684c398e257

2026-01-18 14:00:54,207 - distributed.scheduler - INFO - Remove client Client-b8cd6738-f46d-11f0-8001-d684c398e257

2026-01-18 14:00:54,207 - distributed.scheduler - INFO - Remove client Client-525eeef2-f46c-11f0-8001-d684c398e257

2026-01-18 14:00:54,206 - distributed.scheduler - INFO - Remove client Client-85672752-f469-11f0-8001-d684c398e257

2026-01-18 14:00:54,205 - distributed.scheduler - INFO - Remove client Client-1f536ee5-f46f-11f0-8001-d684c398e257

2026-01-18 14:00:54,205 - distributed.scheduler - INFO - Remove client Client-ec5c6767-f471-11f0-8001-d684c398e257

2026-01-18 14:00:54,191 - distributed.scheduler - INFO - Remove client Client-52dd635d-f473-11f0-8001-d684c398e257

2026-01-18 14:00:54,190 - distributed.scheduler - INFO - Remove client Client-85d26e4b-f470-11f0-8001-d684c398e257

2026-01-18 14:00:54,189 - distributed.scheduler - INFO - Remove client Client-95968469-f474-11f0-8001-d684c398e257

2026-01-18 14:00:53,260 - distributed.scheduler - INFO - Close client connection: Client-fc245d2d-f475-11f0-8001-d684c398e257

2026-01-18 14:00:53,258 - distributed.scheduler - INFO - Remove client Client-fc245d2d-f475-11f0-8001-d684c398e257

2026-01-18 14:00:53,255 - distributed.scheduler - INFO - Remove client Client-fc245d2d-f475-11f0-8001-d684c398e257

2026-01-18 14:00:02,731 - distributed.scheduler - INFO - Receive client connection: Client-fc245d2d-f475-11f0-8001-d684c398e257

2026-01-18 13:50:01,176 - distributed.scheduler - INFO - Receive client connection: Client-95968469-f474-11f0-8001-d684c398e257

2026-01-18 13:40:59,740 - distributed.scheduler - INFO - Receive client connection: Client-52dd635d-f473-11f0-8001-d684c398e257

2026-01-18 13:30:58,271 - distributed.scheduler - INFO - Receive client connection: Client-ec5c6767-f471-11f0-8001-d684c398e257

2026-01-18 13:20:56,748 - distributed.scheduler - INFO - Receive client connection: Client-85d26e4b-f470-11f0-8001-d684c398e257

2026-01-18 13:10:55,283 - distributed.scheduler - INFO - Receive client connection: Client-1f536ee5-f46f-11f0-8001-d684c398e257

2026-01-18 13:00:55,631 - distributed.scheduler - INFO - Receive client connection: Client-worker-b9e3e7e8-f46d-11f0-825d-a217f266f416

2026-01-18 13:00:53,782 - distributed.scheduler - INFO - Receive client connection: Client-b8cd6738-f46d-11f0-8001-d684c398e257

2026-01-18 12:50:52,437 - distributed.scheduler - INFO - Receive client connection: Client-525eeef2-f46c-11f0-8001-d684c398e257

2026-01-18 12:40:51,052 - distributed.scheduler - INFO - Receive client connection: Client-ebebb0ee-f46a-11f0-8001-d684c398e257

2026-01-18 12:30:49,563 - distributed.scheduler - INFO - Receive client connection: Client-85672752-f469-11f0-8001-d684c398e257

2026-01-18 12:20:48,022 - distributed.scheduler - INFO - Receive client connection: Client-1edb48c9-f468-11f0-8001-d684c398e257

2026-01-18 12:10:46,620 - distributed.scheduler - INFO - Receive client connection: Client-b86583af-f466-11f0-8001-d684c398e257

2026-01-18 12:00:45,150 - distributed.scheduler - INFO - Receive client connection: Client-51e411f2-f465-11f0-8001-d684c398e257

2026-01-18 11:50:43,853 - distributed.scheduler - INFO - Receive client connection: Client-eb7ed714-f463-11f0-8001-d684c398e257

2026-01-18 11:40:42,536 - distributed.scheduler - INFO - Receive client connection: Client-8513d689-f462-11f0-8001-d684c398e257

2026-01-18 11:30:42,499 - distributed.scheduler - INFO - Receive client connection: Client-worker-1f6ea300-f461-11f0-82fb-fa70b2057bbc

2026-01-18 11:30:41,065 - distributed.scheduler - INFO - Receive client connection: Client-1e92d89a-f461-11f0-8001-d684c398e257

2026-01-18 11:20:39,578 - distributed.scheduler - INFO - Receive client connection: Client-b80eccd7-f45f-11f0-8001-d684c398e257

2026-01-18 11:10:38,109 - distributed.scheduler - INFO - Receive client connection: Client-518dd2c7-f45e-11f0-8001-d684c398e257

2026-01-18 11:00:39,005 - distributed.scheduler - INFO - Receive client connection: Client-worker-ec7020b7-f45c-11f0-8380-c6c79f0eb8d9

2026-01-18 11:00:36,624 - distributed.scheduler - INFO - Receive client connection: Client-eb0a3832-f45c-11f0-8001-d684c398e257

2026-01-18 10:50:35,102 - distributed.scheduler - INFO - Receive client connection: Client-8481c80e-f45b-11f0-8001-d684c398e257

2026-01-18 10:40:33,660 - distributed.scheduler - INFO - Receive client connection: Client-1e04f002-f45a-11f0-8001-d684c398e257

2026-01-18 10:32:11,859 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.244:42213

2026-01-18 10:32:11,856 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.244:42213', status: closed, memory: 0, processing: 0>

2026-01-18 10:32:11,011 - distributed.scheduler - INFO - Close client connection: Client-worker-5df20a30-f216-11f0-81bf-fa70b2057bbc

2026-01-18 10:32:11,006 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.244:45097', status: closed, memory: 0, processing: 0>

2026-01-18 10:32:11,003 - distributed.scheduler - INFO - Remove client Client-worker-5df20a30-f216-11f0-81bf-fa70b2057bbc

2026-01-18 10:32:01,764 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.68:33971

2026-01-18 10:32:01,763 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.68:33971', status: running, memory: 0, processing: 0>

2026-01-18 10:32:01,717 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.159.228:35277

2026-01-18 10:32:01,715 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.159.228:35277', status: closed, memory: 0, processing: 0>

2026-01-18 10:32:00,897 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.159.228:44635', status: closed, memory: 0, processing: 0>

2026-01-18 10:32:00,846 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.68:36413', status: closed, memory: 0, processing: 0>

2026-01-18 10:31:49,609 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.68:36413

2026-01-18 10:31:49,608 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.68:36413', status: closed, memory: 0, processing: 0>

2026-01-18 10:31:49,381 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.159.228:44635

2026-01-18 10:31:49,378 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.159.228:44635', status: closed, memory: 0, processing: 0>

2026-01-18 10:31:48,685 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.68:37493', status: closed, memory: 0, processing: 0>

2026-01-18 10:31:48,467 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.159.228:39603', status: closed, memory: 0, processing: 0>

2026-01-18 10:31:25,318 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.159.228:39603

2026-01-18 10:31:25,317 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.159.228:39603', status: closed, memory: 0, processing: 0>

2026-01-18 10:31:25,273 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.68:37493

2026-01-18 10:31:25,272 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.68:37493', status: closed, memory: 0, processing: 0>

2026-01-18 10:31:24,477 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.159.228:43761', status: closed, memory: 0, processing: 0>

2026-01-18 10:31:24,352 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.68:42805', status: closed, memory: 0, processing: 0>

2026-01-18 10:31:00,558 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.159.228:43761

2026-01-18 10:31:00,558 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.159.228:43761', status: closed, memory: 0, processing: 0>

2026-01-18 10:31:00,168 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.68:42805

2026-01-18 10:31:00,166 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.68:42805', status: closed, memory: 0, processing: 0>

2026-01-18 10:30:59,686 - distributed.scheduler - INFO - Close client connection: Client-worker-f6ca34fc-f20d-11f0-812d-a217f266f416

2026-01-18 10:30:59,684 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.159.228:36567', status: closed, memory: 0, processing: 0>

2026-01-18 10:30:59,683 - distributed.scheduler - INFO - Remove client Client-worker-f6ca34fc-f20d-11f0-812d-a217f266f416

2026-01-18 10:30:59,267 - distributed.scheduler - INFO - Close client connection: Client-worker-866f967b-f29c-11f0-827c-c6c79f0eb8d9

2026-01-18 10:30:59,251 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.68:32987', status: closed, memory: 0, processing: 0>

2026-01-18 10:30:59,250 - distributed.scheduler - INFO - Remove client Client-worker-866f967b-f29c-11f0-827c-c6c79f0eb8d9

2026-01-18 10:30:32,349 - distributed.scheduler - INFO - Receive client connection: Client-b784735b-f458-11f0-8001-d684c398e257

2026-01-18 10:20:30,947 - distributed.scheduler - INFO - Receive client connection: Client-51204276-f457-11f0-8001-d684c398e257

2026-01-18 10:10:29,522 - distributed.scheduler - INFO - Receive client connection: Client-eaab95d5-f455-11f0-8001-d684c398e257

2026-01-18 10:00:28,003 - distributed.scheduler - INFO - Receive client connection: Client-84233a1f-f454-11f0-8001-d684c398e257

2026-01-18 09:50:26,449 - distributed.scheduler - INFO - Receive client connection: Client-1d955659-f453-11f0-8001-d684c398e257

2026-01-18 09:40:25,078 - distributed.scheduler - INFO - Receive client connection: Client-b72138c3-f451-11f0-8001-d684c398e257

2026-01-18 09:30:27,527 - distributed.scheduler - ERROR - Shut down workers that don't have promised key: [], ('len-agg-0bdb0ca60f06a05d70fcae46291b9d49', 0) NoneType: None

2026-01-18 09:30:27,526 - distributed.scheduler - ERROR - Couldn't gather keys {"('len-agg-0bdb0ca60f06a05d70fcae46291b9d49', 0)": []} state: ['waiting'] workers: [] NoneType: None

2026-01-18 09:30:23,596 - distributed.scheduler - INFO - Receive client connection: Client-50a14423-f450-11f0-8001-d684c398e257

2026-01-18 09:20:22,194 - distributed.scheduler - INFO - Receive client connection: Client-ea29f05d-f44e-11f0-8001-d684c398e257

2026-01-18 09:10:20,716 - distributed.scheduler - INFO - Receive client connection: Client-83a6dbf4-f44d-11f0-8001-d684c398e257

2026-01-18 09:00:19,304 - distributed.scheduler - INFO - Receive client connection: Client-1d2ef8a6-f44c-11f0-8001-d684c398e257

2026-01-18 08:50:17,806 - distributed.scheduler - INFO - Receive client connection: Client-b6aa5616-f44a-11f0-8001-d684c398e257

2026-01-18 08:40:16,401 - distributed.scheduler - INFO - Receive client connection: Client-5033b4ed-f449-11f0-8001-d684c398e257

2026-01-18 08:30:14,945 - distributed.scheduler - INFO - Receive client connection: Client-e9b4b508-f447-11f0-8001-d684c398e257

2026-01-18 08:20:13,605 - distributed.scheduler - INFO - Receive client connection: Client-8347c06f-f446-11f0-8001-d684c398e257

2026-01-18 08:10:12,286 - distributed.scheduler - INFO - Receive client connection: Client-1cdc61db-f445-11f0-8001-d684c398e257

2026-01-18 08:00:10,795 - distributed.scheduler - INFO - Receive client connection: Client-b659963f-f443-11f0-8001-d684c398e257

2026-01-18 07:50:09,410 - distributed.scheduler - INFO - Receive client connection: Client-4fe5795c-f442-11f0-8001-d684c398e257

2026-01-18 07:40:07,891 - distributed.scheduler - INFO - Receive client connection: Client-e95b0d3d-f440-11f0-8001-d684c398e257

2026-01-18 07:30:59,052 - distributed.scheduler - INFO - Close client connection: Client-82e01f49-f43f-11f0-8001-d684c398e257

2026-01-18 07:30:59,050 - distributed.scheduler - INFO - Remove client Client-82e01f49-f43f-11f0-8001-d684c398e257

2026-01-18 07:30:59,048 - distributed.scheduler - INFO - Remove client Client-82e01f49-f43f-11f0-8001-d684c398e257

2026-01-18 07:30:06,459 - distributed.scheduler - INFO - Receive client connection: Client-82e01f49-f43f-11f0-8001-d684c398e257

2026-01-18 07:20:39,535 - distributed.scheduler - INFO - Close client connection: Client-1c6076d1-f43e-11f0-8001-d684c398e257

2026-01-18 07:20:39,534 - distributed.scheduler - INFO - Remove client Client-1c6076d1-f43e-11f0-8001-d684c398e257

2026-01-18 07:20:39,533 - distributed.scheduler - INFO - Remove client Client-1c6076d1-f43e-11f0-8001-d684c398e257

2026-01-18 07:20:04,999 - distributed.scheduler - INFO - Receive client connection: Client-1c6076d1-f43e-11f0-8001-d684c398e257

2026-01-18 07:10:35,272 - distributed.scheduler - INFO - Close client connection: Client-b5edfcee-f43c-11f0-8001-d684c398e257

2026-01-18 07:10:35,272 - distributed.scheduler - INFO - Remove client Client-b5edfcee-f43c-11f0-8001-d684c398e257

2026-01-18 07:10:35,272 - distributed.scheduler - INFO - Remove client Client-b5edfcee-f43c-11f0-8001-d684c398e257

2026-01-18 07:10:03,629 - distributed.scheduler - INFO - Receive client connection: Client-b5edfcee-f43c-11f0-8001-d684c398e257

2026-01-18 07:00:56,640 - distributed.scheduler - INFO - Close client connection: Client-4f6d8e49-f43b-11f0-8001-d684c398e257

2026-01-18 07:00:56,640 - distributed.scheduler - INFO - Remove client Client-4f6d8e49-f43b-11f0-8001-d684c398e257

2026-01-18 07:00:56,638 - distributed.scheduler - INFO - Remove client Client-4f6d8e49-f43b-11f0-8001-d684c398e257

2026-01-18 07:00:02,163 - distributed.scheduler - INFO - Receive client connection: Client-4f6d8e49-f43b-11f0-8001-d684c398e257

2026-01-18 06:50:33,057 - distributed.scheduler - INFO - Close client connection: Client-e8e7f1e2-f439-11f0-8001-d684c398e257

2026-01-18 06:50:33,056 - distributed.scheduler - INFO - Remove client Client-e8e7f1e2-f439-11f0-8001-d684c398e257

2026-01-18 06:50:33,054 - distributed.scheduler - INFO - Remove client Client-e8e7f1e2-f439-11f0-8001-d684c398e257

2026-01-18 06:50:00,656 - distributed.scheduler - INFO - Receive client connection: Client-e8e7f1e2-f439-11f0-8001-d684c398e257

2026-01-18 06:41:34,385 - distributed.scheduler - INFO - Close client connection: Client-a643434b-f438-11f0-8001-d684c398e257

2026-01-18 06:41:34,383 - distributed.scheduler - INFO - Remove client Client-a643434b-f438-11f0-8001-d684c398e257

2026-01-18 06:41:34,382 - distributed.scheduler - INFO - Remove client Client-a643434b-f438-11f0-8001-d684c398e257

2026-01-18 06:40:59,353 - distributed.scheduler - INFO - Receive client connection: Client-a643434b-f438-11f0-8001-d684c398e257

2026-01-18 06:31:55,020 - distributed.scheduler - INFO - Close client connection: Client-3fc37b77-f437-11f0-8001-d684c398e257

2026-01-18 06:31:55,019 - distributed.scheduler - INFO - Remove client Client-3fc37b77-f437-11f0-8001-d684c398e257

2026-01-18 06:31:55,018 - distributed.scheduler - INFO - Remove client Client-3fc37b77-f437-11f0-8001-d684c398e257

2026-01-18 06:30:57,891 - distributed.scheduler - INFO - Receive client connection: Client-3fc37b77-f437-11f0-8001-d684c398e257

2026-01-18 06:21:29,096 - distributed.scheduler - INFO - Close client connection: Client-d932aea0-f435-11f0-8001-d684c398e257

2026-01-18 06:21:29,094 - distributed.scheduler - INFO - Remove client Client-d932aea0-f435-11f0-8001-d684c398e257

2026-01-18 06:21:29,093 - distributed.scheduler - INFO - Remove client Client-d932aea0-f435-11f0-8001-d684c398e257

2026-01-18 06:20:56,353 - distributed.scheduler - INFO - Receive client connection: Client-d932aea0-f435-11f0-8001-d684c398e257

2026-01-18 06:11:26,107 - distributed.scheduler - INFO - Close client connection: Client-72b20168-f434-11f0-8001-d684c398e257

2026-01-18 06:11:26,106 - distributed.scheduler - INFO - Remove client Client-72b20168-f434-11f0-8001-d684c398e257

2026-01-18 06:11:26,104 - distributed.scheduler - INFO - Remove client Client-72b20168-f434-11f0-8001-d684c398e257

2026-01-18 06:10:54,856 - distributed.scheduler - INFO - Receive client connection: Client-72b20168-f434-11f0-8001-d684c398e257

2026-01-18 06:01:42,438 - distributed.scheduler - INFO - Close client connection: Client-0c23a023-f433-11f0-8001-d684c398e257

2026-01-18 06:01:42,437 - distributed.scheduler - INFO - Remove client Client-0c23a023-f433-11f0-8001-d684c398e257

2026-01-18 06:01:42,435 - distributed.scheduler - INFO - Remove client Client-0c23a023-f433-11f0-8001-d684c398e257

2026-01-18 06:00:53,294 - distributed.scheduler - INFO - Receive client connection: Client-0c23a023-f433-11f0-8001-d684c398e257

2026-01-18 05:51:22,465 - distributed.scheduler - INFO - Close client connection: Client-a5b0209b-f431-11f0-8001-d684c398e257

2026-01-18 05:51:22,464 - distributed.scheduler - INFO - Remove client Client-a5b0209b-f431-11f0-8001-d684c398e257

2026-01-18 05:51:22,462 - distributed.scheduler - INFO - Remove client Client-a5b0209b-f431-11f0-8001-d684c398e257

2026-01-18 05:50:51,915 - distributed.scheduler - INFO - Receive client connection: Client-a5b0209b-f431-11f0-8001-d684c398e257

2026-01-18 05:41:22,516 - distributed.scheduler - INFO - Close client connection: Client-3f40ccc5-f430-11f0-8001-d684c398e257

2026-01-18 05:41:22,515 - distributed.scheduler - INFO - Remove client Client-3f40ccc5-f430-11f0-8001-d684c398e257

2026-01-18 05:41:22,513 - distributed.scheduler - INFO - Remove client Client-3f40ccc5-f430-11f0-8001-d684c398e257

2026-01-18 05:40:50,561 - distributed.scheduler - INFO - Receive client connection: Client-3f40ccc5-f430-11f0-8001-d684c398e257

2026-01-18 05:31:41,217 - distributed.scheduler - INFO - Close client connection: Client-3e55eeb6-f422-11f0-8001-d684c398e257

2026-01-18 05:31:41,217 - distributed.scheduler - INFO - Close client connection: Client-a4e03035-f423-11f0-8001-d684c398e257

2026-01-18 05:31:41,217 - distributed.scheduler - INFO - Close client connection: Client-d84dbfaf-f427-11f0-8001-d684c398e257

2026-01-18 05:31:41,217 - distributed.scheduler - INFO - Close client connection: Client-0b5eaf00-f425-11f0-8001-d684c398e257

2026-01-18 05:31:41,217 - distributed.scheduler - INFO - Close client connection: Client-3ecd6653-f429-11f0-8001-d684c398e257

2026-01-18 05:31:41,216 - distributed.scheduler - INFO - Close client connection: Client-71dc5fd1-f426-11f0-8001-d684c398e257

2026-01-18 05:31:41,216 - distributed.scheduler - INFO - Close client connection: Client-a545fcaf-f42a-11f0-8001-d684c398e257

2026-01-18 05:31:41,216 - distributed.scheduler - INFO - Close client connection: Client-0bbf1285-f42c-11f0-8001-d684c398e257

2026-01-18 05:31:41,215 - distributed.scheduler - INFO - Close client connection: Client-724d181e-f42d-11f0-8001-d684c398e257

2026-01-18 05:31:41,214 - distributed.scheduler - INFO - Remove client Client-3e55eeb6-f422-11f0-8001-d684c398e257

2026-01-18 05:31:41,213 - distributed.scheduler - INFO - Remove client Client-a4e03035-f423-11f0-8001-d684c398e257

2026-01-18 05:31:41,212 - distributed.scheduler - INFO - Remove client Client-d84dbfaf-f427-11f0-8001-d684c398e257

2026-01-18 05:31:41,212 - distributed.scheduler - INFO - Remove client Client-0b5eaf00-f425-11f0-8001-d684c398e257

2026-01-18 05:31:41,211 - distributed.scheduler - INFO - Remove client Client-3ecd6653-f429-11f0-8001-d684c398e257

2026-01-18 05:31:41,210 - distributed.scheduler - INFO - Remove client Client-71dc5fd1-f426-11f0-8001-d684c398e257

2026-01-18 05:31:41,210 - distributed.scheduler - INFO - Remove client Client-a545fcaf-f42a-11f0-8001-d684c398e257

2026-01-18 05:31:41,209 - distributed.scheduler - INFO - Remove client Client-0bbf1285-f42c-11f0-8001-d684c398e257

2026-01-18 05:31:41,206 - distributed.scheduler - INFO - Remove client Client-724d181e-f42d-11f0-8001-d684c398e257

2026-01-18 05:31:40,550 - distributed.scheduler - INFO - Close client connection: Client-d8bc776d-f42e-11f0-8001-d684c398e257

2026-01-18 05:31:40,549 - distributed.scheduler - INFO - Remove client Client-d8bc776d-f42e-11f0-8001-d684c398e257

2026-01-18 05:31:40,547 - distributed.scheduler - INFO - Remove client Client-d8bc776d-f42e-11f0-8001-d684c398e257

2026-01-18 05:30:49,060 - distributed.scheduler - INFO - Receive client connection: Client-d8bc776d-f42e-11f0-8001-d684c398e257

2026-01-18 05:20:47,704 - distributed.scheduler - INFO - Receive client connection: Client-724d181e-f42d-11f0-8001-d684c398e257

2026-01-18 05:10:46,148 - distributed.scheduler - INFO - Receive client connection: Client-0bbf1285-f42c-11f0-8001-d684c398e257

2026-01-18 05:00:44,733 - distributed.scheduler - INFO - Receive client connection: Client-a545fcaf-f42a-11f0-8001-d684c398e257

2026-01-18 04:50:43,311 - distributed.scheduler - INFO - Receive client connection: Client-3ecd6653-f429-11f0-8001-d684c398e257

2026-01-18 04:40:41,860 - distributed.scheduler - INFO - Receive client connection: Client-d84dbfaf-f427-11f0-8001-d684c398e257

2026-01-18 04:30:40,578 - distributed.scheduler - INFO - Receive client connection: Client-71dc5fd1-f426-11f0-8001-d684c398e257

2026-01-18 04:20:39,042 - distributed.scheduler - INFO - Receive client connection: Client-0b5eaf00-f425-11f0-8001-d684c398e257

2026-01-18 04:10:37,586 - distributed.scheduler - INFO - Receive client connection: Client-a4e03035-f423-11f0-8001-d684c398e257

2026-01-18 04:00:36,067 - distributed.scheduler - INFO - Receive client connection: Client-3e55eeb6-f422-11f0-8001-d684c398e257

2026-01-18 03:50:57,682 - distributed.scheduler - INFO - Close client connection: Client-d7d7be7d-f420-11f0-8001-d684c398e257

2026-01-18 03:50:57,681 - distributed.scheduler - INFO - Remove client Client-d7d7be7d-f420-11f0-8001-d684c398e257

2026-01-18 03:50:57,679 - distributed.scheduler - INFO - Remove client Client-d7d7be7d-f420-11f0-8001-d684c398e257

2026-01-18 03:50:34,614 - distributed.scheduler - INFO - Receive client connection: Client-d7d7be7d-f420-11f0-8001-d684c398e257

2026-01-18 03:40:58,834 - distributed.scheduler - INFO - Close client connection: Client-7164ea2b-f41f-11f0-8001-d684c398e257

2026-01-18 03:40:58,833 - distributed.scheduler - INFO - Remove client Client-7164ea2b-f41f-11f0-8001-d684c398e257

2026-01-18 03:40:58,832 - distributed.scheduler - INFO - Remove client Client-7164ea2b-f41f-11f0-8001-d684c398e257

2026-01-18 03:40:33,237 - distributed.scheduler - INFO - Receive client connection: Client-7164ea2b-f41f-11f0-8001-d684c398e257

2026-01-18 03:31:15,495 - distributed.scheduler - INFO - Close client connection: Client-0ae92585-f41e-11f0-8001-d684c398e257

2026-01-18 03:31:15,494 - distributed.scheduler - INFO - Remove client Client-0ae92585-f41e-11f0-8001-d684c398e257

2026-01-18 03:31:15,492 - distributed.scheduler - INFO - Remove client Client-0ae92585-f41e-11f0-8001-d684c398e257

2026-01-18 03:30:32,930 - distributed.scheduler - INFO - Receive client connection: Client-worker-0b9658be-f41e-11f0-832e-92d0b450f87a

2026-01-18 03:30:31,803 - distributed.scheduler - INFO - Receive client connection: Client-0ae92585-f41e-11f0-8001-d684c398e257

2026-01-18 03:20:55,449 - distributed.scheduler - INFO - Close client connection: Client-a4608fb6-f41c-11f0-8001-d684c398e257

2026-01-18 03:20:55,448 - distributed.scheduler - INFO - Remove client Client-a4608fb6-f41c-11f0-8001-d684c398e257

2026-01-18 03:20:55,446 - distributed.scheduler - INFO - Remove client Client-a4608fb6-f41c-11f0-8001-d684c398e257

2026-01-18 03:20:30,320 - distributed.scheduler - INFO - Receive client connection: Client-a4608fb6-f41c-11f0-8001-d684c398e257

2026-01-18 03:10:48,143 - distributed.scheduler - INFO - Close client connection: Client-3ddcb717-f41b-11f0-8001-d684c398e257

2026-01-18 03:10:48,141 - distributed.scheduler - INFO - Remove client Client-3ddcb717-f41b-11f0-8001-d684c398e257

2026-01-18 03:10:48,139 - distributed.scheduler - INFO - Remove client Client-3ddcb717-f41b-11f0-8001-d684c398e257

2026-01-18 03:10:28,801 - distributed.scheduler - INFO - Receive client connection: Client-3ddcb717-f41b-11f0-8001-d684c398e257

2026-01-18 03:03:40,147 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:42161 failed: OSError: Timed out trying to connect to tcp://172.21.151.136:42161 after 30 s

2026-01-18 03:03:40,132 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:41381 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:42161 after 30 s')

2026-01-18 03:03:40,022 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:37283 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:42161 after 30 s')

2026-01-18 03:03:40,020 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:33329 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:42161 after 30 s')

2026-01-18 03:03:40,019 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:35843 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:42161 after 30 s')

2026-01-18 03:03:39,994 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:33649 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:42161 after 30 s')

2026-01-18 03:03:39,994 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:44951 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:42161 after 30 s')

2026-01-18 03:03:39,992 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:33779 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:42161 after 30 s')

2026-01-18 03:03:39,989 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:44341 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:42161 after 30 s')

2026-01-18 03:03:39,988 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:35235 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:42161 after 30 s')

2026-01-18 03:03:39,987 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:32987 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:42161 after 30 s')

2026-01-18 03:03:39,987 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:42711 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:42161 after 30 s')

2026-01-18 03:03:39,975 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:33153 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:42161 after 30 s')

2026-01-18 03:03:10,711 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.136:46861

2026-01-18 03:03:10,709 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.136:46861', status: running, memory: 0, processing: 0>

2026-01-18 03:03:09,846 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.136:42161', status: closed, memory: 0, processing: 0>

2026-01-18 03:03:00,285 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:43741 failed: OSError: Timed out trying to connect to tcp://172.21.151.136:43741 after 30 s

2026-01-18 03:03:00,244 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:41381 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:43741 after 30 s')

2026-01-18 03:03:00,218 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:44951 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:43741 after 30 s')

2026-01-18 03:03:00,200 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:36567 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:43741 after 30 s')

2026-01-18 03:03:00,184 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:35235 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:43741 after 30 s')

2026-01-18 03:03:00,173 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:33153 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:43741 after 30 s')

2026-01-18 03:02:30,908 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.136:42161

2026-01-18 03:02:30,906 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.136:42161', status: closed, memory: 0, processing: 0>

2026-01-18 03:02:30,035 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.136:43741', status: closed, memory: 0, processing: 0>

2026-01-18 03:02:21,859 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.136:43741

2026-01-18 03:02:21,858 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.136:43741', status: closed, memory: 0, processing: 0>

2026-01-18 03:02:21,048 - distributed.scheduler - INFO - Close client connection: Client-worker-118f8899-f41a-11f0-82f7-92d0b450f87a

2026-01-18 03:02:21,040 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.136:46017', status: closed, memory: 0, processing: 0>

2026-01-18 03:02:21,039 - distributed.scheduler - INFO - Remove client Client-worker-118f8899-f41a-11f0-82f7-92d0b450f87a

2026-01-18 03:02:04,951 - distributed.scheduler - INFO - Receive client connection: Client-worker-118f8899-f41a-11f0-82f7-92d0b450f87a

2026-01-18 03:02:02,955 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:45969 failed: OSError: Timed out trying to connect to tcp://172.21.151.136:45969 after 30 s

2026-01-18 03:02:02,949 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:41381 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:45969 after 30 s')

2026-01-18 03:02:02,881 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:36567 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:45969 after 30 s')

2026-01-18 03:02:02,879 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:32987 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:45969 after 30 s')

2026-01-18 03:02:02,871 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:42711 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:45969 after 30 s')

2026-01-18 03:02:02,871 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:33779 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:45969 after 30 s')

2026-01-18 03:02:02,870 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:37283 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:45969 after 30 s')

2026-01-18 03:02:02,849 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:44951 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:45969 after 30 s')

2026-01-18 03:02:02,843 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:35843 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:45969 after 30 s')

2026-01-18 03:02:02,839 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:45097 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:45969 after 30 s')

2026-01-18 03:02:02,837 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:33153 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:45969 after 30 s')

2026-01-18 03:02:02,827 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:44341 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:45969 after 30 s')

2026-01-18 03:01:33,564 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.136:46017

2026-01-18 03:01:33,561 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.136:46017', status: closed, memory: 0, processing: 0>

2026-01-18 03:01:32,704 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.136:45969', status: closed, memory: 0, processing: 0>

2026-01-18 03:01:22,950 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:38831 failed: OSError: Timed out trying to connect to tcp://172.21.151.136:38831 after 30 s

2026-01-18 03:01:22,843 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:38831 failed: OSError: Timed out trying to connect to tcp://172.21.151.136:38831 after 30 s

2026-01-18 03:01:22,832 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:41381 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:38831 after 30 s')

2026-01-18 03:01:22,778 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:45097 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:38831 after 30 s')

2026-01-18 03:01:22,731 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:42711 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:38831 after 30 s')

2026-01-18 03:01:22,723 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:35235 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:38831 after 30 s')

2026-01-18 03:01:22,629 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:37283 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:38831 after 30 s')

2026-01-18 03:01:22,608 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:32987 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:38831 after 30 s')

2026-01-18 03:01:22,592 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:38831 failed: OSError: Timed out trying to connect to tcp://172.21.151.136:38831 after 30 s

2026-01-18 03:01:22,590 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:40415 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:38831 after 30 s')

2026-01-18 03:01:22,576 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:33153 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:38831 after 30 s')

2026-01-18 03:01:22,574 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:33649 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:38831 after 30 s')

2026-01-18 03:01:22,539 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:44341 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:38831 after 30 s')

2026-01-18 03:01:22,459 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:44951 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:38831 after 30 s')

2026-01-18 03:01:22,442 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:40415 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:38831 after 30 s')

2026-01-18 03:01:22,436 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:32987 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:38831 after 30 s')

2026-01-18 03:01:22,428 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:33329 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:38831 after 30 s')

2026-01-18 03:01:22,428 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:36567 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:38831 after 30 s')

2026-01-18 03:01:22,427 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:33779 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:38831 after 30 s')

2026-01-18 03:01:22,376 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:41381 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:38831 after 30 s')

2026-01-18 03:01:22,347 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:42711 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:38831 after 30 s')

2026-01-18 03:01:22,338 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:44341 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:38831 after 30 s')

2026-01-18 03:01:22,324 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:33779 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:38831 after 30 s')

2026-01-18 03:01:10,688 - distributed.scheduler - INFO - Close client connection: Client-913750e5-f3e7-11f0-8001-d684c398e257

2026-01-18 03:01:10,687 - distributed.scheduler - INFO - Close client connection: Client-f7b3139e-f3e8-11f0-8001-d684c398e257

2026-01-18 03:01:10,687 - distributed.scheduler - INFO - Close client connection: Client-5e387c43-f3ea-11f0-8001-d684c398e257

2026-01-18 03:01:10,687 - distributed.scheduler - INFO - Close client connection: Client-c4bcd36e-f3eb-11f0-8001-d684c398e257

2026-01-18 03:01:10,687 - distributed.scheduler - INFO - Close client connection: Client-2b413ccd-f3ed-11f0-8001-d684c398e257

2026-01-18 03:01:10,687 - distributed.scheduler - INFO - Close client connection: Client-91c719ee-f3ee-11f0-8001-d684c398e257

2026-01-18 03:01:10,687 - distributed.scheduler - INFO - Close client connection: Client-f84a55d9-f3ef-11f0-8001-d684c398e257

2026-01-18 03:01:10,686 - distributed.scheduler - INFO - Close client connection: Client-5ec5f317-f3f1-11f0-8001-d684c398e257

2026-01-18 03:01:10,686 - distributed.scheduler - INFO - Close client connection: Client-c5425bff-f3f2-11f0-8001-d684c398e257

2026-01-18 03:01:10,686 - distributed.scheduler - INFO - Close client connection: Client-f8b19529-f3f6-11f0-8001-d684c398e257

2026-01-18 03:01:10,686 - distributed.scheduler - INFO - Close client connection: Client-2bb8f54d-f3f4-11f0-8001-d684c398e257

2026-01-18 03:01:10,686 - distributed.scheduler - INFO - Close client connection: Client-922b706f-f3f5-11f0-8001-d684c398e257

2026-01-18 03:01:10,686 - distributed.scheduler - INFO - Close client connection: Client-5f3733bf-f3f8-11f0-8001-d684c398e257

2026-01-18 03:01:10,686 - distributed.scheduler - INFO - Close client connection: Client-c5bcbcc1-f3f9-11f0-8001-d684c398e257

2026-01-18 03:01:10,685 - distributed.scheduler - INFO - Close client connection: Client-92b4e57d-f3fc-11f0-8001-d684c398e257

2026-01-18 03:01:10,685 - distributed.scheduler - INFO - Close client connection: Client-2c3f8f6f-f3fb-11f0-8001-d684c398e257

2026-01-18 03:01:10,685 - distributed.scheduler - INFO - Close client connection: Client-5fb3a2fc-f3ff-11f0-8001-d684c398e257

2026-01-18 03:01:10,685 - distributed.scheduler - INFO - Close client connection: Client-f92ccb71-f3fd-11f0-8001-d684c398e257

2026-01-18 03:01:10,685 - distributed.scheduler - INFO - Close client connection: Client-a25f4795-f400-11f0-8001-d684c398e257

2026-01-18 03:01:10,685 - distributed.scheduler - INFO - Close client connection: Client-08eacb54-f402-11f0-8001-d684c398e257

2026-01-18 03:01:10,685 - distributed.scheduler - INFO - Close client connection: Client-6f63a7bf-f403-11f0-8001-d684c398e257

2026-01-18 03:01:10,685 - distributed.scheduler - INFO - Close client connection: Client-d5dbd7ba-f404-11f0-8001-d684c398e257

2026-01-18 03:01:10,685 - distributed.scheduler - INFO - Close client connection: Client-3c59c5ad-f406-11f0-8001-d684c398e257

2026-01-18 03:01:10,684 - distributed.scheduler - INFO - Close client connection: Client-a2e02cd0-f407-11f0-8001-d684c398e257

2026-01-18 03:01:10,684 - distributed.scheduler - INFO - Close client connection: Client-095fa68f-f409-11f0-8001-d684c398e257

2026-01-18 03:01:10,684 - distributed.scheduler - INFO - Close client connection: Client-6fe4e3d0-f40a-11f0-8001-d684c398e257

2026-01-18 03:01:10,684 - distributed.scheduler - INFO - Close client connection: Client-d662efe1-f40b-11f0-8001-d684c398e257

2026-01-18 03:01:10,684 - distributed.scheduler - INFO - Close client connection: Client-3cd0cf0a-f40d-11f0-8001-d684c398e257

2026-01-18 03:01:10,684 - distributed.scheduler - INFO - Close client connection: Client-a34cb6f4-f40e-11f0-8001-d684c398e257

2026-01-18 03:01:10,684 - distributed.scheduler - INFO - Close client connection: Client-7043b9de-f411-11f0-8001-d684c398e257

2026-01-18 03:01:10,684 - distributed.scheduler - INFO - Close client connection: Client-09c63eda-f410-11f0-8001-d684c398e257

2026-01-18 03:01:10,683 - distributed.scheduler - INFO - Close client connection: Client-3d4efa56-f414-11f0-8001-d684c398e257

2026-01-18 03:01:10,683 - distributed.scheduler - INFO - Close client connection: Client-d6cb8c4e-f412-11f0-8001-d684c398e257

2026-01-18 03:01:10,683 - distributed.scheduler - INFO - Close client connection: Client-a3bd7d4a-f415-11f0-8001-d684c398e257

2026-01-18 03:01:10,681 - distributed.scheduler - INFO - Close client connection: Client-0a3502a0-f417-11f0-8001-d684c398e257

2026-01-18 03:01:10,680 - distributed.scheduler - INFO - Close client connection: Client-70be3bdd-f418-11f0-8001-d684c398e257

2026-01-18 03:01:10,680 - distributed.scheduler - INFO - Remove client Client-913750e5-f3e7-11f0-8001-d684c398e257

2026-01-18 03:01:10,680 - distributed.scheduler - INFO - Remove client Client-f7b3139e-f3e8-11f0-8001-d684c398e257

2026-01-18 03:01:10,679 - distributed.scheduler - INFO - Remove client Client-5e387c43-f3ea-11f0-8001-d684c398e257

2026-01-18 03:01:10,679 - distributed.scheduler - INFO - Remove client Client-c4bcd36e-f3eb-11f0-8001-d684c398e257

2026-01-18 03:01:10,679 - distributed.scheduler - INFO - Remove client Client-2b413ccd-f3ed-11f0-8001-d684c398e257

2026-01-18 03:01:10,678 - distributed.scheduler - INFO - Remove client Client-91c719ee-f3ee-11f0-8001-d684c398e257

2026-01-18 03:01:10,678 - distributed.scheduler - INFO - Remove client Client-f84a55d9-f3ef-11f0-8001-d684c398e257

2026-01-18 03:01:10,675 - distributed.scheduler - INFO - Remove client Client-5ec5f317-f3f1-11f0-8001-d684c398e257

2026-01-18 03:01:10,674 - distributed.scheduler - INFO - Remove client Client-c5425bff-f3f2-11f0-8001-d684c398e257

2026-01-18 03:01:10,674 - distributed.scheduler - INFO - Remove client Client-f8b19529-f3f6-11f0-8001-d684c398e257

2026-01-18 03:01:10,674 - distributed.scheduler - INFO - Remove client Client-2bb8f54d-f3f4-11f0-8001-d684c398e257

2026-01-18 03:01:10,674 - distributed.scheduler - INFO - Remove client Client-922b706f-f3f5-11f0-8001-d684c398e257

2026-01-18 03:01:10,673 - distributed.scheduler - INFO - Remove client Client-5f3733bf-f3f8-11f0-8001-d684c398e257

2026-01-18 03:01:10,673 - distributed.scheduler - INFO - Remove client Client-c5bcbcc1-f3f9-11f0-8001-d684c398e257

2026-01-18 03:01:10,672 - distributed.scheduler - INFO - Remove client Client-92b4e57d-f3fc-11f0-8001-d684c398e257

2026-01-18 03:01:10,672 - distributed.scheduler - INFO - Remove client Client-2c3f8f6f-f3fb-11f0-8001-d684c398e257

2026-01-18 03:01:10,672 - distributed.scheduler - INFO - Remove client Client-5fb3a2fc-f3ff-11f0-8001-d684c398e257

2026-01-18 03:01:10,671 - distributed.scheduler - INFO - Remove client Client-f92ccb71-f3fd-11f0-8001-d684c398e257

2026-01-18 03:01:10,671 - distributed.scheduler - INFO - Remove client Client-a25f4795-f400-11f0-8001-d684c398e257

2026-01-18 03:01:10,670 - distributed.scheduler - INFO - Remove client Client-08eacb54-f402-11f0-8001-d684c398e257

2026-01-18 03:01:10,670 - distributed.scheduler - INFO - Remove client Client-6f63a7bf-f403-11f0-8001-d684c398e257

2026-01-18 03:01:10,669 - distributed.scheduler - INFO - Remove client Client-d5dbd7ba-f404-11f0-8001-d684c398e257

2026-01-18 03:01:10,668 - distributed.scheduler - INFO - Remove client Client-3c59c5ad-f406-11f0-8001-d684c398e257

2026-01-18 03:01:10,668 - distributed.scheduler - INFO - Remove client Client-a2e02cd0-f407-11f0-8001-d684c398e257

2026-01-18 03:01:10,667 - distributed.scheduler - INFO - Remove client Client-095fa68f-f409-11f0-8001-d684c398e257

2026-01-18 03:01:10,667 - distributed.scheduler - INFO - Remove client Client-6fe4e3d0-f40a-11f0-8001-d684c398e257

2026-01-18 03:01:10,667 - distributed.scheduler - INFO - Remove client Client-d662efe1-f40b-11f0-8001-d684c398e257

2026-01-18 03:01:10,666 - distributed.scheduler - INFO - Remove client Client-3cd0cf0a-f40d-11f0-8001-d684c398e257

2026-01-18 03:01:10,666 - distributed.scheduler - INFO - Remove client Client-a34cb6f4-f40e-11f0-8001-d684c398e257

2026-01-18 03:01:10,665 - distributed.scheduler - INFO - Remove client Client-7043b9de-f411-11f0-8001-d684c398e257

2026-01-18 03:01:10,665 - distributed.scheduler - INFO - Remove client Client-09c63eda-f410-11f0-8001-d684c398e257

2026-01-18 03:01:10,664 - distributed.scheduler - INFO - Remove client Client-3d4efa56-f414-11f0-8001-d684c398e257

2026-01-18 03:01:10,663 - distributed.scheduler - INFO - Remove client Client-d6cb8c4e-f412-11f0-8001-d684c398e257

2026-01-18 03:01:10,663 - distributed.scheduler - INFO - Remove client Client-a3bd7d4a-f415-11f0-8001-d684c398e257

2026-01-18 03:01:10,646 - distributed.scheduler - INFO - Remove client Client-0a3502a0-f417-11f0-8001-d684c398e257

2026-01-18 03:01:10,645 - distributed.scheduler - INFO - Remove client Client-70be3bdd-f418-11f0-8001-d684c398e257

2026-01-18 03:01:09,846 - distributed.scheduler - INFO - Close client connection: Client-d73b046e-f419-11f0-8001-d684c398e257

2026-01-18 03:01:09,846 - distributed.scheduler - INFO - Remove client Client-d73b046e-f419-11f0-8001-d684c398e257

2026-01-18 03:01:09,844 - distributed.scheduler - INFO - Remove client Client-d73b046e-f419-11f0-8001-d684c398e257

2026-01-18 03:00:52,970 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.136:45969

2026-01-18 03:00:52,970 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.136:45969', status: closed, memory: 0, processing: 0>

2026-01-18 03:00:52,190 - distributed.scheduler - INFO - Close client connection: Client-worker-4b397c05-f1e8-11f0-8184-92d0b450f87a

2026-01-18 03:00:52,160 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.136:38831', status: closed, memory: 0, processing: 0>

2026-01-18 03:00:52,157 - distributed.scheduler - INFO - Remove client Client-worker-4b397c05-f1e8-11f0-8184-92d0b450f87a

2026-01-18 03:00:27,101 - distributed.scheduler - INFO - Receive client connection: Client-d73b046e-f419-11f0-8001-d684c398e257

2026-01-18 02:50:25,660 - distributed.scheduler - INFO - Receive client connection: Client-70be3bdd-f418-11f0-8001-d684c398e257

2026-01-18 02:40:24,139 - distributed.scheduler - INFO - Receive client connection: Client-0a3502a0-f417-11f0-8001-d684c398e257

2026-01-18 02:30:22,732 - distributed.scheduler - INFO - Receive client connection: Client-a3bd7d4a-f415-11f0-8001-d684c398e257

2026-01-18 02:20:21,378 - distributed.scheduler - INFO - Receive client connection: Client-3d4efa56-f414-11f0-8001-d684c398e257

2026-01-18 02:10:19,896 - distributed.scheduler - INFO - Receive client connection: Client-d6cb8c4e-f412-11f0-8001-d684c398e257

2026-01-18 02:00:18,383 - distributed.scheduler - INFO - Receive client connection: Client-7043b9de-f411-11f0-8001-d684c398e257

2026-01-18 01:50:16,934 - distributed.scheduler - INFO - Receive client connection: Client-09c63eda-f410-11f0-8001-d684c398e257

2026-01-18 01:40:15,513 - distributed.scheduler - INFO - Receive client connection: Client-a34cb6f4-f40e-11f0-8001-d684c398e257

2026-01-18 01:30:14,072 - distributed.scheduler - INFO - Receive client connection: Client-3cd0cf0a-f40d-11f0-8001-d684c398e257

2026-01-18 01:20:12,731 - distributed.scheduler - INFO - Receive client connection: Client-d662efe1-f40b-11f0-8001-d684c398e257

2026-01-18 01:10:11,281 - distributed.scheduler - INFO - Receive client connection: Client-6fe4e3d0-f40a-11f0-8001-d684c398e257

2026-01-18 01:00:09,786 - distributed.scheduler - INFO - Receive client connection: Client-095fa68f-f409-11f0-8001-d684c398e257

2026-01-18 00:50:08,327 - distributed.scheduler - INFO - Receive client connection: Client-a2e02cd0-f407-11f0-8001-d684c398e257

2026-01-18 00:40:06,820 - distributed.scheduler - INFO - Receive client connection: Client-3c59c5ad-f406-11f0-8001-d684c398e257

2026-01-18 00:30:05,373 - distributed.scheduler - INFO - Receive client connection: Client-d5dbd7ba-f404-11f0-8001-d684c398e257

2026-01-18 00:20:03,956 - distributed.scheduler - INFO - Receive client connection: Client-6f63a7bf-f403-11f0-8001-d684c398e257

2026-01-18 00:10:02,560 - distributed.scheduler - INFO - Receive client connection: Client-08eacb54-f402-11f0-8001-d684c398e257

2026-01-18 00:00:01,005 - distributed.scheduler - INFO - Receive client connection: Client-a25f4795-f400-11f0-8001-d684c398e257

2026-01-17 23:50:59,653 - distributed.scheduler - INFO - Receive client connection: Client-5fb3a2fc-f3ff-11f0-8001-d684c398e257

2026-01-17 23:40:58,144 - distributed.scheduler - INFO - Receive client connection: Client-f92ccb71-f3fd-11f0-8001-d684c398e257

2026-01-17 23:30:56,739 - distributed.scheduler - INFO - Receive client connection: Client-92b4e57d-f3fc-11f0-8001-d684c398e257

2026-01-17 23:20:55,342 - distributed.scheduler - INFO - Receive client connection: Client-2c3f8f6f-f3fb-11f0-8001-d684c398e257

2026-01-17 23:10:53,859 - distributed.scheduler - INFO - Receive client connection: Client-c5bcbcc1-f3f9-11f0-8001-d684c398e257

2026-01-17 23:00:52,353 - distributed.scheduler - INFO - Receive client connection: Client-5f3733bf-f3f8-11f0-8001-d684c398e257

2026-01-17 22:50:50,861 - distributed.scheduler - INFO - Receive client connection: Client-f8b19529-f3f6-11f0-8001-d684c398e257

2026-01-17 22:40:49,354 - distributed.scheduler - INFO - Receive client connection: Client-922b706f-f3f5-11f0-8001-d684c398e257

2026-01-17 22:30:47,983 - distributed.scheduler - INFO - Receive client connection: Client-2bb8f54d-f3f4-11f0-8001-d684c398e257

2026-01-17 22:20:46,575 - distributed.scheduler - INFO - Receive client connection: Client-c5425bff-f3f2-11f0-8001-d684c398e257

2026-01-17 22:10:45,134 - distributed.scheduler - INFO - Receive client connection: Client-5ec5f317-f3f1-11f0-8001-d684c398e257

2026-01-17 22:00:43,697 - distributed.scheduler - INFO - Receive client connection: Client-f84a55d9-f3ef-11f0-8001-d684c398e257

2026-01-17 21:50:42,221 - distributed.scheduler - INFO - Receive client connection: Client-91c719ee-f3ee-11f0-8001-d684c398e257

2026-01-17 21:40:40,721 - distributed.scheduler - INFO - Receive client connection: Client-2b413ccd-f3ed-11f0-8001-d684c398e257

2026-01-17 21:30:39,221 - distributed.scheduler - INFO - Receive client connection: Client-c4bcd36e-f3eb-11f0-8001-d684c398e257

2026-01-17 21:20:37,733 - distributed.scheduler - INFO - Receive client connection: Client-5e387c43-f3ea-11f0-8001-d684c398e257

2026-01-17 21:10:36,233 - distributed.scheduler - INFO - Receive client connection: Client-f7b3139e-f3e8-11f0-8001-d684c398e257

2026-01-17 21:00:34,804 - distributed.scheduler - INFO - Receive client connection: Client-913750e5-f3e7-11f0-8001-d684c398e257

2026-01-17 20:50:53,339 - distributed.scheduler - INFO - Close client connection: Client-2ac1d815-f3e6-11f0-8001-d684c398e257

2026-01-17 20:50:53,338 - distributed.scheduler - INFO - Remove client Client-2ac1d815-f3e6-11f0-8001-d684c398e257

2026-01-17 20:50:53,336 - distributed.scheduler - INFO - Remove client Client-2ac1d815-f3e6-11f0-8001-d684c398e257

2026-01-17 20:50:33,412 - distributed.scheduler - INFO - Receive client connection: Client-2ac1d815-f3e6-11f0-8001-d684c398e257

2026-01-17 20:40:52,883 - distributed.scheduler - INFO - Close client connection: Client-c4397847-f3e4-11f0-8001-d684c398e257

2026-01-17 20:40:52,882 - distributed.scheduler - INFO - Remove client Client-c4397847-f3e4-11f0-8001-d684c398e257

2026-01-17 20:40:52,880 - distributed.scheduler - INFO - Remove client Client-c4397847-f3e4-11f0-8001-d684c398e257

2026-01-17 20:40:31,899 - distributed.scheduler - INFO - Receive client connection: Client-c4397847-f3e4-11f0-8001-d684c398e257

2026-01-17 20:30:51,972 - distributed.scheduler - INFO - Close client connection: Client-5dae8d22-f3e3-11f0-8001-d684c398e257

2026-01-17 20:30:51,972 - distributed.scheduler - INFO - Remove client Client-5dae8d22-f3e3-11f0-8001-d684c398e257

2026-01-17 20:30:51,970 - distributed.scheduler - INFO - Remove client Client-5dae8d22-f3e3-11f0-8001-d684c398e257

2026-01-17 20:30:30,369 - distributed.scheduler - INFO - Receive client connection: Client-5dae8d22-f3e3-11f0-8001-d684c398e257

2026-01-17 20:20:50,159 - distributed.scheduler - INFO - Close client connection: Client-f73a6a93-f3e1-11f0-8001-d684c398e257

2026-01-17 20:20:50,158 - distributed.scheduler - INFO - Remove client Client-f73a6a93-f3e1-11f0-8001-d684c398e257

2026-01-17 20:20:50,156 - distributed.scheduler - INFO - Remove client Client-f73a6a93-f3e1-11f0-8001-d684c398e257

2026-01-17 20:20:28,977 - distributed.scheduler - INFO - Receive client connection: Client-f73a6a93-f3e1-11f0-8001-d684c398e257

2026-01-17 20:10:48,758 - distributed.scheduler - INFO - Close client connection: Client-90b92afc-f3e0-11f0-8001-d684c398e257

2026-01-17 20:10:48,757 - distributed.scheduler - INFO - Remove client Client-90b92afc-f3e0-11f0-8001-d684c398e257

2026-01-17 20:10:48,756 - distributed.scheduler - INFO - Remove client Client-90b92afc-f3e0-11f0-8001-d684c398e257

2026-01-17 20:10:27,528 - distributed.scheduler - INFO - Receive client connection: Client-90b92afc-f3e0-11f0-8001-d684c398e257

2026-01-17 20:01:10,341 - distributed.scheduler - INFO - Close client connection: Client-2975c2a5-f3d1-11f0-8001-d684c398e257

2026-01-17 20:01:10,341 - distributed.scheduler - INFO - Close client connection: Client-f65934a8-f3d3-11f0-8001-d684c398e257

2026-01-17 20:01:10,341 - distributed.scheduler - INFO - Close client connection: Client-8fec10d0-f3d2-11f0-8001-d684c398e257

2026-01-17 20:01:10,341 - distributed.scheduler - INFO - Close client connection: Client-5cd16932-f3d5-11f0-8001-d684c398e257

2026-01-17 20:01:10,340 - distributed.scheduler - INFO - Close client connection: Client-c3410278-f3d6-11f0-8001-d684c398e257

2026-01-17 20:01:10,340 - distributed.scheduler - INFO - Close client connection: Client-904463fc-f3d9-11f0-8001-d684c398e257

2026-01-17 20:01:10,340 - distributed.scheduler - INFO - Close client connection: Client-f6ce8e6e-f3da-11f0-8001-d684c398e257

2026-01-17 20:01:10,340 - distributed.scheduler - INFO - Close client connection: Client-29c6f547-f3d8-11f0-8001-d684c398e257

2026-01-17 20:01:10,340 - distributed.scheduler - INFO - Close client connection: Client-5d36b0f7-f3dc-11f0-8001-d684c398e257

2026-01-17 20:01:10,339 - distributed.scheduler - INFO - Close client connection: Client-c3c0d3be-f3dd-11f0-8001-d684c398e257

2026-01-17 20:01:10,338 - distributed.scheduler - INFO - Remove client Client-2975c2a5-f3d1-11f0-8001-d684c398e257

2026-01-17 20:01:10,337 - distributed.scheduler - INFO - Remove client Client-f65934a8-f3d3-11f0-8001-d684c398e257

2026-01-17 20:01:10,337 - distributed.scheduler - INFO - Remove client Client-8fec10d0-f3d2-11f0-8001-d684c398e257

2026-01-17 20:01:10,336 - distributed.scheduler - INFO - Remove client Client-5cd16932-f3d5-11f0-8001-d684c398e257

2026-01-17 20:01:10,335 - distributed.scheduler - INFO - Remove client Client-c3410278-f3d6-11f0-8001-d684c398e257

2026-01-17 20:01:10,335 - distributed.scheduler - INFO - Remove client Client-904463fc-f3d9-11f0-8001-d684c398e257

2026-01-17 20:01:10,334 - distributed.scheduler - INFO - Remove client Client-f6ce8e6e-f3da-11f0-8001-d684c398e257

2026-01-17 20:01:10,333 - distributed.scheduler - INFO - Remove client Client-29c6f547-f3d8-11f0-8001-d684c398e257

2026-01-17 20:01:10,332 - distributed.scheduler - INFO - Remove client Client-5d36b0f7-f3dc-11f0-8001-d684c398e257

2026-01-17 20:01:10,331 - distributed.scheduler - INFO - Remove client Client-c3c0d3be-f3dd-11f0-8001-d684c398e257

2026-01-17 20:01:09,812 - distributed.scheduler - INFO - Close client connection: Client-2a4441d4-f3df-11f0-8001-d684c398e257

2026-01-17 20:01:09,811 - distributed.scheduler - INFO - Remove client Client-2a4441d4-f3df-11f0-8001-d684c398e257

2026-01-17 20:01:09,809 - distributed.scheduler - INFO - Remove client Client-2a4441d4-f3df-11f0-8001-d684c398e257

2026-01-17 20:00:28,548 - distributed.scheduler - ERROR - Shut down workers that don't have promised key: [], ('len-agg-2dcab7fb2175df276e4108b2c8c0c621', 0) NoneType: None

2026-01-17 20:00:28,547 - distributed.scheduler - ERROR - Couldn't gather keys {"('len-agg-2dcab7fb2175df276e4108b2c8c0c621', 0)": []} state: ['waiting'] workers: [] NoneType: None

2026-01-17 20:00:26,108 - distributed.scheduler - INFO - Receive client connection: Client-2a4441d4-f3df-11f0-8001-d684c398e257

2026-01-17 19:50:24,619 - distributed.scheduler - INFO - Receive client connection: Client-c3c0d3be-f3dd-11f0-8001-d684c398e257

2026-01-17 19:40:23,104 - distributed.scheduler - INFO - Receive client connection: Client-5d36b0f7-f3dc-11f0-8001-d684c398e257

2026-01-17 19:30:21,786 - distributed.scheduler - INFO - Receive client connection: Client-f6ce8e6e-f3da-11f0-8001-d684c398e257

2026-01-17 19:20:20,302 - distributed.scheduler - INFO - Receive client connection: Client-904463fc-f3d9-11f0-8001-d684c398e257

2026-01-17 19:10:18,806 - distributed.scheduler - INFO - Receive client connection: Client-29c6f547-f3d8-11f0-8001-d684c398e257

2026-01-17 19:00:17,309 - distributed.scheduler - INFO - Receive client connection: Client-c3410278-f3d6-11f0-8001-d684c398e257

2026-01-17 18:50:15,954 - distributed.scheduler - INFO - Receive client connection: Client-5cd16932-f3d5-11f0-8001-d684c398e257

2026-01-17 18:40:14,536 - distributed.scheduler - INFO - Receive client connection: Client-f65934a8-f3d3-11f0-8001-d684c398e257

2026-01-17 18:30:13,192 - distributed.scheduler - INFO - Receive client connection: Client-8fec10d0-f3d2-11f0-8001-d684c398e257

2026-01-17 18:20:11,807 - distributed.scheduler - INFO - Receive client connection: Client-2975c2a5-f3d1-11f0-8001-d684c398e257

2026-01-17 18:10:40,609 - distributed.scheduler - INFO - Close client connection: Client-c2ea1ae6-f3cf-11f0-8001-d684c398e257

2026-01-17 18:10:40,607 - distributed.scheduler - INFO - Remove client Client-c2ea1ae6-f3cf-11f0-8001-d684c398e257

2026-01-17 18:10:40,605 - distributed.scheduler - INFO - Remove client Client-c2ea1ae6-f3cf-11f0-8001-d684c398e257

2026-01-17 18:10:10,294 - distributed.scheduler - INFO - Receive client connection: Client-c2ea1ae6-f3cf-11f0-8001-d684c398e257

2026-01-17 18:01:03,827 - distributed.scheduler - INFO - Close client connection: Client-5c642fd1-f3ce-11f0-8001-d684c398e257

2026-01-17 18:01:03,826 - distributed.scheduler - INFO - Remove client Client-5c642fd1-f3ce-11f0-8001-d684c398e257

2026-01-17 18:01:03,825 - distributed.scheduler - INFO - Remove client Client-5c642fd1-f3ce-11f0-8001-d684c398e257

2026-01-17 18:00:08,765 - distributed.scheduler - INFO - Receive client connection: Client-5c642fd1-f3ce-11f0-8001-d684c398e257

2026-01-17 17:50:36,973 - distributed.scheduler - INFO - Close client connection: Client-f5ebc951-f3cc-11f0-8001-d684c398e257

2026-01-17 17:50:36,972 - distributed.scheduler - INFO - Remove client Client-f5ebc951-f3cc-11f0-8001-d684c398e257

2026-01-17 17:50:36,970 - distributed.scheduler - INFO - Remove client Client-f5ebc951-f3cc-11f0-8001-d684c398e257

2026-01-17 17:50:07,350 - distributed.scheduler - INFO - Receive client connection: Client-f5ebc951-f3cc-11f0-8001-d684c398e257

2026-01-17 17:40:37,732 - distributed.scheduler - INFO - Close client connection: Client-8f63864a-f3cb-11f0-8001-d684c398e257

2026-01-17 17:40:37,731 - distributed.scheduler - INFO - Remove client Client-8f63864a-f3cb-11f0-8001-d684c398e257

2026-01-17 17:40:37,729 - distributed.scheduler - INFO - Remove client Client-8f63864a-f3cb-11f0-8001-d684c398e257

2026-01-17 17:40:05,824 - distributed.scheduler - INFO - Receive client connection: Client-8f63864a-f3cb-11f0-8001-d684c398e257

2026-01-17 17:30:54,356 - distributed.scheduler - INFO - Close client connection: Client-28e18fc6-f3ca-11f0-8001-d684c398e257

2026-01-17 17:30:54,354 - distributed.scheduler - INFO - Remove client Client-28e18fc6-f3ca-11f0-8001-d684c398e257

2026-01-17 17:30:54,352 - distributed.scheduler - INFO - Remove client Client-28e18fc6-f3ca-11f0-8001-d684c398e257

2026-01-17 17:30:04,361 - distributed.scheduler - INFO - Receive client connection: Client-28e18fc6-f3ca-11f0-8001-d684c398e257

2026-01-17 17:20:34,628 - distributed.scheduler - INFO - Close client connection: Client-7f3a7b27-f3c0-11f0-8001-d684c398e257

2026-01-17 17:20:34,628 - distributed.scheduler - INFO - Close client connection: Client-e5baaa94-f3c1-11f0-8001-d684c398e257

2026-01-17 17:20:34,628 - distributed.scheduler - INFO - Close client connection: Client-4c4a0831-f3c3-11f0-8001-d684c398e257

2026-01-17 17:20:34,628 - distributed.scheduler - INFO - Close client connection: Client-b2c5743d-f3c4-11f0-8001-d684c398e257

2026-01-17 17:20:34,628 - distributed.scheduler - INFO - Close client connection: Client-193b46c8-f3c6-11f0-8001-d684c398e257

2026-01-17 17:20:34,628 - distributed.scheduler - INFO - Close client connection: Client-5be5cd2f-f3c7-11f0-8001-d684c398e257

2026-01-17 17:20:34,627 - distributed.scheduler - INFO - Remove client Client-7f3a7b27-f3c0-11f0-8001-d684c398e257

2026-01-17 17:20:34,627 - distributed.scheduler - INFO - Remove client Client-e5baaa94-f3c1-11f0-8001-d684c398e257

2026-01-17 17:20:34,626 - distributed.scheduler - INFO - Remove client Client-4c4a0831-f3c3-11f0-8001-d684c398e257

2026-01-17 17:20:34,625 - distributed.scheduler - INFO - Remove client Client-b2c5743d-f3c4-11f0-8001-d684c398e257

2026-01-17 17:20:34,625 - distributed.scheduler - INFO - Remove client Client-193b46c8-f3c6-11f0-8001-d684c398e257

2026-01-17 17:20:34,625 - distributed.scheduler - INFO - Remove client Client-5be5cd2f-f3c7-11f0-8001-d684c398e257

2026-01-17 17:20:33,818 - distributed.scheduler - INFO - Close client connection: Client-c26a8e0a-f3c8-11f0-8001-d684c398e257

2026-01-17 17:20:33,818 - distributed.scheduler - INFO - Remove client Client-c26a8e0a-f3c8-11f0-8001-d684c398e257

2026-01-17 17:20:33,816 - distributed.scheduler - INFO - Remove client Client-c26a8e0a-f3c8-11f0-8001-d684c398e257

2026-01-17 17:20:02,951 - distributed.scheduler - INFO - Receive client connection: Client-c26a8e0a-f3c8-11f0-8001-d684c398e257

2026-01-17 17:10:01,451 - distributed.scheduler - INFO - Receive client connection: Client-5be5cd2f-f3c7-11f0-8001-d684c398e257

2026-01-17 17:01:00,110 - distributed.scheduler - INFO - Receive client connection: Client-193b46c8-f3c6-11f0-8001-d684c398e257

2026-01-17 16:50:58,712 - distributed.scheduler - INFO - Receive client connection: Client-b2c5743d-f3c4-11f0-8001-d684c398e257

2026-01-17 16:40:57,284 - distributed.scheduler - INFO - Receive client connection: Client-4c4a0831-f3c3-11f0-8001-d684c398e257

2026-01-17 16:30:55,716 - distributed.scheduler - INFO - Receive client connection: Client-e5baaa94-f3c1-11f0-8001-d684c398e257

2026-01-17 16:20:54,259 - distributed.scheduler - INFO - Receive client connection: Client-7f3a7b27-f3c0-11f0-8001-d684c398e257

2026-01-17 16:11:26,721 - distributed.scheduler - INFO - Close client connection: Client-18b364d9-f3bf-11f0-8001-d684c398e257

2026-01-17 16:11:26,721 - distributed.scheduler - INFO - Remove client Client-18b364d9-f3bf-11f0-8001-d684c398e257

2026-01-17 16:11:26,719 - distributed.scheduler - INFO - Remove client Client-18b364d9-f3bf-11f0-8001-d684c398e257

2026-01-17 16:10:52,751 - distributed.scheduler - INFO - Receive client connection: Client-18b364d9-f3bf-11f0-8001-d684c398e257

2026-01-17 16:01:49,170 - distributed.scheduler - INFO - Close client connection: Client-b250fcd9-f3bd-11f0-8001-d684c398e257

2026-01-17 16:01:49,168 - distributed.scheduler - INFO - Remove client Client-b250fcd9-f3bd-11f0-8001-d684c398e257

2026-01-17 16:01:49,166 - distributed.scheduler - INFO - Remove client Client-b250fcd9-f3bd-11f0-8001-d684c398e257

2026-01-17 16:00:51,491 - distributed.scheduler - INFO - Receive client connection: Client-b250fcd9-f3bd-11f0-8001-d684c398e257

2026-01-17 15:51:24,264 - distributed.scheduler - INFO - Close client connection: Client-4bc3ff4a-f3bc-11f0-8001-d684c398e257

2026-01-17 15:51:24,263 - distributed.scheduler - INFO - Remove client Client-4bc3ff4a-f3bc-11f0-8001-d684c398e257

2026-01-17 15:51:24,261 - distributed.scheduler - INFO - Remove client Client-4bc3ff4a-f3bc-11f0-8001-d684c398e257

2026-01-17 15:50:49,932 - distributed.scheduler - INFO - Receive client connection: Client-4bc3ff4a-f3bc-11f0-8001-d684c398e257

2026-01-17 15:41:21,572 - distributed.scheduler - INFO - Close client connection: Client-e53d2bab-f3ba-11f0-8001-d684c398e257

2026-01-17 15:41:21,569 - distributed.scheduler - INFO - Remove client Client-e53d2bab-f3ba-11f0-8001-d684c398e257

2026-01-17 15:41:21,568 - distributed.scheduler - INFO - Remove client Client-e53d2bab-f3ba-11f0-8001-d684c398e257

2026-01-17 15:40:48,419 - distributed.scheduler - INFO - Receive client connection: Client-e53d2bab-f3ba-11f0-8001-d684c398e257

2026-01-17 15:31:47,296 - distributed.scheduler - INFO - Close client connection: Client-7ec39bf7-f3b9-11f0-8001-d684c398e257

2026-01-17 15:31:47,295 - distributed.scheduler - INFO - Remove client Client-7ec39bf7-f3b9-11f0-8001-d684c398e257

2026-01-17 15:31:47,293 - distributed.scheduler - INFO - Remove client Client-7ec39bf7-f3b9-11f0-8001-d684c398e257

2026-01-17 15:30:47,007 - distributed.scheduler - INFO - Receive client connection: Client-7ec39bf7-f3b9-11f0-8001-d684c398e257

2026-01-17 15:21:18,367 - distributed.scheduler - INFO - Close client connection: Client-4b560c0b-f3b5-11f0-8001-d684c398e257

2026-01-17 15:21:18,367 - distributed.scheduler - INFO - Close client connection: Client-b1cd07f4-f3b6-11f0-8001-d684c398e257

2026-01-17 15:21:18,366 - distributed.scheduler - INFO - Remove client Client-4b560c0b-f3b5-11f0-8001-d684c398e257

2026-01-17 15:21:18,365 - distributed.scheduler - INFO - Remove client Client-b1cd07f4-f3b6-11f0-8001-d684c398e257

2026-01-17 15:21:17,535 - distributed.scheduler - INFO - Close client connection: Client-184354cb-f3b8-11f0-8001-d684c398e257

2026-01-17 15:21:17,534 - distributed.scheduler - INFO - Remove client Client-184354cb-f3b8-11f0-8001-d684c398e257

2026-01-17 15:21:17,532 - distributed.scheduler - INFO - Remove client Client-184354cb-f3b8-11f0-8001-d684c398e257

2026-01-17 15:20:45,532 - distributed.scheduler - INFO - Receive client connection: Client-184354cb-f3b8-11f0-8001-d684c398e257

2026-01-17 15:10:44,126 - distributed.scheduler - INFO - Receive client connection: Client-b1cd07f4-f3b6-11f0-8001-d684c398e257

2026-01-17 15:00:42,727 - distributed.scheduler - INFO - Receive client connection: Client-4b560c0b-f3b5-11f0-8001-d684c398e257

2026-01-17 14:51:12,014 - distributed.scheduler - INFO - Close client connection: Client-e4e277e8-f3b3-11f0-8001-d684c398e257

2026-01-17 14:51:12,013 - distributed.scheduler - INFO - Remove client Client-e4e277e8-f3b3-11f0-8001-d684c398e257

2026-01-17 14:51:12,011 - distributed.scheduler - INFO - Remove client Client-e4e277e8-f3b3-11f0-8001-d684c398e257

2026-01-17 14:50:41,351 - distributed.scheduler - INFO - Receive client connection: Client-e4e277e8-f3b3-11f0-8001-d684c398e257

2026-01-17 14:41:12,216 - distributed.scheduler - INFO - Close client connection: Client-7e570699-f3b2-11f0-8001-d684c398e257

2026-01-17 14:41:12,215 - distributed.scheduler - INFO - Remove client Client-7e570699-f3b2-11f0-8001-d684c398e257

2026-01-17 14:41:12,213 - distributed.scheduler - INFO - Remove client Client-7e570699-f3b2-11f0-8001-d684c398e257

2026-01-17 14:40:39,811 - distributed.scheduler - INFO - Receive client connection: Client-7e570699-f3b2-11f0-8001-d684c398e257

2026-01-17 14:31:31,660 - distributed.scheduler - INFO - Close client connection: Client-17cbd038-f3b1-11f0-8001-d684c398e257

2026-01-17 14:31:31,658 - distributed.scheduler - INFO - Remove client Client-17cbd038-f3b1-11f0-8001-d684c398e257

2026-01-17 14:31:31,657 - distributed.scheduler - INFO - Remove client Client-17cbd038-f3b1-11f0-8001-d684c398e257

2026-01-17 14:30:38,273 - distributed.scheduler - INFO - Receive client connection: Client-17cbd038-f3b1-11f0-8001-d684c398e257

2026-01-17 14:21:13,181 - distributed.scheduler - INFO - Close client connection: Client-b14e8a87-f3af-11f0-8001-d684c398e257

2026-01-17 14:21:13,180 - distributed.scheduler - INFO - Remove client Client-b14e8a87-f3af-11f0-8001-d684c398e257

2026-01-17 14:21:13,178 - distributed.scheduler - INFO - Remove client Client-b14e8a87-f3af-11f0-8001-d684c398e257

2026-01-17 14:20:36,831 - distributed.scheduler - INFO - Receive client connection: Client-b14e8a87-f3af-11f0-8001-d684c398e257

2026-01-17 14:11:08,655 - distributed.scheduler - INFO - Close client connection: Client-4ac661f0-f3ae-11f0-8001-d684c398e257

2026-01-17 14:11:08,654 - distributed.scheduler - INFO - Remove client Client-4ac661f0-f3ae-11f0-8001-d684c398e257

2026-01-17 14:11:08,652 - distributed.scheduler - INFO - Remove client Client-4ac661f0-f3ae-11f0-8001-d684c398e257

2026-01-17 14:10:35,319 - distributed.scheduler - INFO - Receive client connection: Client-4ac661f0-f3ae-11f0-8001-d684c398e257

2026-01-17 14:01:35,633 - distributed.scheduler - INFO - Close client connection: Client-b0be8778-f3a8-11f0-8001-d684c398e257

2026-01-17 14:01:35,633 - distributed.scheduler - INFO - Close client connection: Client-1749834b-f3aa-11f0-8001-d684c398e257

2026-01-17 14:01:35,633 - distributed.scheduler - INFO - Close client connection: Client-7dc54ba3-f3ab-11f0-8001-d684c398e257

2026-01-17 14:01:35,632 - distributed.scheduler - INFO - Remove client Client-b0be8778-f3a8-11f0-8001-d684c398e257

2026-01-17 14:01:35,632 - distributed.scheduler - INFO - Remove client Client-1749834b-f3aa-11f0-8001-d684c398e257

2026-01-17 14:01:35,631 - distributed.scheduler - INFO - Remove client Client-7dc54ba3-f3ab-11f0-8001-d684c398e257

2026-01-17 14:01:35,152 - distributed.scheduler - INFO - Close client connection: Client-e44973f0-f3ac-11f0-8001-d684c398e257

2026-01-17 14:01:35,150 - distributed.scheduler - INFO - Remove client Client-e44973f0-f3ac-11f0-8001-d684c398e257

2026-01-17 14:01:35,149 - distributed.scheduler - INFO - Remove client Client-e44973f0-f3ac-11f0-8001-d684c398e257

2026-01-17 14:00:33,864 - distributed.scheduler - INFO - Receive client connection: Client-e44973f0-f3ac-11f0-8001-d684c398e257

2026-01-17 13:50:32,373 - distributed.scheduler - INFO - Receive client connection: Client-7dc54ba3-f3ab-11f0-8001-d684c398e257

2026-01-17 13:40:30,952 - distributed.scheduler - INFO - Receive client connection: Client-1749834b-f3aa-11f0-8001-d684c398e257

2026-01-17 13:30:29,408 - distributed.scheduler - INFO - Receive client connection: Client-b0be8778-f3a8-11f0-8001-d684c398e257

2026-01-17 13:20:58,290 - distributed.scheduler - INFO - Close client connection: Client-4a37c7eb-f3a7-11f0-8001-d684c398e257

2026-01-17 13:20:58,288 - distributed.scheduler - INFO - Remove client Client-4a37c7eb-f3a7-11f0-8001-d684c398e257

2026-01-17 13:20:58,286 - distributed.scheduler - INFO - Remove client Client-4a37c7eb-f3a7-11f0-8001-d684c398e257

2026-01-17 13:20:27,903 - distributed.scheduler - INFO - Receive client connection: Client-4a37c7eb-f3a7-11f0-8001-d684c398e257

2026-01-17 13:10:57,432 - distributed.scheduler - INFO - Close client connection: Client-e3aa7f33-f3a5-11f0-8001-d684c398e257

2026-01-17 13:10:57,431 - distributed.scheduler - INFO - Remove client Client-e3aa7f33-f3a5-11f0-8001-d684c398e257

2026-01-17 13:10:57,429 - distributed.scheduler - INFO - Remove client Client-e3aa7f33-f3a5-11f0-8001-d684c398e257

2026-01-17 13:10:26,375 - distributed.scheduler - INFO - Receive client connection: Client-e3aa7f33-f3a5-11f0-8001-d684c398e257

2026-01-17 13:01:14,258 - distributed.scheduler - INFO - Close client connection: Client-7d298774-f3a4-11f0-8001-d684c398e257

2026-01-17 13:01:14,257 - distributed.scheduler - INFO - Remove client Client-7d298774-f3a4-11f0-8001-d684c398e257

2026-01-17 13:01:14,255 - distributed.scheduler - INFO - Remove client Client-7d298774-f3a4-11f0-8001-d684c398e257

2026-01-17 13:00:24,880 - distributed.scheduler - INFO - Receive client connection: Client-7d298774-f3a4-11f0-8001-d684c398e257

2026-01-17 12:50:59,932 - distributed.scheduler - INFO - Close client connection: Client-16acc0d7-f3a3-11f0-8001-d684c398e257

2026-01-17 12:50:59,930 - distributed.scheduler - INFO - Remove client Client-16acc0d7-f3a3-11f0-8001-d684c398e257

2026-01-17 12:50:59,929 - distributed.scheduler - INFO - Remove client Client-16acc0d7-f3a3-11f0-8001-d684c398e257

2026-01-17 12:50:23,449 - distributed.scheduler - INFO - Receive client connection: Client-16acc0d7-f3a3-11f0-8001-d684c398e257

2026-01-17 12:40:57,156 - distributed.scheduler - INFO - Close client connection: Client-b028fb07-f3a1-11f0-8001-d684c398e257

2026-01-17 12:40:57,155 - distributed.scheduler - INFO - Remove client Client-b028fb07-f3a1-11f0-8001-d684c398e257

2026-01-17 12:40:57,153 - distributed.scheduler - INFO - Remove client Client-b028fb07-f3a1-11f0-8001-d684c398e257

2026-01-17 12:40:21,954 - distributed.scheduler - INFO - Receive client connection: Client-b028fb07-f3a1-11f0-8001-d684c398e257

2026-01-17 12:31:14,507 - distributed.scheduler - INFO - Close client connection: Client-7c384cc7-f396-11f0-8001-d684c398e257

2026-01-17 12:31:14,507 - distributed.scheduler - INFO - Close client connection: Client-e2bfa0ab-f397-11f0-8001-d684c398e257

2026-01-17 12:31:14,506 - distributed.scheduler - INFO - Close client connection: Client-4949674d-f399-11f0-8001-d684c398e257

2026-01-17 12:31:14,506 - distributed.scheduler - INFO - Close client connection: Client-afae6b5f-f39a-11f0-8001-d684c398e257

2026-01-17 12:31:14,506 - distributed.scheduler - INFO - Close client connection: Client-7ca28482-f39d-11f0-8001-d684c398e257

2026-01-17 12:31:14,506 - distributed.scheduler - INFO - Close client connection: Client-1634032c-f39c-11f0-8001-d684c398e257

2026-01-17 12:31:14,505 - distributed.scheduler - INFO - Close client connection: Client-e313152d-f39e-11f0-8001-d684c398e257

2026-01-17 12:31:14,503 - distributed.scheduler - INFO - Remove client Client-7c384cc7-f396-11f0-8001-d684c398e257

2026-01-17 12:31:14,502 - distributed.scheduler - INFO - Remove client Client-e2bfa0ab-f397-11f0-8001-d684c398e257

2026-01-17 12:31:14,501 - distributed.scheduler - INFO - Remove client Client-4949674d-f399-11f0-8001-d684c398e257

2026-01-17 12:31:14,500 - distributed.scheduler - INFO - Remove client Client-afae6b5f-f39a-11f0-8001-d684c398e257

2026-01-17 12:31:14,499 - distributed.scheduler - INFO - Remove client Client-7ca28482-f39d-11f0-8001-d684c398e257

2026-01-17 12:31:14,498 - distributed.scheduler - INFO - Remove client Client-1634032c-f39c-11f0-8001-d684c398e257

2026-01-17 12:31:14,493 - distributed.scheduler - INFO - Remove client Client-e313152d-f39e-11f0-8001-d684c398e257

2026-01-17 12:31:13,711 - distributed.scheduler - INFO - Close client connection: Client-49983dc1-f3a0-11f0-8001-d684c398e257

2026-01-17 12:31:13,710 - distributed.scheduler - INFO - Remove client Client-49983dc1-f3a0-11f0-8001-d684c398e257

2026-01-17 12:31:13,708 - distributed.scheduler - INFO - Remove client Client-49983dc1-f3a0-11f0-8001-d684c398e257

2026-01-17 12:30:20,383 - distributed.scheduler - INFO - Receive client connection: Client-49983dc1-f3a0-11f0-8001-d684c398e257

2026-01-17 12:20:18,878 - distributed.scheduler - INFO - Receive client connection: Client-e313152d-f39e-11f0-8001-d684c398e257

2026-01-17 12:10:17,511 - distributed.scheduler - INFO - Receive client connection: Client-7ca28482-f39d-11f0-8001-d684c398e257

2026-01-17 12:00:16,163 - distributed.scheduler - INFO - Receive client connection: Client-1634032c-f39c-11f0-8001-d684c398e257

2026-01-17 11:50:14,662 - distributed.scheduler - INFO - Receive client connection: Client-afae6b5f-f39a-11f0-8001-d684c398e257

2026-01-17 11:40:13,367 - distributed.scheduler - INFO - Receive client connection: Client-4949674d-f399-11f0-8001-d684c398e257

2026-01-17 11:30:11,850 - distributed.scheduler - INFO - Receive client connection: Client-e2bfa0ab-f397-11f0-8001-d684c398e257

2026-01-17 11:20:10,350 - distributed.scheduler - INFO - Receive client connection: Client-7c384cc7-f396-11f0-8001-d684c398e257

2026-01-17 11:10:42,319 - distributed.scheduler - INFO - Close client connection: Client-15b92701-f395-11f0-8001-d684c398e257

2026-01-17 11:10:42,318 - distributed.scheduler - INFO - Remove client Client-15b92701-f395-11f0-8001-d684c398e257

2026-01-17 11:10:42,316 - distributed.scheduler - INFO - Remove client Client-15b92701-f395-11f0-8001-d684c398e257

2026-01-17 11:10:08,891 - distributed.scheduler - INFO - Receive client connection: Client-15b92701-f395-11f0-8001-d684c398e257

2026-01-17 11:01:01,798 - distributed.scheduler - INFO - Close client connection: Client-af36a096-f393-11f0-8001-d684c398e257

2026-01-17 11:01:01,797 - distributed.scheduler - INFO - Remove client Client-af36a096-f393-11f0-8001-d684c398e257

2026-01-17 11:01:01,795 - distributed.scheduler - INFO - Remove client Client-af36a096-f393-11f0-8001-d684c398e257

2026-01-17 11:00:07,413 - distributed.scheduler - INFO - Receive client connection: Client-af36a096-f393-11f0-8001-d684c398e257

2026-01-17 10:50:39,058 - distributed.scheduler - INFO - Close client connection: Client-48ad5d35-f392-11f0-8001-d684c398e257

2026-01-17 10:50:39,057 - distributed.scheduler - INFO - Remove client Client-48ad5d35-f392-11f0-8001-d684c398e257

2026-01-17 10:50:39,055 - distributed.scheduler - INFO - Remove client Client-48ad5d35-f392-11f0-8001-d684c398e257

2026-01-17 10:50:05,886 - distributed.scheduler - INFO - Receive client connection: Client-48ad5d35-f392-11f0-8001-d684c398e257

2026-01-17 10:40:36,933 - distributed.scheduler - INFO - Close client connection: Client-e2348488-f390-11f0-8001-d684c398e257

2026-01-17 10:40:36,930 - distributed.scheduler - INFO - Remove client Client-e2348488-f390-11f0-8001-d684c398e257

2026-01-17 10:40:36,929 - distributed.scheduler - INFO - Remove client Client-e2348488-f390-11f0-8001-d684c398e257

2026-01-17 10:40:04,470 - distributed.scheduler - INFO - Receive client connection: Client-e2348488-f390-11f0-8001-d684c398e257

2026-01-17 10:30:57,300 - distributed.scheduler - INFO - Close client connection: Client-7bb7686f-f38f-11f0-8001-d684c398e257

2026-01-17 10:30:57,298 - distributed.scheduler - INFO - Remove client Client-7bb7686f-f38f-11f0-8001-d684c398e257

2026-01-17 10:30:57,297 - distributed.scheduler - INFO - Remove client Client-7bb7686f-f38f-11f0-8001-d684c398e257

2026-01-17 10:30:03,028 - distributed.scheduler - INFO - Receive client connection: Client-7bb7686f-f38f-11f0-8001-d684c398e257

2026-01-17 10:20:38,660 - distributed.scheduler - INFO - Close client connection: Client-1536e093-f38e-11f0-8001-d684c398e257

2026-01-17 10:20:38,659 - distributed.scheduler - INFO - Remove client Client-1536e093-f38e-11f0-8001-d684c398e257

2026-01-17 10:20:38,658 - distributed.scheduler - INFO - Remove client Client-1536e093-f38e-11f0-8001-d684c398e257

2026-01-17 10:20:01,548 - distributed.scheduler - INFO - Receive client connection: Client-1536e093-f38e-11f0-8001-d684c398e257

2026-01-17 10:10:33,600 - distributed.scheduler - INFO - Close client connection: Client-aeb658ca-f38c-11f0-8001-d684c398e257

2026-01-17 10:10:33,598 - distributed.scheduler - INFO - Remove client Client-aeb658ca-f38c-11f0-8001-d684c398e257

2026-01-17 10:10:33,596 - distributed.scheduler - INFO - Remove client Client-aeb658ca-f38c-11f0-8001-d684c398e257

2026-01-17 10:10:00,094 - distributed.scheduler - INFO - Receive client connection: Client-aeb658ca-f38c-11f0-8001-d684c398e257

2026-01-17 10:01:48,922 - distributed.scheduler - INFO - Close client connection: Client-6bfd4bbc-f38b-11f0-8001-d684c398e257

2026-01-17 10:01:48,920 - distributed.scheduler - INFO - Remove client Client-6bfd4bbc-f38b-11f0-8001-d684c398e257

2026-01-17 10:01:48,918 - distributed.scheduler - INFO - Remove client Client-6bfd4bbc-f38b-11f0-8001-d684c398e257

2026-01-17 10:00:58,657 - distributed.scheduler - INFO - Receive client connection: Client-6bfd4bbc-f38b-11f0-8001-d684c398e257

2026-01-17 09:51:28,029 - distributed.scheduler - INFO - Close client connection: Client-058027c1-f38a-11f0-8001-d684c398e257

2026-01-17 09:51:28,026 - distributed.scheduler - INFO - Remove client Client-058027c1-f38a-11f0-8001-d684c398e257

2026-01-17 09:51:28,024 - distributed.scheduler - INFO - Remove client Client-058027c1-f38a-11f0-8001-d684c398e257

2026-01-17 09:50:57,211 - distributed.scheduler - INFO - Receive client connection: Client-058027c1-f38a-11f0-8001-d684c398e257

2026-01-17 09:41:26,642 - distributed.scheduler - INFO - Close client connection: Client-3873829c-f387-11f0-8001-d684c398e257

2026-01-17 09:41:26,641 - distributed.scheduler - INFO - Remove client Client-3873829c-f387-11f0-8001-d684c398e257

2026-01-17 09:41:26,118 - distributed.scheduler - INFO - Close client connection: Client-9ef5bc51-f388-11f0-8001-d684c398e257

2026-01-17 09:41:26,117 - distributed.scheduler - INFO - Remove client Client-9ef5bc51-f388-11f0-8001-d684c398e257

2026-01-17 09:41:26,115 - distributed.scheduler - INFO - Remove client Client-9ef5bc51-f388-11f0-8001-d684c398e257

2026-01-17 09:40:55,670 - distributed.scheduler - INFO - Receive client connection: Client-9ef5bc51-f388-11f0-8001-d684c398e257

2026-01-17 09:30:54,201 - distributed.scheduler - INFO - Receive client connection: Client-3873829c-f387-11f0-8001-d684c398e257

2026-01-17 09:21:23,505 - distributed.scheduler - INFO - Close client connection: Client-d1f88a48-f385-11f0-8001-d684c398e257

2026-01-17 09:21:23,504 - distributed.scheduler - INFO - Remove client Client-d1f88a48-f385-11f0-8001-d684c398e257

2026-01-17 09:21:23,502 - distributed.scheduler - INFO - Remove client Client-d1f88a48-f385-11f0-8001-d684c398e257

2026-01-17 09:20:52,770 - distributed.scheduler - INFO - Receive client connection: Client-d1f88a48-f385-11f0-8001-d684c398e257

2026-01-17 09:11:19,622 - distributed.scheduler - INFO - Close client connection: Client-6b77c674-f384-11f0-8001-d684c398e257

2026-01-17 09:11:19,621 - distributed.scheduler - INFO - Remove client Client-6b77c674-f384-11f0-8001-d684c398e257

2026-01-17 09:11:19,620 - distributed.scheduler - INFO - Remove client Client-6b77c674-f384-11f0-8001-d684c398e257

2026-01-17 09:10:51,309 - distributed.scheduler - INFO - Receive client connection: Client-6b77c674-f384-11f0-8001-d684c398e257

2026-01-17 09:01:36,464 - distributed.scheduler - INFO - Close client connection: Client-050396d1-f383-11f0-8001-d684c398e257

2026-01-17 09:01:36,462 - distributed.scheduler - INFO - Remove client Client-050396d1-f383-11f0-8001-d684c398e257

2026-01-17 09:01:36,460 - distributed.scheduler - INFO - Remove client Client-050396d1-f383-11f0-8001-d684c398e257

2026-01-17 09:00:49,917 - distributed.scheduler - INFO - Receive client connection: Client-050396d1-f383-11f0-8001-d684c398e257

2026-01-17 08:51:17,125 - distributed.scheduler - INFO - Close client connection: Client-9e805c42-f381-11f0-8001-d684c398e257

2026-01-17 08:51:17,124 - distributed.scheduler - INFO - Remove client Client-9e805c42-f381-11f0-8001-d684c398e257

2026-01-17 08:51:17,122 - distributed.scheduler - INFO - Remove client Client-9e805c42-f381-11f0-8001-d684c398e257

2026-01-17 08:50:48,431 - distributed.scheduler - INFO - Receive client connection: Client-9e805c42-f381-11f0-8001-d684c398e257

2026-01-17 08:41:15,379 - distributed.scheduler - INFO - Close client connection: Client-37ffc905-f380-11f0-8001-d684c398e257

2026-01-17 08:41:15,377 - distributed.scheduler - INFO - Remove client Client-37ffc905-f380-11f0-8001-d684c398e257

2026-01-17 08:41:15,376 - distributed.scheduler - INFO - Remove client Client-37ffc905-f380-11f0-8001-d684c398e257

2026-01-17 08:40:46,959 - distributed.scheduler - INFO - Receive client connection: Client-37ffc905-f380-11f0-8001-d684c398e257

2026-01-17 08:31:32,573 - distributed.scheduler - INFO - Close client connection: Client-01eb45e0-f359-11f0-8001-d684c398e257

2026-01-17 08:31:32,573 - distributed.scheduler - INFO - Close client connection: Client-68794788-f35a-11f0-8001-d684c398e257

2026-01-17 08:31:32,573 - distributed.scheduler - INFO - Close client connection: Client-358a2a48-f35d-11f0-8001-d684c398e257

2026-01-17 08:31:32,573 - distributed.scheduler - INFO - Close client connection: Client-cefff44a-f35b-11f0-8001-d684c398e257

2026-01-17 08:31:32,573 - distributed.scheduler - INFO - Close client connection: Client-028b2d08-f360-11f0-8001-d684c398e257

2026-01-17 08:31:32,573 - distributed.scheduler - INFO - Close client connection: Client-9c102952-f35e-11f0-8001-d684c398e257

2026-01-17 08:31:32,573 - distributed.scheduler - INFO - Close client connection: Client-690172b6-f361-11f0-8001-d684c398e257

2026-01-17 08:31:32,573 - distributed.scheduler - INFO - Close client connection: Client-cf734669-f362-11f0-8001-d684c398e257

2026-01-17 08:31:32,573 - distributed.scheduler - INFO - Close client connection: Client-35f13c29-f364-11f0-8001-d684c398e257

2026-01-17 08:31:32,572 - distributed.scheduler - INFO - Close client connection: Client-9c62725f-f365-11f0-8001-d684c398e257

2026-01-17 08:31:32,572 - distributed.scheduler - INFO - Close client connection: Client-02e498f4-f367-11f0-8001-d684c398e257

2026-01-17 08:31:32,572 - distributed.scheduler - INFO - Close client connection: Client-695e248f-f368-11f0-8001-d684c398e257

2026-01-17 08:31:32,572 - distributed.scheduler - INFO - Close client connection: Client-9cf5052b-f36c-11f0-8001-d684c398e257

2026-01-17 08:31:32,572 - distributed.scheduler - INFO - Close client connection: Client-69f0e475-f36f-11f0-8001-d684c398e257

2026-01-17 08:31:32,572 - distributed.scheduler - INFO - Close client connection: Client-cfcd2876-f369-11f0-8001-d684c398e257

2026-01-17 08:31:32,572 - distributed.scheduler - INFO - Close client connection: Client-36747db1-f36b-11f0-8001-d684c398e257

2026-01-17 08:31:32,572 - distributed.scheduler - INFO - Close client connection: Client-d07230cd-f370-11f0-8001-d684c398e257

2026-01-17 08:31:32,571 - distributed.scheduler - INFO - Close client connection: Client-36f0c1f7-f372-11f0-8001-d684c398e257

2026-01-17 08:31:32,571 - distributed.scheduler - INFO - Close client connection: Client-03fc7839-f375-11f0-8001-d684c398e257

2026-01-17 08:31:32,571 - distributed.scheduler - INFO - Close client connection: Client-03753e3c-f36e-11f0-8001-d684c398e257

2026-01-17 08:31:32,571 - distributed.scheduler - INFO - Close client connection: Client-6a79f771-f376-11f0-8001-d684c398e257

2026-01-17 08:31:32,571 - distributed.scheduler - INFO - Close client connection: Client-9d858526-f373-11f0-8001-d684c398e257

2026-01-17 08:31:32,571 - distributed.scheduler - INFO - Close client connection: Client-d10a8e50-f377-11f0-8001-d684c398e257

2026-01-17 08:31:32,568 - distributed.scheduler - INFO - Close client connection: Client-379661b1-f379-11f0-8001-d684c398e257

2026-01-17 08:31:32,568 - distributed.scheduler - INFO - Close client connection: Client-9e1af209-f37a-11f0-8001-d684c398e257

2026-01-17 08:31:32,568 - distributed.scheduler - INFO - Close client connection: Client-049b7afa-f37c-11f0-8001-d684c398e257

2026-01-17 08:31:32,568 - distributed.scheduler - INFO - Close client connection: Client-6b136739-f37d-11f0-8001-d684c398e257

2026-01-17 08:31:32,565 - distributed.scheduler - INFO - Remove client Client-01eb45e0-f359-11f0-8001-d684c398e257

2026-01-17 08:31:32,565 - distributed.scheduler - INFO - Remove client Client-68794788-f35a-11f0-8001-d684c398e257

2026-01-17 08:31:32,565 - distributed.scheduler - INFO - Remove client Client-358a2a48-f35d-11f0-8001-d684c398e257

2026-01-17 08:31:32,564 - distributed.scheduler - INFO - Remove client Client-cefff44a-f35b-11f0-8001-d684c398e257

2026-01-17 08:31:32,564 - distributed.scheduler - INFO - Remove client Client-028b2d08-f360-11f0-8001-d684c398e257

2026-01-17 08:31:32,564 - distributed.scheduler - INFO - Remove client Client-9c102952-f35e-11f0-8001-d684c398e257

2026-01-17 08:31:32,563 - distributed.scheduler - INFO - Remove client Client-690172b6-f361-11f0-8001-d684c398e257

2026-01-17 08:31:32,563 - distributed.scheduler - INFO - Remove client Client-cf734669-f362-11f0-8001-d684c398e257

2026-01-17 08:31:32,563 - distributed.scheduler - INFO - Remove client Client-35f13c29-f364-11f0-8001-d684c398e257

2026-01-17 08:31:32,562 - distributed.scheduler - INFO - Remove client Client-9c62725f-f365-11f0-8001-d684c398e257

2026-01-17 08:31:32,562 - distributed.scheduler - INFO - Remove client Client-02e498f4-f367-11f0-8001-d684c398e257

2026-01-17 08:31:32,562 - distributed.scheduler - INFO - Remove client Client-695e248f-f368-11f0-8001-d684c398e257

2026-01-17 08:31:32,561 - distributed.scheduler - INFO - Remove client Client-9cf5052b-f36c-11f0-8001-d684c398e257

2026-01-17 08:31:32,561 - distributed.scheduler - INFO - Remove client Client-69f0e475-f36f-11f0-8001-d684c398e257

2026-01-17 08:31:32,560 - distributed.scheduler - INFO - Remove client Client-cfcd2876-f369-11f0-8001-d684c398e257

2026-01-17 08:31:32,560 - distributed.scheduler - INFO - Remove client Client-36747db1-f36b-11f0-8001-d684c398e257

2026-01-17 08:31:32,559 - distributed.scheduler - INFO - Remove client Client-d07230cd-f370-11f0-8001-d684c398e257

2026-01-17 08:31:32,559 - distributed.scheduler - INFO - Remove client Client-36f0c1f7-f372-11f0-8001-d684c398e257

2026-01-17 08:31:32,558 - distributed.scheduler - INFO - Remove client Client-03fc7839-f375-11f0-8001-d684c398e257

2026-01-17 08:31:32,558 - distributed.scheduler - INFO - Remove client Client-03753e3c-f36e-11f0-8001-d684c398e257

2026-01-17 08:31:32,557 - distributed.scheduler - INFO - Remove client Client-6a79f771-f376-11f0-8001-d684c398e257

2026-01-17 08:31:32,556 - distributed.scheduler - INFO - Remove client Client-9d858526-f373-11f0-8001-d684c398e257

2026-01-17 08:31:32,556 - distributed.scheduler - INFO - Remove client Client-d10a8e50-f377-11f0-8001-d684c398e257

2026-01-17 08:31:32,546 - distributed.scheduler - INFO - Remove client Client-379661b1-f379-11f0-8001-d684c398e257

2026-01-17 08:31:32,546 - distributed.scheduler - INFO - Remove client Client-9e1af209-f37a-11f0-8001-d684c398e257

2026-01-17 08:31:32,545 - distributed.scheduler - INFO - Remove client Client-049b7afa-f37c-11f0-8001-d684c398e257

2026-01-17 08:31:32,539 - distributed.scheduler - INFO - Remove client Client-6b136739-f37d-11f0-8001-d684c398e257

2026-01-17 08:31:32,043 - distributed.scheduler - INFO - Close client connection: Client-d18c2c14-f37e-11f0-8001-d684c398e257

2026-01-17 08:31:32,041 - distributed.scheduler - INFO - Remove client Client-d18c2c14-f37e-11f0-8001-d684c398e257

2026-01-17 08:31:32,039 - distributed.scheduler - INFO - Remove client Client-d18c2c14-f37e-11f0-8001-d684c398e257

2026-01-17 08:30:45,576 - distributed.scheduler - INFO - Receive client connection: Client-d18c2c14-f37e-11f0-8001-d684c398e257

2026-01-17 08:20:44,162 - distributed.scheduler - INFO - Receive client connection: Client-6b136739-f37d-11f0-8001-d684c398e257

2026-01-17 08:10:42,750 - distributed.scheduler - INFO - Receive client connection: Client-049b7afa-f37c-11f0-8001-d684c398e257

2026-01-17 08:00:41,285 - distributed.scheduler - INFO - Receive client connection: Client-9e1af209-f37a-11f0-8001-d684c398e257

2026-01-17 07:50:39,793 - distributed.scheduler - INFO - Receive client connection: Client-379661b1-f379-11f0-8001-d684c398e257

2026-01-17 07:40:38,252 - distributed.scheduler - INFO - Receive client connection: Client-d10a8e50-f377-11f0-8001-d684c398e257

2026-01-17 07:30:38,916 - distributed.scheduler - INFO - Receive client connection: Client-worker-6bca13cf-f376-11f0-820a-2a3d63591f59

2026-01-17 07:30:36,677 - distributed.scheduler - INFO - Receive client connection: Client-6a79f771-f376-11f0-8001-d684c398e257

2026-01-17 07:20:35,231 - distributed.scheduler - INFO - Receive client connection: Client-03fc7839-f375-11f0-8001-d684c398e257

2026-01-17 07:10:33,827 - distributed.scheduler - INFO - Receive client connection: Client-9d858526-f373-11f0-8001-d684c398e257

2026-01-17 07:04:10,635 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:43889 failed: OSError: Timed out trying to connect to tcp://172.21.159.225:43889 after 30 s

2026-01-17 07:04:10,622 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:41381 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:43889 after 30 s')

2026-01-17 07:04:10,567 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:45097 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:43889 after 30 s')

2026-01-17 07:04:10,564 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:37283 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:43889 after 30 s')

2026-01-17 07:04:10,535 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:44341 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:43889 after 30 s')

2026-01-17 07:04:10,528 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:33329 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:43889 after 30 s')

2026-01-17 07:04:10,523 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:44951 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:43889 after 30 s')

2026-01-17 07:04:10,522 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:35235 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:43889 after 30 s')

2026-01-17 07:04:10,511 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:36567 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:43889 after 30 s')

2026-01-17 07:03:41,179 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.159.225:42711

2026-01-17 07:03:41,177 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.159.225:42711', status: running, memory: 0, processing: 0>

2026-01-17 07:03:40,382 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.159.225:43889', status: closed, memory: 0, processing: 0>

2026-01-17 07:03:30,483 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:37447 failed: OSError: Timed out trying to connect to tcp://172.21.159.225:37447 after 30 s

2026-01-17 07:03:30,452 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:41381 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:37447 after 30 s')

2026-01-17 07:03:30,399 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:37283 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:37447 after 30 s')

2026-01-17 07:03:30,369 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:44951 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:37447 after 30 s')

2026-01-17 07:03:30,356 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:36567 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:37447 after 30 s')

2026-01-17 07:03:30,352 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:33153 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:37447 after 30 s')

2026-01-17 07:03:30,349 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:33779 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:37447 after 30 s')

2026-01-17 07:03:30,343 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:33329 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:37447 after 30 s')

2026-01-17 07:03:30,333 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:44341 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:37447 after 30 s')

2026-01-17 07:03:01,006 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.159.225:43889

2026-01-17 07:03:01,004 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.159.225:43889', status: closed, memory: 0, processing: 0>

2026-01-17 07:03:00,205 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.159.225:37447', status: closed, memory: 0, processing: 0>

2026-01-17 07:02:52,409 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:36567 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:39779 after 30 s')

2026-01-17 07:02:51,946 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:39779 failed: OSError: Timed out trying to connect to tcp://172.21.159.225:39779 after 30 s

2026-01-17 07:02:51,938 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:41381 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:39779 after 30 s')

2026-01-17 07:02:51,879 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:37283 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:39779 after 30 s')

2026-01-17 07:02:51,877 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:33779 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:39779 after 30 s')

2026-01-17 07:02:51,876 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:35843 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:39779 after 30 s')

2026-01-17 07:02:51,855 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:35235 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:39779 after 30 s')

2026-01-17 07:02:51,854 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:44951 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:39779 after 30 s')

2026-01-17 07:02:51,845 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:45097 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:39779 after 30 s')

2026-01-17 07:02:51,843 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:38831 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:39779 after 30 s')

2026-01-17 07:02:51,834 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:44341 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:39779 after 30 s')

2026-01-17 07:02:22,625 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.159.225:37447

2026-01-17 07:02:22,622 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.159.225:37447', status: closed, memory: 0, processing: 0>

2026-01-17 07:02:21,702 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.159.225:39779', status: closed, memory: 0, processing: 0>

2026-01-17 07:02:05,022 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:44703 failed: OSError: Timed out trying to connect to tcp://172.21.159.225:44703 after 30 s

2026-01-17 07:02:04,994 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:33329 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:44703 after 30 s')

2026-01-17 07:02:04,967 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:41381 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:44703 after 30 s')

2026-01-17 07:02:04,960 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:32987 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:44703 after 30 s')

2026-01-17 07:02:04,939 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:33779 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:44703 after 30 s')

2026-01-17 07:02:04,938 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:36567 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:44703 after 30 s')

2026-01-17 07:02:04,929 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:33649 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:44703 after 30 s')

2026-01-17 07:02:04,923 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:37283 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:44703 after 30 s')

2026-01-17 07:02:04,922 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:35235 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:44703 after 30 s')

2026-01-17 07:02:04,914 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:38831 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:44703 after 30 s')

2026-01-17 07:01:35,615 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.159.225:39779

2026-01-17 07:01:35,612 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.159.225:39779', status: closed, memory: 0, processing: 0>

2026-01-17 07:01:34,814 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.159.225:44703', status: closed, memory: 0, processing: 0>

2026-01-17 07:01:28,475 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:32895 failed: OSError: Timed out trying to connect to tcp://172.21.159.225:32895 after 30 s

2026-01-17 07:01:28,181 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:41381 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:32895 after 30 s')

2026-01-17 07:01:27,277 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:32895 failed: OSError: Timed out trying to connect to tcp://172.21.159.225:32895 after 30 s

2026-01-17 07:01:27,175 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:33329 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:32895 after 30 s')

2026-01-17 07:01:26,994 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:35235 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:32895 after 30 s')

2026-01-17 07:01:26,798 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:33779 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:32895 after 30 s')

2026-01-17 07:01:26,502 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:35843 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:32895 after 30 s')

2026-01-17 07:01:26,402 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:35843 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.159.225:32895 after 30 s')

2026-01-17 07:00:56,558 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.159.225:44703

2026-01-17 07:00:56,557 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.159.225:44703', status: closed, memory: 0, processing: 0>

2026-01-17 07:00:55,726 - distributed.scheduler - INFO - Close client connection: Client-worker-f6edf214-f20d-11f0-80f7-2a3d63591f59

2026-01-17 07:00:55,695 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.159.225:32895', status: closed, memory: 0, processing: 0>

2026-01-17 07:00:55,693 - distributed.scheduler - INFO - Remove client Client-worker-f6edf214-f20d-11f0-80f7-2a3d63591f59

2026-01-17 07:00:32,228 - distributed.scheduler - INFO - Receive client connection: Client-36f0c1f7-f372-11f0-8001-d684c398e257

2026-01-17 06:50:30,775 - distributed.scheduler - INFO - Receive client connection: Client-d07230cd-f370-11f0-8001-d684c398e257

2026-01-17 06:40:29,295 - distributed.scheduler - INFO - Receive client connection: Client-69f0e475-f36f-11f0-8001-d684c398e257

2026-01-17 06:30:27,867 - distributed.scheduler - INFO - Receive client connection: Client-03753e3c-f36e-11f0-8001-d684c398e257

2026-01-17 06:20:26,401 - distributed.scheduler - INFO - Receive client connection: Client-9cf5052b-f36c-11f0-8001-d684c398e257

2026-01-17 06:10:24,948 - distributed.scheduler - INFO - Receive client connection: Client-36747db1-f36b-11f0-8001-d684c398e257

2026-01-17 06:00:23,214 - distributed.scheduler - INFO - Receive client connection: Client-cfcd2876-f369-11f0-8001-d684c398e257

2026-01-17 05:50:21,862 - distributed.scheduler - INFO - Receive client connection: Client-695e248f-f368-11f0-8001-d684c398e257

2026-01-17 05:40:20,443 - distributed.scheduler - INFO - Receive client connection: Client-02e498f4-f367-11f0-8001-d684c398e257

2026-01-17 05:30:18,963 - distributed.scheduler - INFO - Receive client connection: Client-9c62725f-f365-11f0-8001-d684c398e257

2026-01-17 05:20:17,598 - distributed.scheduler - INFO - Receive client connection: Client-35f13c29-f364-11f0-8001-d684c398e257

2026-01-17 05:10:16,146 - distributed.scheduler - INFO - Receive client connection: Client-cf734669-f362-11f0-8001-d684c398e257

2026-01-17 05:00:14,776 - distributed.scheduler - INFO - Receive client connection: Client-690172b6-f361-11f0-8001-d684c398e257

2026-01-17 04:50:13,379 - distributed.scheduler - INFO - Receive client connection: Client-028b2d08-f360-11f0-8001-d684c398e257

2026-01-17 04:40:11,946 - distributed.scheduler - INFO - Receive client connection: Client-9c102952-f35e-11f0-8001-d684c398e257

2026-01-17 04:30:10,445 - distributed.scheduler - INFO - Receive client connection: Client-358a2a48-f35d-11f0-8001-d684c398e257

2026-01-17 04:20:08,917 - distributed.scheduler - INFO - Receive client connection: Client-cefff44a-f35b-11f0-8001-d684c398e257

2026-01-17 04:10:07,408 - distributed.scheduler - INFO - Receive client connection: Client-68794788-f35a-11f0-8001-d684c398e257

2026-01-17 04:00:05,858 - distributed.scheduler - INFO - Receive client connection: Client-01eb45e0-f359-11f0-8001-d684c398e257

2026-01-17 03:50:31,558 - distributed.scheduler - INFO - Close client connection: Client-9b6bfa02-f357-11f0-8001-d684c398e257

2026-01-17 03:50:31,556 - distributed.scheduler - INFO - Remove client Client-9b6bfa02-f357-11f0-8001-d684c398e257

2026-01-17 03:50:31,554 - distributed.scheduler - INFO - Remove client Client-9b6bfa02-f357-11f0-8001-d684c398e257

2026-01-17 03:50:04,396 - distributed.scheduler - INFO - Receive client connection: Client-9b6bfa02-f357-11f0-8001-d684c398e257

2026-01-17 03:40:26,229 - distributed.scheduler - INFO - Close client connection: Client-34e6ccdf-f356-11f0-8001-d684c398e257

2026-01-17 03:40:26,228 - distributed.scheduler - INFO - Remove client Client-34e6ccdf-f356-11f0-8001-d684c398e257

2026-01-17 03:40:26,226 - distributed.scheduler - INFO - Remove client Client-34e6ccdf-f356-11f0-8001-d684c398e257

2026-01-17 03:40:02,906 - distributed.scheduler - INFO - Receive client connection: Client-34e6ccdf-f356-11f0-8001-d684c398e257

2026-01-17 03:30:35,574 - distributed.scheduler - INFO - Receive client connection: Client-worker-e2bfbc8a-f354-11f0-82bd-e2e790da60bf

2026-01-17 03:30:35,361 - distributed.scheduler - INFO - Close client connection: Client-ce6f61b7-f354-11f0-8001-d684c398e257

2026-01-17 03:30:35,359 - distributed.scheduler - INFO - Remove client Client-ce6f61b7-f354-11f0-8001-d684c398e257

2026-01-17 03:30:35,358 - distributed.scheduler - INFO - Remove client Client-ce6f61b7-f354-11f0-8001-d684c398e257

2026-01-17 03:30:01,497 - distributed.scheduler - INFO - Receive client connection: Client-ce6f61b7-f354-11f0-8001-d684c398e257

2026-01-17 03:20:18,909 - distributed.scheduler - INFO - Close client connection: Client-67f5e6b5-f353-11f0-8001-d684c398e257

2026-01-17 03:20:18,908 - distributed.scheduler - INFO - Remove client Client-67f5e6b5-f353-11f0-8001-d684c398e257

2026-01-17 03:20:18,906 - distributed.scheduler - INFO - Remove client Client-67f5e6b5-f353-11f0-8001-d684c398e257

2026-01-17 03:20:00,080 - distributed.scheduler - INFO - Receive client connection: Client-67f5e6b5-f353-11f0-8001-d684c398e257

2026-01-17 03:11:17,126 - distributed.scheduler - INFO - Close client connection: Client-254ab6e6-f352-11f0-8001-d684c398e257

2026-01-17 03:11:17,126 - distributed.scheduler - INFO - Remove client Client-254ab6e6-f352-11f0-8001-d684c398e257

2026-01-17 03:11:17,124 - distributed.scheduler - INFO - Remove client Client-254ab6e6-f352-11f0-8001-d684c398e257

2026-01-17 03:10:58,734 - distributed.scheduler - INFO - Receive client connection: Client-254ab6e6-f352-11f0-8001-d684c398e257

2026-01-17 03:04:03,022 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:35201 failed: OSError: Timed out trying to connect to tcp://172.21.151.165:35201 after 30 s

2026-01-17 03:04:03,018 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:41381 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:35201 after 30 s')

2026-01-17 03:04:02,903 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:35843 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:35201 after 30 s')

2026-01-17 03:04:02,903 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:33153 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:35201 after 30 s')

2026-01-17 03:04:02,875 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:33329 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:35201 after 30 s')

2026-01-17 03:04:02,865 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:33649 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:35201 after 30 s')

2026-01-17 03:04:02,860 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:36567 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:35201 after 30 s')

2026-01-17 03:04:02,852 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:32895 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:35201 after 30 s')

2026-01-17 03:04:02,848 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:32987 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:35201 after 30 s')

2026-01-17 03:04:02,836 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:44951 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:35201 after 30 s')

2026-01-17 03:03:33,522 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.165:40415

2026-01-17 03:03:33,519 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.165:40415', status: running, memory: 0, processing: 0>

2026-01-17 03:03:32,716 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.165:35201', status: closed, memory: 0, processing: 0>

2026-01-17 03:03:23,265 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:44951 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:39533 after 30 s')

2026-01-17 03:03:23,082 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:39533 failed: OSError: Timed out trying to connect to tcp://172.21.151.165:39533 after 30 s

2026-01-17 03:03:23,051 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:41381 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:39533 after 30 s')

2026-01-17 03:03:23,013 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:37283 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:39533 after 30 s')

2026-01-17 03:03:23,012 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:33649 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:39533 after 30 s')

2026-01-17 03:03:22,980 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:33779 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:39533 after 30 s')

2026-01-17 03:03:22,975 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:33329 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:39533 after 30 s')

2026-01-17 03:03:22,974 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:32895 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:39533 after 30 s')

2026-01-17 03:03:22,972 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:44341 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:39533 after 30 s')

2026-01-17 03:03:22,969 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:36567 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:39533 after 30 s')

2026-01-17 03:03:22,955 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:38831 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:39533 after 30 s')

2026-01-17 03:03:22,952 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:35843 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:39533 after 30 s')

2026-01-17 03:03:22,951 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:32987 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:39533 after 30 s')

2026-01-17 03:03:22,939 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:45097 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:39533 after 30 s')

2026-01-17 03:02:53,665 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.165:35201

2026-01-17 03:02:53,663 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.165:35201', status: closed, memory: 0, processing: 0>

2026-01-17 03:02:52,816 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.165:39533', status: closed, memory: 0, processing: 0>

2026-01-17 03:02:44,101 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.165:39533

2026-01-17 03:02:44,100 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.165:39533', status: closed, memory: 0, processing: 0>

2026-01-17 03:02:43,218 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.165:37763', status: closed, memory: 0, processing: 0>

2026-01-17 03:02:33,737 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:45031 failed: OSError: Timed out trying to connect to tcp://172.21.151.165:45031 after 30 s

2026-01-17 03:02:33,724 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:41381 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:45031 after 30 s')

2026-01-17 03:02:33,619 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:45097 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:45031 after 30 s')

2026-01-17 03:02:33,619 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:44951 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:45031 after 30 s')

2026-01-17 03:02:33,619 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:44341 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:45031 after 30 s')

2026-01-17 03:02:33,593 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:33153 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:45031 after 30 s')

2026-01-17 03:02:33,589 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:37283 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:45031 after 30 s')

2026-01-17 03:02:33,587 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:33329 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:45031 after 30 s')

2026-01-17 03:02:33,585 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:36567 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:45031 after 30 s')

2026-01-17 03:02:33,560 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:33779 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:45031 after 30 s')

2026-01-17 03:02:04,431 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.165:37763

2026-01-17 03:02:04,429 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.165:37763', status: closed, memory: 0, processing: 0>

2026-01-17 03:02:03,429 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.165:45031', status: closed, memory: 0, processing: 0>

2026-01-17 03:01:53,749 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:39925 failed: OSError: Timed out trying to connect to tcp://172.21.151.165:39925 after 30 s

2026-01-17 03:01:53,112 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:38831 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:39925 after 30 s')

2026-01-17 03:01:37,677 - distributed.scheduler - INFO - Close client connection: Client-11190d04-f308-11f0-8001-d684c398e257

2026-01-17 03:01:37,677 - distributed.scheduler - INFO - Close client connection: Client-77941d22-f309-11f0-8001-d684c398e257

2026-01-17 03:01:37,677 - distributed.scheduler - INFO - Close client connection: Client-de0287f7-f30a-11f0-8001-d684c398e257

2026-01-17 03:01:37,677 - distributed.scheduler - INFO - Close client connection: Client-44887c65-f30c-11f0-8001-d684c398e257

2026-01-17 03:01:37,677 - distributed.scheduler - INFO - Close client connection: Client-aafdd677-f30d-11f0-8001-d684c398e257

2026-01-17 03:01:37,677 - distributed.scheduler - INFO - Close client connection: Client-11804623-f30f-11f0-8001-d684c398e257

2026-01-17 03:01:37,677 - distributed.scheduler - INFO - Close client connection: Client-7800f9bd-f310-11f0-8001-d684c398e257

2026-01-17 03:01:37,676 - distributed.scheduler - INFO - Close client connection: Client-de893389-f311-11f0-8001-d684c398e257

2026-01-17 03:01:37,676 - distributed.scheduler - INFO - Close client connection: Client-44fda68f-f313-11f0-8001-d684c398e257

2026-01-17 03:01:37,676 - distributed.scheduler - INFO - Close client connection: Client-ab7bff44-f314-11f0-8001-d684c398e257

2026-01-17 03:01:37,676 - distributed.scheduler - INFO - Close client connection: Client-1205e069-f316-11f0-8001-d684c398e257

2026-01-17 03:01:37,676 - distributed.scheduler - INFO - Close client connection: Client-788f506e-f317-11f0-8001-d684c398e257

2026-01-17 03:01:37,676 - distributed.scheduler - INFO - Close client connection: Client-df1cbc6d-f318-11f0-8001-d684c398e257

2026-01-17 03:01:37,675 - distributed.scheduler - INFO - Close client connection: Client-21b9934f-f31a-11f0-8001-d684c398e257

2026-01-17 03:01:37,675 - distributed.scheduler - INFO - Close client connection: Client-883ddd01-f31b-11f0-8001-d684c398e257

2026-01-17 03:01:37,675 - distributed.scheduler - INFO - Close client connection: Client-eeb653c5-f31c-11f0-8001-d684c398e257

2026-01-17 03:01:37,675 - distributed.scheduler - INFO - Close client connection: Client-552fa44c-f31e-11f0-8001-d684c398e257

2026-01-17 03:01:37,675 - distributed.scheduler - INFO - Close client connection: Client-bbaffde6-f31f-11f0-8001-d684c398e257

2026-01-17 03:01:37,675 - distributed.scheduler - INFO - Close client connection: Client-222ff0d2-f321-11f0-8001-d684c398e257

2026-01-17 03:01:37,675 - distributed.scheduler - INFO - Close client connection: Client-88a72a60-f322-11f0-8001-d684c398e257

2026-01-17 03:01:37,674 - distributed.scheduler - INFO - Close client connection: Client-ef1c9fb9-f323-11f0-8001-d684c398e257

2026-01-17 03:01:37,674 - distributed.scheduler - INFO - Close client connection: Client-5592892e-f325-11f0-8001-d684c398e257

2026-01-17 03:01:37,674 - distributed.scheduler - INFO - Close client connection: Client-bc0c5cd6-f326-11f0-8001-d684c398e257

2026-01-17 03:01:37,674 - distributed.scheduler - INFO - Close client connection: Client-2266cc72-f328-11f0-8001-d684c398e257

2026-01-17 03:01:37,674 - distributed.scheduler - INFO - Close client connection: Client-88e1dadb-f329-11f0-8001-d684c398e257

2026-01-17 03:01:37,674 - distributed.scheduler - INFO - Close client connection: Client-ef4e847a-f32a-11f0-8001-d684c398e257

2026-01-17 03:01:37,674 - distributed.scheduler - INFO - Close client connection: Client-55d1e376-f32c-11f0-8001-d684c398e257

2026-01-17 03:01:37,674 - distributed.scheduler - INFO - Close client connection: Client-bc448948-f32d-11f0-8001-d684c398e257

2026-01-17 03:01:37,673 - distributed.scheduler - INFO - Close client connection: Client-22c014ba-f32f-11f0-8001-d684c398e257

2026-01-17 03:01:37,673 - distributed.scheduler - INFO - Close client connection: Client-8931ae65-f330-11f0-8001-d684c398e257

2026-01-17 03:01:37,673 - distributed.scheduler - INFO - Close client connection: Client-efbd0271-f331-11f0-8001-d684c398e257

2026-01-17 03:01:37,673 - distributed.scheduler - INFO - Close client connection: Client-563eb13d-f333-11f0-8001-d684c398e257

2026-01-17 03:01:37,673 - distributed.scheduler - INFO - Close client connection: Client-89c828ca-f337-11f0-8001-d684c398e257

2026-01-17 03:01:37,673 - distributed.scheduler - INFO - Close client connection: Client-bcc27c11-f334-11f0-8001-d684c398e257

2026-01-17 03:01:37,673 - distributed.scheduler - INFO - Close client connection: Client-233b20db-f336-11f0-8001-d684c398e257

2026-01-17 03:01:37,673 - distributed.scheduler - INFO - Close client connection: Client-f055f179-f338-11f0-8001-d684c398e257

2026-01-17 03:01:37,672 - distributed.scheduler - INFO - Close client connection: Client-56d929a9-f33a-11f0-8001-d684c398e257

2026-01-17 03:01:37,672 - distributed.scheduler - INFO - Close client connection: Client-bd5cdf46-f33b-11f0-8001-d684c398e257

2026-01-17 03:01:37,672 - distributed.scheduler - INFO - Close client connection: Client-23d7a364-f33d-11f0-8001-d684c398e257

2026-01-17 03:01:37,672 - distributed.scheduler - INFO - Close client connection: Client-8a5ffa0d-f33e-11f0-8001-d684c398e257

2026-01-17 03:01:37,672 - distributed.scheduler - INFO - Close client connection: Client-f0dc4385-f33f-11f0-8001-d684c398e257

2026-01-17 03:01:37,672 - distributed.scheduler - INFO - Close client connection: Client-5764a2a3-f341-11f0-8001-d684c398e257

2026-01-17 03:01:37,672 - distributed.scheduler - INFO - Close client connection: Client-245c3c10-f344-11f0-8001-d684c398e257

2026-01-17 03:01:37,672 - distributed.scheduler - INFO - Close client connection: Client-bded49f7-f342-11f0-8001-d684c398e257

2026-01-17 03:01:37,671 - distributed.scheduler - INFO - Close client connection: Client-8ad1a5eb-f345-11f0-8001-d684c398e257

2026-01-17 03:01:37,671 - distributed.scheduler - INFO - Close client connection: Client-f15194a9-f346-11f0-8001-d684c398e257

2026-01-17 03:01:37,671 - distributed.scheduler - INFO - Close client connection: Client-57d02f08-f348-11f0-8001-d684c398e257

2026-01-17 03:01:37,671 - distributed.scheduler - INFO - Close client connection: Client-be3e2e79-f349-11f0-8001-d684c398e257

2026-01-17 03:01:37,671 - distributed.scheduler - INFO - Close client connection: Client-24b8716b-f34b-11f0-8001-d684c398e257

2026-01-17 03:01:37,671 - distributed.scheduler - INFO - Close client connection: Client-8b342a9b-f34c-11f0-8001-d684c398e257

2026-01-17 03:01:37,671 - distributed.scheduler - INFO - Close client connection: Client-f1b44d93-f34d-11f0-8001-d684c398e257

2026-01-17 03:01:37,669 - distributed.scheduler - INFO - Close client connection: Client-583d8197-f34f-11f0-8001-d684c398e257

2026-01-17 03:01:37,669 - distributed.scheduler - INFO - Remove client Client-11190d04-f308-11f0-8001-d684c398e257

2026-01-17 03:01:37,669 - distributed.scheduler - INFO - Remove client Client-77941d22-f309-11f0-8001-d684c398e257

2026-01-17 03:01:37,668 - distributed.scheduler - INFO - Remove client Client-de0287f7-f30a-11f0-8001-d684c398e257

2026-01-17 03:01:37,668 - distributed.scheduler - INFO - Remove client Client-44887c65-f30c-11f0-8001-d684c398e257

2026-01-17 03:01:37,668 - distributed.scheduler - INFO - Remove client Client-aafdd677-f30d-11f0-8001-d684c398e257

2026-01-17 03:01:37,667 - distributed.scheduler - INFO - Remove client Client-11804623-f30f-11f0-8001-d684c398e257

2026-01-17 03:01:37,667 - distributed.scheduler - INFO - Remove client Client-7800f9bd-f310-11f0-8001-d684c398e257

2026-01-17 03:01:37,667 - distributed.scheduler - INFO - Remove client Client-de893389-f311-11f0-8001-d684c398e257

2026-01-17 03:01:37,666 - distributed.scheduler - INFO - Remove client Client-44fda68f-f313-11f0-8001-d684c398e257

2026-01-17 03:01:37,666 - distributed.scheduler - INFO - Remove client Client-ab7bff44-f314-11f0-8001-d684c398e257

2026-01-17 03:01:37,666 - distributed.scheduler - INFO - Remove client Client-1205e069-f316-11f0-8001-d684c398e257

2026-01-17 03:01:37,666 - distributed.scheduler - INFO - Remove client Client-788f506e-f317-11f0-8001-d684c398e257

2026-01-17 03:01:37,665 - distributed.scheduler - INFO - Remove client Client-df1cbc6d-f318-11f0-8001-d684c398e257

2026-01-17 03:01:37,661 - distributed.scheduler - INFO - Remove client Client-21b9934f-f31a-11f0-8001-d684c398e257

2026-01-17 03:01:37,660 - distributed.scheduler - INFO - Remove client Client-883ddd01-f31b-11f0-8001-d684c398e257

2026-01-17 03:01:37,660 - distributed.scheduler - INFO - Remove client Client-eeb653c5-f31c-11f0-8001-d684c398e257

2026-01-17 03:01:37,660 - distributed.scheduler - INFO - Remove client Client-552fa44c-f31e-11f0-8001-d684c398e257

2026-01-17 03:01:37,659 - distributed.scheduler - INFO - Remove client Client-bbaffde6-f31f-11f0-8001-d684c398e257

2026-01-17 03:01:37,659 - distributed.scheduler - INFO - Remove client Client-222ff0d2-f321-11f0-8001-d684c398e257

2026-01-17 03:01:37,659 - distributed.scheduler - INFO - Remove client Client-88a72a60-f322-11f0-8001-d684c398e257

2026-01-17 03:01:37,658 - distributed.scheduler - INFO - Remove client Client-ef1c9fb9-f323-11f0-8001-d684c398e257

2026-01-17 03:01:37,658 - distributed.scheduler - INFO - Remove client Client-5592892e-f325-11f0-8001-d684c398e257

2026-01-17 03:01:37,657 - distributed.scheduler - INFO - Remove client Client-bc0c5cd6-f326-11f0-8001-d684c398e257

2026-01-17 03:01:37,657 - distributed.scheduler - INFO - Remove client Client-2266cc72-f328-11f0-8001-d684c398e257

2026-01-17 03:01:37,657 - distributed.scheduler - INFO - Remove client Client-88e1dadb-f329-11f0-8001-d684c398e257

2026-01-17 03:01:37,656 - distributed.scheduler - INFO - Remove client Client-ef4e847a-f32a-11f0-8001-d684c398e257

2026-01-17 03:01:37,656 - distributed.scheduler - INFO - Remove client Client-55d1e376-f32c-11f0-8001-d684c398e257

2026-01-17 03:01:37,656 - distributed.scheduler - INFO - Remove client Client-bc448948-f32d-11f0-8001-d684c398e257

2026-01-17 03:01:37,655 - distributed.scheduler - INFO - Remove client Client-22c014ba-f32f-11f0-8001-d684c398e257

2026-01-17 03:01:37,655 - distributed.scheduler - INFO - Remove client Client-8931ae65-f330-11f0-8001-d684c398e257

2026-01-17 03:01:37,654 - distributed.scheduler - INFO - Remove client Client-efbd0271-f331-11f0-8001-d684c398e257

2026-01-17 03:01:37,654 - distributed.scheduler - INFO - Remove client Client-563eb13d-f333-11f0-8001-d684c398e257

2026-01-17 03:01:37,654 - distributed.scheduler - INFO - Remove client Client-89c828ca-f337-11f0-8001-d684c398e257

2026-01-17 03:01:37,653 - distributed.scheduler - INFO - Remove client Client-bcc27c11-f334-11f0-8001-d684c398e257

2026-01-17 03:01:37,653 - distributed.scheduler - INFO - Remove client Client-233b20db-f336-11f0-8001-d684c398e257

2026-01-17 03:01:37,653 - distributed.scheduler - INFO - Remove client Client-f055f179-f338-11f0-8001-d684c398e257

2026-01-17 03:01:37,652 - distributed.scheduler - INFO - Remove client Client-56d929a9-f33a-11f0-8001-d684c398e257

2026-01-17 03:01:37,651 - distributed.scheduler - INFO - Remove client Client-bd5cdf46-f33b-11f0-8001-d684c398e257

2026-01-17 03:01:37,651 - distributed.scheduler - INFO - Remove client Client-23d7a364-f33d-11f0-8001-d684c398e257

2026-01-17 03:01:37,650 - distributed.scheduler - INFO - Remove client Client-8a5ffa0d-f33e-11f0-8001-d684c398e257

2026-01-17 03:01:37,650 - distributed.scheduler - INFO - Remove client Client-f0dc4385-f33f-11f0-8001-d684c398e257

2026-01-17 03:01:37,649 - distributed.scheduler - INFO - Remove client Client-5764a2a3-f341-11f0-8001-d684c398e257

2026-01-17 03:01:37,649 - distributed.scheduler - INFO - Remove client Client-245c3c10-f344-11f0-8001-d684c398e257

2026-01-17 03:01:37,648 - distributed.scheduler - INFO - Remove client Client-bded49f7-f342-11f0-8001-d684c398e257

2026-01-17 03:01:37,648 - distributed.scheduler - INFO - Remove client Client-8ad1a5eb-f345-11f0-8001-d684c398e257

2026-01-17 03:01:37,647 - distributed.scheduler - INFO - Remove client Client-f15194a9-f346-11f0-8001-d684c398e257

2026-01-17 03:01:37,647 - distributed.scheduler - INFO - Remove client Client-57d02f08-f348-11f0-8001-d684c398e257

2026-01-17 03:01:37,646 - distributed.scheduler - INFO - Remove client Client-be3e2e79-f349-11f0-8001-d684c398e257

2026-01-17 03:01:37,645 - distributed.scheduler - INFO - Remove client Client-24b8716b-f34b-11f0-8001-d684c398e257

2026-01-17 03:01:37,645 - distributed.scheduler - INFO - Remove client Client-8b342a9b-f34c-11f0-8001-d684c398e257

2026-01-17 03:01:37,644 - distributed.scheduler - INFO - Remove client Client-f1b44d93-f34d-11f0-8001-d684c398e257

2026-01-17 03:01:37,629 - distributed.scheduler - INFO - Remove client Client-583d8197-f34f-11f0-8001-d684c398e257

2026-01-17 03:01:36,918 - distributed.scheduler - INFO - Close client connection: Client-bec73bb5-f350-11f0-8001-d684c398e257

2026-01-17 03:01:36,916 - distributed.scheduler - INFO - Remove client Client-bec73bb5-f350-11f0-8001-d684c398e257

2026-01-17 03:01:36,915 - distributed.scheduler - INFO - Remove client Client-bec73bb5-f350-11f0-8001-d684c398e257

2026-01-17 03:01:23,500 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.165:45031

2026-01-17 03:01:23,498 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.165:45031', status: closed, memory: 0, processing: 0>

2026-01-17 03:01:22,559 - distributed.scheduler - INFO - Close client connection: Client-worker-01b58cca-f2fd-11f0-823b-e2e790da60bf

2026-01-17 03:01:22,530 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.165:39925', status: closed, memory: 0, processing: 0>

2026-01-17 03:01:22,529 - distributed.scheduler - INFO - Remove client Client-worker-01b58cca-f2fd-11f0-823b-e2e790da60bf

2026-01-17 03:00:57,242 - distributed.scheduler - INFO - Receive client connection: Client-bec73bb5-f350-11f0-8001-d684c398e257

2026-01-17 02:50:55,709 - distributed.scheduler - INFO - Receive client connection: Client-583d8197-f34f-11f0-8001-d684c398e257

2026-01-17 02:40:54,183 - distributed.scheduler - INFO - Receive client connection: Client-f1b44d93-f34d-11f0-8001-d684c398e257

2026-01-17 02:30:52,723 - distributed.scheduler - INFO - Receive client connection: Client-8b342a9b-f34c-11f0-8001-d684c398e257

2026-01-17 02:20:51,289 - distributed.scheduler - INFO - Receive client connection: Client-24b8716b-f34b-11f0-8001-d684c398e257

2026-01-17 02:10:49,861 - distributed.scheduler - INFO - Receive client connection: Client-be3e2e79-f349-11f0-8001-d684c398e257

2026-01-17 02:00:48,518 - distributed.scheduler - INFO - Receive client connection: Client-57d02f08-f348-11f0-8001-d684c398e257

2026-01-17 01:50:47,070 - distributed.scheduler - INFO - Receive client connection: Client-f15194a9-f346-11f0-8001-d684c398e257

2026-01-17 01:40:45,599 - distributed.scheduler - INFO - Receive client connection: Client-8ad1a5eb-f345-11f0-8001-d684c398e257

2026-01-17 01:30:44,209 - distributed.scheduler - INFO - Receive client connection: Client-245c3c10-f344-11f0-8001-d684c398e257

2026-01-17 01:20:42,855 - distributed.scheduler - INFO - Receive client connection: Client-bded49f7-f342-11f0-8001-d684c398e257

2026-01-17 01:10:41,336 - distributed.scheduler - INFO - Receive client connection: Client-5764a2a3-f341-11f0-8001-d684c398e257

2026-01-17 01:00:39,820 - distributed.scheduler - INFO - Receive client connection: Client-f0dc4385-f33f-11f0-8001-d684c398e257

2026-01-17 00:50:38,386 - distributed.scheduler - INFO - Receive client connection: Client-8a5ffa0d-f33e-11f0-8001-d684c398e257

2026-01-17 00:40:36,862 - distributed.scheduler - INFO - Receive client connection: Client-23d7a364-f33d-11f0-8001-d684c398e257

2026-01-17 00:30:35,438 - distributed.scheduler - INFO - Receive client connection: Client-bd5cdf46-f33b-11f0-8001-d684c398e257

2026-01-17 00:20:33,942 - distributed.scheduler - INFO - Receive client connection: Client-56d929a9-f33a-11f0-8001-d684c398e257

2026-01-17 00:10:32,463 - distributed.scheduler - INFO - Receive client connection: Client-f055f179-f338-11f0-8001-d684c398e257

2026-01-17 00:00:31,040 - distributed.scheduler - INFO - Receive client connection: Client-89c828ca-f337-11f0-8001-d684c398e257

2026-01-16 23:50:29,352 - distributed.scheduler - INFO - Receive client connection: Client-233b20db-f336-11f0-8001-d684c398e257

2026-01-16 23:40:27,943 - distributed.scheduler - INFO - Receive client connection: Client-bcc27c11-f334-11f0-8001-d684c398e257

2026-01-16 23:30:26,453 - distributed.scheduler - INFO - Receive client connection: Client-563eb13d-f333-11f0-8001-d684c398e257

2026-01-16 23:20:24,977 - distributed.scheduler - INFO - Receive client connection: Client-efbd0271-f331-11f0-8001-d684c398e257

2026-01-16 23:10:23,446 - distributed.scheduler - INFO - Receive client connection: Client-8931ae65-f330-11f0-8001-d684c398e257

2026-01-16 23:00:22,072 - distributed.scheduler - INFO - Receive client connection: Client-22c014ba-f32f-11f0-8001-d684c398e257

2026-01-16 22:50:20,642 - distributed.scheduler - INFO - Receive client connection: Client-bc448948-f32d-11f0-8001-d684c398e257

2026-01-16 22:40:19,271 - distributed.scheduler - INFO - Receive client connection: Client-55d1e376-f32c-11f0-8001-d684c398e257

2026-01-16 22:30:17,814 - distributed.scheduler - INFO - Receive client connection: Client-ef4e847a-f32a-11f0-8001-d684c398e257

2026-01-16 22:20:16,442 - distributed.scheduler - INFO - Receive client connection: Client-88e1dadb-f329-11f0-8001-d684c398e257

2026-01-16 22:10:15,016 - distributed.scheduler - INFO - Receive client connection: Client-2266cc72-f328-11f0-8001-d684c398e257

2026-01-16 22:00:13,787 - distributed.scheduler - INFO - Receive client connection: Client-bc0c5cd6-f326-11f0-8001-d684c398e257

2026-01-16 21:50:12,369 - distributed.scheduler - INFO - Receive client connection: Client-5592892e-f325-11f0-8001-d684c398e257

2026-01-16 21:40:10,977 - distributed.scheduler - INFO - Receive client connection: Client-ef1c9fb9-f323-11f0-8001-d684c398e257

2026-01-16 21:30:09,584 - distributed.scheduler - INFO - Receive client connection: Client-88a72a60-f322-11f0-8001-d684c398e257

2026-01-16 21:20:08,176 - distributed.scheduler - INFO - Receive client connection: Client-222ff0d2-f321-11f0-8001-d684c398e257

2026-01-16 21:10:06,723 - distributed.scheduler - INFO - Receive client connection: Client-bbaffde6-f31f-11f0-8001-d684c398e257

2026-01-16 21:00:05,245 - distributed.scheduler - INFO - Receive client connection: Client-552fa44c-f31e-11f0-8001-d684c398e257

2026-01-16 20:50:03,827 - distributed.scheduler - INFO - Receive client connection: Client-eeb653c5-f31c-11f0-8001-d684c398e257

2026-01-16 20:40:02,416 - distributed.scheduler - INFO - Receive client connection: Client-883ddd01-f31b-11f0-8001-d684c398e257

2026-01-16 20:30:00,929 - distributed.scheduler - INFO - Receive client connection: Client-21b9934f-f31a-11f0-8001-d684c398e257

2026-01-16 20:20:59,666 - distributed.scheduler - INFO - Receive client connection: Client-df1cbc6d-f318-11f0-8001-d684c398e257

2026-01-16 20:10:58,116 - distributed.scheduler - INFO - Receive client connection: Client-788f506e-f317-11f0-8001-d684c398e257

2026-01-16 20:00:56,591 - distributed.scheduler - INFO - Receive client connection: Client-1205e069-f316-11f0-8001-d684c398e257

2026-01-16 19:50:55,082 - distributed.scheduler - INFO - Receive client connection: Client-ab7bff44-f314-11f0-8001-d684c398e257

2026-01-16 19:40:53,608 - distributed.scheduler - INFO - Receive client connection: Client-44fda68f-f313-11f0-8001-d684c398e257

2026-01-16 19:30:52,224 - distributed.scheduler - INFO - Receive client connection: Client-de893389-f311-11f0-8001-d684c398e257

2026-01-16 19:20:50,704 - distributed.scheduler - INFO - Receive client connection: Client-7800f9bd-f310-11f0-8001-d684c398e257

2026-01-16 19:10:49,236 - distributed.scheduler - INFO - Receive client connection: Client-11804623-f30f-11f0-8001-d684c398e257

2026-01-16 19:00:47,759 - distributed.scheduler - INFO - Receive client connection: Client-aafdd677-f30d-11f0-8001-d684c398e257

2026-01-16 18:50:46,360 - distributed.scheduler - INFO - Receive client connection: Client-44887c65-f30c-11f0-8001-d684c398e257

2026-01-16 18:40:44,860 - distributed.scheduler - INFO - Receive client connection: Client-de0287f7-f30a-11f0-8001-d684c398e257

2026-01-16 18:30:45,583 - distributed.scheduler - INFO - Receive client connection: Client-worker-78d118b9-f309-11f0-82cd-5693d18fdaf6

2026-01-16 18:30:43,509 - distributed.scheduler - INFO - Receive client connection: Client-77941d22-f309-11f0-8001-d684c398e257

2026-01-16 18:20:42,092 - distributed.scheduler - INFO - Receive client connection: Client-11190d04-f308-11f0-8001-d684c398e257

2026-01-16 18:11:14,676 - distributed.scheduler - INFO - Close client connection: Client-aa969409-f306-11f0-8001-d684c398e257

2026-01-16 18:11:14,675 - distributed.scheduler - INFO - Remove client Client-aa969409-f306-11f0-8001-d684c398e257

2026-01-16 18:11:14,673 - distributed.scheduler - INFO - Remove client Client-aa969409-f306-11f0-8001-d684c398e257

2026-01-16 18:10:40,616 - distributed.scheduler - INFO - Receive client connection: Client-aa969409-f306-11f0-8001-d684c398e257

2026-01-16 18:01:29,469 - distributed.scheduler - INFO - Close client connection: Client-4412f2c3-f305-11f0-8001-d684c398e257

2026-01-16 18:01:29,468 - distributed.scheduler - INFO - Remove client Client-4412f2c3-f305-11f0-8001-d684c398e257

2026-01-16 18:01:29,466 - distributed.scheduler - INFO - Remove client Client-4412f2c3-f305-11f0-8001-d684c398e257

2026-01-16 18:00:39,162 - distributed.scheduler - INFO - Receive client connection: Client-4412f2c3-f305-11f0-8001-d684c398e257

2026-01-16 17:51:08,608 - distributed.scheduler - INFO - Close client connection: Client-dd870a34-f303-11f0-8001-d684c398e257

2026-01-16 17:51:08,606 - distributed.scheduler - INFO - Remove client Client-dd870a34-f303-11f0-8001-d684c398e257

2026-01-16 17:51:08,605 - distributed.scheduler - INFO - Remove client Client-dd870a34-f303-11f0-8001-d684c398e257

2026-01-16 17:50:37,584 - distributed.scheduler - INFO - Receive client connection: Client-dd870a34-f303-11f0-8001-d684c398e257

2026-01-16 17:41:07,392 - distributed.scheduler - INFO - Close client connection: Client-76ffdac3-f302-11f0-8001-d684c398e257

2026-01-16 17:41:07,391 - distributed.scheduler - INFO - Remove client Client-76ffdac3-f302-11f0-8001-d684c398e257

2026-01-16 17:41:07,389 - distributed.scheduler - INFO - Remove client Client-76ffdac3-f302-11f0-8001-d684c398e257

2026-01-16 17:40:36,078 - distributed.scheduler - INFO - Receive client connection: Client-76ffdac3-f302-11f0-8001-d684c398e257

2026-01-16 17:31:34,241 - distributed.scheduler - INFO - Close client connection: Client-10834438-f301-11f0-8001-d684c398e257

2026-01-16 17:31:34,240 - distributed.scheduler - INFO - Remove client Client-10834438-f301-11f0-8001-d684c398e257

2026-01-16 17:31:34,239 - distributed.scheduler - INFO - Remove client Client-10834438-f301-11f0-8001-d684c398e257

2026-01-16 17:30:34,632 - distributed.scheduler - INFO - Receive client connection: Client-10834438-f301-11f0-8001-d684c398e257

2026-01-16 17:21:06,491 - distributed.scheduler - INFO - Close client connection: Client-aa00cd34-f2ff-11f0-8001-d684c398e257

2026-01-16 17:21:06,490 - distributed.scheduler - INFO - Remove client Client-aa00cd34-f2ff-11f0-8001-d684c398e257

2026-01-16 17:21:06,488 - distributed.scheduler - INFO - Remove client Client-aa00cd34-f2ff-11f0-8001-d684c398e257

2026-01-16 17:20:33,151 - distributed.scheduler - INFO - Receive client connection: Client-aa00cd34-f2ff-11f0-8001-d684c398e257

2026-01-16 17:11:03,804 - distributed.scheduler - INFO - Close client connection: Client-437d3718-f2fe-11f0-8001-d684c398e257

2026-01-16 17:11:03,802 - distributed.scheduler - INFO - Remove client Client-437d3718-f2fe-11f0-8001-d684c398e257

2026-01-16 17:11:03,801 - distributed.scheduler - INFO - Remove client Client-437d3718-f2fe-11f0-8001-d684c398e257

2026-01-16 17:10:31,669 - distributed.scheduler - INFO - Receive client connection: Client-437d3718-f2fe-11f0-8001-d684c398e257

2026-01-16 17:01:31,798 - distributed.scheduler - INFO - Receive client connection: Client-worker-01b58cca-f2fd-11f0-823b-e2e790da60bf

2026-01-16 17:01:27,210 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:33997 failed: OSError: Timed out trying to connect to tcp://172.21.12.242:33997 after 30 s

2026-01-16 17:01:27,178 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:45097 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:33997 after 30 s')

2026-01-16 17:01:27,141 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:33153 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:33997 after 30 s')

2026-01-16 17:01:27,076 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:33997 failed: OSError: Timed out trying to connect to tcp://172.21.12.242:33997 after 30 s

2026-01-16 17:01:27,040 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:38831 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:33997 after 30 s')

2026-01-16 17:01:26,952 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:37283 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:33997 after 30 s')

2026-01-16 17:01:26,929 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:32987 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:33997 after 30 s')

2026-01-16 17:01:26,929 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:33329 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:33997 after 30 s')

2026-01-16 17:01:26,889 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:44341 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:33997 after 30 s')

2026-01-16 17:01:26,879 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:44951 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:33997 after 30 s')

2026-01-16 17:01:25,237 - distributed.scheduler - INFO - Close client connection: Client-dcec934d-f2fc-11f0-8001-d684c398e257

2026-01-16 17:01:25,236 - distributed.scheduler - INFO - Remove client Client-dcec934d-f2fc-11f0-8001-d684c398e257

2026-01-16 17:01:25,234 - distributed.scheduler - INFO - Remove client Client-dcec934d-f2fc-11f0-8001-d684c398e257

2026-01-16 17:00:57,667 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.242:41381

2026-01-16 17:00:57,665 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.242:41381', status: running, memory: 0, processing: 0>

2026-01-16 17:00:56,698 - distributed.scheduler - INFO - Close client connection: Client-worker-2a18fea2-f212-11f0-8206-5693d18fdaf6

2026-01-16 17:00:56,679 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.242:33997', status: closed, memory: 0, processing: 0>

2026-01-16 17:00:56,678 - distributed.scheduler - INFO - Remove client Client-worker-2a18fea2-f212-11f0-8206-5693d18fdaf6

2026-01-16 17:00:30,094 - distributed.scheduler - INFO - Receive client connection: Client-dcec934d-f2fc-11f0-8001-d684c398e257

2026-01-16 16:51:02,778 - distributed.scheduler - INFO - Close client connection: Client-767b359c-f2fb-11f0-8001-d684c398e257

2026-01-16 16:51:02,775 - distributed.scheduler - INFO - Remove client Client-767b359c-f2fb-11f0-8001-d684c398e257

2026-01-16 16:51:02,773 - distributed.scheduler - INFO - Remove client Client-767b359c-f2fb-11f0-8001-d684c398e257

2026-01-16 16:50:28,729 - distributed.scheduler - INFO - Receive client connection: Client-767b359c-f2fb-11f0-8001-d684c398e257

2026-01-16 16:41:01,865 - distributed.scheduler - INFO - Close client connection: Client-1001d12f-f2fa-11f0-8001-d684c398e257

2026-01-16 16:41:01,863 - distributed.scheduler - INFO - Remove client Client-1001d12f-f2fa-11f0-8001-d684c398e257

2026-01-16 16:41:01,861 - distributed.scheduler - INFO - Remove client Client-1001d12f-f2fa-11f0-8001-d684c398e257

2026-01-16 16:40:27,309 - distributed.scheduler - INFO - Receive client connection: Client-1001d12f-f2fa-11f0-8001-d684c398e257

2026-01-16 16:31:26,872 - distributed.scheduler - INFO - Close client connection: Client-a97ef524-f2f8-11f0-8001-d684c398e257

2026-01-16 16:31:26,871 - distributed.scheduler - INFO - Remove client Client-a97ef524-f2f8-11f0-8001-d684c398e257

2026-01-16 16:31:26,869 - distributed.scheduler - INFO - Remove client Client-a97ef524-f2f8-11f0-8001-d684c398e257

2026-01-16 16:30:25,829 - distributed.scheduler - INFO - Receive client connection: Client-a97ef524-f2f8-11f0-8001-d684c398e257

2026-01-16 16:20:58,496 - distributed.scheduler - INFO - Close client connection: Client-42f93001-f2f7-11f0-8001-d684c398e257

2026-01-16 16:20:58,495 - distributed.scheduler - INFO - Remove client Client-42f93001-f2f7-11f0-8001-d684c398e257

2026-01-16 16:20:58,493 - distributed.scheduler - INFO - Remove client Client-42f93001-f2f7-11f0-8001-d684c398e257

2026-01-16 16:20:24,328 - distributed.scheduler - INFO - Receive client connection: Client-42f93001-f2f7-11f0-8001-d684c398e257

2026-01-16 16:11:00,467 - distributed.scheduler - INFO - Close client connection: Client-dc7ca01d-f2f5-11f0-8001-d684c398e257

2026-01-16 16:11:00,467 - distributed.scheduler - INFO - Remove client Client-dc7ca01d-f2f5-11f0-8001-d684c398e257

2026-01-16 16:11:00,465 - distributed.scheduler - INFO - Remove client Client-dc7ca01d-f2f5-11f0-8001-d684c398e257

2026-01-16 16:10:22,898 - distributed.scheduler - INFO - Receive client connection: Client-dc7ca01d-f2f5-11f0-8001-d684c398e257

2026-01-16 16:03:38,246 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:37855 failed: OSError: Timed out trying to connect to tcp://172.21.151.165:37855 after 30 s

2026-01-16 16:03:38,244 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:33997 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37855 after 30 s')

2026-01-16 16:03:38,179 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:33153 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37855 after 30 s')

2026-01-16 16:03:38,144 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:45097 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37855 after 30 s')

2026-01-16 16:03:38,142 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:38831 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37855 after 30 s')

2026-01-16 16:03:38,138 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:32895 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37855 after 30 s')

2026-01-16 16:03:38,128 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:35843 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37855 after 30 s')

2026-01-16 16:03:38,122 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:32987 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37855 after 30 s')

2026-01-16 16:03:38,122 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:33649 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37855 after 30 s')

2026-01-16 16:03:38,121 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:33779 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37855 after 30 s')

2026-01-16 16:03:38,120 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:33329 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37855 after 30 s')

2026-01-16 16:03:38,108 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:44951 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37855 after 30 s')

2026-01-16 16:03:08,860 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.165:39925

2026-01-16 16:03:08,858 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.165:39925', status: closed, memory: 0, processing: 0>

2026-01-16 16:03:07,954 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.165:37855', status: closed, memory: 0, processing: 0>

2026-01-16 16:02:57,868 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:34957 failed: OSError: Timed out trying to connect to tcp://172.21.151.165:34957 after 30 s

2026-01-16 16:02:57,759 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:33153 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:34957 after 30 s')

2026-01-16 16:02:57,758 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:37283 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:34957 after 30 s')

2026-01-16 16:02:57,730 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:33649 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:34957 after 30 s')

2026-01-16 16:02:57,716 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:33779 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:34957 after 30 s')

2026-01-16 16:02:57,705 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:44951 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:34957 after 30 s')

2026-01-16 16:02:28,418 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.165:37855

2026-01-16 16:02:28,416 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.165:37855', status: closed, memory: 0, processing: 0>

2026-01-16 16:02:27,556 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.165:34957', status: closed, memory: 0, processing: 0>

2026-01-16 16:02:17,010 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:37807 failed: OSError: Timed out trying to connect to tcp://172.21.151.165:37807 after 30 s

2026-01-16 16:02:16,909 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:33997 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37807 after 30 s')

2026-01-16 16:02:16,908 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:33153 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37807 after 30 s')

2026-01-16 16:02:16,886 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:36567 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37807 after 30 s')

2026-01-16 16:02:16,885 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:37283 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37807 after 30 s')

2026-01-16 16:02:16,883 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:38831 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37807 after 30 s')

2026-01-16 16:02:16,879 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:33649 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37807 after 30 s')

2026-01-16 16:02:16,874 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:33329 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37807 after 30 s')

2026-01-16 16:02:16,864 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:32895 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37807 after 30 s')

2026-01-16 16:02:16,864 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:35235 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37807 after 30 s')

2026-01-16 16:02:16,862 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:35843 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37807 after 30 s')

2026-01-16 16:02:16,861 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:44951 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37807 after 30 s')

2026-01-16 16:02:16,832 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:32987 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37807 after 30 s')

2026-01-16 16:02:16,822 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:44341 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37807 after 30 s')

2026-01-16 16:01:47,659 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.165:34957

2026-01-16 16:01:47,658 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.165:34957', status: closed, memory: 0, processing: 0>

2026-01-16 16:01:46,704 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.165:37807', status: closed, memory: 0, processing: 0>

2026-01-16 16:01:33,429 - distributed.scheduler - INFO - Receive client connection: Client-worker-a0e9d299-f2f4-11f0-821b-4e8606c6fff3

2026-01-16 16:01:27,838 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:37861 failed: OSError: Timed out trying to connect to tcp://172.21.151.165:37861 after 30 s

2026-01-16 16:01:27,836 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:37807 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37861 after 30 s')

2026-01-16 16:01:26,998 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:33329 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37861 after 30 s')

2026-01-16 16:01:26,639 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:33997 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.165:37861 after 30 s')

2026-01-16 16:01:17,893 - distributed.scheduler - INFO - Close client connection: Client-31deae3c-f2de-11f0-8001-d684c398e257

2026-01-16 16:01:17,893 - distributed.scheduler - INFO - Close client connection: Client-db14f798-f2e0-11f0-8001-d684c398e257

2026-01-16 16:01:17,893 - distributed.scheduler - INFO - Close client connection: Client-98689a67-f2df-11f0-8001-d684c398e257

2026-01-16 16:01:17,892 - distributed.scheduler - INFO - Close client connection: Client-4197852e-f2e2-11f0-8001-d684c398e257

2026-01-16 16:01:17,892 - distributed.scheduler - INFO - Close client connection: Client-a8169f3f-f2e3-11f0-8001-d684c398e257

2026-01-16 16:01:17,892 - distributed.scheduler - INFO - Close client connection: Client-0e91148b-f2e5-11f0-8001-d684c398e257

2026-01-16 16:01:17,892 - distributed.scheduler - INFO - Close client connection: Client-750cef75-f2e6-11f0-8001-d684c398e257

2026-01-16 16:01:17,892 - distributed.scheduler - INFO - Close client connection: Client-db8be3f7-f2e7-11f0-8001-d684c398e257

2026-01-16 16:01:17,891 - distributed.scheduler - INFO - Close client connection: Client-421b45e3-f2e9-11f0-8001-d684c398e257

2026-01-16 16:01:17,891 - distributed.scheduler - INFO - Close client connection: Client-a897b0f4-f2ea-11f0-8001-d684c398e257

2026-01-16 16:01:17,891 - distributed.scheduler - INFO - Close client connection: Client-0f225e2c-f2ec-11f0-8001-d684c398e257

2026-01-16 16:01:17,891 - distributed.scheduler - INFO - Close client connection: Client-758be2ee-f2ed-11f0-8001-d684c398e257

2026-01-16 16:01:17,891 - distributed.scheduler - INFO - Close client connection: Client-dbfcc0c4-f2ee-11f0-8001-d684c398e257

2026-01-16 16:01:17,890 - distributed.scheduler - INFO - Close client connection: Client-427d5b44-f2f0-11f0-8001-d684c398e257

2026-01-16 16:01:17,888 - distributed.scheduler - INFO - Close client connection: Client-0f716e2f-f2f3-11f0-8001-d684c398e257

2026-01-16 16:01:17,888 - distributed.scheduler - INFO - Close client connection: Client-a8eed8a3-f2f1-11f0-8001-d684c398e257

2026-01-16 16:01:17,886 - distributed.scheduler - INFO - Remove client Client-31deae3c-f2de-11f0-8001-d684c398e257

2026-01-16 16:01:17,886 - distributed.scheduler - INFO - Remove client Client-db14f798-f2e0-11f0-8001-d684c398e257

2026-01-16 16:01:17,885 - distributed.scheduler - INFO - Remove client Client-98689a67-f2df-11f0-8001-d684c398e257

2026-01-16 16:01:17,884 - distributed.scheduler - INFO - Remove client Client-4197852e-f2e2-11f0-8001-d684c398e257

2026-01-16 16:01:17,884 - distributed.scheduler - INFO - Remove client Client-a8169f3f-f2e3-11f0-8001-d684c398e257

2026-01-16 16:01:17,883 - distributed.scheduler - INFO - Remove client Client-0e91148b-f2e5-11f0-8001-d684c398e257

2026-01-16 16:01:17,882 - distributed.scheduler - INFO - Remove client Client-750cef75-f2e6-11f0-8001-d684c398e257

2026-01-16 16:01:17,882 - distributed.scheduler - INFO - Remove client Client-db8be3f7-f2e7-11f0-8001-d684c398e257

2026-01-16 16:01:17,881 - distributed.scheduler - INFO - Remove client Client-421b45e3-f2e9-11f0-8001-d684c398e257

2026-01-16 16:01:17,880 - distributed.scheduler - INFO - Remove client Client-a897b0f4-f2ea-11f0-8001-d684c398e257

2026-01-16 16:01:17,880 - distributed.scheduler - INFO - Remove client Client-0f225e2c-f2ec-11f0-8001-d684c398e257

2026-01-16 16:01:17,879 - distributed.scheduler - INFO - Remove client Client-758be2ee-f2ed-11f0-8001-d684c398e257

2026-01-16 16:01:17,878 - distributed.scheduler - INFO - Remove client Client-dbfcc0c4-f2ee-11f0-8001-d684c398e257

2026-01-16 16:01:17,878 - distributed.scheduler - INFO - Remove client Client-427d5b44-f2f0-11f0-8001-d684c398e257

2026-01-16 16:01:17,870 - distributed.scheduler - INFO - Remove client Client-0f716e2f-f2f3-11f0-8001-d684c398e257

2026-01-16 16:01:17,869 - distributed.scheduler - INFO - Remove client Client-a8eed8a3-f2f1-11f0-8001-d684c398e257

2026-01-16 16:01:16,975 - distributed.scheduler - INFO - Close client connection: Client-75fed786-f2f4-11f0-8001-d684c398e257

2026-01-16 16:01:16,974 - distributed.scheduler - INFO - Remove client Client-75fed786-f2f4-11f0-8001-d684c398e257

2026-01-16 16:01:16,972 - distributed.scheduler - INFO - Remove client Client-75fed786-f2f4-11f0-8001-d684c398e257

2026-01-16 16:00:56,726 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.165:37807

2026-01-16 16:00:56,725 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.165:37807', status: closed, memory: 0, processing: 0>

2026-01-16 16:00:55,873 - distributed.scheduler - INFO - Close client connection: Client-worker-92d1153b-f22f-11f0-814b-e2e790da60bf

2026-01-16 16:00:55,847 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.165:37861', status: closed, memory: 0, processing: 0>

2026-01-16 16:00:55,845 - distributed.scheduler - INFO - Remove client Client-worker-92d1153b-f22f-11f0-814b-e2e790da60bf

2026-01-16 16:00:21,438 - distributed.scheduler - INFO - Receive client connection: Client-75fed786-f2f4-11f0-8001-d684c398e257

2026-01-16 15:50:19,875 - distributed.scheduler - INFO - Receive client connection: Client-0f716e2f-f2f3-11f0-8001-d684c398e257

2026-01-16 15:40:18,396 - distributed.scheduler - INFO - Receive client connection: Client-a8eed8a3-f2f1-11f0-8001-d684c398e257

2026-01-16 15:32:22,005 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.62:44951

2026-01-16 15:32:22,003 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.62:44951', status: running, memory: 0, processing: 0>

2026-01-16 15:32:21,044 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.62:42429', status: closed, memory: 0, processing: 0>

2026-01-16 15:32:11,000 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:36053 failed: OSError: Timed out trying to connect to tcp://172.21.25.62:36053 after 30 s

2026-01-16 15:32:10,955 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:33997 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.62:36053 after 30 s')

2026-01-16 15:32:10,947 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:33649 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.62:36053 after 30 s')

2026-01-16 15:32:10,942 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:37283 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.62:36053 after 30 s')

2026-01-16 15:32:10,933 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:38831 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.62:36053 after 30 s')

2026-01-16 15:32:10,932 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:36567 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.62:36053 after 30 s')

2026-01-16 15:32:10,931 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:35235 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.62:36053 after 30 s')

2026-01-16 15:32:10,922 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:32895 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.62:36053 after 30 s')

2026-01-16 15:32:10,916 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:45097 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.62:36053 after 30 s')

2026-01-16 15:32:10,911 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:35843 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.62:36053 after 30 s')

2026-01-16 15:32:10,904 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:33779 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.62:36053 after 30 s')

2026-01-16 15:32:10,900 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:33329 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.62:36053 after 30 s')

2026-01-16 15:32:10,890 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:44341 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.62:36053 after 30 s')

2026-01-16 15:31:41,751 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.62:42429

2026-01-16 15:31:41,749 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.62:42429', status: closed, memory: 0, processing: 0>

2026-01-16 15:31:40,742 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.62:36053', status: closed, memory: 0, processing: 0>

2026-01-16 15:31:32,238 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.62:36053

2026-01-16 15:31:32,236 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.62:36053', status: closed, memory: 0, processing: 0>

2026-01-16 15:31:31,248 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.62:45499', status: closed, memory: 0, processing: 0>

2026-01-16 15:31:11,291 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.62:45499

2026-01-16 15:31:11,288 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.62:45499', status: closed, memory: 0, processing: 0>

2026-01-16 15:31:10,260 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.62:36369', status: closed, memory: 0, processing: 0>

2026-01-16 15:30:48,160 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.62:36369

2026-01-16 15:30:48,159 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.62:36369', status: closed, memory: 0, processing: 0>

2026-01-16 15:30:47,129 - distributed.scheduler - INFO - Close client connection: Client-worker-2be4165c-f227-11f0-814b-4e8606c6fff3

2026-01-16 15:30:47,127 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.62:32951', status: closed, memory: 0, processing: 0>

2026-01-16 15:30:47,125 - distributed.scheduler - INFO - Remove client Client-worker-2be4165c-f227-11f0-814b-4e8606c6fff3

2026-01-16 15:30:17,030 - distributed.scheduler - INFO - Receive client connection: Client-427d5b44-f2f0-11f0-8001-d684c398e257

2026-01-16 15:20:15,559 - distributed.scheduler - INFO - Receive client connection: Client-dbfcc0c4-f2ee-11f0-8001-d684c398e257

2026-01-16 15:10:14,193 - distributed.scheduler - INFO - Receive client connection: Client-758be2ee-f2ed-11f0-8001-d684c398e257

2026-01-16 15:00:12,878 - distributed.scheduler - INFO - Receive client connection: Client-0f225e2c-f2ec-11f0-8001-d684c398e257

2026-01-16 14:50:11,348 - distributed.scheduler - INFO - Receive client connection: Client-a897b0f4-f2ea-11f0-8001-d684c398e257

2026-01-16 14:40:09,911 - distributed.scheduler - INFO - Receive client connection: Client-421b45e3-f2e9-11f0-8001-d684c398e257

2026-01-16 14:30:08,344 - distributed.scheduler - INFO - Receive client connection: Client-db8be3f7-f2e7-11f0-8001-d684c398e257

2026-01-16 14:20:06,905 - distributed.scheduler - INFO - Receive client connection: Client-750cef75-f2e6-11f0-8001-d684c398e257

2026-01-16 14:10:05,449 - distributed.scheduler - INFO - Receive client connection: Client-0e91148b-f2e5-11f0-8001-d684c398e257

2026-01-16 14:00:04,021 - distributed.scheduler - INFO - Receive client connection: Client-a8169f3f-f2e3-11f0-8001-d684c398e257

2026-01-16 13:50:02,576 - distributed.scheduler - INFO - Receive client connection: Client-4197852e-f2e2-11f0-8001-d684c398e257

2026-01-16 13:40:01,085 - distributed.scheduler - INFO - Receive client connection: Client-db14f798-f2e0-11f0-8001-d684c398e257

2026-01-16 13:30:59,729 - distributed.scheduler - INFO - Receive client connection: Client-98689a67-f2df-11f0-8001-d684c398e257

2026-01-16 13:20:58,212 - distributed.scheduler - INFO - Receive client connection: Client-31deae3c-f2de-11f0-8001-d684c398e257

2026-01-16 13:11:31,042 - distributed.scheduler - INFO - Close client connection: Client-cb6a7474-f2dc-11f0-8001-d684c398e257

2026-01-16 13:11:31,041 - distributed.scheduler - INFO - Remove client Client-cb6a7474-f2dc-11f0-8001-d684c398e257

2026-01-16 13:11:31,039 - distributed.scheduler - INFO - Remove client Client-cb6a7474-f2dc-11f0-8001-d684c398e257

2026-01-16 13:10:56,834 - distributed.scheduler - INFO - Receive client connection: Client-cb6a7474-f2dc-11f0-8001-d684c398e257

2026-01-16 13:01:57,455 - distributed.scheduler - INFO - Close client connection: Client-64ef960f-f2db-11f0-8001-d684c398e257

2026-01-16 13:01:57,455 - distributed.scheduler - INFO - Remove client Client-64ef960f-f2db-11f0-8001-d684c398e257

2026-01-16 13:01:57,453 - distributed.scheduler - INFO - Remove client Client-64ef960f-f2db-11f0-8001-d684c398e257

2026-01-16 13:00:55,390 - distributed.scheduler - INFO - Receive client connection: Client-64ef960f-f2db-11f0-8001-d684c398e257

2026-01-16 12:51:27,066 - distributed.scheduler - INFO - Close client connection: Client-fe6e1341-f2d9-11f0-8001-d684c398e257

2026-01-16 12:51:27,065 - distributed.scheduler - INFO - Remove client Client-fe6e1341-f2d9-11f0-8001-d684c398e257

2026-01-16 12:51:27,063 - distributed.scheduler - INFO - Remove client Client-fe6e1341-f2d9-11f0-8001-d684c398e257

2026-01-16 12:50:53,930 - distributed.scheduler - INFO - Receive client connection: Client-fe6e1341-f2d9-11f0-8001-d684c398e257

2026-01-16 12:41:27,336 - distributed.scheduler - INFO - Close client connection: Client-97feca47-f2d8-11f0-8001-d684c398e257

2026-01-16 12:41:27,336 - distributed.scheduler - INFO - Remove client Client-97feca47-f2d8-11f0-8001-d684c398e257

2026-01-16 12:41:27,334 - distributed.scheduler - INFO - Remove client Client-97feca47-f2d8-11f0-8001-d684c398e257

2026-01-16 12:40:52,575 - distributed.scheduler - INFO - Receive client connection: Client-97feca47-f2d8-11f0-8001-d684c398e257

2026-01-16 12:31:43,739 - distributed.scheduler - INFO - Close client connection: Client-318a1526-f2d7-11f0-8001-d684c398e257

2026-01-16 12:31:43,738 - distributed.scheduler - INFO - Remove client Client-318a1526-f2d7-11f0-8001-d684c398e257

2026-01-16 12:31:43,736 - distributed.scheduler - INFO - Remove client Client-318a1526-f2d7-11f0-8001-d684c398e257

2026-01-16 12:30:51,182 - distributed.scheduler - INFO - Receive client connection: Client-318a1526-f2d7-11f0-8001-d684c398e257

2026-01-16 12:21:22,814 - distributed.scheduler - INFO - Close client connection: Client-cb05ba5e-f2d5-11f0-8001-d684c398e257

2026-01-16 12:21:22,813 - distributed.scheduler - INFO - Remove client Client-cb05ba5e-f2d5-11f0-8001-d684c398e257

2026-01-16 12:21:22,811 - distributed.scheduler - INFO - Remove client Client-cb05ba5e-f2d5-11f0-8001-d684c398e257

2026-01-16 12:20:49,691 - distributed.scheduler - INFO - Receive client connection: Client-cb05ba5e-f2d5-11f0-8001-d684c398e257

2026-01-16 12:11:21,991 - distributed.scheduler - INFO - Close client connection: Client-c9a63b8a-f2c0-11f0-8001-d684c398e257

2026-01-16 12:11:21,991 - distributed.scheduler - INFO - Close client connection: Client-96a4607b-f2c3-11f0-8001-d684c398e257

2026-01-16 12:11:21,991 - distributed.scheduler - INFO - Close client connection: Client-3019abd9-f2c2-11f0-8001-d684c398e257

2026-01-16 12:11:21,991 - distributed.scheduler - INFO - Close client connection: Client-ca2b98c3-f2c7-11f0-8001-d684c398e257

2026-01-16 12:11:21,991 - distributed.scheduler - INFO - Close client connection: Client-fd2efb4b-f2c4-11f0-8001-d684c398e257

2026-01-16 12:11:21,990 - distributed.scheduler - INFO - Close client connection: Client-63a9d27b-f2c6-11f0-8001-d684c398e257

2026-01-16 12:11:21,990 - distributed.scheduler - INFO - Close client connection: Client-fdacdfc2-f2cb-11f0-8001-d684c398e257

2026-01-16 12:11:21,990 - distributed.scheduler - INFO - Close client connection: Client-30a1b006-f2c9-11f0-8001-d684c398e257

2026-01-16 12:11:21,990 - distributed.scheduler - INFO - Close client connection: Client-97259dcf-f2ca-11f0-8001-d684c398e257

2026-01-16 12:11:21,990 - distributed.scheduler - INFO - Close client connection: Client-642e6ea4-f2cd-11f0-8001-d684c398e257

2026-01-16 12:11:21,990 - distributed.scheduler - INFO - Close client connection: Client-caa487b7-f2ce-11f0-8001-d684c398e257

2026-01-16 12:11:21,989 - distributed.scheduler - INFO - Close client connection: Client-3118db9b-f2d0-11f0-8001-d684c398e257

2026-01-16 12:11:21,989 - distributed.scheduler - INFO - Close client connection: Client-fe05e2a7-f2d2-11f0-8001-d684c398e257

2026-01-16 12:11:21,988 - distributed.scheduler - INFO - Close client connection: Client-9787611a-f2d1-11f0-8001-d684c398e257

2026-01-16 12:11:21,987 - distributed.scheduler - INFO - Remove client Client-c9a63b8a-f2c0-11f0-8001-d684c398e257

2026-01-16 12:11:21,986 - distributed.scheduler - INFO - Remove client Client-96a4607b-f2c3-11f0-8001-d684c398e257

2026-01-16 12:11:21,986 - distributed.scheduler - INFO - Remove client Client-3019abd9-f2c2-11f0-8001-d684c398e257

2026-01-16 12:11:21,985 - distributed.scheduler - INFO - Remove client Client-ca2b98c3-f2c7-11f0-8001-d684c398e257

2026-01-16 12:11:21,985 - distributed.scheduler - INFO - Remove client Client-fd2efb4b-f2c4-11f0-8001-d684c398e257

2026-01-16 12:11:21,984 - distributed.scheduler - INFO - Remove client Client-63a9d27b-f2c6-11f0-8001-d684c398e257

2026-01-16 12:11:21,983 - distributed.scheduler - INFO - Remove client Client-fdacdfc2-f2cb-11f0-8001-d684c398e257

2026-01-16 12:11:21,982 - distributed.scheduler - INFO - Remove client Client-30a1b006-f2c9-11f0-8001-d684c398e257

2026-01-16 12:11:21,982 - distributed.scheduler - INFO - Remove client Client-97259dcf-f2ca-11f0-8001-d684c398e257

2026-01-16 12:11:21,981 - distributed.scheduler - INFO - Remove client Client-642e6ea4-f2cd-11f0-8001-d684c398e257

2026-01-16 12:11:21,980 - distributed.scheduler - INFO - Remove client Client-caa487b7-f2ce-11f0-8001-d684c398e257

2026-01-16 12:11:21,979 - distributed.scheduler - INFO - Remove client Client-3118db9b-f2d0-11f0-8001-d684c398e257

2026-01-16 12:11:21,978 - distributed.scheduler - INFO - Remove client Client-fe05e2a7-f2d2-11f0-8001-d684c398e257

2026-01-16 12:11:21,973 - distributed.scheduler - INFO - Remove client Client-9787611a-f2d1-11f0-8001-d684c398e257

2026-01-16 12:11:21,185 - distributed.scheduler - INFO - Close client connection: Client-647f76ff-f2d4-11f0-8001-d684c398e257

2026-01-16 12:11:21,185 - distributed.scheduler - INFO - Remove client Client-647f76ff-f2d4-11f0-8001-d684c398e257

2026-01-16 12:11:21,183 - distributed.scheduler - INFO - Remove client Client-647f76ff-f2d4-11f0-8001-d684c398e257

2026-01-16 12:10:48,178 - distributed.scheduler - INFO - Receive client connection: Client-647f76ff-f2d4-11f0-8001-d684c398e257

2026-01-16 12:00:48,418 - distributed.scheduler - INFO - Receive client connection: Client-worker-fefe30c2-f2d2-11f0-8299-9edd0389b2a9

2026-01-16 12:00:46,754 - distributed.scheduler - INFO - Receive client connection: Client-fe05e2a7-f2d2-11f0-8001-d684c398e257

2026-01-16 11:50:45,304 - distributed.scheduler - INFO - Receive client connection: Client-9787611a-f2d1-11f0-8001-d684c398e257

2026-01-16 11:40:43,946 - distributed.scheduler - INFO - Receive client connection: Client-3118db9b-f2d0-11f0-8001-d684c398e257

2026-01-16 11:30:42,568 - distributed.scheduler - INFO - Receive client connection: Client-caa487b7-f2ce-11f0-8001-d684c398e257

2026-01-16 11:20:41,169 - distributed.scheduler - INFO - Receive client connection: Client-642e6ea4-f2cd-11f0-8001-d684c398e257

2026-01-16 11:10:39,692 - distributed.scheduler - INFO - Receive client connection: Client-fdacdfc2-f2cb-11f0-8001-d684c398e257

2026-01-16 11:00:38,181 - distributed.scheduler - INFO - Receive client connection: Client-97259dcf-f2ca-11f0-8001-d684c398e257

2026-01-16 10:50:36,696 - distributed.scheduler - INFO - Receive client connection: Client-30a1b006-f2c9-11f0-8001-d684c398e257

2026-01-16 10:40:35,296 - distributed.scheduler - INFO - Receive client connection: Client-ca2b98c3-f2c7-11f0-8001-d684c398e257

2026-01-16 10:30:33,821 - distributed.scheduler - INFO - Receive client connection: Client-63a9d27b-f2c6-11f0-8001-d684c398e257

2026-01-16 10:20:32,396 - distributed.scheduler - INFO - Receive client connection: Client-fd2efb4b-f2c4-11f0-8001-d684c398e257

2026-01-16 10:10:30,859 - distributed.scheduler - INFO - Receive client connection: Client-96a4607b-f2c3-11f0-8001-d684c398e257

2026-01-16 10:00:29,328 - distributed.scheduler - INFO - Receive client connection: Client-3019abd9-f2c2-11f0-8001-d684c398e257

2026-01-16 09:50:27,957 - distributed.scheduler - INFO - Receive client connection: Client-c9a63b8a-f2c0-11f0-8001-d684c398e257

2026-01-16 09:40:56,613 - distributed.scheduler - INFO - Close client connection: Client-6321e7b7-f2bf-11f0-8001-d684c398e257

2026-01-16 09:40:56,612 - distributed.scheduler - INFO - Remove client Client-6321e7b7-f2bf-11f0-8001-d684c398e257

2026-01-16 09:40:56,610 - distributed.scheduler - INFO - Remove client Client-6321e7b7-f2bf-11f0-8001-d684c398e257

2026-01-16 09:40:26,465 - distributed.scheduler - INFO - Receive client connection: Client-6321e7b7-f2bf-11f0-8001-d684c398e257

2026-01-16 09:31:19,672 - distributed.scheduler - INFO - Close client connection: Client-fc8e9a90-f2bd-11f0-8001-d684c398e257

2026-01-16 09:31:19,670 - distributed.scheduler - INFO - Remove client Client-fc8e9a90-f2bd-11f0-8001-d684c398e257

2026-01-16 09:31:19,668 - distributed.scheduler - INFO - Remove client Client-fc8e9a90-f2bd-11f0-8001-d684c398e257

2026-01-16 09:30:24,862 - distributed.scheduler - INFO - Receive client connection: Client-fc8e9a90-f2bd-11f0-8001-d684c398e257

2026-01-16 09:20:56,125 - distributed.scheduler - INFO - Close client connection: Client-960ec577-f2bc-11f0-8001-d684c398e257

2026-01-16 09:20:56,124 - distributed.scheduler - INFO - Remove client Client-960ec577-f2bc-11f0-8001-d684c398e257

2026-01-16 09:20:56,123 - distributed.scheduler - INFO - Remove client Client-960ec577-f2bc-11f0-8001-d684c398e257

2026-01-16 09:20:23,411 - distributed.scheduler - INFO - Receive client connection: Client-960ec577-f2bc-11f0-8001-d684c398e257

2026-01-16 09:10:55,728 - distributed.scheduler - INFO - Close client connection: Client-2f898b1d-f2bb-11f0-8001-d684c398e257

2026-01-16 09:10:55,727 - distributed.scheduler - INFO - Remove client Client-2f898b1d-f2bb-11f0-8001-d684c398e257

2026-01-16 09:10:55,725 - distributed.scheduler - INFO - Remove client Client-2f898b1d-f2bb-11f0-8001-d684c398e257

2026-01-16 09:10:21,915 - distributed.scheduler - INFO - Receive client connection: Client-2f898b1d-f2bb-11f0-8001-d684c398e257

2026-01-16 09:01:20,073 - distributed.scheduler - INFO - Close client connection: Client-c90d1f7c-f2b9-11f0-8001-d684c398e257

2026-01-16 09:01:20,072 - distributed.scheduler - INFO - Remove client Client-c90d1f7c-f2b9-11f0-8001-d684c398e257

2026-01-16 09:01:20,071 - distributed.scheduler - INFO - Remove client Client-c90d1f7c-f2b9-11f0-8001-d684c398e257

2026-01-16 09:00:20,472 - distributed.scheduler - INFO - Receive client connection: Client-c90d1f7c-f2b9-11f0-8001-d684c398e257

2026-01-16 08:50:51,995 - distributed.scheduler - INFO - Close client connection: Client-6293d081-f2b8-11f0-8001-d684c398e257

2026-01-16 08:50:51,994 - distributed.scheduler - INFO - Remove client Client-6293d081-f2b8-11f0-8001-d684c398e257

2026-01-16 08:50:51,993 - distributed.scheduler - INFO - Remove client Client-6293d081-f2b8-11f0-8001-d684c398e257

2026-01-16 08:50:19,053 - distributed.scheduler - INFO - Receive client connection: Client-6293d081-f2b8-11f0-8001-d684c398e257

2026-01-16 08:40:53,027 - distributed.scheduler - INFO - Close client connection: Client-fc13ded7-f2b6-11f0-8001-d684c398e257

2026-01-16 08:40:53,025 - distributed.scheduler - INFO - Remove client Client-fc13ded7-f2b6-11f0-8001-d684c398e257

2026-01-16 08:40:53,023 - distributed.scheduler - INFO - Remove client Client-fc13ded7-f2b6-11f0-8001-d684c398e257

2026-01-16 08:40:17,588 - distributed.scheduler - INFO - Receive client connection: Client-fc13ded7-f2b6-11f0-8001-d684c398e257

2026-01-16 08:31:11,318 - distributed.scheduler - INFO - Close client connection: Client-95915875-f2b5-11f0-8001-d684c398e257

2026-01-16 08:31:11,317 - distributed.scheduler - INFO - Remove client Client-95915875-f2b5-11f0-8001-d684c398e257

2026-01-16 08:31:11,315 - distributed.scheduler - INFO - Remove client Client-95915875-f2b5-11f0-8001-d684c398e257

2026-01-16 08:30:16,102 - distributed.scheduler - INFO - Receive client connection: Client-95915875-f2b5-11f0-8001-d684c398e257

2026-01-16 08:20:48,176 - distributed.scheduler - INFO - Close client connection: Client-2f156052-f2b4-11f0-8001-d684c398e257

2026-01-16 08:20:48,173 - distributed.scheduler - INFO - Remove client Client-2f156052-f2b4-11f0-8001-d684c398e257

2026-01-16 08:20:48,171 - distributed.scheduler - INFO - Remove client Client-2f156052-f2b4-11f0-8001-d684c398e257

2026-01-16 08:20:14,673 - distributed.scheduler - INFO - Receive client connection: Client-2f156052-f2b4-11f0-8001-d684c398e257

2026-01-16 08:10:48,049 - distributed.scheduler - INFO - Close client connection: Client-c8b8f4c6-f2b2-11f0-8001-d684c398e257

2026-01-16 08:10:48,049 - distributed.scheduler - INFO - Remove client Client-c8b8f4c6-f2b2-11f0-8001-d684c398e257

2026-01-16 08:10:48,047 - distributed.scheduler - INFO - Remove client Client-c8b8f4c6-f2b2-11f0-8001-d684c398e257

2026-01-16 08:10:13,443 - distributed.scheduler - INFO - Receive client connection: Client-c8b8f4c6-f2b2-11f0-8001-d684c398e257

2026-01-16 08:01:08,999 - distributed.scheduler - INFO - Close client connection: Client-6233c2a7-f2b1-11f0-8001-d684c398e257

2026-01-16 08:01:08,997 - distributed.scheduler - INFO - Remove client Client-6233c2a7-f2b1-11f0-8001-d684c398e257

2026-01-16 08:01:08,995 - distributed.scheduler - INFO - Remove client Client-6233c2a7-f2b1-11f0-8001-d684c398e257

2026-01-16 08:00:11,947 - distributed.scheduler - INFO - Receive client connection: Client-6233c2a7-f2b1-11f0-8001-d684c398e257

2026-01-16 07:50:43,432 - distributed.scheduler - INFO - Close client connection: Client-fbb1eb0d-f2af-11f0-8001-d684c398e257

2026-01-16 07:50:43,430 - distributed.scheduler - INFO - Remove client Client-fbb1eb0d-f2af-11f0-8001-d684c398e257

2026-01-16 07:50:43,429 - distributed.scheduler - INFO - Remove client Client-fbb1eb0d-f2af-11f0-8001-d684c398e257

2026-01-16 07:50:10,472 - distributed.scheduler - INFO - Receive client connection: Client-fbb1eb0d-f2af-11f0-8001-d684c398e257

2026-01-16 07:40:40,387 - distributed.scheduler - INFO - Close client connection: Client-953d2e04-f2ae-11f0-8001-d684c398e257

2026-01-16 07:40:40,386 - distributed.scheduler - INFO - Remove client Client-953d2e04-f2ae-11f0-8001-d684c398e257

2026-01-16 07:40:40,384 - distributed.scheduler - INFO - Remove client Client-953d2e04-f2ae-11f0-8001-d684c398e257

2026-01-16 07:40:09,114 - distributed.scheduler - INFO - Receive client connection: Client-953d2e04-f2ae-11f0-8001-d684c398e257

2026-01-16 07:30:59,415 - distributed.scheduler - INFO - Close client connection: Client-2eafdabe-f2ad-11f0-8001-d684c398e257

2026-01-16 07:30:59,414 - distributed.scheduler - INFO - Remove client Client-2eafdabe-f2ad-11f0-8001-d684c398e257

2026-01-16 07:30:59,413 - distributed.scheduler - INFO - Remove client Client-2eafdabe-f2ad-11f0-8001-d684c398e257

2026-01-16 07:30:07,531 - distributed.scheduler - INFO - Receive client connection: Client-2eafdabe-f2ad-11f0-8001-d684c398e257

2026-01-16 07:20:38,226 - distributed.scheduler - INFO - Close client connection: Client-c833db32-f2ab-11f0-8001-d684c398e257

2026-01-16 07:20:38,225 - distributed.scheduler - INFO - Remove client Client-c833db32-f2ab-11f0-8001-d684c398e257

2026-01-16 07:20:38,223 - distributed.scheduler - INFO - Remove client Client-c833db32-f2ab-11f0-8001-d684c398e257

2026-01-16 07:20:06,093 - distributed.scheduler - INFO - Receive client connection: Client-c833db32-f2ab-11f0-8001-d684c398e257

2026-01-16 07:10:35,429 - distributed.scheduler - INFO - Close client connection: Client-61b06cf7-f2aa-11f0-8001-d684c398e257

2026-01-16 07:10:35,429 - distributed.scheduler - INFO - Remove client Client-61b06cf7-f2aa-11f0-8001-d684c398e257

2026-01-16 07:10:35,428 - distributed.scheduler - INFO - Remove client Client-61b06cf7-f2aa-11f0-8001-d684c398e257

2026-01-16 07:10:04,605 - distributed.scheduler - INFO - Receive client connection: Client-61b06cf7-f2aa-11f0-8001-d684c398e257

2026-01-16 07:00:53,998 - distributed.scheduler - INFO - Close client connection: Client-94ac4525-f2a7-11f0-8001-d684c398e257

2026-01-16 07:00:53,998 - distributed.scheduler - INFO - Remove client Client-94ac4525-f2a7-11f0-8001-d684c398e257

2026-01-16 07:00:53,182 - distributed.scheduler - INFO - Close client connection: Client-fb39cb77-f2a8-11f0-8001-d684c398e257

2026-01-16 07:00:53,181 - distributed.scheduler - INFO - Remove client Client-fb39cb77-f2a8-11f0-8001-d684c398e257

2026-01-16 07:00:53,179 - distributed.scheduler - INFO - Remove client Client-fb39cb77-f2a8-11f0-8001-d684c398e257

2026-01-16 07:00:03,195 - distributed.scheduler - INFO - Receive client connection: Client-fb39cb77-f2a8-11f0-8001-d684c398e257

2026-01-16 06:50:01,656 - distributed.scheduler - INFO - Receive client connection: Client-94ac4525-f2a7-11f0-8001-d684c398e257

2026-01-16 06:40:31,494 - distributed.scheduler - INFO - Close client connection: Client-2e2831f3-f2a6-11f0-8001-d684c398e257

2026-01-16 06:40:31,492 - distributed.scheduler - INFO - Remove client Client-2e2831f3-f2a6-11f0-8001-d684c398e257

2026-01-16 06:40:31,490 - distributed.scheduler - INFO - Remove client Client-2e2831f3-f2a6-11f0-8001-d684c398e257

2026-01-16 06:40:00,164 - distributed.scheduler - INFO - Receive client connection: Client-2e2831f3-f2a6-11f0-8001-d684c398e257

2026-01-16 06:31:51,055 - distributed.scheduler - INFO - Close client connection: Client-eb8f1d94-f2a4-11f0-8001-d684c398e257

2026-01-16 06:31:51,054 - distributed.scheduler - INFO - Remove client Client-eb8f1d94-f2a4-11f0-8001-d684c398e257

2026-01-16 06:31:51,052 - distributed.scheduler - INFO - Remove client Client-eb8f1d94-f2a4-11f0-8001-d684c398e257

2026-01-16 06:30:58,932 - distributed.scheduler - INFO - Receive client connection: Client-eb8f1d94-f2a4-11f0-8001-d684c398e257

2026-01-16 06:21:28,550 - distributed.scheduler - INFO - Close client connection: Client-850fb48b-f2a3-11f0-8001-d684c398e257

2026-01-16 06:21:28,549 - distributed.scheduler - INFO - Remove client Client-850fb48b-f2a3-11f0-8001-d684c398e257

2026-01-16 06:21:28,547 - distributed.scheduler - INFO - Remove client Client-850fb48b-f2a3-11f0-8001-d684c398e257

2026-01-16 06:20:57,477 - distributed.scheduler - INFO - Receive client connection: Client-850fb48b-f2a3-11f0-8001-d684c398e257

2026-01-16 06:11:26,544 - distributed.scheduler - INFO - Close client connection: Client-1e855d6a-f2a2-11f0-8001-d684c398e257

2026-01-16 06:11:26,543 - distributed.scheduler - INFO - Remove client Client-1e855d6a-f2a2-11f0-8001-d684c398e257

2026-01-16 06:11:26,541 - distributed.scheduler - INFO - Remove client Client-1e855d6a-f2a2-11f0-8001-d684c398e257

2026-01-16 06:10:55,952 - distributed.scheduler - INFO - Receive client connection: Client-1e855d6a-f2a2-11f0-8001-d684c398e257

2026-01-16 06:01:49,806 - distributed.scheduler - INFO - Close client connection: Client-b800823f-f2a0-11f0-8001-d684c398e257

2026-01-16 06:01:49,804 - distributed.scheduler - INFO - Remove client Client-b800823f-f2a0-11f0-8001-d684c398e257

2026-01-16 06:01:49,803 - distributed.scheduler - INFO - Remove client Client-b800823f-f2a0-11f0-8001-d684c398e257

2026-01-16 06:00:54,453 - distributed.scheduler - INFO - Receive client connection: Client-b800823f-f2a0-11f0-8001-d684c398e257

2026-01-16 05:51:28,499 - distributed.scheduler - INFO - Close client connection: Client-eaf68de4-f29d-11f0-8001-d684c398e257

2026-01-16 05:51:28,497 - distributed.scheduler - INFO - Remove client Client-eaf68de4-f29d-11f0-8001-d684c398e257

2026-01-16 05:51:27,678 - distributed.scheduler - INFO - Close client connection: Client-517923ee-f29f-11f0-8001-d684c398e257

2026-01-16 05:51:27,676 - distributed.scheduler - INFO - Remove client Client-517923ee-f29f-11f0-8001-d684c398e257

2026-01-16 05:51:27,675 - distributed.scheduler - INFO - Remove client Client-517923ee-f29f-11f0-8001-d684c398e257

2026-01-16 05:50:52,937 - distributed.scheduler - INFO - Receive client connection: Client-517923ee-f29f-11f0-8001-d684c398e257

2026-01-16 05:40:51,497 - distributed.scheduler - INFO - Receive client connection: Client-eaf68de4-f29d-11f0-8001-d684c398e257

2026-01-16 05:31:50,282 - distributed.scheduler - INFO - Close client connection: Client-846f65a7-f29c-11f0-8001-d684c398e257

2026-01-16 05:31:50,281 - distributed.scheduler - INFO - Remove client Client-846f65a7-f29c-11f0-8001-d684c398e257

2026-01-16 05:31:50,279 - distributed.scheduler - INFO - Remove client Client-846f65a7-f29c-11f0-8001-d684c398e257

2026-01-16 05:30:53,315 - distributed.scheduler - INFO - Receive client connection: Client-worker-866f967b-f29c-11f0-827c-c6c79f0eb8d9

2026-01-16 05:30:49,950 - distributed.scheduler - INFO - Receive client connection: Client-846f65a7-f29c-11f0-8001-d684c398e257

2026-01-16 05:21:22,431 - distributed.scheduler - INFO - Close client connection: Client-1deb42d6-f29b-11f0-8001-d684c398e257

2026-01-16 05:21:22,425 - distributed.scheduler - INFO - Remove client Client-1deb42d6-f29b-11f0-8001-d684c398e257

2026-01-16 05:21:22,423 - distributed.scheduler - INFO - Remove client Client-1deb42d6-f29b-11f0-8001-d684c398e257

2026-01-16 05:20:48,460 - distributed.scheduler - INFO - Receive client connection: Client-1deb42d6-f29b-11f0-8001-d684c398e257

2026-01-16 05:11:21,111 - distributed.scheduler - INFO - Close client connection: Client-b7669068-f299-11f0-8001-d684c398e257

2026-01-16 05:11:21,110 - distributed.scheduler - INFO - Remove client Client-b7669068-f299-11f0-8001-d684c398e257

2026-01-16 05:11:21,108 - distributed.scheduler - INFO - Remove client Client-b7669068-f299-11f0-8001-d684c398e257

2026-01-16 05:10:46,966 - distributed.scheduler - INFO - Receive client connection: Client-b7669068-f299-11f0-8001-d684c398e257

2026-01-16 05:01:47,940 - distributed.scheduler - INFO - Close client connection: Client-50e7ffdf-f298-11f0-8001-d684c398e257

2026-01-16 05:01:47,938 - distributed.scheduler - INFO - Remove client Client-50e7ffdf-f298-11f0-8001-d684c398e257

2026-01-16 05:01:47,936 - distributed.scheduler - INFO - Remove client Client-50e7ffdf-f298-11f0-8001-d684c398e257

2026-01-16 05:00:45,510 - distributed.scheduler - INFO - Receive client connection: Client-50e7ffdf-f298-11f0-8001-d684c398e257

2026-01-16 04:51:17,410 - distributed.scheduler - INFO - Close client connection: Client-ea745d79-f296-11f0-8001-d684c398e257

2026-01-16 04:51:17,409 - distributed.scheduler - INFO - Remove client Client-ea745d79-f296-11f0-8001-d684c398e257

2026-01-16 04:51:17,407 - distributed.scheduler - INFO - Remove client Client-ea745d79-f296-11f0-8001-d684c398e257

2026-01-16 04:50:44,126 - distributed.scheduler - INFO - Receive client connection: Client-ea745d79-f296-11f0-8001-d684c398e257

2026-01-16 04:41:22,273 - distributed.scheduler - INFO - Close client connection: Client-8405c951-f295-11f0-8001-d684c398e257

2026-01-16 04:41:22,272 - distributed.scheduler - INFO - Remove client Client-8405c951-f295-11f0-8001-d684c398e257

2026-01-16 04:41:22,270 - distributed.scheduler - INFO - Remove client Client-8405c951-f295-11f0-8001-d684c398e257

2026-01-16 04:40:42,772 - distributed.scheduler - INFO - Receive client connection: Client-8405c951-f295-11f0-8001-d684c398e257

2026-01-16 04:31:36,119 - distributed.scheduler - INFO - Close client connection: Client-1d8c658d-f294-11f0-8001-d684c398e257

2026-01-16 04:31:36,119 - distributed.scheduler - INFO - Remove client Client-1d8c658d-f294-11f0-8001-d684c398e257

2026-01-16 04:31:36,118 - distributed.scheduler - INFO - Remove client Client-1d8c658d-f294-11f0-8001-d684c398e257

2026-01-16 04:30:43,878 - distributed.scheduler - INFO - Receive client connection: Client-worker-1f0d55ff-f294-11f0-8234-b2b90c3ada4d

2026-01-16 04:30:41,362 - distributed.scheduler - INFO - Receive client connection: Client-1d8c658d-f294-11f0-8001-d684c398e257

2026-01-16 04:21:13,719 - distributed.scheduler - INFO - Close client connection: Client-096ba87e-f251-11f0-8001-d684c398e257

2026-01-16 04:21:13,718 - distributed.scheduler - INFO - Close client connection: Client-6ff21b93-f252-11f0-8001-d684c398e257

2026-01-16 04:21:13,718 - distributed.scheduler - INFO - Close client connection: Client-d670ee29-f253-11f0-8001-d684c398e257

2026-01-16 04:21:13,718 - distributed.scheduler - INFO - Close client connection: Client-a37c6ed8-f256-11f0-8001-d684c398e257

2026-01-16 04:21:13,718 - distributed.scheduler - INFO - Close client connection: Client-3cee6bd6-f255-11f0-8001-d684c398e257

2026-01-16 04:21:13,718 - distributed.scheduler - INFO - Close client connection: Client-0a01c9b3-f258-11f0-8001-d684c398e257

2026-01-16 04:21:13,718 - distributed.scheduler - INFO - Close client connection: Client-7084325d-f259-11f0-8001-d684c398e257

2026-01-16 04:21:13,718 - distributed.scheduler - INFO - Close client connection: Client-d7087ebb-f25a-11f0-8001-d684c398e257

2026-01-16 04:21:13,718 - distributed.scheduler - INFO - Close client connection: Client-3d89722d-f25c-11f0-8001-d684c398e257

2026-01-16 04:21:13,718 - distributed.scheduler - INFO - Close client connection: Client-a3f27b1a-f25d-11f0-8001-d684c398e257

2026-01-16 04:21:13,718 - distributed.scheduler - INFO - Close client connection: Client-0a74f5ec-f25f-11f0-8001-d684c398e257

2026-01-16 04:21:13,718 - distributed.scheduler - INFO - Close client connection: Client-70ee9b98-f260-11f0-8001-d684c398e257

2026-01-16 04:21:13,717 - distributed.scheduler - INFO - Close client connection: Client-d7673620-f261-11f0-8001-d684c398e257

2026-01-16 04:21:13,717 - distributed.scheduler - INFO - Close client connection: Client-3dea011f-f263-11f0-8001-d684c398e257

2026-01-16 04:21:13,717 - distributed.scheduler - INFO - Close client connection: Client-a46e01d3-f264-11f0-8001-d684c398e257

2026-01-16 04:21:13,717 - distributed.scheduler - INFO - Close client connection: Client-0ad14ca6-f266-11f0-8001-d684c398e257

2026-01-16 04:21:13,717 - distributed.scheduler - INFO - Close client connection: Client-715619e0-f267-11f0-8001-d684c398e257

2026-01-16 04:21:13,717 - distributed.scheduler - INFO - Close client connection: Client-d7e23460-f268-11f0-8001-d684c398e257

2026-01-16 04:21:13,717 - distributed.scheduler - INFO - Close client connection: Client-3e68adf8-f26a-11f0-8001-d684c398e257

2026-01-16 04:21:13,717 - distributed.scheduler - INFO - Close client connection: Client-e797659f-f26c-11f0-8001-d684c398e257

2026-01-16 04:21:13,717 - distributed.scheduler - INFO - Close client connection: Client-4e1d1a5e-f26e-11f0-8001-d684c398e257

2026-01-16 04:21:13,717 - distributed.scheduler - INFO - Close client connection: Client-a4dcfd29-f26b-11f0-8001-d684c398e257

2026-01-16 04:21:13,717 - distributed.scheduler - INFO - Close client connection: Client-b4a8ee47-f26f-11f0-8001-d684c398e257

2026-01-16 04:21:13,716 - distributed.scheduler - INFO - Close client connection: Client-1b25f116-f271-11f0-8001-d684c398e257

2026-01-16 04:21:13,716 - distributed.scheduler - INFO - Close client connection: Client-81ac567a-f272-11f0-8001-d684c398e257

2026-01-16 04:21:13,716 - distributed.scheduler - INFO - Close client connection: Client-e8249fce-f273-11f0-8001-d684c398e257

2026-01-16 04:21:13,716 - distributed.scheduler - INFO - Close client connection: Client-4ead62f6-f275-11f0-8001-d684c398e257

2026-01-16 04:21:13,716 - distributed.scheduler - INFO - Close client connection: Client-b52f3079-f276-11f0-8001-d684c398e257

2026-01-16 04:21:13,716 - distributed.scheduler - INFO - Close client connection: Client-1bbb753c-f278-11f0-8001-d684c398e257

2026-01-16 04:21:13,716 - distributed.scheduler - INFO - Close client connection: Client-822e60e4-f279-11f0-8001-d684c398e257

2026-01-16 04:21:13,716 - distributed.scheduler - INFO - Close client connection: Client-e89afc0f-f27a-11f0-8001-d684c398e257

2026-01-16 04:21:13,716 - distributed.scheduler - INFO - Close client connection: Client-4f1e16f7-f27c-11f0-8001-d684c398e257

2026-01-16 04:21:13,716 - distributed.scheduler - INFO - Close client connection: Client-b59d8e32-f27d-11f0-8001-d684c398e257

2026-01-16 04:21:13,715 - distributed.scheduler - INFO - Close client connection: Client-1c12feb3-f27f-11f0-8001-d684c398e257

2026-01-16 04:21:13,715 - distributed.scheduler - INFO - Close client connection: Client-82a72397-f280-11f0-8001-d684c398e257

2026-01-16 04:21:13,715 - distributed.scheduler - INFO - Close client connection: Client-e91c684d-f281-11f0-8001-d684c398e257

2026-01-16 04:21:13,715 - distributed.scheduler - INFO - Close client connection: Client-1ca4824f-f286-11f0-8001-d684c398e257

2026-01-16 04:21:13,715 - distributed.scheduler - INFO - Close client connection: Client-4fa29ea2-f283-11f0-8001-d684c398e257

2026-01-16 04:21:13,715 - distributed.scheduler - INFO - Close client connection: Client-833256f0-f287-11f0-8001-d684c398e257

2026-01-16 04:21:13,715 - distributed.scheduler - INFO - Close client connection: Client-b62678a2-f284-11f0-8001-d684c398e257

2026-01-16 04:21:13,715 - distributed.scheduler - INFO - Close client connection: Client-502be1f4-f28a-11f0-8001-d684c398e257

2026-01-16 04:21:13,715 - distributed.scheduler - INFO - Close client connection: Client-b6a2b064-f28b-11f0-8001-d684c398e257

2026-01-16 04:21:13,714 - distributed.scheduler - INFO - Close client connection: Client-83954f0b-f28e-11f0-8001-d684c398e257

2026-01-16 04:21:13,714 - distributed.scheduler - INFO - Close client connection: Client-e99df020-f288-11f0-8001-d684c398e257

2026-01-16 04:21:13,713 - distributed.scheduler - INFO - Close client connection: Client-508d1b71-f291-11f0-8001-d684c398e257

2026-01-16 04:21:13,713 - distributed.scheduler - INFO - Close client connection: Client-1d1afb91-f28d-11f0-8001-d684c398e257

2026-01-16 04:21:13,713 - distributed.scheduler - INFO - Close client connection: Client-ea1d87e6-f28f-11f0-8001-d684c398e257

2026-01-16 04:21:13,710 - distributed.scheduler - INFO - Remove client Client-096ba87e-f251-11f0-8001-d684c398e257

2026-01-16 04:21:13,710 - distributed.scheduler - INFO - Remove client Client-6ff21b93-f252-11f0-8001-d684c398e257

2026-01-16 04:21:13,709 - distributed.scheduler - INFO - Remove client Client-d670ee29-f253-11f0-8001-d684c398e257

2026-01-16 04:21:13,709 - distributed.scheduler - INFO - Remove client Client-a37c6ed8-f256-11f0-8001-d684c398e257

2026-01-16 04:21:13,709 - distributed.scheduler - INFO - Remove client Client-3cee6bd6-f255-11f0-8001-d684c398e257

2026-01-16 04:21:13,709 - distributed.scheduler - INFO - Remove client Client-0a01c9b3-f258-11f0-8001-d684c398e257

2026-01-16 04:21:13,708 - distributed.scheduler - INFO - Remove client Client-7084325d-f259-11f0-8001-d684c398e257

2026-01-16 04:21:13,708 - distributed.scheduler - INFO - Remove client Client-d7087ebb-f25a-11f0-8001-d684c398e257

2026-01-16 04:21:13,708 - distributed.scheduler - INFO - Remove client Client-3d89722d-f25c-11f0-8001-d684c398e257

2026-01-16 04:21:13,707 - distributed.scheduler - INFO - Remove client Client-a3f27b1a-f25d-11f0-8001-d684c398e257

2026-01-16 04:21:13,707 - distributed.scheduler - INFO - Remove client Client-0a74f5ec-f25f-11f0-8001-d684c398e257

2026-01-16 04:21:13,707 - distributed.scheduler - INFO - Remove client Client-70ee9b98-f260-11f0-8001-d684c398e257

2026-01-16 04:21:13,707 - distributed.scheduler - INFO - Remove client Client-d7673620-f261-11f0-8001-d684c398e257

2026-01-16 04:21:13,706 - distributed.scheduler - INFO - Remove client Client-3dea011f-f263-11f0-8001-d684c398e257

2026-01-16 04:21:13,706 - distributed.scheduler - INFO - Remove client Client-a46e01d3-f264-11f0-8001-d684c398e257

2026-01-16 04:21:13,706 - distributed.scheduler - INFO - Remove client Client-0ad14ca6-f266-11f0-8001-d684c398e257

2026-01-16 04:21:13,706 - distributed.scheduler - INFO - Remove client Client-715619e0-f267-11f0-8001-d684c398e257

2026-01-16 04:21:13,705 - distributed.scheduler - INFO - Remove client Client-d7e23460-f268-11f0-8001-d684c398e257

2026-01-16 04:21:13,705 - distributed.scheduler - INFO - Remove client Client-3e68adf8-f26a-11f0-8001-d684c398e257

2026-01-16 04:21:13,705 - distributed.scheduler - INFO - Remove client Client-e797659f-f26c-11f0-8001-d684c398e257

2026-01-16 04:21:13,704 - distributed.scheduler - INFO - Remove client Client-4e1d1a5e-f26e-11f0-8001-d684c398e257

2026-01-16 04:21:13,704 - distributed.scheduler - INFO - Remove client Client-a4dcfd29-f26b-11f0-8001-d684c398e257

2026-01-16 04:21:13,704 - distributed.scheduler - INFO - Remove client Client-b4a8ee47-f26f-11f0-8001-d684c398e257

2026-01-16 04:21:13,704 - distributed.scheduler - INFO - Remove client Client-1b25f116-f271-11f0-8001-d684c398e257

2026-01-16 04:21:13,703 - distributed.scheduler - INFO - Remove client Client-81ac567a-f272-11f0-8001-d684c398e257

2026-01-16 04:21:13,703 - distributed.scheduler - INFO - Remove client Client-e8249fce-f273-11f0-8001-d684c398e257

2026-01-16 04:21:13,703 - distributed.scheduler - INFO - Remove client Client-4ead62f6-f275-11f0-8001-d684c398e257

2026-01-16 04:21:13,702 - distributed.scheduler - INFO - Remove client Client-b52f3079-f276-11f0-8001-d684c398e257

2026-01-16 04:21:13,702 - distributed.scheduler - INFO - Remove client Client-1bbb753c-f278-11f0-8001-d684c398e257

2026-01-16 04:21:13,701 - distributed.scheduler - INFO - Remove client Client-822e60e4-f279-11f0-8001-d684c398e257

2026-01-16 04:21:13,701 - distributed.scheduler - INFO - Remove client Client-e89afc0f-f27a-11f0-8001-d684c398e257

2026-01-16 04:21:13,700 - distributed.scheduler - INFO - Remove client Client-4f1e16f7-f27c-11f0-8001-d684c398e257

2026-01-16 04:21:13,700 - distributed.scheduler - INFO - Remove client Client-b59d8e32-f27d-11f0-8001-d684c398e257

2026-01-16 04:21:13,700 - distributed.scheduler - INFO - Remove client Client-1c12feb3-f27f-11f0-8001-d684c398e257

2026-01-16 04:21:13,699 - distributed.scheduler - INFO - Remove client Client-82a72397-f280-11f0-8001-d684c398e257

2026-01-16 04:21:13,698 - distributed.scheduler - INFO - Remove client Client-e91c684d-f281-11f0-8001-d684c398e257

2026-01-16 04:21:13,698 - distributed.scheduler - INFO - Remove client Client-1ca4824f-f286-11f0-8001-d684c398e257

2026-01-16 04:21:13,698 - distributed.scheduler - INFO - Remove client Client-4fa29ea2-f283-11f0-8001-d684c398e257

2026-01-16 04:21:13,697 - distributed.scheduler - INFO - Remove client Client-833256f0-f287-11f0-8001-d684c398e257

2026-01-16 04:21:13,697 - distributed.scheduler - INFO - Remove client Client-b62678a2-f284-11f0-8001-d684c398e257

2026-01-16 04:21:13,696 - distributed.scheduler - INFO - Remove client Client-502be1f4-f28a-11f0-8001-d684c398e257

2026-01-16 04:21:13,696 - distributed.scheduler - INFO - Remove client Client-b6a2b064-f28b-11f0-8001-d684c398e257

2026-01-16 04:21:13,682 - distributed.scheduler - INFO - Remove client Client-83954f0b-f28e-11f0-8001-d684c398e257

2026-01-16 04:21:13,682 - distributed.scheduler - INFO - Remove client Client-e99df020-f288-11f0-8001-d684c398e257

2026-01-16 04:21:13,681 - distributed.scheduler - INFO - Remove client Client-508d1b71-f291-11f0-8001-d684c398e257

2026-01-16 04:21:13,680 - distributed.scheduler - INFO - Remove client Client-1d1afb91-f28d-11f0-8001-d684c398e257

2026-01-16 04:21:13,679 - distributed.scheduler - INFO - Remove client Client-ea1d87e6-f28f-11f0-8001-d684c398e257

2026-01-16 04:21:13,101 - distributed.scheduler - INFO - Close client connection: Client-b711c161-f292-11f0-8001-d684c398e257

2026-01-16 04:21:13,100 - distributed.scheduler - INFO - Remove client Client-b711c161-f292-11f0-8001-d684c398e257

2026-01-16 04:21:13,098 - distributed.scheduler - INFO - Remove client Client-b711c161-f292-11f0-8001-d684c398e257

2026-01-16 04:20:39,924 - distributed.scheduler - INFO - Receive client connection: Client-b711c161-f292-11f0-8001-d684c398e257

2026-01-16 04:10:38,429 - distributed.scheduler - INFO - Receive client connection: Client-508d1b71-f291-11f0-8001-d684c398e257

2026-01-16 04:00:37,080 - distributed.scheduler - INFO - Receive client connection: Client-ea1d87e6-f28f-11f0-8001-d684c398e257

2026-01-16 03:50:35,554 - distributed.scheduler - INFO - Receive client connection: Client-83954f0b-f28e-11f0-8001-d684c398e257

2026-01-16 03:40:34,122 - distributed.scheduler - INFO - Receive client connection: Client-1d1afb91-f28d-11f0-8001-d684c398e257

2026-01-16 03:32:35,507 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.159:35235

2026-01-16 03:32:35,506 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.159:35235', status: closed, memory: 0, processing: 0>

2026-01-16 03:32:35,321 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.92:33649

2026-01-16 03:32:35,320 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.92:33649', status: running, memory: 0, processing: 0>

2026-01-16 03:32:35,229 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.68:32987

2026-01-16 03:32:35,228 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.68:32987', status: closed, memory: 0, processing: 0>

2026-01-16 03:32:34,513 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.159:35673', status: closed, memory: 0, processing: 0>

2026-01-16 03:32:34,415 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.92:45321', status: closed, memory: 0, processing: 0>

2026-01-16 03:32:34,357 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.68:46725', status: closed, memory: 0, processing: 0>

2026-01-16 03:32:25,063 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.92:45321

2026-01-16 03:32:25,061 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.92:45321', status: closed, memory: 0, processing: 0>

2026-01-16 03:32:24,825 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.159:35673

2026-01-16 03:32:24,825 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.159:35673', status: closed, memory: 0, processing: 0>

2026-01-16 03:32:24,555 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.68:46725

2026-01-16 03:32:24,553 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.68:46725', status: closed, memory: 0, processing: 0>

2026-01-16 03:32:24,152 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.92:35581', status: closed, memory: 0, processing: 0>

2026-01-16 03:32:23,916 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.159:38339', status: closed, memory: 0, processing: 0>

2026-01-16 03:32:23,663 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.68:46011', status: closed, memory: 0, processing: 0>

2026-01-16 03:32:14,503 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.92:35581

2026-01-16 03:32:14,501 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.92:35581', status: closed, memory: 0, processing: 0>

2026-01-16 03:32:13,536 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.159:38339

2026-01-16 03:32:13,535 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.159:38339', status: closed, memory: 0, processing: 0>

2026-01-16 03:32:13,533 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.68:46011

2026-01-16 03:32:13,531 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.68:46011', status: closed, memory: 0, processing: 0>

2026-01-16 03:32:13,469 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.92:36233', status: closed, memory: 0, processing: 0>

2026-01-16 03:32:12,712 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.159:40617', status: closed, memory: 0, processing: 0>

2026-01-16 03:32:12,574 - distributed.scheduler - INFO - Close client connection: Client-worker-e712e1f2-f28b-11f0-8247-c6c79f0eb8d9

2026-01-16 03:32:12,569 - distributed.scheduler - INFO - Remove client Client-worker-e712e1f2-f28b-11f0-8247-c6c79f0eb8d9

2026-01-16 03:32:12,566 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.68:33225', status: closed, memory: 0, processing: 0>

2026-01-16 03:31:53,979 - distributed.scheduler - INFO - Receive client connection: Client-worker-e712e1f2-f28b-11f0-8247-c6c79f0eb8d9

2026-01-16 03:31:52,237 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.159:40617

2026-01-16 03:31:52,236 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.159:40617', status: closed, memory: 0, processing: 0>

2026-01-16 03:31:52,230 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.92:36233

2026-01-16 03:31:52,229 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.92:36233', status: closed, memory: 0, processing: 0>

2026-01-16 03:31:52,095 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.68:33225

2026-01-16 03:31:52,094 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.68:33225', status: closed, memory: 0, processing: 0>

2026-01-16 03:31:51,409 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.159:37517', status: closed, memory: 0, processing: 0>

2026-01-16 03:31:51,225 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.92:40827', status: closed, memory: 0, processing: 0>

2026-01-16 03:31:51,190 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.68:36885', status: closed, memory: 0, processing: 0>

2026-01-16 03:31:36,910 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:38501 failed: OSError: Timed out trying to connect to tcp://172.21.25.68:38501 after 30 s

2026-01-16 03:31:36,910 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:35813 failed: OSError: Timed out trying to connect to tcp://172.21.151.159:35813 after 30 s

2026-01-16 03:31:36,909 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:35319 failed: OSError: Timed out trying to connect to tcp://172.21.25.92:35319 after 30 s

2026-01-16 03:31:36,802 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:35813 failed: OSError: Timed out trying to connect to tcp://172.21.151.159:35813 after 30 s

2026-01-16 03:31:36,802 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:35319 failed: OSError: Timed out trying to connect to tcp://172.21.25.92:35319 after 30 s

2026-01-16 03:31:36,802 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:38501 failed: OSError: Timed out trying to connect to tcp://172.21.25.68:38501 after 30 s

2026-01-16 03:31:36,494 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:40827 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.92:35319 after 30 s')

2026-01-16 03:31:35,149 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:32895 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.92:35319 after 30 s')

2026-01-16 03:31:35,058 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:33153 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:35813 after 30 s')

2026-01-16 03:31:35,022 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:33329 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.92:35319 after 30 s')

2026-01-16 03:31:34,918 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:36567 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.92:35319 after 30 s')

2026-01-16 03:31:34,883 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:33779 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:35813 after 30 s')

2026-01-16 03:31:34,836 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:32895 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:35813 after 30 s')

2026-01-16 03:31:34,717 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:35319 failed: OSError: Timed out trying to connect to tcp://172.21.25.92:35319 after 30 s

2026-01-16 03:31:34,717 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:35813 failed: OSError: Timed out trying to connect to tcp://172.21.151.159:35813 after 30 s

2026-01-16 03:31:34,716 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:38501 failed: OSError: Timed out trying to connect to tcp://172.21.25.68:38501 after 30 s

2026-01-16 03:31:34,622 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:33779 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:35813 after 30 s')

2026-01-16 03:31:34,615 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:45097 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.68:38501 after 30 s')

2026-01-16 03:31:34,584 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:37283 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:35813 after 30 s')

2026-01-16 03:31:34,569 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:37283 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.92:35319 after 30 s')

2026-01-16 03:31:34,431 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:32951 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:35813 after 30 s')

2026-01-16 03:31:34,430 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:44341 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:35813 after 30 s')

2026-01-16 03:31:34,296 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:32951 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:35813 after 30 s')

2026-01-16 03:31:34,240 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:32951 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.92:35319 after 30 s')

2026-01-16 03:31:34,234 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:44341 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:35813 after 30 s')

2026-01-16 03:31:34,225 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:44341 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:35813 after 30 s')

2026-01-16 03:31:34,208 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:32895 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.68:38501 after 30 s')

2026-01-16 03:31:34,192 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:33153 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.92:35319 after 30 s')

2026-01-16 03:31:34,180 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:33329 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.92:35319 after 30 s')

2026-01-16 03:31:34,121 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:33779 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.68:38501 after 30 s')

2026-01-16 03:31:34,075 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:36567 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:35813 after 30 s')

2026-01-16 03:31:05,028 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.159:37517

2026-01-16 03:31:05,027 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.159:37517', status: closed, memory: 0, processing: 0>

2026-01-16 03:31:04,713 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.92:40827

2026-01-16 03:31:04,713 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.92:40827', status: closed, memory: 0, processing: 0>

2026-01-16 03:31:04,543 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.68:36885

2026-01-16 03:31:04,542 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.68:36885', status: closed, memory: 0, processing: 0>

2026-01-16 03:31:03,883 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.159:35813', status: closed, memory: 0, processing: 0>

2026-01-16 03:31:03,882 - distributed.scheduler - INFO - Close client connection: Client-worker-d6e3ef99-f237-11f0-8179-b2b90c3ada4d

2026-01-16 03:31:03,880 - distributed.scheduler - INFO - Remove client Client-worker-d6e3ef99-f237-11f0-8179-b2b90c3ada4d

2026-01-16 03:31:03,818 - distributed.scheduler - INFO - Close client connection: Client-worker-f67bff22-f20d-11f0-81e3-9edd0389b2a9

2026-01-16 03:31:03,811 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.92:35319', status: closed, memory: 0, processing: 0>

2026-01-16 03:31:03,810 - distributed.scheduler - INFO - Remove client Client-worker-f67bff22-f20d-11f0-81e3-9edd0389b2a9

2026-01-16 03:31:03,552 - distributed.scheduler - INFO - Close client connection: Client-worker-f744eedb-f20d-11f0-81b0-c6c79f0eb8d9

2026-01-16 03:31:03,538 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.68:38501', status: closed, memory: 0, processing: 0>

2026-01-16 03:31:03,537 - distributed.scheduler - INFO - Remove client Client-worker-f744eedb-f20d-11f0-81b0-c6c79f0eb8d9

2026-01-16 03:30:32,721 - distributed.scheduler - INFO - Receive client connection: Client-b6a2b064-f28b-11f0-8001-d684c398e257

2026-01-16 03:20:31,320 - distributed.scheduler - INFO - Receive client connection: Client-502be1f4-f28a-11f0-8001-d684c398e257

2026-01-16 03:10:29,763 - distributed.scheduler - INFO - Receive client connection: Client-e99df020-f288-11f0-8001-d684c398e257

2026-01-16 03:00:28,436 - distributed.scheduler - INFO - Receive client connection: Client-833256f0-f287-11f0-8001-d684c398e257

2026-01-16 02:50:26,911 - distributed.scheduler - INFO - Receive client connection: Client-1ca4824f-f286-11f0-8001-d684c398e257

2026-01-16 02:40:25,435 - distributed.scheduler - INFO - Receive client connection: Client-b62678a2-f284-11f0-8001-d684c398e257

2026-01-16 02:30:23,943 - distributed.scheduler - INFO - Receive client connection: Client-4fa29ea2-f283-11f0-8001-d684c398e257

2026-01-16 02:20:22,433 - distributed.scheduler - INFO - Receive client connection: Client-e91c684d-f281-11f0-8001-d684c398e257

2026-01-16 02:10:21,046 - distributed.scheduler - INFO - Receive client connection: Client-82a72397-f280-11f0-8001-d684c398e257

2026-01-16 02:00:22,488 - distributed.scheduler - ERROR - Shut down workers that don't have promised key: [], ('len-agg-e4f2647bb89dc488575d62a32f9504b7', 0) NoneType: None

2026-01-16 02:00:22,487 - distributed.scheduler - ERROR - Couldn't gather keys {"('len-agg-e4f2647bb89dc488575d62a32f9504b7', 0)": []} state: ['waiting'] workers: [] NoneType: None

2026-01-16 02:00:19,443 - distributed.scheduler - INFO - Receive client connection: Client-1c12feb3-f27f-11f0-8001-d684c398e257

2026-01-16 01:50:18,054 - distributed.scheduler - INFO - Receive client connection: Client-b59d8e32-f27d-11f0-8001-d684c398e257

2026-01-16 01:40:16,598 - distributed.scheduler - INFO - Receive client connection: Client-4f1e16f7-f27c-11f0-8001-d684c398e257

2026-01-16 01:30:15,112 - distributed.scheduler - INFO - Receive client connection: Client-e89afc0f-f27a-11f0-8001-d684c398e257

2026-01-16 01:20:13,766 - distributed.scheduler - INFO - Receive client connection: Client-822e60e4-f279-11f0-8001-d684c398e257

2026-01-16 01:10:12,393 - distributed.scheduler - INFO - Receive client connection: Client-1bbb753c-f278-11f0-8001-d684c398e257

2026-01-16 01:00:10,855 - distributed.scheduler - INFO - Receive client connection: Client-b52f3079-f276-11f0-8001-d684c398e257

2026-01-16 00:50:09,379 - distributed.scheduler - INFO - Receive client connection: Client-4ead62f6-f275-11f0-8001-d684c398e257

2026-01-16 00:40:07,854 - distributed.scheduler - INFO - Receive client connection: Client-e8249fce-f273-11f0-8001-d684c398e257

2026-01-16 00:30:06,446 - distributed.scheduler - INFO - Receive client connection: Client-81ac567a-f272-11f0-8001-d684c398e257

2026-01-16 00:20:04,942 - distributed.scheduler - INFO - Receive client connection: Client-1b25f116-f271-11f0-8001-d684c398e257

2026-01-16 00:10:03,494 - distributed.scheduler - INFO - Receive client connection: Client-b4a8ee47-f26f-11f0-8001-d684c398e257

2026-01-16 00:00:01,955 - distributed.scheduler - INFO - Receive client connection: Client-4e1d1a5e-f26e-11f0-8001-d684c398e257

2026-01-15 23:50:00,457 - distributed.scheduler - INFO - Receive client connection: Client-e797659f-f26c-11f0-8001-d684c398e257

2026-01-15 23:40:59,007 - distributed.scheduler - INFO - Receive client connection: Client-a4dcfd29-f26b-11f0-8001-d684c398e257

2026-01-15 23:30:57,618 - distributed.scheduler - INFO - Receive client connection: Client-3e68adf8-f26a-11f0-8001-d684c398e257

2026-01-15 23:20:56,113 - distributed.scheduler - INFO - Receive client connection: Client-d7e23460-f268-11f0-8001-d684c398e257

2026-01-15 23:10:54,571 - distributed.scheduler - INFO - Receive client connection: Client-715619e0-f267-11f0-8001-d684c398e257

2026-01-15 23:00:53,078 - distributed.scheduler - INFO - Receive client connection: Client-0ad14ca6-f266-11f0-8001-d684c398e257

2026-01-15 22:50:51,803 - distributed.scheduler - INFO - Receive client connection: Client-a46e01d3-f264-11f0-8001-d684c398e257

2026-01-15 22:40:50,315 - distributed.scheduler - INFO - Receive client connection: Client-3dea011f-f263-11f0-8001-d684c398e257

2026-01-15 22:30:48,828 - distributed.scheduler - INFO - Receive client connection: Client-d7673620-f261-11f0-8001-d684c398e257

2026-01-15 22:20:47,417 - distributed.scheduler - INFO - Receive client connection: Client-70ee9b98-f260-11f0-8001-d684c398e257

2026-01-15 22:10:45,993 - distributed.scheduler - INFO - Receive client connection: Client-0a74f5ec-f25f-11f0-8001-d684c398e257

2026-01-15 22:00:44,511 - distributed.scheduler - INFO - Receive client connection: Client-a3f27b1a-f25d-11f0-8001-d684c398e257

2026-01-15 21:50:43,195 - distributed.scheduler - INFO - Receive client connection: Client-3d89722d-f25c-11f0-8001-d684c398e257

2026-01-15 21:40:41,760 - distributed.scheduler - INFO - Receive client connection: Client-d7087ebb-f25a-11f0-8001-d684c398e257

2026-01-15 21:30:40,241 - distributed.scheduler - INFO - Receive client connection: Client-7084325d-f259-11f0-8001-d684c398e257

2026-01-15 21:20:38,761 - distributed.scheduler - INFO - Receive client connection: Client-0a01c9b3-f258-11f0-8001-d684c398e257

2026-01-15 21:10:37,266 - distributed.scheduler - INFO - Receive client connection: Client-a37c6ed8-f256-11f0-8001-d684c398e257

2026-01-15 21:00:35,707 - distributed.scheduler - INFO - Receive client connection: Client-3cee6bd6-f255-11f0-8001-d684c398e257

2026-01-15 20:50:34,257 - distributed.scheduler - INFO - Receive client connection: Client-d670ee29-f253-11f0-8001-d684c398e257

2026-01-15 20:40:32,808 - distributed.scheduler - INFO - Receive client connection: Client-6ff21b93-f252-11f0-8001-d684c398e257

2026-01-15 20:30:31,312 - distributed.scheduler - INFO - Receive client connection: Client-096ba87e-f251-11f0-8001-d684c398e257

2026-01-15 20:20:47,071 - distributed.scheduler - INFO - Close client connection: Client-a2f08018-f24f-11f0-8001-d684c398e257

2026-01-15 20:20:47,071 - distributed.scheduler - INFO - Remove client Client-a2f08018-f24f-11f0-8001-d684c398e257

2026-01-15 20:20:47,069 - distributed.scheduler - INFO - Remove client Client-a2f08018-f24f-11f0-8001-d684c398e257

2026-01-15 20:20:29,883 - distributed.scheduler - INFO - Receive client connection: Client-a2f08018-f24f-11f0-8001-d684c398e257

2026-01-15 20:10:48,492 - distributed.scheduler - INFO - Close client connection: Client-3c6a98cb-f24e-11f0-8001-d684c398e257

2026-01-15 20:10:48,491 - distributed.scheduler - INFO - Remove client Client-3c6a98cb-f24e-11f0-8001-d684c398e257

2026-01-15 20:10:48,489 - distributed.scheduler - INFO - Remove client Client-3c6a98cb-f24e-11f0-8001-d684c398e257

2026-01-15 20:10:28,380 - distributed.scheduler - INFO - Receive client connection: Client-3c6a98cb-f24e-11f0-8001-d684c398e257

2026-01-15 20:01:06,937 - distributed.scheduler - INFO - Close client connection: Client-d5e9ac4f-f24c-11f0-8001-d684c398e257

2026-01-15 20:01:06,937 - distributed.scheduler - INFO - Remove client Client-d5e9ac4f-f24c-11f0-8001-d684c398e257

2026-01-15 20:01:06,935 - distributed.scheduler - INFO - Remove client Client-d5e9ac4f-f24c-11f0-8001-d684c398e257

2026-01-15 20:00:26,909 - distributed.scheduler - INFO - Receive client connection: Client-d5e9ac4f-f24c-11f0-8001-d684c398e257

2026-01-15 19:50:46,534 - distributed.scheduler - INFO - Close client connection: Client-6f6b211e-f24b-11f0-8001-d684c398e257

2026-01-15 19:50:46,532 - distributed.scheduler - INFO - Remove client Client-6f6b211e-f24b-11f0-8001-d684c398e257

2026-01-15 19:50:46,530 - distributed.scheduler - INFO - Remove client Client-6f6b211e-f24b-11f0-8001-d684c398e257

2026-01-15 19:50:25,456 - distributed.scheduler - INFO - Receive client connection: Client-6f6b211e-f24b-11f0-8001-d684c398e257

2026-01-15 19:40:52,188 - distributed.scheduler - INFO - Close client connection: Client-08f2e439-f24a-11f0-8001-d684c398e257

2026-01-15 19:40:52,187 - distributed.scheduler - INFO - Remove client Client-08f2e439-f24a-11f0-8001-d684c398e257

2026-01-15 19:40:52,185 - distributed.scheduler - INFO - Remove client Client-08f2e439-f24a-11f0-8001-d684c398e257

2026-01-15 19:40:24,043 - distributed.scheduler - INFO - Receive client connection: Client-08f2e439-f24a-11f0-8001-d684c398e257

2026-01-15 19:31:08,137 - distributed.scheduler - INFO - Close client connection: Client-a2775922-f248-11f0-8001-d684c398e257

2026-01-15 19:31:08,137 - distributed.scheduler - INFO - Remove client Client-a2775922-f248-11f0-8001-d684c398e257

2026-01-15 19:31:08,135 - distributed.scheduler - INFO - Remove client Client-a2775922-f248-11f0-8001-d684c398e257

2026-01-15 19:30:22,610 - distributed.scheduler - INFO - Receive client connection: Client-a2775922-f248-11f0-8001-d684c398e257

2026-01-15 19:20:50,793 - distributed.scheduler - INFO - Close client connection: Client-3bf6f716-f247-11f0-8001-d684c398e257

2026-01-15 19:20:50,792 - distributed.scheduler - INFO - Remove client Client-3bf6f716-f247-11f0-8001-d684c398e257

2026-01-15 19:20:50,790 - distributed.scheduler - INFO - Remove client Client-3bf6f716-f247-11f0-8001-d684c398e257

2026-01-15 19:20:21,144 - distributed.scheduler - INFO - Receive client connection: Client-3bf6f716-f247-11f0-8001-d684c398e257

2026-01-15 19:10:48,077 - distributed.scheduler - INFO - Close client connection: Client-d5754d1a-f245-11f0-8001-d684c398e257

2026-01-15 19:10:48,076 - distributed.scheduler - INFO - Remove client Client-d5754d1a-f245-11f0-8001-d684c398e257

2026-01-15 19:10:48,075 - distributed.scheduler - INFO - Remove client Client-d5754d1a-f245-11f0-8001-d684c398e257

2026-01-15 19:10:19,672 - distributed.scheduler - INFO - Receive client connection: Client-d5754d1a-f245-11f0-8001-d684c398e257

2026-01-15 19:01:07,930 - distributed.scheduler - INFO - Close client connection: Client-6eea762c-f244-11f0-8001-d684c398e257

2026-01-15 19:01:07,924 - distributed.scheduler - INFO - Remove client Client-6eea762c-f244-11f0-8001-d684c398e257

2026-01-15 19:01:07,923 - distributed.scheduler - INFO - Remove client Client-6eea762c-f244-11f0-8001-d684c398e257

2026-01-15 19:00:18,134 - distributed.scheduler - INFO - Receive client connection: Client-6eea762c-f244-11f0-8001-d684c398e257

2026-01-15 18:50:45,076 - distributed.scheduler - INFO - Close client connection: Client-087903d2-f243-11f0-8001-d684c398e257

2026-01-15 18:50:45,074 - distributed.scheduler - INFO - Remove client Client-087903d2-f243-11f0-8001-d684c398e257

2026-01-15 18:50:45,072 - distributed.scheduler - INFO - Remove client Client-087903d2-f243-11f0-8001-d684c398e257

2026-01-15 18:50:16,759 - distributed.scheduler - INFO - Receive client connection: Client-087903d2-f243-11f0-8001-d684c398e257

2026-01-15 18:40:45,682 - distributed.scheduler - INFO - Close client connection: Client-a201d542-f241-11f0-8001-d684c398e257

2026-01-15 18:40:45,681 - distributed.scheduler - INFO - Remove client Client-a201d542-f241-11f0-8001-d684c398e257

2026-01-15 18:40:45,679 - distributed.scheduler - INFO - Remove client Client-a201d542-f241-11f0-8001-d684c398e257

2026-01-15 18:40:15,357 - distributed.scheduler - INFO - Receive client connection: Client-a201d542-f241-11f0-8001-d684c398e257

2026-01-15 18:31:05,448 - distributed.scheduler - INFO - Close client connection: Client-3b8d59d7-f240-11f0-8001-d684c398e257

2026-01-15 18:31:05,446 - distributed.scheduler - INFO - Remove client Client-3b8d59d7-f240-11f0-8001-d684c398e257

2026-01-15 18:31:05,444 - distributed.scheduler - INFO - Remove client Client-3b8d59d7-f240-11f0-8001-d684c398e257

2026-01-15 18:30:13,965 - distributed.scheduler - INFO - Receive client connection: Client-3b8d59d7-f240-11f0-8001-d684c398e257

2026-01-15 18:20:43,389 - distributed.scheduler - INFO - Close client connection: Client-d50da650-f23e-11f0-8001-d684c398e257

2026-01-15 18:20:43,387 - distributed.scheduler - INFO - Remove client Client-d50da650-f23e-11f0-8001-d684c398e257

2026-01-15 18:20:43,385 - distributed.scheduler - INFO - Remove client Client-d50da650-f23e-11f0-8001-d684c398e257

2026-01-15 18:20:12,515 - distributed.scheduler - INFO - Receive client connection: Client-d50da650-f23e-11f0-8001-d684c398e257

2026-01-15 18:10:40,757 - distributed.scheduler - INFO - Close client connection: Client-6e7bd5b4-f23d-11f0-8001-d684c398e257

2026-01-15 18:10:40,756 - distributed.scheduler - INFO - Remove client Client-6e7bd5b4-f23d-11f0-8001-d684c398e257

2026-01-15 18:10:40,754 - distributed.scheduler - INFO - Remove client Client-6e7bd5b4-f23d-11f0-8001-d684c398e257

2026-01-15 18:10:10,932 - distributed.scheduler - INFO - Receive client connection: Client-6e7bd5b4-f23d-11f0-8001-d684c398e257

2026-01-15 18:00:57,524 - distributed.scheduler - INFO - Close client connection: Client-080b15f6-f23c-11f0-8001-d684c398e257

2026-01-15 18:00:57,523 - distributed.scheduler - INFO - Remove client Client-080b15f6-f23c-11f0-8001-d684c398e257

2026-01-15 18:00:57,521 - distributed.scheduler - INFO - Remove client Client-080b15f6-f23c-11f0-8001-d684c398e257

2026-01-15 18:00:09,569 - distributed.scheduler - INFO - Receive client connection: Client-080b15f6-f23c-11f0-8001-d684c398e257

2026-01-15 17:50:40,973 - distributed.scheduler - INFO - Close client connection: Client-a196af00-f23a-11f0-8001-d684c398e257

2026-01-15 17:50:40,972 - distributed.scheduler - INFO - Remove client Client-a196af00-f23a-11f0-8001-d684c398e257

2026-01-15 17:50:40,970 - distributed.scheduler - INFO - Remove client Client-a196af00-f23a-11f0-8001-d684c398e257

2026-01-15 17:50:08,183 - distributed.scheduler - INFO - Receive client connection: Client-a196af00-f23a-11f0-8001-d684c398e257

2026-01-15 17:40:38,724 - distributed.scheduler - INFO - Close client connection: Client-3af3e134-f239-11f0-8001-d684c398e257

2026-01-15 17:40:38,723 - distributed.scheduler - INFO - Remove client Client-3af3e134-f239-11f0-8001-d684c398e257

2026-01-15 17:40:38,721 - distributed.scheduler - INFO - Remove client Client-3af3e134-f239-11f0-8001-d684c398e257

2026-01-15 17:40:06,503 - distributed.scheduler - INFO - Receive client connection: Client-3af3e134-f239-11f0-8001-d684c398e257

2026-01-15 17:31:02,970 - distributed.scheduler - INFO - Close client connection: Client-d474721c-f237-11f0-8001-d684c398e257

2026-01-15 17:31:02,969 - distributed.scheduler - INFO - Remove client Client-d474721c-f237-11f0-8001-d684c398e257

2026-01-15 17:31:02,967 - distributed.scheduler - INFO - Remove client Client-d474721c-f237-11f0-8001-d684c398e257

2026-01-15 17:30:09,152 - distributed.scheduler - INFO - Receive client connection: Client-worker-d6e3ef99-f237-11f0-8179-b2b90c3ada4d

2026-01-15 17:30:05,031 - distributed.scheduler - INFO - Receive client connection: Client-d474721c-f237-11f0-8001-d684c398e257

2026-01-15 17:20:36,776 - distributed.scheduler - INFO - Close client connection: Client-6df5198c-f236-11f0-8001-d684c398e257

2026-01-15 17:20:36,775 - distributed.scheduler - INFO - Remove client Client-6df5198c-f236-11f0-8001-d684c398e257

2026-01-15 17:20:36,774 - distributed.scheduler - INFO - Remove client Client-6df5198c-f236-11f0-8001-d684c398e257

2026-01-15 17:20:03,572 - distributed.scheduler - INFO - Receive client connection: Client-6df5198c-f236-11f0-8001-d684c398e257

2026-01-15 17:10:36,017 - distributed.scheduler - INFO - Close client connection: Client-0784878b-f235-11f0-8001-d684c398e257

2026-01-15 17:10:36,016 - distributed.scheduler - INFO - Remove client Client-0784878b-f235-11f0-8001-d684c398e257

2026-01-15 17:10:36,015 - distributed.scheduler - INFO - Remove client Client-0784878b-f235-11f0-8001-d684c398e257

2026-01-15 17:10:02,211 - distributed.scheduler - INFO - Receive client connection: Client-0784878b-f235-11f0-8001-d684c398e257

2026-01-15 17:00:53,441 - distributed.scheduler - INFO - Close client connection: Client-a1020346-f233-11f0-8001-d684c398e257

2026-01-15 17:00:53,440 - distributed.scheduler - INFO - Remove client Client-a1020346-f233-11f0-8001-d684c398e257

2026-01-15 17:00:53,438 - distributed.scheduler - INFO - Remove client Client-a1020346-f233-11f0-8001-d684c398e257

2026-01-15 17:00:00,733 - distributed.scheduler - INFO - Receive client connection: Client-a1020346-f233-11f0-8001-d684c398e257

2026-01-15 16:51:31,917 - distributed.scheduler - INFO - Close client connection: Client-5e570dc4-f232-11f0-8001-d684c398e257

2026-01-15 16:51:31,915 - distributed.scheduler - INFO - Remove client Client-5e570dc4-f232-11f0-8001-d684c398e257

2026-01-15 16:51:31,914 - distributed.scheduler - INFO - Remove client Client-5e570dc4-f232-11f0-8001-d684c398e257

2026-01-15 16:50:59,385 - distributed.scheduler - INFO - Receive client connection: Client-5e570dc4-f232-11f0-8001-d684c398e257

2026-01-15 16:41:31,535 - distributed.scheduler - INFO - Close client connection: Client-f7d93739-f230-11f0-8001-d684c398e257

2026-01-15 16:41:31,532 - distributed.scheduler - INFO - Remove client Client-f7d93739-f230-11f0-8001-d684c398e257

2026-01-15 16:41:31,530 - distributed.scheduler - INFO - Remove client Client-f7d93739-f230-11f0-8001-d684c398e257

2026-01-15 16:40:57,934 - distributed.scheduler - INFO - Receive client connection: Client-f7d93739-f230-11f0-8001-d684c398e257

2026-01-15 16:33:46,896 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:35799 failed: OSError: Timed out trying to connect to tcp://172.21.151.159:35799 after 30 s

2026-01-15 16:33:46,874 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:33997 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:35799 after 30 s')

2026-01-15 16:33:46,859 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:38831 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:35799 after 30 s')

2026-01-15 16:33:46,857 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:45097 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:35799 after 30 s')

2026-01-15 16:33:46,829 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:37283 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:35799 after 30 s')

2026-01-15 16:33:46,821 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:36567 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:35799 after 30 s')

2026-01-15 16:33:46,818 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:35843 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:35799 after 30 s')

2026-01-15 16:33:46,805 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:33153 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:35799 after 30 s')

2026-01-15 16:33:46,804 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:33779 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:35799 after 30 s')

2026-01-15 16:33:46,804 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:33329 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:35799 after 30 s')

2026-01-15 16:33:46,773 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:35319 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:35799 after 30 s')

2026-01-15 16:33:46,766 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:38501 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:35799 after 30 s')

2026-01-15 16:33:46,755 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:44341 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:35799 after 30 s')

2026-01-15 16:33:17,580 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.159:35813

2026-01-15 16:33:17,577 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.159:35813', status: closed, memory: 0, processing: 0>

2026-01-15 16:33:16,643 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.159:35799', status: closed, memory: 0, processing: 0>

2026-01-15 16:33:06,835 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:44201 failed: OSError: Timed out trying to connect to tcp://172.21.151.159:44201 after 30 s

2026-01-15 16:33:06,821 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:33997 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:44201 after 30 s')

2026-01-15 16:33:06,757 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:38831 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:44201 after 30 s')

2026-01-15 16:33:06,738 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:33779 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:44201 after 30 s')

2026-01-15 16:33:06,728 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:35843 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:44201 after 30 s')

2026-01-15 16:33:06,702 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:32951 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:44201 after 30 s')

2026-01-15 16:33:06,700 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:36567 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:44201 after 30 s')

2026-01-15 16:33:06,699 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:44341 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:44201 after 30 s')

2026-01-15 16:33:06,696 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:32895 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:44201 after 30 s')

2026-01-15 16:33:06,688 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:35319 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:44201 after 30 s')

2026-01-15 16:33:06,686 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:33153 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:44201 after 30 s')

2026-01-15 16:33:06,684 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:33329 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:44201 after 30 s')

2026-01-15 16:33:06,683 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:45097 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:44201 after 30 s')

2026-01-15 16:33:06,679 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:37283 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:44201 after 30 s')

2026-01-15 16:33:06,675 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:38501 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:44201 after 30 s')

2026-01-15 16:33:06,664 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:37861 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:44201 after 30 s')

2026-01-15 16:32:37,515 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.159:35799

2026-01-15 16:32:37,513 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.159:35799', status: closed, memory: 0, processing: 0>

2026-01-15 16:32:36,531 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.159:44201', status: closed, memory: 0, processing: 0>

2026-01-15 16:32:26,578 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:42489 failed: OSError: Timed out trying to connect to tcp://172.21.151.159:42489 after 30 s

2026-01-15 16:32:26,547 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:33997 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:42489 after 30 s')

2026-01-15 16:32:26,530 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:44341 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:42489 after 30 s')

2026-01-15 16:32:26,508 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:37283 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:42489 after 30 s')

2026-01-15 16:32:26,507 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:32895 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:42489 after 30 s')

2026-01-15 16:32:26,505 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:36567 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:42489 after 30 s')

2026-01-15 16:32:26,500 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:32951 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:42489 after 30 s')

2026-01-15 16:32:26,498 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:33779 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:42489 after 30 s')

2026-01-15 16:32:26,493 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:35843 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:42489 after 30 s')

2026-01-15 16:32:26,491 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:38831 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:42489 after 30 s')

2026-01-15 16:32:26,489 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:45097 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:42489 after 30 s')

2026-01-15 16:32:26,488 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:33329 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:42489 after 30 s')

2026-01-15 16:32:26,476 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:35319 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.159:42489 after 30 s')

2026-01-15 16:31:57,305 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.159:44201

2026-01-15 16:31:57,302 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.159:44201', status: closed, memory: 0, processing: 0>

2026-01-15 16:31:56,367 - distributed.scheduler - INFO - Close client connection: Client-worker-aa88d2fb-f22f-11f0-8147-b2b90c3ada4d

2026-01-15 16:31:56,344 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.159:42489', status: closed, memory: 0, processing: 0>

2026-01-15 16:31:56,342 - distributed.scheduler - INFO - Remove client Client-worker-aa88d2fb-f22f-11f0-8147-b2b90c3ada4d

2026-01-15 16:31:50,975 - distributed.scheduler - INFO - Close client connection: Client-91543063-f22f-11f0-8001-d684c398e257

2026-01-15 16:31:50,973 - distributed.scheduler - INFO - Remove client Client-91543063-f22f-11f0-8001-d684c398e257

2026-01-15 16:31:50,972 - distributed.scheduler - INFO - Remove client Client-91543063-f22f-11f0-8001-d684c398e257

2026-01-15 16:31:38,719 - distributed.scheduler - INFO - Receive client connection: Client-worker-aa88d2fb-f22f-11f0-8147-b2b90c3ada4d

2026-01-15 16:31:29,854 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.159:42489

2026-01-15 16:31:29,851 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.159:42489', status: closed, memory: 0, processing: 0>

2026-01-15 16:31:28,936 - distributed.scheduler - INFO - Close client connection: Client-worker-78e0aae1-f13c-11f0-8074-b2b90c3ada4d

2026-01-15 16:31:28,923 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.159:40437', status: closed, memory: 0, processing: 0>

2026-01-15 16:31:28,922 - distributed.scheduler - INFO - Remove client Client-worker-78e0aae1-f13c-11f0-8074-b2b90c3ada4d

2026-01-15 16:30:58,920 - distributed.scheduler - INFO - Receive client connection: Client-worker-92d1153b-f22f-11f0-814b-e2e790da60bf

2026-01-15 16:30:56,442 - distributed.scheduler - INFO - Receive client connection: Client-91543063-f22f-11f0-8001-d684c398e257

2026-01-15 16:21:29,239 - distributed.scheduler - INFO - Close client connection: Client-2ac6e3af-f22e-11f0-8001-d684c398e257

2026-01-15 16:21:29,238 - distributed.scheduler - INFO - Remove client Client-2ac6e3af-f22e-11f0-8001-d684c398e257

2026-01-15 16:21:29,236 - distributed.scheduler - INFO - Remove client Client-2ac6e3af-f22e-11f0-8001-d684c398e257

2026-01-15 16:20:54,890 - distributed.scheduler - INFO - Receive client connection: Client-2ac6e3af-f22e-11f0-8001-d684c398e257

2026-01-15 16:11:30,761 - distributed.scheduler - INFO - Close client connection: Client-5cc35949-f21d-11f0-8001-d684c398e257

2026-01-15 16:11:30,760 - distributed.scheduler - INFO - Close client connection: Client-f63aee5e-f21b-11f0-8001-d684c398e257

2026-01-15 16:11:30,760 - distributed.scheduler - INFO - Close client connection: Client-c34a3adf-f21e-11f0-8001-d684c398e257

2026-01-15 16:11:30,760 - distributed.scheduler - INFO - Close client connection: Client-29d3df06-f220-11f0-8001-d684c398e257

2026-01-15 16:11:30,760 - distributed.scheduler - INFO - Close client connection: Client-9052f417-f221-11f0-8001-d684c398e257

2026-01-15 16:11:30,760 - distributed.scheduler - INFO - Close client connection: Client-f6df7c76-f222-11f0-8001-d684c398e257

2026-01-15 16:11:30,759 - distributed.scheduler - INFO - Close client connection: Client-5d57e8af-f224-11f0-8001-d684c398e257

2026-01-15 16:11:30,759 - distributed.scheduler - INFO - Close client connection: Client-90c5b160-f228-11f0-8001-d684c398e257

2026-01-15 16:11:30,759 - distributed.scheduler - INFO - Close client connection: Client-c3e1515b-f225-11f0-8001-d684c398e257

2026-01-15 16:11:30,759 - distributed.scheduler - INFO - Close client connection: Client-2a5bf697-f227-11f0-8001-d684c398e257

2026-01-15 16:11:30,758 - distributed.scheduler - INFO - Close client connection: Client-5dc74613-f22b-11f0-8001-d684c398e257

2026-01-15 16:11:30,756 - distributed.scheduler - INFO - Close client connection: Client-f741fbdc-f229-11f0-8001-d684c398e257

2026-01-15 16:11:30,753 - distributed.scheduler - INFO - Remove client Client-5cc35949-f21d-11f0-8001-d684c398e257

2026-01-15 16:11:30,752 - distributed.scheduler - INFO - Remove client Client-f63aee5e-f21b-11f0-8001-d684c398e257

2026-01-15 16:11:30,751 - distributed.scheduler - INFO - Remove client Client-c34a3adf-f21e-11f0-8001-d684c398e257

2026-01-15 16:11:30,750 - distributed.scheduler - INFO - Remove client Client-29d3df06-f220-11f0-8001-d684c398e257

2026-01-15 16:11:30,750 - distributed.scheduler - INFO - Remove client Client-9052f417-f221-11f0-8001-d684c398e257

2026-01-15 16:11:30,749 - distributed.scheduler - INFO - Remove client Client-f6df7c76-f222-11f0-8001-d684c398e257

2026-01-15 16:11:30,748 - distributed.scheduler - INFO - Remove client Client-5d57e8af-f224-11f0-8001-d684c398e257

2026-01-15 16:11:30,747 - distributed.scheduler - INFO - Remove client Client-90c5b160-f228-11f0-8001-d684c398e257

2026-01-15 16:11:30,746 - distributed.scheduler - INFO - Remove client Client-c3e1515b-f225-11f0-8001-d684c398e257

2026-01-15 16:11:30,746 - distributed.scheduler - INFO - Remove client Client-2a5bf697-f227-11f0-8001-d684c398e257

2026-01-15 16:11:30,745 - distributed.scheduler - INFO - Remove client Client-5dc74613-f22b-11f0-8001-d684c398e257

2026-01-15 16:11:30,740 - distributed.scheduler - INFO - Remove client Client-f741fbdc-f229-11f0-8001-d684c398e257

2026-01-15 16:11:29,968 - distributed.scheduler - INFO - Close client connection: Client-c447242e-f22c-11f0-8001-d684c398e257

2026-01-15 16:11:29,965 - distributed.scheduler - INFO - Remove client Client-c447242e-f22c-11f0-8001-d684c398e257

2026-01-15 16:11:29,963 - distributed.scheduler - INFO - Remove client Client-c447242e-f22c-11f0-8001-d684c398e257

2026-01-15 16:10:53,417 - distributed.scheduler - INFO - Receive client connection: Client-c447242e-f22c-11f0-8001-d684c398e257

2026-01-15 16:00:51,954 - distributed.scheduler - INFO - Receive client connection: Client-5dc74613-f22b-11f0-8001-d684c398e257

2026-01-15 15:50:50,457 - distributed.scheduler - INFO - Receive client connection: Client-f741fbdc-f229-11f0-8001-d684c398e257

2026-01-15 15:40:49,021 - distributed.scheduler - INFO - Receive client connection: Client-90c5b160-f228-11f0-8001-d684c398e257

2026-01-15 15:30:50,314 - distributed.scheduler - INFO - Receive client connection: Client-worker-2be4165c-f227-11f0-814b-4e8606c6fff3

2026-01-15 15:30:47,706 - distributed.scheduler - INFO - Receive client connection: Client-2a5bf697-f227-11f0-8001-d684c398e257

2026-01-15 15:20:46,276 - distributed.scheduler - INFO - Receive client connection: Client-c3e1515b-f225-11f0-8001-d684c398e257

2026-01-15 15:10:44,745 - distributed.scheduler - INFO - Receive client connection: Client-5d57e8af-f224-11f0-8001-d684c398e257

2026-01-15 15:00:46,745 - distributed.scheduler - INFO - Receive client connection: Client-worker-f8dbde48-f222-11f0-8143-123d2a42b3d6

2026-01-15 15:00:43,328 - distributed.scheduler - INFO - Receive client connection: Client-f6df7c76-f222-11f0-8001-d684c398e257

2026-01-15 14:50:41,786 - distributed.scheduler - INFO - Receive client connection: Client-9052f417-f221-11f0-8001-d684c398e257

2026-01-15 14:40:40,337 - distributed.scheduler - INFO - Receive client connection: Client-29d3df06-f220-11f0-8001-d684c398e257

2026-01-15 14:30:38,810 - distributed.scheduler - INFO - Receive client connection: Client-c34a3adf-f21e-11f0-8001-d684c398e257

2026-01-15 14:20:37,292 - distributed.scheduler - INFO - Receive client connection: Client-5cc35949-f21d-11f0-8001-d684c398e257

2026-01-15 14:10:35,803 - distributed.scheduler - INFO - Receive client connection: Client-f63aee5e-f21b-11f0-8001-d684c398e257

2026-01-15 14:01:20,988 - distributed.scheduler - INFO - Close client connection: Client-8fca04e2-f21a-11f0-8001-d684c398e257

2026-01-15 14:01:20,986 - distributed.scheduler - INFO - Remove client Client-8fca04e2-f21a-11f0-8001-d684c398e257

2026-01-15 14:01:20,984 - distributed.scheduler - INFO - Remove client Client-8fca04e2-f21a-11f0-8001-d684c398e257

2026-01-15 14:00:36,167 - distributed.scheduler - INFO - Receive client connection: Client-worker-90d445cd-f21a-11f0-8163-42992fa4ff5e

2026-01-15 14:00:34,423 - distributed.scheduler - INFO - Receive client connection: Client-8fca04e2-f21a-11f0-8001-d684c398e257

2026-01-15 13:51:04,729 - distributed.scheduler - INFO - Close client connection: Client-294edc8c-f219-11f0-8001-d684c398e257

2026-01-15 13:51:04,728 - distributed.scheduler - INFO - Remove client Client-294edc8c-f219-11f0-8001-d684c398e257

2026-01-15 13:51:04,728 - distributed.scheduler - INFO - Remove client Client-294edc8c-f219-11f0-8001-d684c398e257

2026-01-15 13:50:32,991 - distributed.scheduler - INFO - Receive client connection: Client-294edc8c-f219-11f0-8001-d684c398e257

2026-01-15 13:41:01,537 - distributed.scheduler - INFO - Close client connection: Client-c2cbaef6-f217-11f0-8001-d684c398e257

2026-01-15 13:41:01,536 - distributed.scheduler - INFO - Remove client Client-c2cbaef6-f217-11f0-8001-d684c398e257

2026-01-15 13:41:01,534 - distributed.scheduler - INFO - Remove client Client-c2cbaef6-f217-11f0-8001-d684c398e257

2026-01-15 13:40:31,509 - distributed.scheduler - INFO - Receive client connection: Client-c2cbaef6-f217-11f0-8001-d684c398e257

2026-01-15 13:31:26,277 - distributed.scheduler - INFO - Close client connection: Client-5c3e3f03-f216-11f0-8001-d684c398e257

2026-01-15 13:31:26,276 - distributed.scheduler - INFO - Remove client Client-5c3e3f03-f216-11f0-8001-d684c398e257

2026-01-15 13:31:26,274 - distributed.scheduler - INFO - Remove client Client-5c3e3f03-f216-11f0-8001-d684c398e257

2026-01-15 13:30:33,860 - distributed.scheduler - INFO - Receive client connection: Client-worker-5e8f99b8-f216-11f0-813c-b671f5ff8c70

2026-01-15 13:30:33,563 - distributed.scheduler - INFO - Receive client connection: Client-worker-5e63ce38-f216-11f0-815e-a2be1fdf94d6

2026-01-15 13:30:32,815 - distributed.scheduler - INFO - Receive client connection: Client-worker-5df20a30-f216-11f0-81bf-fa70b2057bbc

2026-01-15 13:30:29,958 - distributed.scheduler - INFO - Receive client connection: Client-5c3e3f03-f216-11f0-8001-d684c398e257

2026-01-15 13:21:00,874 - distributed.scheduler - INFO - Close client connection: Client-f5b69052-f214-11f0-8001-d684c398e257

2026-01-15 13:21:00,872 - distributed.scheduler - INFO - Remove client Client-f5b69052-f214-11f0-8001-d684c398e257

2026-01-15 13:21:00,871 - distributed.scheduler - INFO - Remove client Client-f5b69052-f214-11f0-8001-d684c398e257

2026-01-15 13:20:28,446 - distributed.scheduler - INFO - Receive client connection: Client-f5b69052-f214-11f0-8001-d684c398e257

2026-01-15 13:10:58,951 - distributed.scheduler - INFO - Close client connection: Client-8f36ca0f-f213-11f0-8001-d684c398e257

2026-01-15 13:10:58,949 - distributed.scheduler - INFO - Remove client Client-8f36ca0f-f213-11f0-8001-d684c398e257

2026-01-15 13:10:58,947 - distributed.scheduler - INFO - Remove client Client-8f36ca0f-f213-11f0-8001-d684c398e257

2026-01-15 13:10:26,984 - distributed.scheduler - INFO - Receive client connection: Client-8f36ca0f-f213-11f0-8001-d684c398e257

2026-01-15 13:01:17,320 - distributed.scheduler - INFO - Close client connection: Client-28b285a9-f212-11f0-8001-d684c398e257

2026-01-15 13:01:17,319 - distributed.scheduler - INFO - Remove client Client-28b285a9-f212-11f0-8001-d684c398e257

2026-01-15 13:01:17,317 - distributed.scheduler - INFO - Remove client Client-28b285a9-f212-11f0-8001-d684c398e257

2026-01-15 13:00:28,595 - distributed.scheduler - INFO - Receive client connection: Client-worker-2a899064-f212-11f0-8163-76b515aac91e

2026-01-15 13:00:27,819 - distributed.scheduler - INFO - Receive client connection: Client-worker-2a18fea2-f212-11f0-8206-5693d18fdaf6

2026-01-15 13:00:25,484 - distributed.scheduler - INFO - Receive client connection: Client-28b285a9-f212-11f0-8001-d684c398e257

2026-01-15 12:50:55,088 - distributed.scheduler - INFO - Close client connection: Client-c22a14d4-f210-11f0-8001-d684c398e257

2026-01-15 12:50:55,086 - distributed.scheduler - INFO - Remove client Client-c22a14d4-f210-11f0-8001-d684c398e257

2026-01-15 12:50:55,084 - distributed.scheduler - INFO - Remove client Client-c22a14d4-f210-11f0-8001-d684c398e257

2026-01-15 12:50:23,975 - distributed.scheduler - INFO - Receive client connection: Client-c22a14d4-f210-11f0-8001-d684c398e257

2026-01-15 12:40:53,870 - distributed.scheduler - INFO - Close client connection: Client-5bb82ac0-f20f-11f0-8001-d684c398e257

2026-01-15 12:40:53,869 - distributed.scheduler - INFO - Remove client Client-5bb82ac0-f20f-11f0-8001-d684c398e257

2026-01-15 12:40:53,867 - distributed.scheduler - INFO - Remove client Client-5bb82ac0-f20f-11f0-8001-d684c398e257

2026-01-15 12:40:22,603 - distributed.scheduler - INFO - Receive client connection: Client-5bb82ac0-f20f-11f0-8001-d684c398e257

2026-01-15 12:31:08,716 - distributed.scheduler - INFO - Close client connection: Client-f5505693-f20d-11f0-8001-d684c398e257

2026-01-15 12:31:08,711 - distributed.scheduler - INFO - Remove client Client-f5505693-f20d-11f0-8001-d684c398e257

2026-01-15 12:31:08,709 - distributed.scheduler - INFO - Remove client Client-f5505693-f20d-11f0-8001-d684c398e257

2026-01-15 12:30:24,614 - distributed.scheduler - INFO - Receive client connection: Client-worker-f744eedb-f20d-11f0-81b0-c6c79f0eb8d9

2026-01-15 12:30:23,997 - distributed.scheduler - INFO - Receive client connection: Client-worker-f6edf214-f20d-11f0-80f7-2a3d63591f59

2026-01-15 12:30:23,767 - distributed.scheduler - INFO - Receive client connection: Client-worker-f6ca34fc-f20d-11f0-812d-a217f266f416

2026-01-15 12:30:23,527 - distributed.scheduler - INFO - Receive client connection: Client-worker-f6a4c69c-f20d-11f0-81e9-e6b3e8b2508c

2026-01-15 12:30:23,254 - distributed.scheduler - INFO - Receive client connection: Client-worker-f67bff22-f20d-11f0-81e3-9edd0389b2a9

2026-01-15 12:30:21,293 - distributed.scheduler - INFO - Receive client connection: Client-f5505693-f20d-11f0-8001-d684c398e257

2026-01-15 12:20:52,172 - distributed.scheduler - INFO - Close client connection: Client-8ed97907-f20c-11f0-8001-d684c398e257

2026-01-15 12:20:52,171 - distributed.scheduler - INFO - Remove client Client-8ed97907-f20c-11f0-8001-d684c398e257

2026-01-15 12:20:52,169 - distributed.scheduler - INFO - Remove client Client-8ed97907-f20c-11f0-8001-d684c398e257

2026-01-15 12:20:19,891 - distributed.scheduler - INFO - Receive client connection: Client-8ed97907-f20c-11f0-8001-d684c398e257

2026-01-15 12:10:52,605 - distributed.scheduler - INFO - Close client connection: Client-2859aac6-f20b-11f0-8001-d684c398e257

2026-01-15 12:10:52,604 - distributed.scheduler - INFO - Remove client Client-2859aac6-f20b-11f0-8001-d684c398e257

2026-01-15 12:10:52,602 - distributed.scheduler - INFO - Remove client Client-2859aac6-f20b-11f0-8001-d684c398e257

2026-01-15 12:10:18,431 - distributed.scheduler - INFO - Receive client connection: Client-2859aac6-f20b-11f0-8001-d684c398e257

2026-01-15 12:01:14,040 - distributed.scheduler - INFO - Close client connection: Client-8f02e0f0-f207-11f0-8001-d684c398e257

2026-01-15 12:01:14,040 - distributed.scheduler - INFO - Close client connection: Client-5b6a689c-f208-11f0-8001-d684c398e257

2026-01-15 12:01:14,038 - distributed.scheduler - INFO - Remove client Client-8f02e0f0-f207-11f0-8001-d684c398e257

2026-01-15 12:01:14,036 - distributed.scheduler - INFO - Remove client Client-5b6a689c-f208-11f0-8001-d684c398e257

2026-01-15 12:01:13,377 - distributed.scheduler - INFO - Close client connection: Client-c1e11c32-f209-11f0-8001-d684c398e257

2026-01-15 12:01:13,376 - distributed.scheduler - INFO - Remove client Client-c1e11c32-f209-11f0-8001-d684c398e257

2026-01-15 12:01:13,374 - distributed.scheduler - INFO - Remove client Client-c1e11c32-f209-11f0-8001-d684c398e257

2026-01-15 12:00:52,992 - distributed.scheduler - INFO - Receive client connection: Client-d75162d8-f209-11f0-8007-c203cd76de85

2026-01-15 12:00:51,313 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.68:38501

2026-01-15 12:00:51,312 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.68:38501', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:51,243 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.188:37283

2026-01-15 12:00:51,242 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.188:37283', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:51,083 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.159.225:32895

2026-01-15 12:00:51,081 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.159.225:32895', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:51,003 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.250:35843

2026-01-15 12:00:51,002 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.250:35843', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:50,983 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.92:35319

2026-01-15 12:00:50,982 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.92:35319', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:50,909 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.159.211:33779

2026-01-15 12:00:50,908 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.159.211:33779', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:50,853 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.37:44341

2026-01-15 12:00:50,846 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.37:44341', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:50,811 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.165:37861

2026-01-15 12:00:50,810 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.165:37861', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:50,773 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.247:33153

2026-01-15 12:00:50,772 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.247:33153', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:50,739 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.244:45097

2026-01-15 12:00:50,738 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.244:45097', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:50,628 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.62:32951

2026-01-15 12:00:50,627 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.62:32951', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:50,590 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.159.228:36567

2026-01-15 12:00:50,589 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.159.228:36567', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:50,555 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.159.254:33329

2026-01-15 12:00:50,554 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.159.254:33329', status: running, memory: 0, processing: 0>

2026-01-15 12:00:50,548 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.242:33997

2026-01-15 12:00:50,546 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.242:33997', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:50,443 - distributed.scheduler - INFO - Close client connection: Client-worker-ac1c9fd0-f140-11f0-80b8-76b515aac91e

2026-01-15 12:00:50,438 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.188:45721', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:50,437 - distributed.scheduler - INFO - Remove client Client-worker-ac1c9fd0-f140-11f0-80b8-76b515aac91e

2026-01-15 12:00:50,354 - distributed.scheduler - INFO - Close client connection: Client-worker-7ddf0b08-f1ec-11f0-8175-c6c79f0eb8d9

2026-01-15 12:00:50,349 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.68:33025', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:50,348 - distributed.scheduler - INFO - Remove client Client-worker-7ddf0b08-f1ec-11f0-8175-c6c79f0eb8d9

2026-01-15 12:00:50,289 - distributed.scheduler - INFO - Close client connection: Client-worker-78572b86-f13c-11f0-8074-2a3d63591f59

2026-01-15 12:00:50,286 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.159.225:37655', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:50,284 - distributed.scheduler - INFO - Remove client Client-worker-78572b86-f13c-11f0-8074-2a3d63591f59

2026-01-15 12:00:50,178 - distributed.scheduler - INFO - Close client connection: Client-6ad69684-f137-11f0-8007-c203cd76de85

2026-01-15 12:00:50,177 - distributed.scheduler - INFO - Remove client Client-6ad69684-f137-11f0-8007-c203cd76de85

2026-01-15 12:00:50,175 - distributed.scheduler - INFO - Remove client Client-6ad69684-f137-11f0-8007-c203cd76de85

2026-01-15 12:00:50,160 - distributed.scheduler - INFO - Close client connection: Client-worker-a6edeadd-f13c-11f0-80af-123d2a42b3d6

2026-01-15 12:00:50,159 - distributed.scheduler - INFO - Task run-18545fd47974bfc641d16f91bfa274e0 marked as failed because 3 workers died while trying to run it

2026-01-15 12:00:50,159 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.250:37171', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:50,158 - distributed.scheduler - INFO - Remove client Client-worker-a6edeadd-f13c-11f0-80af-123d2a42b3d6

2026-01-15 12:00:50,096 - distributed.scheduler - INFO - Close client connection: Client-worker-abfc9067-f140-11f0-80d7-42992fa4ff5e

2026-01-15 12:00:50,087 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.159.211:43863', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:50,085 - distributed.scheduler - INFO - Remove client Client-worker-abfc9067-f140-11f0-80d7-42992fa4ff5e

2026-01-15 12:00:49,935 - distributed.scheduler - INFO - Close client connection: Client-worker-bd8e2545-f140-11f0-80af-e2e790da60bf

2026-01-15 12:00:49,933 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.165:41319', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:49,932 - distributed.scheduler - INFO - Remove client Client-worker-bd8e2545-f140-11f0-80af-e2e790da60bf

2026-01-15 12:00:49,926 - distributed.scheduler - INFO - Close client connection: Client-worker-7e8732fc-f1ec-11f0-8199-9edd0389b2a9

2026-01-15 12:00:49,917 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.92:43923', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:49,917 - distributed.scheduler - INFO - Remove client Client-worker-7e8732fc-f1ec-11f0-8199-9edd0389b2a9

2026-01-15 12:00:49,913 - distributed.scheduler - INFO - Close client connection: Client-worker-6aaa4cf2-f1be-11f0-818e-e6b3e8b2508c

2026-01-15 12:00:49,900 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.37:34813', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:49,898 - distributed.scheduler - INFO - Remove client Client-worker-6aaa4cf2-f1be-11f0-818e-e6b3e8b2508c

2026-01-15 12:00:49,802 - distributed.scheduler - INFO - Close client connection: Client-worker-a8d05095-f13c-11f0-80ab-a2be1fdf94d6

2026-01-15 12:00:49,797 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.247:45705', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:49,797 - distributed.scheduler - INFO - Remove client Client-worker-a8d05095-f13c-11f0-80ab-a2be1fdf94d6

2026-01-15 12:00:49,794 - distributed.scheduler - INFO - Close client connection: Client-worker-c3cade2f-f209-11f0-817c-fa70b2057bbc

2026-01-15 12:00:49,777 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.244:37329', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:49,775 - distributed.scheduler - INFO - Remove client Client-worker-c3cade2f-f209-11f0-817c-fa70b2057bbc

2026-01-15 12:00:49,713 - distributed.scheduler - INFO - Close client connection: Client-worker-ac22d150-f140-11f0-80b3-b671f5ff8c70

2026-01-15 12:00:49,692 - distributed.scheduler - INFO - Remove client Client-worker-ac22d150-f140-11f0-80b3-b671f5ff8c70

2026-01-15 12:00:49,688 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.159.254:43107', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:49,686 - distributed.scheduler - INFO - Close client connection: Client-worker-940bdd92-f13c-11f0-80ab-a217f266f416

2026-01-15 12:00:49,678 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.159.228:41827', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:49,677 - distributed.scheduler - INFO - Remove client Client-worker-940bdd92-f13c-11f0-80ab-a217f266f416

2026-01-15 12:00:49,640 - distributed.scheduler - INFO - Close client connection: Client-worker-893eb4c5-f16a-11f0-817e-5693d18fdaf6

2026-01-15 12:00:49,615 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.242:34949', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:49,614 - distributed.scheduler - INFO - Remove client Client-worker-893eb4c5-f16a-11f0-817e-5693d18fdaf6

2026-01-15 12:00:49,566 - distributed.scheduler - INFO - Close client connection: Client-worker-ac464224-f140-11f0-80b7-4e8606c6fff3

2026-01-15 12:00:49,554 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.62:40891', status: closed, memory: 0, processing: 0>

2026-01-15 12:00:49,551 - distributed.scheduler - INFO - Remove client Client-worker-ac464224-f140-11f0-80b7-4e8606c6fff3

2026-01-15 12:00:20,228 - distributed.scheduler - INFO - Receive client connection: Client-worker-c3cade2f-f209-11f0-817c-fa70b2057bbc

2026-01-15 12:00:17,009 - distributed.scheduler - INFO - Receive client connection: Client-c1e11c32-f209-11f0-8001-d684c398e257

2026-01-15 11:50:15,606 - distributed.scheduler - INFO - Receive client connection: Client-5b6a689c-f208-11f0-8001-d684c398e257

2026-01-15 11:44:32,676 - distributed.scheduler - INFO - Receive client connection: Client-8f02e0f0-f207-11f0-8001-d684c398e257

2026-01-15 11:39:17,545 - distributed.scheduler - INFO - Close client connection: Client-c3b835ac-f206-11f0-8001-d684c398e257

2026-01-15 11:39:17,544 - distributed.scheduler - INFO - Remove client Client-c3b835ac-f206-11f0-8001-d684c398e257

2026-01-15 11:39:17,542 - distributed.scheduler - INFO - Remove client Client-c3b835ac-f206-11f0-8001-d684c398e257

2026-01-15 11:38:51,607 - distributed.scheduler - INFO - Receive client connection: Client-c3b835ac-f206-11f0-8001-d684c398e257

2026-01-15 08:33:18,198 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:45121 failed: OSError: Timed out trying to connect to tcp://172.21.12.244:45121 after 30 s

2026-01-15 08:33:18,170 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:34949 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:45121 after 30 s')

2026-01-15 08:33:18,046 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:41319 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:45121 after 30 s')

2026-01-15 08:33:18,007 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:33025 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:45121 after 30 s')

2026-01-15 08:33:18,006 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:40891 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:45121 after 30 s')

2026-01-15 08:33:18,004 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:40437 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:45121 after 30 s')

2026-01-15 08:33:17,998 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:43863 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:45121 after 30 s')

2026-01-15 08:33:17,986 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:45705 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:45121 after 30 s')

2026-01-15 08:33:17,984 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:43107 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:45121 after 30 s')

2026-01-15 08:33:17,979 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:37655 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:45121 after 30 s')

2026-01-15 08:33:17,968 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:43923 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:45121 after 30 s')

2026-01-15 08:32:48,759 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.244:37329

2026-01-15 08:32:48,757 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.244:37329', status: closed, memory: 0, processing: 0>

2026-01-15 08:32:47,841 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.244:45121', status: closed, memory: 0, processing: 0>

2026-01-15 08:32:38,918 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:37525 failed: OSError: Timed out trying to connect to tcp://172.21.12.244:37525 after 30 s

2026-01-15 08:32:38,902 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:45721 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:37525 after 30 s')

2026-01-15 08:32:38,611 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:34949 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:37525 after 30 s')

2026-01-15 08:32:38,513 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:38831 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:37525 after 30 s')

2026-01-15 08:32:38,507 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:40891 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:37525 after 30 s')

2026-01-15 08:32:38,502 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:41319 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:37525 after 30 s')

2026-01-15 08:32:38,495 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:34813 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:37525 after 30 s')

2026-01-15 08:32:38,494 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:43107 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:37525 after 30 s')

2026-01-15 08:32:38,493 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:45705 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:37525 after 30 s')

2026-01-15 08:32:38,485 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:37655 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:37525 after 30 s')

2026-01-15 08:32:38,475 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:33025 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:37525 after 30 s')

2026-01-15 08:32:38,465 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:43923 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:37525 after 30 s')

2026-01-15 08:32:09,344 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.244:45121

2026-01-15 08:32:09,341 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.244:45121', status: closed, memory: 0, processing: 0>

2026-01-15 08:32:08,342 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.244:37525', status: closed, memory: 0, processing: 0>

2026-01-15 08:32:00,091 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.244:37525

2026-01-15 08:32:00,089 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.244:37525', status: closed, memory: 0, processing: 0>

2026-01-15 08:31:59,230 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.244:41309', status: closed, memory: 0, processing: 0>

2026-01-15 08:31:50,592 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:36079 failed: OSError: Timed out trying to connect to tcp://172.21.12.244:36079 after 30 s

2026-01-15 08:31:50,582 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:34949 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:36079 after 30 s')

2026-01-15 08:31:50,496 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:41319 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:36079 after 30 s')

2026-01-15 08:31:50,495 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:41827 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:36079 after 30 s')

2026-01-15 08:31:50,467 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:37171 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:36079 after 30 s')

2026-01-15 08:31:50,465 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:40437 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:36079 after 30 s')

2026-01-15 08:31:50,464 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:38831 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:36079 after 30 s')

2026-01-15 08:31:50,464 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:45721 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:36079 after 30 s')

2026-01-15 08:31:50,463 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:43107 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:36079 after 30 s')

2026-01-15 08:31:50,438 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:33025 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:36079 after 30 s')

2026-01-15 08:31:50,437 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:43923 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:36079 after 30 s')

2026-01-15 08:31:50,432 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:34813 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:36079 after 30 s')

2026-01-15 08:31:50,432 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:43863 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:36079 after 30 s')

2026-01-15 08:31:50,418 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:37655 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:36079 after 30 s')

2026-01-15 08:31:21,215 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.244:41309

2026-01-15 08:31:21,213 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.244:41309', status: closed, memory: 0, processing: 0>

2026-01-15 08:31:20,316 - distributed.scheduler - INFO - Close client connection: Client-worker-57de0a07-f149-11f0-80f6-fa70b2057bbc

2026-01-15 08:31:20,291 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.244:36079', status: closed, memory: 0, processing: 0>

2026-01-15 08:31:20,288 - distributed.scheduler - INFO - Remove client Client-worker-57de0a07-f149-11f0-80f6-fa70b2057bbc

2026-01-15 08:30:48,601 - distributed.scheduler - INFO - Receive client connection: Client-worker-7e8732fc-f1ec-11f0-8199-9edd0389b2a9

2026-01-15 08:30:47,507 - distributed.scheduler - INFO - Receive client connection: Client-worker-7ddf0b08-f1ec-11f0-8175-c6c79f0eb8d9

2026-01-15 08:03:13,318 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:34949 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.92:45431 after 30 s')

2026-01-15 08:03:13,309 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:35011 failed: OSError: Timed out trying to connect to tcp://172.21.25.68:35011 after 30 s

2026-01-15 08:03:13,309 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:45431 failed: OSError: Timed out trying to connect to tcp://172.21.25.92:45431 after 30 s

2026-01-15 08:03:13,308 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:36079 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.68:35011 after 30 s')

2026-01-15 08:03:13,225 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:38831 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.68:35011 after 30 s')

2026-01-15 08:03:13,224 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:41319 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.92:45431 after 30 s')

2026-01-15 08:03:13,201 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:45721 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.68:35011 after 30 s')

2026-01-15 08:03:13,197 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:37171 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.68:35011 after 30 s')

2026-01-15 08:03:13,196 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:41827 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.68:35011 after 30 s')

2026-01-15 08:03:13,195 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:43107 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.92:45431 after 30 s')

2026-01-15 08:03:13,191 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:40437 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.92:45431 after 30 s')

2026-01-15 08:03:13,190 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:43863 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.68:35011 after 30 s')

2026-01-15 08:03:13,159 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:34813 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.92:45431 after 30 s')

2026-01-15 08:03:13,139 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:40891 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.92:45431 after 30 s')

2026-01-15 08:02:44,109 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.92:43923

2026-01-15 08:02:44,107 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.92:43923', status: closed, memory: 0, processing: 0>

2026-01-15 08:02:44,054 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.68:33025

2026-01-15 08:02:44,052 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.68:33025', status: closed, memory: 0, processing: 0>

2026-01-15 08:02:43,014 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.92:45431', status: closed, memory: 0, processing: 0>

2026-01-15 08:02:42,973 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.68:35011', status: closed, memory: 0, processing: 0>

2026-01-15 08:02:34,061 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.92:45431

2026-01-15 08:02:34,059 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.92:45431', status: closed, memory: 0, processing: 0>

2026-01-15 08:02:33,999 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.68:35011

2026-01-15 08:02:33,997 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.68:35011', status: closed, memory: 0, processing: 0>

2026-01-15 08:02:33,135 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.92:33327', status: closed, memory: 0, processing: 0>

2026-01-15 08:02:33,038 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.68:43811', status: closed, memory: 0, processing: 0>

2026-01-15 08:02:23,450 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:39161 failed: OSError: Timed out trying to connect to tcp://172.21.25.68:39161 after 30 s

2026-01-15 08:02:23,449 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:34069 failed: OSError: Timed out trying to connect to tcp://172.21.25.92:34069 after 30 s

2026-01-15 08:02:23,418 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:36079 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.92:34069 after 30 s')

2026-01-15 08:02:23,367 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:34949 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.92:34069 after 30 s')

2026-01-15 08:02:23,304 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:41319 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.92:34069 after 30 s')

2026-01-15 08:02:23,284 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:45721 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.68:39161 after 30 s')

2026-01-15 08:02:23,284 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:38831 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.68:39161 after 30 s')

2026-01-15 08:02:23,283 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:40437 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.92:34069 after 30 s')

2026-01-15 08:02:23,282 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:45705 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.92:34069 after 30 s')

2026-01-15 08:02:23,282 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:37171 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.92:34069 after 30 s')

2026-01-15 08:02:23,281 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:37655 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.68:39161 after 30 s')

2026-01-15 08:02:23,281 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:34813 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.92:34069 after 30 s')

2026-01-15 08:02:23,244 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:43107 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.92:34069 after 30 s')

2026-01-15 08:02:23,242 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:40891 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.68:39161 after 30 s')

2026-01-15 08:02:23,223 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:43863 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.68:39161 after 30 s')

2026-01-15 08:01:54,110 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.68:43811

2026-01-15 08:01:54,108 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.68:43811', status: closed, memory: 0, processing: 0>

2026-01-15 08:01:54,060 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.92:33327

2026-01-15 08:01:54,058 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.92:33327', status: closed, memory: 0, processing: 0>

2026-01-15 08:01:53,118 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.92:34069', status: closed, memory: 0, processing: 0>

2026-01-15 08:01:53,038 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.68:39161', status: closed, memory: 0, processing: 0>

2026-01-15 08:01:34,166 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.92:34069

2026-01-15 08:01:34,165 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.92:34069', status: closed, memory: 0, processing: 0>

2026-01-15 08:01:34,133 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.68:39161

2026-01-15 08:01:34,132 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.68:39161', status: closed, memory: 0, processing: 0>

2026-01-15 08:01:33,209 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.92:39403', status: closed, memory: 0, processing: 0>

2026-01-15 08:01:33,193 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.68:44371', status: closed, memory: 0, processing: 0>

2026-01-15 08:01:10,152 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.68:44371

2026-01-15 08:01:10,151 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.68:44371', status: closed, memory: 0, processing: 0>

2026-01-15 08:01:09,834 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.92:39403

2026-01-15 08:01:09,832 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.92:39403', status: closed, memory: 0, processing: 0>

2026-01-15 08:01:09,544 - distributed.scheduler - ERROR - Shut down workers that don't have promised key: [], run-8d5af277b61132f269e06ff63a03ba08 NoneType: None

2026-01-15 08:01:09,544 - distributed.scheduler - ERROR - Shut down workers that don't have promised key: [], run-93fb172770e920366c1976cd02cead29 NoneType: None

2026-01-15 08:01:09,543 - distributed.scheduler - ERROR - Shut down workers that don't have promised key: [], run-0cee5e2eda22079d03096023b70f6b89 NoneType: None

2026-01-15 08:01:09,543 - distributed.scheduler - ERROR - Couldn't gather keys {'run-0cee5e2eda22079d03096023b70f6b89': [], 'run-93fb172770e920366c1976cd02cead29': [], 'run-8d5af277b61132f269e06ff63a03ba08': []} state: ['processing', 'processing', 'processing'] workers: [] NoneType: None

2026-01-15 08:01:09,215 - distributed.scheduler - INFO - Close client connection: Client-worker-78c4e733-f13c-11f0-8074-c6c79f0eb8d9

2026-01-15 08:01:09,208 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.68:42109', status: closed, memory: 0, processing: 0>

2026-01-15 08:01:09,207 - distributed.scheduler - INFO - Remove client Client-worker-78c4e733-f13c-11f0-8074-c6c79f0eb8d9

2026-01-15 08:01:08,871 - distributed.scheduler - INFO - Close client connection: Client-worker-13b5ebef-f149-11f0-80af-9edd0389b2a9

2026-01-15 08:01:08,867 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.92:44641', status: closed, memory: 0, processing: 0>

2026-01-15 08:01:08,864 - distributed.scheduler - INFO - Remove client Client-worker-13b5ebef-f149-11f0-80af-9edd0389b2a9

2026-01-15 08:00:44,691 - distributed.scheduler - INFO - Receive client connection: Client-worker-4b397c05-f1e8-11f0-8184-92d0b450f87a

2026-01-15 07:33:28,522 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.136:38831

2026-01-15 07:33:28,520 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.136:38831', status: closed, memory: 0, processing: 0>

2026-01-15 07:33:27,607 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.136:37029', status: closed, memory: 0, processing: 0>

2026-01-15 07:33:18,376 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:37787 failed: OSError: Timed out trying to connect to tcp://172.21.151.136:37787 after 30 s

2026-01-15 07:33:18,332 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:41319 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:37787 after 30 s')

2026-01-15 07:33:18,299 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:45721 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:37787 after 30 s')

2026-01-15 07:33:18,291 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:34949 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:37787 after 30 s')

2026-01-15 07:33:18,278 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:45705 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:37787 after 30 s')

2026-01-15 07:33:18,256 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:37655 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:37787 after 30 s')

2026-01-15 07:33:18,255 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:43863 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:37787 after 30 s')

2026-01-15 07:33:18,252 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:40437 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:37787 after 30 s')

2026-01-15 07:33:18,237 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:36079 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:37787 after 30 s')

2026-01-15 07:33:18,227 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:44641 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:37787 after 30 s')

2026-01-15 07:32:48,943 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.136:37029

2026-01-15 07:32:48,941 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.136:37029', status: closed, memory: 0, processing: 0>

2026-01-15 07:32:48,098 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.136:37787', status: closed, memory: 0, processing: 0>

2026-01-15 07:32:37,870 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:33519 failed: OSError: Timed out trying to connect to tcp://172.21.151.136:33519 after 30 s

2026-01-15 07:32:37,849 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:34813 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:33519 after 30 s')

2026-01-15 07:32:37,801 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:41827 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:33519 after 30 s')

2026-01-15 07:32:37,773 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:41319 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:33519 after 30 s')

2026-01-15 07:32:37,771 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:45721 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:33519 after 30 s')

2026-01-15 07:32:37,770 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:43107 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:33519 after 30 s')

2026-01-15 07:32:37,767 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:40891 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:33519 after 30 s')

2026-01-15 07:32:37,763 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:45705 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:33519 after 30 s')

2026-01-15 07:32:37,752 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:40437 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:33519 after 30 s')

2026-01-15 07:32:08,501 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.136:37787

2026-01-15 07:32:08,499 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.136:37787', status: closed, memory: 0, processing: 0>

2026-01-15 07:32:07,620 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.136:33519', status: closed, memory: 0, processing: 0>

2026-01-15 07:31:48,429 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:44777 failed: OSError: Timed out trying to connect to tcp://172.21.151.136:44777 after 30 s

2026-01-15 07:31:48,415 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:37171 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:44777 after 30 s')

2026-01-15 07:31:48,414 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:36079 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:44777 after 30 s')

2026-01-15 07:31:48,414 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:34813 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:44777 after 30 s')

2026-01-15 07:31:48,414 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:41319 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:44777 after 30 s')

2026-01-15 07:31:48,393 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:42109 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:44777 after 30 s')

2026-01-15 07:31:48,391 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:40437 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:44777 after 30 s')

2026-01-15 07:31:48,387 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:41827 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:44777 after 30 s')

2026-01-15 07:31:48,387 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:34949 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:44777 after 30 s')

2026-01-15 07:31:48,375 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:37655 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:44777 after 30 s')

2026-01-15 07:31:19,207 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.136:33519

2026-01-15 07:31:19,205 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.136:33519', status: closed, memory: 0, processing: 0>

2026-01-15 07:31:18,221 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.136:44777', status: closed, memory: 0, processing: 0>

2026-01-15 07:31:03,875 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.136:44777

2026-01-15 07:31:03,872 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.136:44777', status: closed, memory: 0, processing: 0>

2026-01-15 07:31:02,946 - distributed.scheduler - INFO - Close client connection: Client-worker-556b6b51-f149-11f0-80c6-92d0b450f87a

2026-01-15 07:31:02,941 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.136:42651', status: closed, memory: 0, processing: 0>

2026-01-15 07:31:02,939 - distributed.scheduler - INFO - Remove client Client-worker-556b6b51-f149-11f0-80c6-92d0b450f87a

2026-01-15 05:30:23,612 - distributed.scheduler - ERROR - Shut down workers that don't have promised key: [], ('len-agg-0445fce3fd51cce7d624c21b371441f9', 0) NoneType: None

2026-01-15 05:30:23,612 - distributed.scheduler - ERROR - Couldn't gather keys {"('len-agg-0445fce3fd51cce7d624c21b371441f9', 0)": []} state: ['waiting'] workers: [] NoneType: None

2026-01-15 03:00:58,432 - distributed.scheduler - INFO - Receive client connection: Client-worker-6aaa4cf2-f1be-11f0-818e-e6b3e8b2508c

2026-01-14 18:35:24,212 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:37627 failed: OSError: Timed out trying to connect to tcp://172.21.25.37:37627 after 30 s

2026-01-14 18:35:24,192 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:34949 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:37627 after 30 s')

2026-01-14 18:35:24,192 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:40437 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:37627 after 30 s')

2026-01-14 18:35:24,176 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:45721 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:37627 after 30 s')

2026-01-14 18:35:24,175 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:41827 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:37627 after 30 s')

2026-01-14 18:35:24,167 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:42651 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:37627 after 30 s')

2026-01-14 18:35:24,167 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:36079 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:37627 after 30 s')

2026-01-14 18:35:24,167 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:43863 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:37627 after 30 s')

2026-01-14 18:35:24,137 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:43107 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:37627 after 30 s')

2026-01-14 18:35:24,118 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:44641 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:37627 after 30 s')

2026-01-14 18:34:55,141 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.37:34813

2026-01-14 18:34:55,138 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.37:34813', status: closed, memory: 0, processing: 0>

2026-01-14 18:34:53,965 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.37:37627', status: closed, memory: 0, processing: 0>

2026-01-14 18:34:31,795 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:45385 failed: OSError: Timed out trying to connect to tcp://172.21.25.37:45385 after 30 s

2026-01-14 18:34:31,762 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:42651 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:45385 after 30 s')

2026-01-14 18:34:31,735 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:34949 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:45385 after 30 s')

2026-01-14 18:34:31,726 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:40437 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:45385 after 30 s')

2026-01-14 18:34:31,719 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:41319 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:45385 after 30 s')

2026-01-14 18:34:31,717 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:43107 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:45385 after 30 s')

2026-01-14 18:34:31,716 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:41827 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:45385 after 30 s')

2026-01-14 18:34:31,716 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:37655 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:45385 after 30 s')

2026-01-14 18:34:31,716 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:43863 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:45385 after 30 s')

2026-01-14 18:34:31,684 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:37171 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:45385 after 30 s')

2026-01-14 18:34:31,680 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:36079 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:45385 after 30 s')

2026-01-14 18:34:31,678 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:44641 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:45385 after 30 s')

2026-01-14 18:34:31,665 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:45705 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:45385 after 30 s')

2026-01-14 18:34:02,759 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.37:37627

2026-01-14 18:34:02,757 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.37:37627', status: closed, memory: 0, processing: 0>

2026-01-14 18:34:01,559 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.37:45385', status: closed, memory: 0, processing: 0>

2026-01-14 18:33:38,529 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:34949 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:45717 after 30 s')

2026-01-14 18:33:38,524 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:45717 failed: OSError: Timed out trying to connect to tcp://172.21.25.37:45717 after 30 s

2026-01-14 18:33:38,475 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:36079 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:45717 after 30 s')

2026-01-14 18:33:38,475 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:40437 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:45717 after 30 s')

2026-01-14 18:33:38,457 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:41319 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:45717 after 30 s')

2026-01-14 18:33:38,448 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:45721 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:45717 after 30 s')

2026-01-14 18:33:38,444 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:42651 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:45717 after 30 s')

2026-01-14 18:33:38,442 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:43107 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:45717 after 30 s')

2026-01-14 18:33:38,441 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:37171 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:45717 after 30 s')

2026-01-14 18:33:38,441 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:45705 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:45717 after 30 s')

2026-01-14 18:33:38,438 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:43863 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:45717 after 30 s')

2026-01-14 18:33:38,438 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:37655 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:45717 after 30 s')

2026-01-14 18:33:38,385 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:42109 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:45717 after 30 s')

2026-01-14 18:33:38,374 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:40891 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:45717 after 30 s')

2026-01-14 18:33:09,399 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.37:45385

2026-01-14 18:33:09,397 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.37:45385', status: closed, memory: 0, processing: 0>

2026-01-14 18:33:08,270 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.37:45717', status: closed, memory: 0, processing: 0>

2026-01-14 18:32:45,914 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:39405 failed: OSError: Timed out trying to connect to tcp://172.21.25.37:39405 after 30 s

2026-01-14 18:32:45,825 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:36079 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:39405 after 30 s')

2026-01-14 18:32:45,824 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:37171 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:39405 after 30 s')

2026-01-14 18:32:45,823 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:43107 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:39405 after 30 s')

2026-01-14 18:32:45,811 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:45705 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:39405 after 30 s')

2026-01-14 18:32:16,847 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.37:45717

2026-01-14 18:32:16,845 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.37:45717', status: closed, memory: 0, processing: 0>

2026-01-14 18:32:15,662 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.37:39405', status: closed, memory: 0, processing: 0>

2026-01-14 18:31:50,607 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:41115 failed: OSError: Timed out trying to connect to tcp://172.21.25.37:41115 after 30 s

2026-01-14 18:31:50,541 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:40437 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:41115 after 30 s')

2026-01-14 18:31:50,539 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:34949 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:41115 after 30 s')

2026-01-14 18:31:50,509 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:41827 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:41115 after 30 s')

2026-01-14 18:31:50,498 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:42651 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:41115 after 30 s')

2026-01-14 18:31:50,483 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:45721 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:41115 after 30 s')

2026-01-14 18:31:50,446 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:40891 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.25.37:41115 after 30 s')

2026-01-14 18:31:21,524 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.37:39405

2026-01-14 18:31:21,521 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.37:39405', status: closed, memory: 0, processing: 0>

2026-01-14 18:31:20,367 - distributed.scheduler - INFO - Close client connection: Client-worker-12d4e658-f149-11f0-80ea-e6b3e8b2508c

2026-01-14 18:31:20,355 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.37:41115', status: closed, memory: 0, processing: 0>

2026-01-14 18:31:20,354 - distributed.scheduler - INFO - Remove client Client-worker-12d4e658-f149-11f0-80ea-e6b3e8b2508c

2026-01-14 18:00:43,037 - distributed.scheduler - ERROR - Shut down workers that don't have promised key: [], ('len-agg-603f6bb8603aa4a92752c83589a373cb', 0) NoneType: None

2026-01-14 18:00:43,036 - distributed.scheduler - ERROR - Couldn't gather keys {"('len-agg-603f6bb8603aa4a92752c83589a373cb', 0)": []} state: ['waiting'] workers: [] NoneType: None

2026-01-14 17:00:32,039 - distributed.scheduler - INFO - Receive client connection: Client-worker-893eb4c5-f16a-11f0-817e-5693d18fdaf6

2026-01-14 15:34:11,999 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:46235 failed: OSError: Timed out trying to connect to tcp://172.21.12.242:46235 after 30 s

2026-01-14 15:34:11,944 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:36079 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:46235 after 30 s')

2026-01-14 15:34:11,685 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:40437 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:46235 after 30 s')

2026-01-14 15:34:11,630 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:41827 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:46235 after 30 s')

2026-01-14 15:34:11,626 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:43863 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:46235 after 30 s')

2026-01-14 15:34:11,622 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:45705 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:46235 after 30 s')

2026-01-14 15:34:11,577 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:40891 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:46235 after 30 s')

2026-01-14 15:33:42,485 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.242:34949

2026-01-14 15:33:42,483 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.242:34949', status: closed, memory: 0, processing: 0>

2026-01-14 15:33:41,478 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.242:46235', status: closed, memory: 0, processing: 0>

2026-01-14 15:33:30,914 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:40781 failed: OSError: Timed out trying to connect to tcp://172.21.12.242:40781 after 30 s

2026-01-14 15:33:30,871 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:43863 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:40781 after 30 s')

2026-01-14 15:33:30,865 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:45705 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:40781 after 30 s')

2026-01-14 15:33:30,846 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:41319 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:40781 after 30 s')

2026-01-14 15:33:30,802 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:44641 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:40781 after 30 s')

2026-01-14 15:33:30,802 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:41115 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:40781 after 30 s')

2026-01-14 15:33:30,792 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:40891 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:40781 after 30 s')

2026-01-14 15:33:01,555 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.242:46235

2026-01-14 15:33:01,553 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.242:46235', status: closed, memory: 0, processing: 0>

2026-01-14 15:33:00,673 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.242:40781', status: closed, memory: 0, processing: 0>

2026-01-14 15:32:50,595 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:35579 failed: OSError: Timed out trying to connect to tcp://172.21.12.242:35579 after 30 s

2026-01-14 15:32:50,476 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:36079 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:35579 after 30 s')

2026-01-14 15:32:50,474 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:40437 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:35579 after 30 s')

2026-01-14 15:32:50,473 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:45721 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:35579 after 30 s')

2026-01-14 15:32:50,383 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:41115 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:35579 after 30 s')

2026-01-14 15:32:50,365 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:42109 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:35579 after 30 s')

2026-01-14 15:32:21,198 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.242:40781

2026-01-14 15:32:21,196 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.242:40781', status: closed, memory: 0, processing: 0>

2026-01-14 15:32:20,275 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.242:35579', status: closed, memory: 0, processing: 0>

2026-01-14 15:31:57,744 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:35247 failed: OSError: Timed out trying to connect to tcp://172.21.12.242:35247 after 30 s

2026-01-14 15:31:57,676 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:36079 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:35247 after 30 s')

2026-01-14 15:31:57,676 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:40437 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:35247 after 30 s')

2026-01-14 15:31:57,638 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:41319 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:35247 after 30 s')

2026-01-14 15:31:57,633 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:41827 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:35247 after 30 s')

2026-01-14 15:31:57,625 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:37171 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:35247 after 30 s')

2026-01-14 15:31:57,618 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:45721 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:35247 after 30 s')

2026-01-14 15:31:57,574 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:41115 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:35247 after 30 s')

2026-01-14 15:31:57,564 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:42109 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:35247 after 30 s')

2026-01-14 15:31:28,417 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.242:35579

2026-01-14 15:31:28,414 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.242:35579', status: closed, memory: 0, processing: 0>

2026-01-14 15:31:27,478 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.242:35247', status: closed, memory: 0, processing: 0>

2026-01-14 15:31:14,540 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:36507 failed: OSError: Timed out trying to connect to tcp://172.21.12.242:36507 after 30 s

2026-01-14 15:31:14,486 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:36507 failed: OSError: Timed out trying to connect to tcp://172.21.12.242:36507 after 30 s

2026-01-14 15:31:14,470 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:41319 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:36507 after 30 s')

2026-01-14 15:31:14,298 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:37655 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:36507 after 30 s')

2026-01-14 15:31:14,271 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:40437 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:36507 after 30 s')

2026-01-14 15:31:14,206 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:44641 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:36507 after 30 s')

2026-01-14 15:31:14,203 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:37171 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:36507 after 30 s')

2026-01-14 15:31:14,180 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:40891 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:36507 after 30 s')

2026-01-14 15:31:14,169 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:43863 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:36507 after 30 s')

2026-01-14 15:31:14,167 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:45705 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:36507 after 30 s')

2026-01-14 15:31:14,118 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:41827 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:36507 after 30 s')

2026-01-14 15:31:14,078 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:43107 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:36507 after 30 s')

2026-01-14 15:31:14,056 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:36507 failed: OSError: Timed out trying to connect to tcp://172.21.12.242:36507 after 30 s

2026-01-14 15:31:13,919 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:42109 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:36507 after 30 s')

2026-01-14 15:31:13,915 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:43863 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:36507 after 30 s')

2026-01-14 15:31:13,910 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:41115 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:36507 after 30 s')

2026-01-14 15:31:13,837 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:40891 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:36507 after 30 s')

2026-01-14 15:31:13,824 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:41115 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:36507 after 30 s')

2026-01-14 15:30:44,648 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.242:35247

2026-01-14 15:30:44,645 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.242:35247', status: closed, memory: 0, processing: 0>

2026-01-14 15:30:43,727 - distributed.scheduler - INFO - Close client connection: Client-worker-22c6a82e-f14d-11f0-80ff-5693d18fdaf6

2026-01-14 15:30:43,703 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.242:36507', status: closed, memory: 0, processing: 0>

2026-01-14 15:30:43,700 - distributed.scheduler - INFO - Remove client Client-worker-22c6a82e-f14d-11f0-80ff-5693d18fdaf6

2026-01-14 13:30:04,732 - distributed.scheduler - INFO - Receive client connection: Client-worker-22c6a82e-f14d-11f0-80ff-5693d18fdaf6

2026-01-14 13:02:55,798 - distributed.scheduler - INFO - Receive client connection: Client-worker-57de0a07-f149-11f0-80f6-fa70b2057bbc

2026-01-14 13:02:51,665 - distributed.scheduler - INFO - Receive client connection: Client-worker-556b6b51-f149-11f0-80c6-92d0b450f87a

2026-01-14 13:02:36,430 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:35171 failed: OSError: Timed out trying to connect to tcp://172.21.151.136:35171 after 30 s

2026-01-14 13:02:36,430 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:40075 failed: OSError: Timed out trying to connect to tcp://172.21.12.244:40075 after 30 s

2026-01-14 13:02:36,429 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:43581 failed: OSError: Timed out trying to connect to tcp://172.21.12.242:43581 after 30 s

2026-01-14 13:02:36,415 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:37171 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:35171 after 30 s')

2026-01-14 13:02:36,349 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.247:45705 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:35171 after 30 s')

2026-01-14 13:02:36,321 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.211:43863 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:35171 after 30 s')

2026-01-14 13:02:36,304 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:37655 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:35171 after 30 s')

2026-01-14 13:02:36,294 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:41319 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:40075 after 30 s')

2026-01-14 13:02:36,292 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.188:45721 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:35171 after 30 s')

2026-01-14 13:02:36,291 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:41827 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:40075 after 30 s')

2026-01-14 13:02:36,247 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:42109 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.242:43581 after 30 s')

2026-01-14 13:02:36,239 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.62:40891 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.12.244:40075 after 30 s')

2026-01-14 13:02:36,237 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:44641 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:35171 after 30 s')

2026-01-14 13:02:22,597 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.159:40437 failed: Exception: OSError('Timed out trying to connect to tcp://172.21.151.136:45631 after 30 s')

2026-01-14 13:02:07,096 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.242:36507

2026-01-14 13:02:07,095 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.242:36507', status: closed, memory: 0, processing: 0>

2026-01-14 13:02:06,989 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.244:36079

2026-01-14 13:02:06,988 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.244:36079', status: closed, memory: 0, processing: 0>

2026-01-14 13:02:06,975 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.136:42651

2026-01-14 13:02:06,972 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.136:42651', status: closed, memory: 0, processing: 0>

2026-01-14 13:02:06,143 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.136:35171', status: closed, memory: 0, processing: 0>

2026-01-14 13:02:06,135 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.242:43581', status: closed, memory: 0, processing: 0>

2026-01-14 13:02:06,123 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.244:40075', status: closed, memory: 0, processing: 0>

2026-01-14 13:01:53,557 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.242:36627 failed: OSError: Timed out trying to connect to tcp://172.21.12.242:36627 after 30 s

2026-01-14 13:01:53,541 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.244:33041 failed: OSError: Timed out trying to connect to tcp://172.21.12.244:33041 after 30 s

2026-01-14 13:01:53,540 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.136:45631 failed: OSError: Timed out trying to connect to tcp://172.21.151.136:45631 after 30 s

2026-01-14 13:01:23,208 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.136:35171

2026-01-14 13:01:23,207 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.136:35171', status: closed, memory: 0, processing: 0>

2026-01-14 13:01:22,906 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.244:40075

2026-01-14 13:01:22,905 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.244:40075', status: closed, memory: 0, processing: 0>

2026-01-14 13:01:22,860 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.242:43581

2026-01-14 13:01:22,859 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.242:43581', status: closed, memory: 0, processing: 0>

2026-01-14 13:01:22,330 - distributed.scheduler - INFO - Close client connection: Client-worker-45c27434-f138-11f0-8074-92d0b450f87a

2026-01-14 13:01:22,306 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.136:45631', status: closed, memory: 0, processing: 0>

2026-01-14 13:01:22,305 - distributed.scheduler - INFO - Remove client Client-worker-45c27434-f138-11f0-8074-92d0b450f87a

2026-01-14 13:01:21,981 - distributed.scheduler - INFO - Close client connection: Client-worker-c0922770-f140-11f0-80ab-5693d18fdaf6

2026-01-14 13:01:21,975 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.242:36627', status: closed, memory: 0, processing: 0>

2026-01-14 13:01:21,971 - distributed.scheduler - INFO - Remove client Client-worker-c0922770-f140-11f0-80ab-5693d18fdaf6

2026-01-14 13:01:21,933 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.244:33041', status: closed, memory: 0, processing: 0>

2026-01-14 13:01:01,488 - distributed.scheduler - INFO - Receive client connection: Client-worker-13b5ebef-f149-11f0-80af-9edd0389b2a9

2026-01-14 13:00:59,945 - distributed.scheduler - INFO - Receive client connection: Client-worker-12d4e658-f149-11f0-80ea-e6b3e8b2508c

2026-01-14 12:41:23,910 - distributed.scheduler - INFO - Close client connection: Client-6ce1ae72-f137-11f0-8001-d684c398e257

2026-01-14 12:41:23,910 - distributed.scheduler - INFO - Close client connection: Client-eb8b2aa7-f137-11f0-8001-d684c398e257

2026-01-14 12:41:23,910 - distributed.scheduler - INFO - Close client connection: Client-05ac99be-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,910 - distributed.scheduler - INFO - Close client connection: Client-0462be5d-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,910 - distributed.scheduler - INFO - Close client connection: Client-0346d6ff-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,910 - distributed.scheduler - INFO - Close client connection: Client-b9d4dbdc-f137-11f0-8001-d684c398e257

2026-01-14 12:41:23,910 - distributed.scheduler - INFO - Close client connection: Client-ce70f9a5-f137-11f0-8001-d684c398e257

2026-01-14 12:41:23,910 - distributed.scheduler - INFO - Close client connection: Client-dd901d34-f137-11f0-8001-d684c398e257

2026-01-14 12:41:23,910 - distributed.scheduler - INFO - Close client connection: Client-01283943-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,910 - distributed.scheduler - INFO - Close client connection: Client-f5e507da-f137-11f0-8001-d684c398e257

2026-01-14 12:41:23,910 - distributed.scheduler - INFO - Close client connection: Client-004bf1dd-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,910 - distributed.scheduler - INFO - Close client connection: Client-00c6c424-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,910 - distributed.scheduler - INFO - Close client connection: Client-01919df4-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,909 - distributed.scheduler - INFO - Close client connection: Client-01f1ab10-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,909 - distributed.scheduler - INFO - Close client connection: Client-007cd8a3-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,909 - distributed.scheduler - INFO - Close client connection: Client-04cc7c24-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,909 - distributed.scheduler - INFO - Close client connection: Client-03803df2-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,909 - distributed.scheduler - INFO - Close client connection: Client-0314b7c8-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,909 - distributed.scheduler - INFO - Close client connection: Client-00f19bf4-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,909 - distributed.scheduler - INFO - Close client connection: Client-02d592c0-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,909 - distributed.scheduler - INFO - Close client connection: Client-015b1ea5-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,909 - distributed.scheduler - INFO - Close client connection: Client-01c3a9a4-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,909 - distributed.scheduler - INFO - Close client connection: Client-02640ef2-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,909 - distributed.scheduler - INFO - Close client connection: Client-02a07c15-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,909 - distributed.scheduler - INFO - Close client connection: Client-02311855-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,909 - distributed.scheduler - INFO - Close client connection: Client-03f21de1-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,909 - distributed.scheduler - INFO - Close client connection: Client-03b0e28c-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,909 - distributed.scheduler - INFO - Close client connection: Client-053f0580-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,909 - distributed.scheduler - INFO - Close client connection: Client-04903e9f-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,908 - distributed.scheduler - INFO - Close client connection: Client-04233a84-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,908 - distributed.scheduler - INFO - Close client connection: Client-440fbab6-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,908 - distributed.scheduler - INFO - Close client connection: Client-061e60f2-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,908 - distributed.scheduler - INFO - Close client connection: Client-aa7f1712-f139-11f0-8001-d684c398e257

2026-01-14 12:41:23,908 - distributed.scheduler - INFO - Close client connection: Client-0501cc3c-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,908 - distributed.scheduler - INFO - Close client connection: Client-10eb673c-f13b-11f0-8001-d684c398e257

2026-01-14 12:41:23,908 - distributed.scheduler - INFO - Close client connection: Client-056bf22f-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,908 - distributed.scheduler - INFO - Close client connection: Client-7754f7c7-f13c-11f0-8001-d684c398e257

2026-01-14 12:41:23,908 - distributed.scheduler - INFO - Close client connection: Client-05e01535-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,908 - distributed.scheduler - INFO - Close client connection: Client-aa9f6ac2-f140-11f0-8001-d684c398e257

2026-01-14 12:41:23,908 - distributed.scheduler - INFO - Close client connection: Client-ddcb83ca-f13d-11f0-8001-d684c398e257

2026-01-14 12:41:23,907 - distributed.scheduler - INFO - Close client connection: Client-778b3a89-f143-11f0-8001-d684c398e257

2026-01-14 12:41:23,907 - distributed.scheduler - INFO - Close client connection: Client-064f6579-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,906 - distributed.scheduler - INFO - Close client connection: Client-44376f88-f13f-11f0-8001-d684c398e257

2026-01-14 12:41:23,905 - distributed.scheduler - INFO - Close client connection: Client-111130e3-f142-11f0-8001-d684c398e257

2026-01-14 12:41:23,905 - distributed.scheduler - INFO - Close client connection: Client-ddf7bdaa-f144-11f0-8001-d684c398e257

2026-01-14 12:41:23,903 - distributed.scheduler - INFO - Remove client Client-6ce1ae72-f137-11f0-8001-d684c398e257

2026-01-14 12:41:23,903 - distributed.scheduler - INFO - Remove client Client-eb8b2aa7-f137-11f0-8001-d684c398e257

2026-01-14 12:41:23,903 - distributed.scheduler - INFO - Remove client Client-05ac99be-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,902 - distributed.scheduler - INFO - Remove client Client-0462be5d-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,902 - distributed.scheduler - INFO - Remove client Client-0346d6ff-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,902 - distributed.scheduler - INFO - Remove client Client-b9d4dbdc-f137-11f0-8001-d684c398e257

2026-01-14 12:41:23,901 - distributed.scheduler - INFO - Remove client Client-ce70f9a5-f137-11f0-8001-d684c398e257

2026-01-14 12:41:23,901 - distributed.scheduler - INFO - Remove client Client-dd901d34-f137-11f0-8001-d684c398e257

2026-01-14 12:41:23,901 - distributed.scheduler - INFO - Remove client Client-01283943-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,901 - distributed.scheduler - INFO - Remove client Client-f5e507da-f137-11f0-8001-d684c398e257

2026-01-14 12:41:23,901 - distributed.scheduler - INFO - Remove client Client-004bf1dd-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,900 - distributed.scheduler - INFO - Remove client Client-00c6c424-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,900 - distributed.scheduler - INFO - Remove client Client-01919df4-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,900 - distributed.scheduler - INFO - Remove client Client-01f1ab10-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,899 - distributed.scheduler - INFO - Remove client Client-007cd8a3-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,899 - distributed.scheduler - INFO - Remove client Client-04cc7c24-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,899 - distributed.scheduler - INFO - Remove client Client-03803df2-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,899 - distributed.scheduler - INFO - Remove client Client-0314b7c8-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,898 - distributed.scheduler - INFO - Remove client Client-00f19bf4-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,898 - distributed.scheduler - INFO - Remove client Client-02d592c0-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,898 - distributed.scheduler - INFO - Remove client Client-015b1ea5-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,898 - distributed.scheduler - INFO - Remove client Client-01c3a9a4-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,897 - distributed.scheduler - INFO - Remove client Client-02640ef2-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,897 - distributed.scheduler - INFO - Remove client Client-02a07c15-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,897 - distributed.scheduler - INFO - Remove client Client-02311855-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,896 - distributed.scheduler - INFO - Remove client Client-03f21de1-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,896 - distributed.scheduler - INFO - Remove client Client-03b0e28c-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,895 - distributed.scheduler - INFO - Remove client Client-053f0580-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,895 - distributed.scheduler - INFO - Remove client Client-04903e9f-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,894 - distributed.scheduler - INFO - Remove client Client-04233a84-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,894 - distributed.scheduler - INFO - Remove client Client-440fbab6-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,894 - distributed.scheduler - INFO - Remove client Client-061e60f2-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,893 - distributed.scheduler - INFO - Remove client Client-aa7f1712-f139-11f0-8001-d684c398e257

2026-01-14 12:41:23,893 - distributed.scheduler - INFO - Remove client Client-0501cc3c-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,892 - distributed.scheduler - INFO - Remove client Client-10eb673c-f13b-11f0-8001-d684c398e257

2026-01-14 12:41:23,892 - distributed.scheduler - INFO - Remove client Client-056bf22f-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,892 - distributed.scheduler - INFO - Remove client Client-7754f7c7-f13c-11f0-8001-d684c398e257

2026-01-14 12:41:23,891 - distributed.scheduler - INFO - Remove client Client-05e01535-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,891 - distributed.scheduler - INFO - Remove client Client-aa9f6ac2-f140-11f0-8001-d684c398e257

2026-01-14 12:41:23,890 - distributed.scheduler - INFO - Remove client Client-ddcb83ca-f13d-11f0-8001-d684c398e257

2026-01-14 12:41:23,890 - distributed.scheduler - INFO - Remove client Client-778b3a89-f143-11f0-8001-d684c398e257

2026-01-14 12:41:23,889 - distributed.scheduler - INFO - Remove client Client-064f6579-f138-11f0-8001-d684c398e257

2026-01-14 12:41:23,877 - distributed.scheduler - INFO - Remove client Client-44376f88-f13f-11f0-8001-d684c398e257

2026-01-14 12:41:23,876 - distributed.scheduler - INFO - Remove client Client-111130e3-f142-11f0-8001-d684c398e257

2026-01-14 12:41:23,875 - distributed.scheduler - INFO - Remove client Client-ddf7bdaa-f144-11f0-8001-d684c398e257

2026-01-14 12:41:23,021 - distributed.scheduler - INFO - Close client connection: Client-4469a00a-f146-11f0-8001-d684c398e257

2026-01-14 12:41:23,020 - distributed.scheduler - INFO - Remove client Client-4469a00a-f146-11f0-8001-d684c398e257

2026-01-14 12:41:23,018 - distributed.scheduler - INFO - Remove client Client-4469a00a-f146-11f0-8001-d684c398e257

2026-01-14 12:40:54,643 - distributed.scheduler - INFO - Receive client connection: Client-4469a00a-f146-11f0-8001-d684c398e257

2026-01-14 12:30:53,280 - distributed.scheduler - INFO - Receive client connection: Client-ddf7bdaa-f144-11f0-8001-d684c398e257

2026-01-14 12:20:51,943 - distributed.scheduler - INFO - Receive client connection: Client-778b3a89-f143-11f0-8001-d684c398e257

2026-01-14 12:10:50,512 - distributed.scheduler - INFO - Receive client connection: Client-111130e3-f142-11f0-8001-d684c398e257

2026-01-14 12:01:25,974 - distributed.scheduler - INFO - Receive client connection: Client-worker-c0922770-f140-11f0-80ab-5693d18fdaf6

2026-01-14 12:01:20,907 - distributed.scheduler - INFO - Receive client connection: Client-worker-bd8e2545-f140-11f0-80af-e2e790da60bf

2026-01-14 12:01:10,138 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.37:41115

2026-01-14 12:01:10,137 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.37:41115', status: closed, memory: 0, processing: 0>

2026-01-14 12:01:09,804 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.244:33041

2026-01-14 12:01:09,803 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.244:33041', status: closed, memory: 0, processing: 0>

2026-01-14 12:01:09,002 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.37:37605', status: closed, memory: 0, processing: 0>

2026-01-14 12:01:08,866 - distributed.scheduler - INFO - Close client connection: Client-worker-85b594fc-f13c-11f0-8074-fa70b2057bbc

2026-01-14 12:01:08,864 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.244:40791', status: closed, memory: 0, processing: 0>

2026-01-14 12:01:08,864 - distributed.scheduler - INFO - Remove client Client-worker-85b594fc-f13c-11f0-8074-fa70b2057bbc

2026-01-14 12:00:51,918 - distributed.scheduler - INFO - Receive client connection: Client-worker-ac464224-f140-11f0-80b7-4e8606c6fff3

2026-01-14 12:00:51,677 - distributed.scheduler - INFO - Receive client connection: Client-worker-ac22d150-f140-11f0-80b3-b671f5ff8c70

2026-01-14 12:00:51,640 - distributed.scheduler - INFO - Receive client connection: Client-worker-ac1c9fd0-f140-11f0-80b8-76b515aac91e

2026-01-14 12:00:51,428 - distributed.scheduler - INFO - Receive client connection: Client-worker-abfc9067-f140-11f0-80d7-42992fa4ff5e

2026-01-14 12:00:49,139 - distributed.scheduler - INFO - Receive client connection: Client-aa9f6ac2-f140-11f0-8001-d684c398e257

2026-01-14 11:50:47,837 - distributed.scheduler - INFO - Receive client connection: Client-44376f88-f13f-11f0-8001-d684c398e257

2026-01-14 11:40:46,510 - distributed.scheduler - INFO - Receive client connection: Client-ddcb83ca-f13d-11f0-8001-d684c398e257

2026-01-14 11:32:08,128 - distributed.scheduler - INFO - Receive client connection: Client-worker-a8d05095-f13c-11f0-80ab-a2be1fdf94d6

2026-01-14 11:32:04,977 - distributed.scheduler - INFO - Receive client connection: Client-worker-a6edeadd-f13c-11f0-80af-123d2a42b3d6

2026-01-14 11:31:33,283 - distributed.scheduler - INFO - Receive client connection: Client-worker-940bdd92-f13c-11f0-80ab-a217f266f416

2026-01-14 11:31:15,798 - distributed.scheduler - ERROR - Shut down workers that don't have promised key: [], run-ffb82d4492a69e9a88899e18cf368b02 NoneType: None

2026-01-14 11:31:15,798 - distributed.scheduler - ERROR - Couldn't gather keys {'run-ffb82d4492a69e9a88899e18cf368b02': []} state: ['processing'] workers: [] NoneType: None

2026-01-14 11:31:09,779 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.242:36627

2026-01-14 11:31:09,778 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.242:36627', status: closed, memory: 0, processing: 0>

2026-01-14 11:31:09,485 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.92:44641

2026-01-14 11:31:09,484 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.92:44641', status: closed, memory: 0, processing: 0>

2026-01-14 11:31:09,436 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.188:45721

2026-01-14 11:31:09,435 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.188:45721', status: closed, memory: 0, processing: 0>

2026-01-14 11:31:09,408 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.62:40891

2026-01-14 11:31:09,407 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.62:40891', status: closed, memory: 0, processing: 0>

2026-01-14 11:31:09,390 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.37:37605

2026-01-14 11:31:09,389 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.37:37605', status: closed, memory: 0, processing: 0>

2026-01-14 11:31:09,283 - distributed.scheduler - INFO - Receive client connection: Client-worker-85b594fc-f13c-11f0-8074-fa70b2057bbc

2026-01-14 11:31:09,044 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.159.211:43863

2026-01-14 11:31:09,043 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.159.211:43863', status: closed, memory: 0, processing: 0>

2026-01-14 11:31:08,986 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.165:41319

2026-01-14 11:31:08,986 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.165:41319', status: closed, memory: 0, processing: 0>

2026-01-14 11:31:08,976 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.247:45705

2026-01-14 11:31:08,976 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.247:45705', status: closed, memory: 0, processing: 0>

2026-01-14 11:31:08,912 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.159.228:41827

2026-01-14 11:31:08,911 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.159.228:41827', status: closed, memory: 0, processing: 0>

2026-01-14 11:31:08,878 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.250:37171

2026-01-14 11:31:08,877 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.250:37171', status: closed, memory: 0, processing: 0>

2026-01-14 11:31:08,804 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.159.254:43107

2026-01-14 11:31:08,803 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.159.254:43107', status: closed, memory: 0, processing: 0>

2026-01-14 11:31:08,776 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.242:37339', status: closed, memory: 0, processing: 0>

2026-01-14 11:31:08,617 - distributed.scheduler - INFO - Close client connection: Client-worker-45841954-f138-11f0-8074-76b515aac91e

2026-01-14 11:31:08,617 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.68:42109 failed: CommClosedError: in <TCP (closed) Scheduler Broadcast local=tcp://172.21.151.191:40054 remote=tcp://172.21.25.68:42109>: Stream is closed

2026-01-14 11:31:08,611 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.188:46155', status: closed, memory: 0, processing: 0>

2026-01-14 11:31:08,590 - distributed.scheduler - INFO - Remove client Client-worker-45841954-f138-11f0-8074-76b515aac91e

2026-01-14 11:31:08,480 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.225:37655 failed: CommClosedError: in <TCP (closed) Scheduler Broadcast local=tcp://172.21.151.191:39304 remote=tcp://172.21.159.225:37655>: Stream is closed

2026-01-14 11:31:08,450 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.92:43509 failed: OSError: Timed out during handshake while connecting to tcp://172.21.25.92:43509 after 30 s

2026-01-14 11:31:08,446 - distributed.scheduler - INFO - Close client connection: Client-worker-44d6627d-f138-11f0-8074-9edd0389b2a9

2026-01-14 11:31:08,425 - distributed.scheduler - INFO - Task ('hash-join-351cbae43e8a5fd66d4671174252fb8e', 6) marked as failed because 3 workers died while trying to run it

2026-01-14 11:31:08,424 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.92:43509', status: closed, memory: 0, processing: 0>

2026-01-14 11:31:08,420 - distributed.scheduler - INFO - Remove client Client-worker-44d6627d-f138-11f0-8074-9edd0389b2a9

2026-01-14 11:31:08,270 - distributed.scheduler - INFO - Close client connection: Client-worker-45d2dd54-f138-11f0-8074-4e8606c6fff3

2026-01-14 11:31:08,269 - distributed.scheduler - INFO - Close client connection: Client-worker-84211378-f137-11f0-8074-42992fa4ff5e

2026-01-14 11:31:08,252 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.62:35385', status: closed, memory: 0, processing: 0>

2026-01-14 11:31:08,251 - distributed.scheduler - INFO - Remove client Client-worker-45d2dd54-f138-11f0-8074-4e8606c6fff3

2026-01-14 11:31:08,243 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.159.211:38167', status: closed, memory: 0, processing: 0>

2026-01-14 11:31:08,242 - distributed.scheduler - INFO - Remove client Client-worker-84211378-f137-11f0-8074-42992fa4ff5e

2026-01-14 11:31:08,221 - distributed.scheduler - INFO - Close client connection: Client-worker-7834b511-f13c-11f0-8074-e6b3e8b2508c

2026-01-14 11:31:08,212 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.25.37:37499', status: closed, memory: 0, processing: 0>

2026-01-14 11:31:08,208 - distributed.scheduler - INFO - Remove client Client-worker-7834b511-f13c-11f0-8074-e6b3e8b2508c

2026-01-14 11:31:08,202 - distributed.scheduler - ERROR - broadcast to tcp://172.21.25.37:37499 failed: CommClosedError: in <TCP (closed) Scheduler Broadcast local=tcp://172.21.151.191:55500 remote=tcp://172.21.25.37:37499>: ConnectionResetError: [Errno 104] Connection reset by peer

2026-01-14 11:31:08,084 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.247:46087', status: closed, memory: 0, processing: 0>

2026-01-14 11:31:08,067 - distributed.scheduler - ERROR - broadcast to tcp://172.21.151.165:32891 failed: OSError: Timed out during handshake while connecting to tcp://172.21.151.165:32891 after 30 s

2026-01-14 11:31:08,063 - distributed.scheduler - INFO - Close client connection: Client-worker-542cb756-f138-11f0-8074-e2e790da60bf

2026-01-14 11:31:08,048 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.151.165:32891', status: closed, memory: 0, processing: 0>

2026-01-14 11:31:08,046 - distributed.scheduler - INFO - Remove client Client-worker-542cb756-f138-11f0-8074-e2e790da60bf

2026-01-14 11:31:07,979 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.228:45693 failed: OSError: Timed out during handshake while connecting to tcp://172.21.159.228:45693 after 30 s

2026-01-14 11:31:07,977 - distributed.scheduler - ERROR - broadcast to tcp://172.21.159.254:41971 failed: OSError: Timed out during handshake while connecting to tcp://172.21.159.254:41971 after 30 s

2026-01-14 11:31:07,972 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.159.228:45693', status: closed, memory: 0, processing: 0>

2026-01-14 11:31:07,969 - distributed.scheduler - INFO - Close client connection: Client-worker-98bd9556-f137-11f0-8074-b671f5ff8c70

2026-01-14 11:31:07,964 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.159.254:41971', status: closed, memory: 0, processing: 0>

2026-01-14 11:31:07,962 - distributed.scheduler - INFO - Remove client Client-worker-98bd9556-f137-11f0-8074-b671f5ff8c70

2026-01-14 11:31:07,915 - distributed.scheduler - ERROR - broadcast to tcp://172.21.12.250:45545 failed: OSError: Timed out during handshake while connecting to tcp://172.21.12.250:45545 after 30 s

2026-01-14 11:31:07,914 - distributed.scheduler - INFO - Close client connection: Client-worker-4505a4b6-f138-11f0-8074-123d2a42b3d6

2026-01-14 11:31:07,904 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.12.250:45545', status: closed, memory: 0, processing: 0>

2026-01-14 11:31:07,903 - distributed.scheduler - INFO - Remove client Client-worker-4505a4b6-f138-11f0-8074-123d2a42b3d6

2026-01-14 11:30:47,752 - distributed.scheduler - INFO - Receive client connection: Client-worker-78e0aae1-f13c-11f0-8074-b2b90c3ada4d

2026-01-14 11:30:47,520 - distributed.scheduler - INFO - Receive client connection: Client-worker-78c4e733-f13c-11f0-8074-c6c79f0eb8d9

2026-01-14 11:30:46,787 - distributed.scheduler - INFO - Receive client connection: Client-worker-78572b86-f13c-11f0-8074-2a3d63591f59

2026-01-14 11:30:46,566 - distributed.scheduler - INFO - Receive client connection: Client-worker-7834b511-f13c-11f0-8074-e6b3e8b2508c

2026-01-14 11:30:45,106 - distributed.scheduler - INFO - Receive client connection: Client-7754f7c7-f13c-11f0-8001-d684c398e257

2026-01-14 11:20:43,785 - distributed.scheduler - INFO - Receive client connection: Client-10eb673c-f13b-11f0-8001-d684c398e257

2026-01-14 11:10:42,453 - distributed.scheduler - INFO - Receive client connection: Client-aa7f1712-f139-11f0-8001-d684c398e257

2026-01-14 11:01:08,129 - distributed.scheduler - INFO - Receive client connection: Client-worker-542cb756-f138-11f0-8074-e2e790da60bf

2026-01-14 11:00:44,048 - distributed.scheduler - INFO - Receive client connection: Client-worker-45d2dd54-f138-11f0-8074-4e8606c6fff3

2026-01-14 11:00:43,951 - distributed.scheduler - INFO - Receive client connection: Client-worker-45c27434-f138-11f0-8074-92d0b450f87a

2026-01-14 11:00:43,547 - distributed.scheduler - INFO - Receive client connection: Client-worker-45841954-f138-11f0-8074-76b515aac91e

2026-01-14 11:00:42,721 - distributed.scheduler - INFO - Receive client connection: Client-worker-4505a4b6-f138-11f0-8074-123d2a42b3d6

2026-01-14 11:00:42,403 - distributed.scheduler - INFO - Receive client connection: Client-worker-44d6627d-f138-11f0-8074-9edd0389b2a9

2026-01-14 11:00:41,096 - distributed.scheduler - INFO - Receive client connection: Client-440fbab6-f138-11f0-8001-d684c398e257

2026-01-14 10:58:57,495 - distributed.scheduler - INFO - Receive client connection: Client-064f6579-f138-11f0-8001-d684c398e257

2026-01-14 10:58:57,172 - distributed.scheduler - INFO - Receive client connection: Client-061e60f2-f138-11f0-8001-d684c398e257

2026-01-14 10:58:56,764 - distributed.scheduler - INFO - Receive client connection: Client-05e01535-f138-11f0-8001-d684c398e257

2026-01-14 10:58:56,439 - distributed.scheduler - INFO - Receive client connection: Client-05ac99be-f138-11f0-8001-d684c398e257

2026-01-14 10:58:56,005 - distributed.scheduler - INFO - Receive client connection: Client-056bf22f-f138-11f0-8001-d684c398e257

2026-01-14 10:58:55,713 - distributed.scheduler - INFO - Receive client connection: Client-053f0580-f138-11f0-8001-d684c398e257

2026-01-14 10:58:55,308 - distributed.scheduler - INFO - Receive client connection: Client-0501cc3c-f138-11f0-8001-d684c398e257

2026-01-14 10:58:54,961 - distributed.scheduler - INFO - Receive client connection: Client-04cc7c24-f138-11f0-8001-d684c398e257

2026-01-14 10:58:54,565 - distributed.scheduler - INFO - Receive client connection: Client-04903e9f-f138-11f0-8001-d684c398e257

2026-01-14 10:58:54,267 - distributed.scheduler - INFO - Receive client connection: Client-0462be5d-f138-11f0-8001-d684c398e257

2026-01-14 10:58:53,853 - distributed.scheduler - INFO - Receive client connection: Client-04233a84-f138-11f0-8001-d684c398e257

2026-01-14 10:58:53,525 - distributed.scheduler - INFO - Receive client connection: Client-03f21de1-f138-11f0-8001-d684c398e257

2026-01-14 10:58:53,102 - distributed.scheduler - INFO - Receive client connection: Client-03b0e28c-f138-11f0-8001-d684c398e257

2026-01-14 10:58:52,780 - distributed.scheduler - INFO - Receive client connection: Client-03803df2-f138-11f0-8001-d684c398e257

2026-01-14 10:58:52,404 - distributed.scheduler - INFO - Receive client connection: Client-0346d6ff-f138-11f0-8001-d684c398e257

2026-01-14 10:58:52,076 - distributed.scheduler - INFO - Receive client connection: Client-0314b7c8-f138-11f0-8001-d684c398e257

2026-01-14 10:58:51,661 - distributed.scheduler - INFO - Receive client connection: Client-02d592c0-f138-11f0-8001-d684c398e257

2026-01-14 10:58:51,314 - distributed.scheduler - INFO - Receive client connection: Client-02a07c15-f138-11f0-8001-d684c398e257

2026-01-14 10:58:50,918 - distributed.scheduler - INFO - Receive client connection: Client-02640ef2-f138-11f0-8001-d684c398e257

2026-01-14 10:58:50,588 - distributed.scheduler - INFO - Receive client connection: Client-02311855-f138-11f0-8001-d684c398e257

2026-01-14 10:58:50,167 - distributed.scheduler - INFO - Receive client connection: Client-01f1ab10-f138-11f0-8001-d684c398e257

2026-01-14 10:58:49,866 - distributed.scheduler - INFO - Receive client connection: Client-01c3a9a4-f138-11f0-8001-d684c398e257

2026-01-14 10:58:49,539 - distributed.scheduler - INFO - Receive client connection: Client-01919df4-f138-11f0-8001-d684c398e257

2026-01-14 10:58:49,181 - distributed.scheduler - INFO - Receive client connection: Client-015b1ea5-f138-11f0-8001-d684c398e257

2026-01-14 10:58:48,851 - distributed.scheduler - INFO - Receive client connection: Client-01283943-f138-11f0-8001-d684c398e257

2026-01-14 10:58:48,492 - distributed.scheduler - INFO - Receive client connection: Client-00f19bf4-f138-11f0-8001-d684c398e257

2026-01-14 10:58:48,210 - distributed.scheduler - INFO - Receive client connection: Client-00c6c424-f138-11f0-8001-d684c398e257

2026-01-14 10:58:47,724 - distributed.scheduler - INFO - Receive client connection: Client-007cd8a3-f138-11f0-8001-d684c398e257

2026-01-14 10:58:47,402 - distributed.scheduler - INFO - Receive client connection: Client-004bf1dd-f138-11f0-8001-d684c398e257

2026-01-14 10:58:29,960 - distributed.scheduler - INFO - Receive client connection: Client-f5e507da-f137-11f0-8001-d684c398e257

2026-01-14 10:58:12,591 - distributed.scheduler - INFO - Receive client connection: Client-eb8b2aa7-f137-11f0-8001-d684c398e257

2026-01-14 10:57:49,132 - distributed.scheduler - INFO - Receive client connection: Client-dd901d34-f137-11f0-8001-d684c398e257

2026-01-14 10:57:23,759 - distributed.scheduler - INFO - Receive client connection: Client-ce70f9a5-f137-11f0-8001-d684c398e257

2026-01-14 10:56:49,189 - distributed.scheduler - INFO - Receive client connection: Client-b9d4dbdc-f137-11f0-8001-d684c398e257

2026-01-14 10:56:47,876 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.247:46087

2026-01-14 10:56:47,875 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.247:46087', status: closed, memory: 0, processing: 0>

2026-01-14 10:56:32,935 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.250:45545

2026-01-14 10:56:32,934 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.250:45545', status: closed, memory: 0, processing: 0>

2026-01-14 10:56:32,430 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.244:40791

2026-01-14 10:56:32,429 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.244:40791', status: closed, memory: 0, processing: 0>

2026-01-14 10:56:31,428 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.12.242:37339

2026-01-14 10:56:31,427 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.12.242:37339', status: closed, memory: 0, processing: 0>

2026-01-14 10:56:27,754 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.92:43509

2026-01-14 10:56:27,752 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.92:43509', status: closed, memory: 0, processing: 0>

2026-01-14 10:56:23,998 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.136:45631

2026-01-14 10:56:23,995 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.136:45631', status: closed, memory: 0, processing: 0>

2026-01-14 10:56:23,504 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.159.228:45693

2026-01-14 10:56:23,502 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.159.228:45693', status: closed, memory: 0, processing: 0>

2026-01-14 10:56:18,274 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.188:46155

2026-01-14 10:56:18,272 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.188:46155', status: closed, memory: 0, processing: 0>

2026-01-14 10:56:15,472 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.159:40437

2026-01-14 10:56:15,470 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.159:40437', status: closed, memory: 0, processing: 0>

2026-01-14 10:56:03,663 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.159.225:37655

2026-01-14 10:56:03,662 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.159.225:37655', status: closed, memory: 0, processing: 0>

2026-01-14 10:56:01,745 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.37:37499

2026-01-14 10:56:01,742 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.37:37499', status: closed, memory: 0, processing: 0>

2026-01-14 10:55:53,671 - distributed.scheduler - INFO - Receive client connection: Client-worker-98bd9556-f137-11f0-8074-b671f5ff8c70

2026-01-14 10:55:41,052 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.68:42109

2026-01-14 10:55:41,051 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.68:42109', status: closed, memory: 0, processing: 0>

2026-01-14 10:55:38,263 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.151.165:32891

2026-01-14 10:55:38,261 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.151.165:32891', status: closed, memory: 0, processing: 0>

2026-01-14 10:55:36,765 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.25.62:35385

2026-01-14 10:55:36,764 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.25.62:35385', status: closed, memory: 0, processing: 0>

2026-01-14 10:55:30,743 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.159.254:41971

2026-01-14 10:55:30,741 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.159.254:41971', status: closed, memory: 0, processing: 0>

2026-01-14 10:55:19,728 - distributed.scheduler - INFO - Close client connection: Client-73deb2f9-f137-11f0-8007-1eb77754604e

2026-01-14 10:55:19,727 - distributed.scheduler - INFO - Remove client Client-73deb2f9-f137-11f0-8007-1eb77754604e

2026-01-14 10:55:19,098 - distributed.scheduler - INFO - Receive client connection: Client-worker-84211378-f137-11f0-8074-42992fa4ff5e

2026-01-14 10:55:15,631 - distributed.scheduler - INFO - Close client connection: Client-69eb6265-f137-11f0-8007-b272d00f6b4d

2026-01-14 10:55:15,628 - distributed.scheduler - INFO - Remove client Client-69eb6265-f137-11f0-8007-b272d00f6b4d

2026-01-14 10:55:14,036 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.159.211:38167

2026-01-14 10:55:14,034 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.159.211:38167', status: closed, memory: 0, processing: 0>

2026-01-14 10:54:51,819 - distributed.scheduler - INFO - Receive client connection: Client-73deb2f9-f137-11f0-8007-1eb77754604e

2026-01-14 10:54:46,828 - distributed.scheduler - INFO - Receive client connection: Client-70e35479-f137-11f0-8007-0672b9e4a534

2026-01-14 10:54:40,103 - distributed.scheduler - INFO - Receive client connection: Client-6ce1ae72-f137-11f0-8001-d684c398e257

2026-01-14 10:54:36,669 - distributed.scheduler - INFO - Receive client connection: Client-6ad69684-f137-11f0-8007-c203cd76de85

2026-01-14 10:54:35,139 - distributed.scheduler - INFO - Receive client connection: Client-69eb6265-f137-11f0-8007-b272d00f6b4d

2026-01-14 10:54:29,072 - distributed.scheduler - INFO - Lost all workers

2026-01-14 10:54:29,071 - distributed.scheduler - INFO - Remove worker <WorkerState 'tcp://172.21.159.226:34549', status: closed, memory: 0, processing: 0>

2026-01-14 10:54:25,353 - distributed.scheduler - INFO - Starting worker compute stream, tcp://172.21.159.226:34549

2026-01-14 10:54:25,345 - distributed.scheduler - INFO - Register worker <WorkerState 'tcp://172.21.159.226:34549', status: closed, memory: 0, processing: 0>

2026-01-14 10:54:23,422 - distributed.scheduler - INFO - dashboard at: http://172.21.151.191:8787/status

2026-01-14 10:54:23,421 - distributed.scheduler - INFO - Scheduler at: tcp://172.21.151.191:8786

2026-01-14 10:54:23,420 - distributed.scheduler - INFO - -----------------------------------------------

2026-01-14 10:54:23,415 - distributed.scheduler - INFO - State start