Skip to content

Commit bf97c8f

Browse files
committed
update notes
1 parent a96bed2 commit bf97c8f

File tree

1 file changed

+3
-2
lines changed
  • services/director-v2/src/simcore_service_director_v2/modules/comp_scheduler

1 file changed

+3
-2
lines changed

services/director-v2/src/simcore_service_director_v2/modules/comp_scheduler/_scheduler_base.py

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -504,9 +504,10 @@ async def _update_states_from_comp_backend(
504504
# now process the tasks
505505
if sorted_tasks.started:
506506
# NOTE: the dask-scheduler cannot differentiate between tasks that are effectively computing and
507-
# tasks that are only queued and accepted by a dask-worker.
507+
# tasks that are only queued and accepted by a dask-worker. We use dask plugins to report on tasks states
508+
# states are published to log_event, and we directly publish into RabbitMQ the sidecar and services logs.
508509
# tasks_started should therefore be mostly empty but for cases where
509-
# - dask Pub/Sub mechanism failed, the tasks goes from PENDING -> SUCCESS/FAILED/ABORTED without STARTED
510+
# - dask log_event/subscribe_topic mechanism failed, the tasks goes from PENDING -> SUCCESS/FAILED/ABORTED without STARTED
510511
# - the task finished so fast that the STARTED state was skipped between 2 runs of the dv-2 comp scheduler
511512
await self._process_started_tasks(
512513
sorted_tasks.started,

0 commit comments

Comments
 (0)