Skip to content

Revert task interrupted because worker gets killed #120

@wetneb

Description

@wetneb

This happened today on editgroups-commons:

[2024-08-30 14:24:21,458: INFO/MainProcess] Task revert_batch[ddf63a4e-27fc-4a66-8152-dcf2b323b53f] received
[2024-08-30 14:24:33,246: INFO/Beat] Scheduler: Sending due task inspect_batches (inspect_batches)
[2024-08-30 14:24:33,259: INFO/MainProcess] Task inspect_batches[d6fe33ba-b88c-4d21-8fdb-50f7bc1283e6] received
[2024-08-30 14:24:33,351: ERROR/MainProcess] Process 'ForkPoolWorker-8' pid:16 exited with 'signal 9 (SIGKILL)'
[2024-08-30 14:24:33,389: ERROR/MainProcess] Task handler raised error: WorkerLostError('Worker exited prematurely: signal 9 (SIGKILL) Job: 120.')
Traceback (most recent call last):
  File "/data/project/editgroups-commons/www/python/venv/lib/python3.11/site-packages/billiard/pool.py", line 1264, in mark_as_worker_lost
    raise WorkerLostError(
billiard.einfo.ExceptionWithTraceback: 
"""
Traceback (most recent call last):
  File "/data/project/editgroups-commons/www/python/venv/lib/python3.11/site-packages/billiard/pool.py", line 1264, in mark_as_worker_lost
    raise WorkerLostError(
billiard.exceptions.WorkerLostError: Worker exited prematurely: signal 9 (SIGKILL) Job: 120.
"""
[2024-08-30 14:24:33,659: INFO/ForkPoolWorker-9] Task inspect_batches[d6fe33ba-b88c-4d21-8fdb-50f7bc1283e6] succeeded in 0.3911465781275183s: None
[2024-08-30 14:34:33,243: INFO/Beat] Scheduler: Sending due task inspect_batches (inspect_batches)
[2024-08-30 14:34:33,252: INFO/MainProcess] Task inspect_batches[0b0219a3-9f82-4ac0-a9fe-096660cdab84] received
/data/project/editgroups-commons/www/python/src/tasks.sh: line 18:     7 Killed                  /data/project/editgroups-commons/www/python/venv/bin/python3 /data/project/editgroups-commons/www/python/venv/bin/celery --app=editgroups.celery:app worker -l INFO -B

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions