Skip to content

AAP-62273 longer stop timeout for task#214

Merged
justinc1 merged 5 commits intomainfrom
AAP-62273-longer-stop-timeout-for-task
Feb 3, 2026
Merged

AAP-62273 longer stop timeout for task#214
justinc1 merged 5 commits intomainfrom
AAP-62273-longer-stop-timeout-for-task

Conversation

@justinc1
Copy link
Contributor

When running systemctl --user stop automation-dashboard-task, we get in logs ERROR:dispatcherd.service.pool:Worker 1 pid=70 failed to send exit message in 3 seconds. The worker is then killed, potentionaly in middle of work.

PR updates dispatcherd, and this helps. In logs I see 2026-01-29 17:27:29,727 WARNING [-] dispatcherd.worker.target Worker 1 exiting main loop due to stop message.

The 60 seconds timeout in systemd is just additional safeguard. I assume worker could be in middle of slow http GET, and might need extra time.

PR removes one setting from dispatcherd config.py. This gave a nice oportunity to check if additional tests in #209 catch this bad code - the did show the problem (without building image, building bundled installer, deploying to a VM, etc).

@justinc1 justinc1 self-assigned this Jan 29, 2026
Partially fixes AAP-62273

Signed-off-by: Justin Cinkelj <justin.cinkelj@xlab.si>
task container started via systemd did receive SIGTERM, but workers did
not receive it, and were force killed.
Updating dispatcherd helped.

Signed-off-by: Justin Cinkelj <justin.cinkelj@xlab.si>
log_level is not a valid in metrics_kwargs
Tested with tests/mock_aap/test_full.py from #209

Signed-off-by: Justin Cinkelj <justin.cinkelj@xlab.si>
@justinc1 justinc1 force-pushed the AAP-62273-longer-stop-timeout-for-task branch from 8656ff9 to ec941e7 Compare January 30, 2026 13:25
@github-actions
Copy link

Requirements-build.txt needs to be updated

The requirements-pinned.txt file has changed but requirements-build.txt is not in sync. Please run make sync-requirements locally and commit the updated requirements-build.txt file.

Signed-off-by: Justin Cinkelj <justin.cinkelj@xlab.si>
Signed-off-by: Justin Cinkelj <justin.cinkelj@xlab.si>
@justinc1 justinc1 force-pushed the AAP-62273-longer-stop-timeout-for-task branch from ec941e7 to 17f6e16 Compare January 30, 2026 13:33
@sonarqubecloud
Copy link

@justinc1 justinc1 merged commit da7d120 into main Feb 3, 2026
9 checks passed
@justinc1 justinc1 deleted the AAP-62273-longer-stop-timeout-for-task branch February 3, 2026 20:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants