Skip to content

Conversation

@SniperSister
Copy link
Collaborator

This PR applies various improvements to the current setup:

  • we now have two queues: the default queue has a 15 second timeout and is used for health check jobs; the updates queue has has 10min timeout
  • both jobs types now implement the "unique" interface, making sure only one job instance per site is executed at the same time
  • the http client uses sensible values for connect and execution timeouts to prevent slow tasks from locking up update server resources
  • the rate limiting now takes various factors (site host, site ip, request ip) into account

@SniperSister SniperSister requested review from HLeithner and rdeutz May 22, 2025 08:02
@SniperSister SniperSister self-assigned this May 22, 2025
@rdeutz rdeutz merged commit 2f65ee1 into main May 22, 2025
3 checks passed
@SniperSister SniperSister deleted the feature/queue-and-rate-tweaks branch November 18, 2025 18:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants