Too many concurrent connections to nomad when using autoscaler with thousands of services

[pawelbeza]

As the title suggests, Nomad is rate-limiting the Nomad Autoscaler when it begins monitoring thousands of services.

I understand that increasing http_max_conns_per_client or adjusting evaluation_interval/default_evaluation_interval can help, but at scale, we eventually run into the same issue.

I’m more than happy to contribute a fix for this! 🙂

[pawelbeza]

#332 is related to this