Redis Sentinel cluster bootstrap takes too long on initial startup #987
Closed
rinatvafin
started this conversation in
General
Replies: 1 comment
-
|
During initial bootstrap, the init container loops through all sentinel pods (0, 1, 2) trying to query for an existing master. Since these pods don't exist yet on first startup, each redis-cli connection waits for the TCP connection timeout (~240 seconds) before failing. Adding explicit timeouts like I am planning to implement a fix for this in the near future. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hello.
Has anyone faced an issue with the initial startup of a 3-node Redis Sentinel cluster?
During startup, the init container of the first pod checks for the existence of a Redis master node. Since the second and third pods are not created yet, each check takes about 240 seconds to time out in my environment.
As a workaround, I added explicit timeouts to the init container scripts, for example:
This significantly reduced the bootstrap time.
However, I’m not sure if this is the correct or recommended approach, or if the initial startup logic should be handled differently.
With the default init script, the initial bootstrap of a 3-node Redis Sentinel cluster takes 10+ minutes, which seems excessive.
Any suggestions or best practices would be appreciated.
Beta Was this translation helpful? Give feedback.
All reactions