You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/high_availability.md
+17-5Lines changed: 17 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -312,13 +312,25 @@ This ensures:
312
312
- **Independent processing** - Each instance independently evaluates routing, grouping, and deduplication
313
313
- **No single point of failure** - Load balancers introduce a single point of failure
314
314
315
-
### Cluster Size Recommendations
315
+
### Cluster Size Considerations
316
316
317
-
- **3 instances** - Recommended minimum for production (tolerates 1 failure)
318
-
- **5 instances** - For critical environments (tolerates 2 failures)
319
-
- **Odd numbers** - Preferred for simpler split-brain scenarios
317
+
Since Alertmanager uses gossip without quorum or voting, **any N instances tolerate up to N-1 failures** - as long as one instance is alive, notifications will be sent.
320
318
321
-
The gossip protocol scales to dozens of instances, but typical deployments use 3-5.
319
+
However, cluster size involves tradeoffs:
320
+
321
+
**Benefits of more instances:**
322
+
- Greater resilience to simultaneous failures (hardware, network, datacenter outages)
323
+
- Continued operation even during maintenance windows
324
+
325
+
**Costs of more instances:**
326
+
- In case of partitions there will be an increase in duplicate notifications
327
+
- More gossip traffic
328
+
329
+
**Typical deployments:**
330
+
- **3-4 instances** - Common for single-datacenter production deployments
331
+
- **4-5 instances** - Multi-datacenter or highly critical environments
332
+
333
+
**Note**: Unlike consensus-based systems (etcd, Raft), odd vs. even cluster sizes make no difference - there is no voting or quorum.
0 commit comments