🚀 Feature Description and Motivation
Currently, the gateway plugin doesn't support leader election, which means all instances are active simultaneously.
This can lead to:
- Inconsistent KV cache event processing across multiple instances
- Potential race conditions when handling shared resources
- No high availability with failover capabilities
Use Case
high availability with failover capabilities
Proposed Solution
Implement leader election support to enable an active-passive (leader-follower) architecture where only one instance is active at a time while others remain in standby mode.