Support for Round-Robin API Key Rotation to Prevent Request Limit Blocking

[Its-me-nishmal]

Problem

When multiple API keys are available (e.g., from multiple free-tier accounts), applications must manually implement logic to rotate between them to avoid hitting individual request limits.

Proposed Feature

Add built-in round-robin API key rotation in the SDKs or API gateway configuration.

Key Functions:

• Rotate keys after each request or after a configurable number of requests.
• Detect rate-limit errors (429) and automatically retry with the next key in the pool.
• Support weighted rotation (use some keys more frequently than others).
• Log key usage stats for better monitoring.

Benefits

• Useful for free-tier API key users to bypass individual account request limits.
• Reduces manual handling and code complexity.
• Improves uptime and resilience without requiring expensive paid plans.