Provider Tab: Automatically Switch to Next Provider/Model on Rate Limit

[mlibre]

Hey.

Currently, the provider tab in KiloCode's VSCode extension lets you select both the model and provider, which is good. However, if I have multiple free API keys from different providers (or different models across providers), and one of them hits a rate limit, KiloCode does not automatically switch to the next available provider/model. Instead, it just fails, requiring manual intervention.

Feature:

add an option for KiloCode to automatically try the next available provider or model when the currently selected one hits a rate limit (or similar temporary failure). This would allow users with multiple free/limited keys to have a smoother, uninterrupted experience.

Additional:

• Ideally, this could work for both rate limits and other temporary errors.
• There could be a prioritized list or rotation setting in the provider tab.

[kevinvandijk]

Hi! I think we have what you propose in the Virtual Quota Fallback provider:

You can configure multiple profiles and then use the Virtual Quota Fallback in your default profile, which will then provide fallbacks depending on the limits you configured. Is this what you are looking for?

I noticed we don't have any documentation for so it's quite easy to miss it so I'll make sure we add that!

[mlibre]

Ah yes. was hard find. thank you

@kevinvandijk