Skip to content

feat(ai-proxy-multi): implement rate limiting based fallback strategy#12047

Merged
shreemaan-abhishek merged 2 commits intoapache:masterfrom
shreemaan-abhishek:rate-limiting-based-fallback
Mar 17, 2025
Merged

feat(ai-proxy-multi): implement rate limiting based fallback strategy#12047
shreemaan-abhishek merged 2 commits intoapache:masterfrom
shreemaan-abhishek:rate-limiting-based-fallback

Conversation

@shreemaan-abhishek
Copy link
Contributor

Description

In a previous refactor PR the fallback strategy was removed in order to accomodate the ai-rate-limiting-plugin. This PR introduces a fallback strategy that fits well with the rate-limiting construct in ai-proxy-multi.

Checklist

  • I have explained the need for this PR and the problem it solves
  • I have explained the changes or the new features added to this PR
  • I have added tests corresponding to this change
  • I have updated the documentation to reflect this change
  • I have verified that this change is backward compatible (If not, please discuss on the APISIX mailing list first)

@dosubot dosubot bot added size:L This PR changes 100-499 lines, ignoring generated files. enhancement New feature or request labels Mar 13, 2025
nic-6443
nic-6443 previously approved these changes Mar 13, 2025
AlinsRan
AlinsRan previously approved these changes Mar 17, 2025
membphis
membphis previously approved these changes Mar 17, 2025
@shreemaan-abhishek shreemaan-abhishek dismissed stale reviews from membphis, AlinsRan, and nic-6443 via 595bb89 March 17, 2025 06:30
@shreemaan-abhishek shreemaan-abhishek merged commit 428f43a into apache:master Mar 17, 2025
36 checks passed
@shreemaan-abhishek shreemaan-abhishek deleted the rate-limiting-based-fallback branch March 17, 2025 07:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request size:L This PR changes 100-499 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants