429 Errors with VertexAI + Retry Strategy #10155
Unanswered
matthill33
asked this question in
Help
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi all,
I'm experiencing frequent 429 errors in continue.dev when using the vertexai endpoint. One of the best way to resolve this is to implement a retry strategy.
I found this issue (2343) which mentions that there is some exponential backoff logic in the continue.dev codebase, which would help with these errors. However, I don't believe it's enabled since I don't see any "retry" statements in the error logs.
Are others seeing the same thing? Could we possible enable this logic for the vertexai endpoint?
Beta Was this translation helpful? Give feedback.
All reactions