Best practice to setup rate limit within a LangGraph Cloud app #1858
Unanswered
arthberman
asked this question in
Q&A
Replies: 1 comment
-
@arthberman Did you find any interesting solution? |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
We have multiple assistants deployed on LangGraph Cloud, we use the LangGraph API to interact with. We use sub graph and ReAct nodes.
What is the best practice to handle our API rate limit (OpenAI, Anthropic and Bedrock), as we are using the same API key for multiple assistants so we share the same tier ?
How to share a InMemoryRateLimiter through multiple assistant ? Is it the good approach ?
Beta Was this translation helpful? Give feedback.
All reactions