Rate dashboard with auto throttling for API calls per minute, hour, and day #1917
akhil41
started this conversation in
1. Feature requests
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Summary
Provide real time visibility of API call volume per minute, per hour, and per day, plus controls to cap or delay calls automatically based on detected provider limits and recent error rates.
Problem
Users cannot see or control call rates, so sessions hit provider limits and fail. This causes avoidable retries, crashes, and lost context.
Proposal
Add a rate limits dashboard and an automatic throttler that learns and applies safe call pacing.
Key features
Live counters: requests, successes, failures per min, hour, day
Rolling windows with configurable period size
Auto detection of provider limits from headers or config
Auto throttling: queue, jittered delays, backoff on 429 or rate related errors
Manual caps: max calls per min, hour, day
Policy presets: conservative, balanced, aggressive
Alerts: soft warning at 80 percent, hard block at 100 percent with ETA to resume
Export metrics: JSON and CSV
Beta Was this translation helpful? Give feedback.
All reactions