Skip to content

[Inference API] update docs to reflect new daily rate limits #1439

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 5 commits into from
Oct 4, 2024
Merged

[Inference API] update docs to reflect new daily rate limits #1439

Changes from 3 commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
d29b510
update docs for inference API rate limits
SBrandeis Oct 3, 2024
02de78c
Update docs/api-inference/rate-limits.md
SBrandeis Oct 3, 2024
aabaa59
add a line about logging in
SBrandeis Oct 3, 2024
d41505d
thousands separator
SBrandeis Oct 4, 2024
c35ce3c
Update docs/api-inference/rate-limits.md
SBrandeis Oct 4, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 5 additions & 3 deletions docs/api-inference/rate-limits.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,10 @@ The Inference API has rate limits based on the number of requests. These rate li

Serverless API is not meant to be used for heavy production applications. If you need higher rate limits, consider [Inference Endpoints](https://huggingface.co/docs/inference-endpoints) to have dedicated resources.

Only registered users can use the Inference API.


| User Tier | Rate Limit |
|---------------------|---------------------------|
| Unregistered Users | 1 request per hour |
| Signed-up Users | 50 requests per hour |
| PRO and Enterprise Users | 500 requests per hour |
| Signed-up Users | 1.000 requests per day |
| PRO and Enterprise Users | 20.000 requests per day |
Copy link
Member

@pcuenca pcuenca Oct 3, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This might be confusing to US people (they can read it as 1 and 20 requests per day with too many decimals). Maybe use "1 thousand" or "1K" instead?

Copy link
Member

@Pierrci Pierrci Oct 4, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes, either 1k/20k or 1,000/20,000 otherwise

Loading