-
Notifications
You must be signed in to change notification settings - Fork 374
quickfix re. pricing system #1597
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from 1 commit
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
julien-c marked this conversation as resolved.
Show resolved
Hide resolved
|
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,13 +1,20 @@ | ||
| # Rate Limits | ||
|
|
||
| The Inference API has rate limits based on the number of requests. These rate limits are subject to change in the future to be compute-based or token-based. | ||
| As a HF user, you get monthly credits to run the HF Inference API. The amount of credits you get depends on your type of account (Free or PRO or Enterprise Hub), see table below. | ||
| You get charged for every inference request, based on the compute time x price of the underlying hardware. | ||
|
|
||
| Serverless API is not meant to be used for heavy production applications. If you need higher rate limits, consider [Inference Endpoints](https://huggingface.co/docs/inference-endpoints) to have dedicated resources. | ||
| For instance, a request to [deepseek-ai/DeepSeek-R1](https://huggingface.co/deepseek-ai/DeepSeek-R1) that takes 10 seconds to complete on a GPU machine that costs $0.00012 per second to run, will be billed $0.0012. | ||
|
||
|
|
||
| When your monthly included credits are depleted: | ||
| - if you're a Free user, you won't be able to query the Inference API anymore, | ||
| - if you're a PRO or Enterprise Hub user, you will get charged for the requests on top of your subscription. You can monitor your spending on your billing page. | ||
|
|
||
| Note that serverless API is not meant to be used for heavy production applications. If you need to handle large numbers of requests, consider [Inference Endpoints](https://huggingface.co/docs/inference-endpoints) to have dedicated resources. | ||
|
|
||
| You need to be authenticated (passing a token or through your browser) to use the Inference API. | ||
|
|
||
|
|
||
| | User Tier | Rate Limit | | ||
| |---------------------|---------------------------| | ||
| | Signed-up Users | 1,000 requests per day | | ||
| | PRO and Enterprise Users | 20,000 requests per day | | ||
| | User Tier | Included monthly credits | | ||
| |---------------------------|------------------------------------| | ||
| | Free Users | subject to change, less than $0.10 | | ||
| | PRO and Enterprise Users | $2.00 | | ||
Uh oh!
There was an error while loading. Please reload this page.