Skip to content

Commit 8177411

Browse files
fpagnySamyOubouazizRoRoJ
authored
feat(genapi): update rate limits (#4676)
* feat(genapi): update rate limits * Update pages/generative-apis/reference-content/rate-limits.mdx Co-authored-by: Rowena Jones <[email protected]> --------- Co-authored-by: SamyOubouaziz <[email protected]> Co-authored-by: Rowena Jones <[email protected]>
1 parent 17cbdfb commit 8177411

File tree

1 file changed

+15
-9
lines changed

1 file changed

+15
-9
lines changed

pages/generative-apis/reference-content/rate-limits.mdx

Lines changed: 15 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -17,25 +17,31 @@ Any model served through Scaleway Generative APIs gets limited by:
1717
- Tokens per minute
1818
- Queries per minute
1919

20+
Base limits apply if you registered a valid payment method. This limits are increased automatically if you also validate your identity.
21+
2022
<Message type="tip">
21-
These limits only apply if you created a Scaleway Account and registered a valid payment method. Otherwise, stricter limits apply to ensure usage stays within Free Tier only.
23+
If you created a Scaleway Account but did not register a valid payment method, stricter limits apply to ensure usage stays within Free Tier only.
2224
</Message>
2325

2426
## How can I increase the rate limits?
2527

2628
We actively monitor usage and will improve rates based on feedback.
27-
If you need to increase your rate limits, [contact our support team](https://console.scaleway.com/support/create), providing details on the model used and specific use case.
29+
If you need to increase your rate limits:
30+
- [Verify your identity](/account/how-to/verify-identity/) to automatically increase your rate limit as described below
31+
- [Contact our support team](https://console.scaleway.com/support/create), providing details on the model used and specific use case, for additional increase.
2832
Note that for increases of up to x5 or x10 volumes, we highly recommend using dedicated deployments with [Managed Inference](https://console.scaleway.com/inference/deployments), which provides exactly the same features and API compatibility.
2933

3034
### Chat models
3135

32-
| Model string | Requests per minute | Total tokens per minute |
33-
|-----------------|-----------------|-----------------|
34-
| `llama-3.1-8b-instruct` | 300 | 200K |
35-
| `llama-3.1-70b-instruct` | 300 | 200K |
36-
| `mistral-nemo-instruct-2407`| 300 | 200K |
37-
| `pixtral-12b-2409`| 300 | 200K |
38-
| `qwen2.5-32b-instruct`| 300 | 200K |
36+
| Model string | Additional steps required | Requests per minute | Total tokens per minute |
37+
|-----------------|-----------------|-----------------|-----------------|
38+
| `llama-3.1-8b-instruct` | None | 300 | 200K |
39+
| `llama-3.1-70b-instruct` | None | 300 | 200K |
40+
| `llama-3.3-70b-instruct` | None | 300 | 200K |
41+
| `llama-3.3-70b-instruct` | Identity verified | 600 | 400K |
42+
| `mistral-nemo-instruct-2407`| None | 300 | 200K |
43+
| `pixtral-12b-2409`| None | 300 | 200K |
44+
| `qwen2.5-32b-instruct`| None | 300 | 200K |
3945

4046
### Embedding models
4147

0 commit comments

Comments
 (0)