Skip to content

Commit aab809b

Browse files
authored
feat(inference): add custom models requirements
1 parent e3a4985 commit aab809b

File tree

1 file changed

+52
-0
lines changed

1 file changed

+52
-0
lines changed
Lines changed: 52 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,52 @@
1+
---
2+
meta:
3+
title: Supported Models in Managed Inference
4+
description: Supported Models in Managed Inference
5+
content:
6+
h1: Supported Models in Managed Inference
7+
paragraph: Supported Models in Managed Inference
8+
tags:
9+
dates:
10+
validation: 2025-04-08
11+
posted: 2025-04-08
12+
categories:
13+
- ai-data
14+
---
15+
16+
## Models supported on Managed Inference
17+
18+
Managed Inference supports multiple AI models either from:
19+
- [Scaleway catalog]((#scaleway-catalog)): A curated model list available in [Scaleway Console](https://console.scaleway.com/inference/deployments/) or through [Managed Inference Models API](https://www.scaleway.com/en/developers/api/inference/#path-models-list-models)
20+
- [Custom models](#custom-models): Models imported by you as a user from sources such as HuggingFace.
21+
22+
## Scaleway Catalog
23+
24+
### Multimodal models (Chat and Vision)
25+
26+
### Chat models
27+
28+
| Provider | Model string | Documentation | License |
29+
|-----------------|-----------------|-----------------|-----------------|
30+
| Meta | `llama-3.3-70b-instruct` | [Details](https://www.scaleway.com/en/docs/managed-inference/reference-content/llama-3.3-70b-instruct/) | [Llama 3.3 Community](https://www.llama.com/llama3_3/license/) |
31+
| Meta | `llama-3.1-8b-instruct` | [Details](https://www.scaleway.com/en/docs/managed-inference/reference-content/llama-3.1-8b-instruct/) | [HF](https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct) |
32+
33+
### Vision models
34+
35+
### Embedding models
36+
37+
## Custom models
38+
39+
<Message type="note">
40+
Custom models are still in Beta status. If you identify unsupported models, you can report the issue to us through our [Slack Community Channel](https://scaleway-community.slack.com/archives/C01SGLGRLEA) or our [customer support](https://console.scaleway.com/support/tickets/create?for=product&productName=inference).
41+
</Message>
42+
43+
### Prerequesites
44+
45+
To deploy a model by providing its URL on Hugging Face, you need to:
46+
- Have access to this model with your Hugging Face credentials (if the model is "Gated", you specifically need to ask access from your Hugging Face account). Note that your Hugging Face credentials will not be stored, but we still recommend you to create [read or fine-grained access tokens](https://huggingface.co/docs/hub/security-tokens) for this purpose.
47+
48+
### Additional consideration
49+
50+
- When deploying custom models, you remain responsible for complying with any License requirements from the model provider.
51+
- We currently
52+

0 commit comments

Comments
 (0)