Skip to content

Commit 4feb680

Browse files
committed
feat(inf): add advice
1 parent a72c73d commit 4feb680

File tree

1 file changed

+7
-1
lines changed

1 file changed

+7
-1
lines changed

pages/managed-inference/how-to/change-model.mdx

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,9 @@ categories:
1111
import Requirements from '@macros/iam/requirements.mdx'
1212

1313

14-
You can change the model used by your Managed Inference deployment at any time. Follow the steps below to change the model using the Scaleway console:
14+
You can change the model used by your Managed Inference deployment at any time, as long as the new model is compatible with the existing deployment node. If you want to change to a model that is too big for your current node type, you must [delete your existing deployment](/managed-inference/how-to/delete-deployment/) and [create a new one](/managed-inference/how-to/create-deployment/) with a compatible node type.
15+
16+
Follow the steps below to change the model using the Scaleway console:
1517

1618
<Requirements />
1719

@@ -28,3 +30,7 @@ You can change the model used by your Managed Inference deployment at any time.
2830
6. From the drop-down menu, select the model you want to change to, and click **Change model**.
2931
<br/> <br/>
3032
The change of model is initiated. Note that while the model is changed, your deployment will not be available for 15 - 30 minutes.
33+
34+
Remember to update the model string in your client configuration, to reflect the new model. You can find the model string in the code sample available in the **Playground** tab of your deployment's dashboard (use the **View code** button).
35+
36+
If you have also changed to a different type of model (e.g. from a chat model to an embedding model), you will also need to update the client code itself, as well as the model string.

0 commit comments

Comments
 (0)