Merge branch 'main' into MTA-4949-2

Author: bene2k1

ai-data/generative-apis/how-to/use-structured-outputs.mdx

@@ -162,6 +162,7 @@ extract = client.chat.completions.create(
     response_format={
         "type": "json_schema",
         "json_schema": {
+            "name": "VoiceNote",
             "schema": VoiceNote.model_json_schema(),
         }
     },
@@ -203,6 +204,7 @@ extract = client.chat.completions.create(
     response_format={
         "type": "json_schema",
         "json_schema": {
+            "name": "VoiceNote", 
             "schema": {
                 "type": "object",
                 "properties": {
@@ -213,6 +215,7 @@ extract = client.chat.completions.create(
                         "items": {"type": "string"}
                     }
                 },
+                "additionalProperties": false,
                 "required": ["title", "summary", "actionItems"]
             }
         }
@@ -235,6 +238,10 @@ Output example:
 }
 ```
 
+<Message type="tip">
+  When using the OpenAI SDKs like in the examples above, you are expected to set `additionalProperties` to false, and to specify all your properties as required.
+</Message>
+
 ## Conclusion
 
 Using structured outputs with LLMs can significantly enhance data handling in your applications.
@@ -243,4 +250,4 @@ By choosing between JSON mode and Structured outputs with JSON schema, you contr
 - **JSON mode** is flexible but less predictable.
 - **Structured outputs** provide strict adherence to a predefined schema, ensuring consistency.
 
-Experiment with both methods to determine which best fits your application's requirements.
+Experiment with both methods to determine which best fits your application's requirements.

ai-data/managed-inference/how-to/managed-inference-with-private-network.mdx

@@ -91,7 +91,7 @@ Using a Private Network for communications between your Instances hosting your a
     import requests
 
     PAYLOAD = {
-        "model": "<MODEL_DEPLOYED>", # EXAMPLE= meta/llama-3-8b-instruct:bf16
+        "model": "<MODEL_DEPLOYED>", # EXAMPLE= meta/llama-3.1-8b-instruct:fp8
         "messages": [
             {"role": "system",
             "content": "You are a helpful, respectful and honest assistant."},

ai-data/managed-inference/reference-content/llama-3-70b-instruct.mdx

@@ -17,7 +17,6 @@ categories:
 | Attribute       | Details                            |
 |-----------------|------------------------------------|
 | Provider        | [Meta](https://llama.meta.com/llama3/)  |
-| Model Name      | `llama-3-70b-instruct`                 |
 | Compatible Instances | H100 (FP8)    |
 | Context size | 8192 tokens   |
 
@@ -62,7 +61,7 @@ curl -s \
 -H "Content-Type: application/json" \
 --request POST \
 --url "https://<Deployment UUID>.ifr.fr-par.scaleway.com/v1/chat/completions" \
---data '{"model":"llama-3-70b-instruct", "messages":[{"role": "user","content": "Sing me a song about Xavier Niel"}], "max_tokens": 500, "top_p": 1, "temperature": 0.7, "stream": false}'
+--data '{"model":"meta/llama-3-70b-instruct:fp8", "messages":[{"role": "user","content": "Sing me a song about Xavier Niel"}], "max_tokens": 500, "top_p": 1, "temperature": 0.7, "stream": false}'
 ```
 
 Make sure to replace `<IAM API key>` and `<Deployment UUID>` with your actual [IAM API key](/identity-and-access-management/iam/how-to/create-api-keys/) and the Deployment UUID you are targeting.

ai-data/managed-inference/reference-content/llama-3-8b-instruct.mdx

@@ -17,7 +17,6 @@ categories:
 | Attribute       | Details                            |
 |-----------------|------------------------------------|
 | Provider        | [Meta](https://llama.meta.com/llama3/)  |
-| Model Name      | `llama-3-8b-instruct`                 |
 | Compatible Instances | L4, H100 (FP8, BF16) |
 | Context size | 8192 tokens    |
 
@@ -66,7 +65,7 @@ curl -s \
 -H "Content-Type: application/json" \
 --request POST \
 --url "https://<Deployment UUID>.ifr.fr-par.scaleway.com/v1/chat/completions" \
---data '{"model":"llama-3-8b-instruct", "messages":[{"role": "user","content": "There is a llama in my garden, what should I do?"}], "max_tokens": 500, "top_p": 1, "temperature": 0.7, "stream": false}'
+--data '{"model":"meta/llama-3-8b-instruct:fp8", "messages":[{"role": "user","content": "There is a llama in my garden, what should I do?"}], "max_tokens": 500, "top_p": 1, "temperature": 0.7, "stream": false}'
 ```
 
 Make sure to replace `<IAM API key>` and `<Deployment UUID>` with your actual [IAM API key](/identity-and-access-management/iam/how-to/create-api-keys/) and the Deployment UUID you are targeting.

ai-data/managed-inference/reference-content/llama-3.1-70b-instruct.mdx

@@ -17,8 +17,7 @@ categories:
 | Attribute       | Details                            |
 |-----------------|------------------------------------|
 | Provider        | [Meta](https://llama.meta.com/llama3/)  |
-| License        | [Llama 3.1 community](https://llama.meta.com/llama3_1/license/)  |
-| Model Name      | `llama-3.1-70b-instruct`                 |
+| License        | [Llama 3.1 community](https://llama.meta.com/llama3_1/license/)  |                |
 | Compatible Instances | H100 (FP8), H100-2 (FP8, BF16) |
 | Context Length | up to 128k tokens    |
 
@@ -61,7 +60,7 @@ curl -s \
 -H "Content-Type: application/json" \
 --request POST \
 --url "https://<Deployment UUID>.ifr.fr-par.scaleway.com/v1/chat/completions" \
---data '{"model":"llama-3.1-70b-instruct", "messages":[{"role": "user","content": "There is a llama in my garden, what should I do?"}], "max_tokens": 500, "temperature": 0.7, "stream": false}'
+--data '{"model":"meta/llama-3.1-70b-instruct:fp8", "messages":[{"role": "user","content": "There is a llama in my garden, what should I do?"}], "max_tokens": 500, "temperature": 0.7, "stream": false}'
 ```
 
 Make sure to replace `<IAM API key>` and `<Deployment UUID>` with your actual [IAM API key](/identity-and-access-management/iam/how-to/create-api-keys/) and the Deployment UUID you are targeting.

ai-data/managed-inference/reference-content/llama-3.1-8b-instruct.mdx

@@ -18,7 +18,6 @@ categories:
 |-----------------|------------------------------------|
 | Provider        | [Meta](https://llama.meta.com/llama3/)  |
 | License        | [Llama 3.1 community](https://llama.meta.com/llama3_1/license/)  |
-| Model Name      | `llama-3.1-8b-instruct`                 |
 | Compatible Instances | L4, H100, H100-2 (FP8, BF16) |
 | Context Length | up to 128k tokens |
 
@@ -62,7 +61,7 @@ curl -s \
 -H "Content-Type: application/json" \
 --request POST \
 --url "https://<Deployment UUID>.ifr.fr-par.scaleway.com/v1/chat/completions" \
---data '{"model":"llama-3.1-8b-instruct", "messages":[{"role": "user","content": "There is a llama in my garden, what should I do?"}], "max_tokens": 500, "temperature": 0.7, "stream": false}'
+--data '{"model":"meta/llama-3.1-8b-instruct:fp8", "messages":[{"role": "user","content": "There is a llama in my garden, what should I do?"}], "max_tokens": 500, "temperature": 0.7, "stream": false}'
 ```
 
 Make sure to replace `<IAM API key>` and `<Deployment UUID>` with your actual [IAM API key](/identity-and-access-management/iam/how-to/create-api-keys/) and the Deployment UUID you are targeting.

ai-data/managed-inference/reference-content/mistral-7b-instruct-v0.3.mdx

@@ -17,14 +17,13 @@ categories:
 | Attribute       | Details                            |
 |-----------------|------------------------------------|
 | Provider        | [Mistral](https://mistral.ai/technology/#models)                         |
-| Model Name      | `mistral-7b-instruct-v0.3`       |
 | Compatible Instances | L4 (BF16)                 |
 | Context size | 32K tokens    |
 
 ## Model name
 
 ```bash
-mistral-7b-instruct-v0.3:bf16
+mistral/mistral-7b-instruct-v0.3:bf16
 ```
 
 ## Compatible Instances
@@ -55,7 +54,7 @@ curl -s \
 -H "Content-Type: application/json" \
 --request POST \
 --url "https://<Deployment UUID>.ifr.fr-par.scaleway.com/v1/chat/completions" \
---data '{"model":"mistral-7b-instruct-v0.3", "messages":[{"role": "user","content": "Explain Public Cloud in a nutshell."}], "top_p": 1, "temperature": 0.7, "stream": false}'
+--data '{"model":"mistral/mistral-7b-instruct-v0.3:bf16", "messages":[{"role": "user","content": "Explain Public Cloud in a nutshell."}], "top_p": 1, "temperature": 0.7, "stream": false}'
 ```
 
 Make sure to replace `<IAM API key>` and `<Deployment UUID>` with your actual [IAM API key](/identity-and-access-management/iam/how-to/create-api-keys/) and the Deployment UUID you are targeting.

ai-data/managed-inference/reference-content/mistral-nemo-instruct-2407.mdx

@@ -17,14 +17,13 @@ categories:
 | Attribute       | Details                            |
 |-----------------|------------------------------------|
 | Provider        | [Mistral](https://mistral.ai/technology/#models)                         |
-| Model Name      | `mistral-nemo-instruct-2407`       |
 | Compatible Instances | H100 (FP8)                 |
 | Context size | 128K tokens    |
 
 ## Model name
 
 ```bash
-mistral-nemo-instruct-2407:fp8
+mistral/mistral-nemo-instruct-2407:fp8
 ```
 
 ## Compatible Instances
@@ -61,7 +60,7 @@ curl -s \
 -H "Content-Type: application/json" \
 --request POST \
 --url "https://<Deployment UUID>.ifr.fr-par.scaleway.com/v1/chat/completions" \
---data '{"model":"mistral-nemo-instruct-2407", "messages":[{"role": "user","content": "Sing me a song about Xavier Niel"}], "top_p": 1, "temperature": 0.35, "stream": false}'
+--data '{"model":"mistral/mistral-nemo-instruct-2407:fp8", "messages":[{"role": "user","content": "Sing me a song about Xavier Niel"}], "top_p": 1, "temperature": 0.35, "stream": false}'
 ```
 
 Make sure to replace `<IAM API key>` and `<Deployment UUID>` with your actual [IAM API key](/identity-and-access-management/iam/how-to/create-api-keys/) and the Deployment UUID you are targeting.

ai-data/managed-inference/reference-content/mixtral-8x7b-instruct-v0.1.mdx

@@ -17,7 +17,6 @@ categories:
 | Attribute       | Details                            |
 |-----------------|------------------------------------|
 | Provider        | [Mistral](https://mistral.ai/technology/#models)                         |
-| Model Name      | `mixtral-8x7b-instruct-v0.1`       |
 | Compatible Instances | H100 (FP8) - H100-2 (FP16)                 |
 | Context size | 32k tokens    |
 
@@ -57,7 +56,7 @@ curl -s \
 -H "Content-Type: application/json" \
 --request POST \
 --url "https://<Deployment UUID>.ifr.fr-par.scaleway.com/v1/chat/completions" \
---data '{"model":"mixtral-8x7b-instruct-v0.1", "messages":[{"role": "user","content": "Sing me a song about Scaleway"}], "max_tokens": 200, "top_p": 1, "temperature": 1, "stream": false}'
+--data '{"model":"mistral/mixtral-8x7b-instruct-v0.1:fp8", "messages":[{"role": "user","content": "Sing me a song about Scaleway"}], "max_tokens": 200, "top_p": 1, "temperature": 1, "stream": false}'
 ```
 
 Make sure to replace `<IAM API key>` and `<Deployment UUID>` with your actual [IAM API key](/identity-and-access-management/iam/how-to/create-api-keys/) and the Deployment UUID you are targeting.

ai-data/managed-inference/reference-content/pixtral-12b-2409.mdx

@@ -17,7 +17,6 @@ categories:
 | Attribute       | Details                            |
 |-----------------|------------------------------------|
 | Provider        | [Mistral](https://mistral.ai/technology/#models)                         |
-| Model Name      | `pixtral-12b-2409`       |
 | Compatible Instances | H100, H100-2 (bf16)                 |
 | Context size | 128k tokens    |