You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In addition to the supported Azure OpenAI models, you can also use the following 3rd party models with Azure AI Agent Service.
33
+
The Azure AI Agent Service also supports the following models from the Azure AI Foundry model catalog.
34
34
35
35
* Llama 3.1-70B-instruct
36
36
* Mistral-large-2407
37
37
* Cohere command R+
38
38
39
39
To use these models, you can use Azure AI Foundry portal to make a deployment, and then reference it in your agent.
40
40
41
-
1. Go to the [Azure AI Foundry portal](https://ai.azure.com/) and select **Model catalog** in the left navigation menu, and scroll down to **Meta-Llama-3-70B-Instruct**. You can also find and use one of the models listed above.
41
+
1. Go to the [Azure AI Foundry portal](https://ai.azure.com/) and select **Model catalog** in the left navigation menu, and scroll down to **Meta-Llama-3-70B-Instruct**. You can also find and use one of the models listed previously.
42
42
43
43
1. Select **Deploy**.
44
44
45
45
1. In the Deployment options screen that appears, select **Serverless API** with Azure AI Content Safety.
46
46
47
47
:::image type="content" source="../media/llama/llama-deployment.png" alt-text="An image of the llama model project selection screen.":::
48
48
49
-
1. Select your project and click**Subscribe and deploy**.
49
+
1. Select your project and then select**Subscribe and deploy**.
50
50
51
51
:::image type="content" source="../media/llama/llama-deployment-2.png" alt-text="An image of the llama model deployment screen.":::
52
52
53
-
1. Add the serverless connection to your hub/project. The deployment name you choose will be the one you reference in your code.
53
+
1. Add the serverless connection to your hub/project. The deployment name you choose is the one that you reference in your code.
54
54
55
55
1. When calling agent creation API, set the `models` parameter to your deployment name. For example:
0 commit comments