Skip to content

Commit 6d023cf

Browse files
committed
new doc draft
1 parent 378f135 commit 6d023cf

File tree

1 file changed

+36
-0
lines changed

1 file changed

+36
-0
lines changed
Lines changed: 36 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,36 @@
1+
---
2+
title: How to use model router in Azure OpenAI Service
3+
titleSuffix: Azure OpenAI Service
4+
description: Learn how to use the model router in Azure OpenAI Service to select the best model for your task.
5+
author: PatrickFarley
6+
ms.author: pafarley
7+
#customer intent:
8+
ms.service: azure-ai-openai
9+
ms.topic: how-to
10+
ms.date: 04/17/2025
11+
manager: nitinme
12+
---
13+
14+
# Use model router
15+
16+
Azure OpenAI model router is a deployable AI chat model that automatically selects the best underlying chat model to respond to a given prompt. It uses a combination of preexisting models to provide high performance while saving on compute costs where possible. For more information on how model router works and its advantages and limitations, see the [Model router concepts guide](../concepts/model-router.md).
17+
18+
You can access model router through the Completions API just as you would use a single base model like GPT-4.
19+
20+
## Deploy a model router model
21+
22+
Model router is packaged as a single OpenAI model that you deploy. Follow the steps in the [resource deployment guide](/azure/ai-services/openai/how-to/create-resource), and in the **Create new deployment** step, find `Azure OpenAI model router` in the **Model** list. Select it, and then complete the rest of the deployment steps.
23+
24+
> [!NOTE]
25+
> You don't need to deploy the underlying models separately. Model router works independently of your other deployed models.
26+
27+
## Use model router in chat
28+
29+
### REST API
30+
31+
32+
### Portal
33+
34+
## Evaluate model router performance
35+
36+
## Troubleshooting

0 commit comments

Comments
 (0)