You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/reasoning.md
+31-9Lines changed: 31 additions & 9 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -19,9 +19,22 @@ This repository includes an optional feature that uses reasoning models to gener
19
19
20
20
Set the environment variables for your Azure OpenAI GPT deployments to your reasoning model
21
21
22
+
For o3-mini:
23
+
22
24
```shell
23
25
azd env set AZURE_OPENAI_CHATGPT_MODEL o3-mini
24
26
azd env set AZURE_OPENAI_CHATGPT_DEPLOYMENT o3-mini
27
+
azd env set AZURE_OPENAI_CHATGPT_DEPLOYMENT_VERSION 2025-01-31
28
+
azd env set AZURE_OPENAI_CHATGPT_DEPLOYMENT_SKU GlobalStandard
29
+
```
30
+
31
+
For o1:
32
+
33
+
```shell
34
+
azd env set AZURE_OPENAI_CHATGPT_MODEL o1
35
+
azd env set AZURE_OPENAI_CHATGPT_DEPLOYMENT o1
36
+
azd env set AZURE_OPENAI_CHATGPT_DEPLOYMENT_VERSION 2024-12-17
37
+
azd env set AZURE_OPENAI_CHATGPT_DEPLOYMENT_SKU GlobalStandard
25
38
```
26
39
27
40
2.**(Optional) Set default reasoning effort**
@@ -34,14 +47,23 @@ This repository includes an optional feature that uses reasoning models to gener
34
47
azd env set AZURE_OPENAI_REASONING_EFFORT medium
35
48
```
36
49
37
-
3.**Clean old deployments (optional):**
38
-
Run `azd down --purge` for a fresh setup.
50
+
3.**Update the infrastructure and application:**
51
+
52
+
Execute `azd up` to provision the infrastructure changes (only the new model, if you ran `up` previously) and deploy the application code with the updated environment variables.
53
+
54
+
4.**Try out the feature:**
55
+
56
+
Open the web app and start a new chat. The reasoning model will be used for all chat completion requests, including the query rewriting step.
57
+
58
+
5.**Experiment with reasoning effort:**
59
+
60
+
Select the developer options in the web app and change "Reasoning Effort" to `low`, `medium`, or `high`. This will override the default reasoning effort of "medium".
Execute `azd up` to build, provision, deploy, and initiate document preparation.
66
+
The reasoning models use additional billed tokens behind the scenes for the thinking process.
67
+
To see the token usage, select the lightbulb icon on a chat answer. This will open the "Thought process" tab, which shows the reasoning model's thought process and the token usage for each chat completion.
0 commit comments