You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/logic-apps/create-agent-workflows.md
+17-15Lines changed: 17 additions & 15 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -671,21 +671,23 @@ Here are some approaches to reduce your agent's chat history:
671
671
672
672
- Carefully craft your system instructions and prompts to control the model's behavior.
673
673
674
-
[- Lower the maximum number of tokens or messages to keep in chat history and pass into the model.]:#
675
-
[ A workflow agent has almost the same advanced parameters as the]:#
676
-
[Azure OpenAI built-in, service provider connector]:#
677
-
[(/azure/logic-apps/connectors/built-in/reference/openai/), except for the **Agent History Reduction Type** advanced parameter, which exists only in the agent. This parameter controls the chat history that the agent maintains, based on the maximum number of tokens or messages.]:#
678
-
[ To complete the following chat history management tasks, follow these steps:]:#
679
-
[ - Switch the **Agent History Reduction Type** between tokens and messages.]:#
680
-
[ - Change the maximum number of tokens or messages in chat history.]:#
681
-
[ 1. On the designer, select the agent's title bar to open the information pane.]:#
682
-
[ 1. On the **Parameters** tab, find the **Advanced parameters** section.]:#
683
-
[ 1. Check whether the parameter named **Agent History Reduction Type** exists. If not, open the **Advanced parameters** list, and select that parameter.]:#
684
-
[ 1. From the **Agent History Reduction Type** list, select one of the following options:]:#
685
-
[ | Option | Description |]:#
686
-
[ |--------|-------------|]:#
687
-
[ | **Token count reduction** | Shows the parameter named **Maximum Token Count**. Specifies the maximum number of tokens in chat history to keep and pass into the model for the next chat interaction. The default differs based on the currently used model in Azure OpenAI Service. The default limit is **128,000**. |]:#
688
-
[ | **Message count reduction** | Shows the parameter named **Message Count Limit**. Specifies the maximum number of messages in chat history to keep and pass into the model for the next chat interaction. No default limit exists. |]:#
674
+
-**Experimental capability**: You have the option to try chat reduction so you can reduce the maximum number of tokens or messages to keep in chat history and pass into the model.
675
+
676
+
A workflow agent has almost the same advanced parameters as the [Azure OpenAI built-in, service provider connector](/azure/logic-apps/connectors/built-in/reference/openai/), except for the **Agent History Reduction Type** advanced parameter, which exists only in the agent. This parameter controls the chat history that the agent maintains, based on the maximum number of tokens or messages.
677
+
678
+
This capability is in active development and might not work for all scenarios. You can change the **Agent History Reduction Type** option to reduce the limit on tokens or messages. You then specify the numerical limit that you want.
679
+
680
+
To try the capability, follow these steps:
681
+
682
+
1. On the designer, select the agent's title bar to open the information pane.
683
+
1. On the **Parameters** tab, find the **Advanced parameters** section.
684
+
1. Check whether the parameter named **Agent History Reduction Type** exists. If not, open the **Advanced parameters** list, and select that parameter.
685
+
1. From the **Agent History Reduction Type** list, select one of the following options:
686
+
687
+
| Option | Description |
688
+
|--------|-------------|
689
+
|**Token count reduction**| Shows the parameter named **Maximum Token Count**. Specifies the maximum number of tokens in chat history to keep and pass into the model for the next chat interaction. The default differs based on the currently used model in Azure OpenAI Service. The default limit is **128,000**. |
690
+
|**Message count reduction**| Shows the parameter named **Message Count Limit**. Specifies the maximum number of messages in chat history to keep and pass into the model for the next chat interaction. No default limit exists. |
0 commit comments