Skip to content

Commit cb39554

Browse files
Merge pull request #300022 from karanbirsingh/patch-2
Make chat reduction experimental and add it back to docs
2 parents 2da4e52 + a911a31 commit cb39554

File tree

1 file changed

+17
-15
lines changed

1 file changed

+17
-15
lines changed

articles/logic-apps/create-agent-workflows.md

Lines changed: 17 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -671,21 +671,23 @@ Here are some approaches to reduce your agent's chat history:
671671

672672
- Carefully craft your system instructions and prompts to control the model's behavior.
673673

674-
[- Lower the maximum number of tokens or messages to keep in chat history and pass into the model.]:#
675-
[ A workflow agent has almost the same advanced parameters as the]:#
676-
[Azure OpenAI built-in, service provider connector]:#
677-
[(/azure/logic-apps/connectors/built-in/reference/openai/), except for the **Agent History Reduction Type** advanced parameter, which exists only in the agent. This parameter controls the chat history that the agent maintains, based on the maximum number of tokens or messages.]:#
678-
[ To complete the following chat history management tasks, follow these steps:]:#
679-
[ - Switch the **Agent History Reduction Type** between tokens and messages.]:#
680-
[ - Change the maximum number of tokens or messages in chat history.]:#
681-
[ 1. On the designer, select the agent's title bar to open the information pane.]:#
682-
[ 1. On the **Parameters** tab, find the **Advanced parameters** section.]:#
683-
[ 1. Check whether the parameter named **Agent History Reduction Type** exists. If not, open the **Advanced parameters** list, and select that parameter.]:#
684-
[ 1. From the **Agent History Reduction Type** list, select one of the following options:]:#
685-
[ | Option | Description |]:#
686-
[ |--------|-------------|]:#
687-
[ | **Token count reduction** | Shows the parameter named **Maximum Token Count**. Specifies the maximum number of tokens in chat history to keep and pass into the model for the next chat interaction. The default differs based on the currently used model in Azure OpenAI Service. The default limit is **128,000**. |]:#
688-
[ | **Message count reduction** | Shows the parameter named **Message Count Limit**. Specifies the maximum number of messages in chat history to keep and pass into the model for the next chat interaction. No default limit exists. |]:#
674+
- **Experimental capability**: You have the option to try chat reduction so you can reduce the maximum number of tokens or messages to keep in chat history and pass into the model.
675+
676+
A workflow agent has almost the same advanced parameters as the [Azure OpenAI built-in, service provider connector](/azure/logic-apps/connectors/built-in/reference/openai/), except for the **Agent History Reduction Type** advanced parameter, which exists only in the agent. This parameter controls the chat history that the agent maintains, based on the maximum number of tokens or messages.
677+
678+
This capability is in active development and might not work for all scenarios. You can change the **Agent History Reduction Type** option to reduce the limit on tokens or messages. You then specify the numerical limit that you want.
679+
680+
To try the capability, follow these steps:
681+
682+
1. On the designer, select the agent's title bar to open the information pane.
683+
1. On the **Parameters** tab, find the **Advanced parameters** section.
684+
1. Check whether the parameter named **Agent History Reduction Type** exists. If not, open the **Advanced parameters** list, and select that parameter.
685+
1. From the **Agent History Reduction Type** list, select one of the following options:
686+
687+
| Option | Description |
688+
|--------|-------------|
689+
| **Token count reduction** | Shows the parameter named **Maximum Token Count**. Specifies the maximum number of tokens in chat history to keep and pass into the model for the next chat interaction. The default differs based on the currently used model in Azure OpenAI Service. The default limit is **128,000**. |
690+
| **Message count reduction** | Shows the parameter named **Message Count Limit**. Specifies the maximum number of messages in chat history to keep and pass into the model for the next chat interaction. No default limit exists. |
689691

690692
### Tools
691693

0 commit comments

Comments
 (0)