Pass custom parameters to AzureAugmentedLLM request body

[pavelorehov]

I need to pass extra custom parameters related to user key in request body to LLM.
Below is example with "user" parameter.
Cannot find any example if AzureAugmentedLLM supports that, if not would be good to add it or share workaround.

{
"messages": [
{
"role": "system",
"content": "You are a chatbot"
},
{
"role": "user",
"content": "who is the president of USA."
}
],
"user": "{"appkey": ""}",
"stop": [
"<|im_end|>"
]
}

[saqadri]

@pavelorehov thanks for reporting! This is supported by the OpenAIAugmentedLLM --

mcp-agent/src/mcp_agent/workflows/llm/augmented_llm_openai.py

Line 220 in 89b888e

user = params.user or getattr(self.context.config.openai, "user", None)

But not the AzureAugmentedLLM doesn't support this. It should be the exact same pattern to add. Would you be open to contributing the fix?

In order to specify it on the request, you just define the user property in the RequestParams object:

mcp-agent/src/mcp_agent/workflows/llm/augmented_llm.py

Line 124 in 89b888e

class RequestParams(CreateMessageRequestParams):

which is passed as a request_params field on generate, generate_str, and generate_structured:

mcp-agent/src/mcp_agent/workflows/llm/augmented_llm.py

Line 175 in 89b888e

async def generate(

[Tanmay-Kant]

Hey @saqadri, I've been working with @pavelorehov on this, can I make the fix?

[saqadri]

Hey @saqadri, I've been working with @pavelorehov on this, can I make the fix?

Absolutely! @Tanmay-Kant just let me know how I can help

[Tanmay-Kant]

Hey @saqadri, made the changes: #394
I also added a unit test but did not push that in case we want to leave those alone. Please advise.

Test 25: User Parameter Handling

@pytest.mark.asyncio
async def test_user_param_handling(self, mock_llm, default_usage):
    """
    Tests that the user parameter is properly included in Azure API calls.
    """
    # Setup mock executor
    mock_llm.executor.execute = AsyncMock(
        return_value=self.create_text_response(
            "Response with user parameter", usage=default_usage
        )
    )

    # Create request params with user parameter (for CIRCUIT API)
    user_param = json.dumps({"appkey": "test-app-key"})
    request_params = RequestParams(user=user_param)

    # Call LLM with user parameter
    await mock_llm.generate("Test query", request_params)

    # Verify that user parameter was included in the API call arguments
    req = mock_llm.executor.execute.call_args[0][1]
    assert "user" in req.payload
    assert req.payload["user"] == user_param

    # Test with user parameter from config
    # Reset mock to clear call history
    mock_llm.executor.execute.reset_mock()
    
    # Set user parameter in config
    mock_llm.context.config.azure.user = "config-user-param"
    
    # Call LLM without explicit user parameter
    await mock_llm.generate("Test query")
    
    # Verify that user parameter from config was used
    req = mock_llm.executor.execute.call_args[0][1]
    assert "user" in req.payload
    assert req.payload["user"] == "config-user-param"

    # Verify that explicit user parameter takes precedence over config
    mock_llm.executor.execute.reset_mock()
    request_params = RequestParams(user=user_param)
    await mock_llm.generate("Test query", request_params)
    req = mock_llm.executor.execute.call_args[0][1]
    assert req.payload["user"] == user_param

Let me know if you want me to push this as well to the PR. Thank you!

[saqadri]

@Tanmay-Kant if you wouldn't mind creating a new PR with the test that would be great! I saw your comment after merging your PR

[Tanmay-Kant]

Hey @saqadri, turns out there was a slight issue with how the Azure SDK expects the user param to be passed that was different than the original implementation. I have made the fix here: #403, could you please review and approve at your earliest convenience? Also, I would like to request a Slack channel with you or a representative so we can work closely on evaluating (and hopefully using) your repo. Would that be possible? Thank you once again and hope to speak to you soon!

EDIT

Actually, please wait while I investigate further fixes before merging

[pavelorehov]

With #394 fix and below config there is an error below, @saqadri any idea ?

mcp_agent.config.yaml
azure:
  user: { "appkey": "abcd" }

[ERROR] 2025-09-10T21:45:38 mcp_agent.executor.executor - Error executing task: Session.request() got an unexpected keyword argument 'user'
[ERROR] 2025-09-10T21:45:38 mcp_agent.workflows.llm.augmented_llm_azure.router-classifier - Error: Session.request() got an unexpected keyword argument 'user'