Can I make the framework to return the tool result directly, without rewriting or summarizing it via another LLM pass？

[dlwangac]

I need the agent only do tool-routing without a second LLM call for final synthesis.

Current behavior

When tools are enabled, the framework executes tool calls and then performs another LLM step to produce the final assistant response.
In some scenarios, we need the framework to return the tool result directly, without rewriting or summarizing it via another LLM pass.

Desired behavior

• The model can still decide which tool to call (routing).
• After tool execution, the framework can short-circuit and return the raw tool output as the final response.
• No second LLM completion is made for synthesis/rephrasing.

Is there any option setting or other method to achieve this?

Thank you!

[moonbox3]

Hi @dlwangac, yes, this is done via middleware. Are you using MAF Python or C#? I can provide some samples depending on which language you're using.

[dlwangac]

Hi @moonbox3 ,thank you very much.
I'm using MAF Python.

[moonbox3]

Please have a look at this sample: https://github.com/microsoft/agent-framework/blob/main/python/samples/02-agents/middleware/override_result_with_middleware.py

[moonbox3]

@dlwangac you can also read about middleware in our docs here: https://learn.microsoft.com/en-us/agent-framework/agents/middleware/?pivots=programming-language-python