MagenticOrchestration with Bing Grounding Tool annotations

[cgdietz]

I've been experimenting with MagenticOrchestration where one of the Agents is an AzureAIAgent using a BingGroundingToolDefinition. Works great! However the way the Bing grounding tool works is to pass annotations for the referenced links separately from the raw text content, and expects you to replace a place holder in the text with actual URIs. see (https://learn.microsoft.com/en-us/azure/ai-foundry/agents/how-to/tools/bing-code-samples?pivots=csharp) for an example.

The MagenticOrchestration boils down all messages to just the text inside a ChatMessageContent object, and never seems to have a reference to the Annotations. Is there anyway to either get the annotations into ChatMessageContent -or- intercept the creation of ChatMessageContent and do the URI replacement before?

[cgdietz]

I think I see where to look now.... You parse the ChatMessageContent response, for Items that are AnnotationContent. Then do a find replace on Quote.