What is the role of FilereferenceContent and ChatMessageContentItemCollection Class?

[lovedeepatsgit]

I am working on attach files with the ChatComplementServices, ChatCompletionAgents, and AzureAiAgents. AzureAiAgents are working fine, but during this process i cam aceoss FileReferenceContent and ChatMessageContentItemCollection Class, what are the exact role of these classes in the whole file upload sceanario, can i use or modify these classes directly to attach file with chatcompletionagents or chatcompletion services, if not then what roles these does actually play? because due to their naming it sounds like i should use these classes at the place of AzureAiAgents?

[crickman]

@lovedeepatsgit - FileReferenceContent is only used to capture file output that is included in an agent response. Specifically for AzureAIAgent and OpenAIAssistantAgent. This could be images (PNG/JPEG) and data files (CSV/JSON/PDF).

There agents types only accept text or image content for input. For specifiying an image for input, use ImageContent.

https://github.com/microsoft/semantic-kernel/blob/main/dotnet/samples/GettingStartedWithAgents/OpenAIAssistant/Step03_Assistant_Vision.cs

https://github.com/microsoft/semantic-kernel/blob/main/dotnet/samples/Concepts/Agents/OpenAIAssistant_FileManipulation.cs

https://github.com/microsoft/semantic-kernel/blob/main/dotnet/samples/Concepts/Agents/OpenAIAssistant_ChartMaker.cs

[lovedeepatsgit]

Thanks a lot @crickman

[x3haloed]

Any plans for SK to support the content "type": "file" in the completions API as outlined by OpenAI? https://platform.openai.com/docs/guides/pdf-files?api-mode=chat