Adding content_filter_results to generationInfo with AzureChatOpenAI

[aleclair-KoAi]

Checked

• I searched existing ideas and did not find a similar one
• I added a very descriptive title
• I've clearly described the feature request and motivation for it

Feature request

With OpenAI chat_models we only keep newTokenIndices (prompt and completion), finish_reason and system_fingerprint. I would like to add content_filter_results to get more informations from my content filter.

Motivation

I'm frustated to get finish_reason "content_filter" without any informations about what could have been detected or filtered.

Proposal (If applicable)

If want to modify chat_models file to add content_filter_results in generationInfo where it is needed :

generation.generationInfo = {
  ...(part.finish_reason ? { finish_reason: part.finish_reason } : {}),
  ...(part.content_filter_results ? { content_filter_results: part.content_filter_results } : {}),
  ...(part.logprobs ? { logprobs: part.logprobs } : {}),
};

if (choice.finish_reason != null) {
  generationInfo.finish_reason = choice.finish_reason;
  generationInfo.content_filter_results = choice.content_filter_results;
  // Only include system fingerprint in the last chunk for now
  // to avoid concatenation issues
  generationInfo.system_fingerprint = data.system_fingerprint;
}