How to retrieve AvgLogprobs when using ChatVertexAI?

[jaymon0703]

Checked other resources

• I added a very descriptive title to this question.
• I searched the LangChain documentation with the integrated search.
• I used the GitHub search to find a similar question and didn't find it.

Commit to Help

• I commit to help with one of those options 👆

Example Code

N/A

Description

We can retrieve AvgLogprobs using Gemini API, but how do we retrieve this when using langchain_google_vertexai and specifically ChatVertexAI models?

System Info

N/A

[dosubot[bot]]

Retrieving AvgLogprobs is not supported by ChatVertexAI models in the langchain_google_vertexai integration ^[1].

To continue talking to Dosu, mention @dosu.

[jaymon0703]

@dosu will LangChain consider adding this model feature in the future?

[dosubot[bot]]

There is no information available regarding future plans to add AvgLogprobs support for ChatVertexAI models in LangChain. For the most accurate and up-to-date information, you may want to keep an eye on the official LangChain repository and its release notes.

To continue talking to Dosu, mention @dosu.