Client unable to configure model parameters #640
Closed
TaoChenOSU
started this conversation in
2. Feature requests
Replies: 1 comment
-
Since #673 the summarization handler allows to customize the prompt. However, the handler is designed for precision, e.g. using temperature = 0 on purpose. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
The client currently cannot configure parameters (TopP, temperature...) for the completion model used in the summarization handler and the Ask API: https://github.com/microsoft/semantic-memory/blob/main/dotnet/CoreLib/Search/SearchClient.cs#L312
Would be useful to be able to configure those parameters.
Beta Was this translation helpful? Give feedback.
All reactions