Skip to content

Conversation

@MadhavJivrajani
Copy link

@MadhavJivrajani MadhavJivrajani commented Nov 29, 2025

To add the N parameter, each choice in the response is the same text content.
This also helps simplify things a little bit in terms of testing and response construction.

Fixes #249

cc @mayabar

To add the N parameter, each choice in the response is the same text content.
This also helps simplify things a little bit in terms of testing and response construction.

Signed-off-by: Madhav Jivrajani <[email protected]>
Signed-off-by: Madhav Jivrajani <[email protected]>
@irar2
Copy link
Collaborator

irar2 commented Nov 30, 2025

Hi @MadhavJivrajani, thanks for the PR.
Several comments:

  1. We prefer that choices will contain different responses (text, tools, etc.)
  2. Multiple choices should affect tokens generation times
  3. Please add similar support to streaming
  4. n can be a field in baseCompletionResponse
  5. The tests should expect the exact number of choices

@MadhavJivrajani
Copy link
Author

Thanks! Let me rework it based on your comment.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add support for N request parameter

2 participants