Skip to content

Allow response generation with no user message#310

Merged
zqhuang211 merged 1 commit intofixie-ai:mainfrom
Okaya-API:main
Aug 5, 2025
Merged

Allow response generation with no user message#310
zqhuang211 merged 1 commit intofixie-ai:mainfrom
Okaya-API:main

Conversation

@matthewclso
Copy link
Contributor

@matthewclso matthewclso commented Jul 29, 2025

I may be wrong, but it is currently not possible to generate an assistant message without first inputting a user message. This would allow for situations where you might want to generate an assistant message with just a system message prompt. This PR allows for sample to be None, provided there are previous messages in the history (such as system messages). I am not sure if this is the best implementation - so please let me know if it needs any changes!

Copy link
Contributor

@zqhuang211 zqhuang211 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks good. Thank you!

@zqhuang211 zqhuang211 merged commit 0c61959 into fixie-ai:main Aug 5, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants