Skip to content
This repository was archived by the owner on Jul 22, 2025. It is now read-only.

Conversation

@SamSaffron
Copy link
Member

When sharing artifacts on mobile we had no viewport tag so
text would be TINY

When sharing artifacts on mobile we had no viewport tag so
text would be TINY
This is required for models such o1 that do not have streaming
enabled yet

It is good to carry this feature around in case various apis
decide not to support streaming endpoints
end

def disable_streaming?
@disable_streaming = llm_model.lookup_custom_param("disable_streaming")
Copy link
Contributor

@nattsw nattsw Jan 13, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What will happen for existing llm models? Does this default to a false / blank?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

sure will add a double negative here, good call, no need for migration by default we don't disable so it is just "not disabled"

Copy link
Contributor

@nattsw nattsw left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Generally looks ok but I am not sure what the behaviour is now for existing models without the param.

Is a migration needed?

@SamSaffron SamSaffron merged commit 20612fd into main Jan 13, 2025
6 checks passed
@SamSaffron SamSaffron deleted the viewport branch January 13, 2025 06:01
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Development

Successfully merging this pull request may close these issues.

3 participants