Skip to content

Conversation

@prwhelan
Copy link
Member

@prwhelan prwhelan commented Aug 21, 2025

Set default value to 4 hours to lower the dollar cost for most users, who only use inference intermittently, at the risk of cold start times.

Set a max value to 72 hours to prevent an effective nonzero min allocation.

@prwhelan prwhelan added >non-issue :ml Machine learning Team:ML Meta label for the ML team v9.2.0 labels Aug 21, 2025
@shubhaat
Copy link

Set a max value to 72 hours to prevent an effective nonzero min allocation.

Wait the intent here was to allow customers to be able to set it to a value between 4 and 72 hours. This seems like an internal setting that Elastic can set?

@prwhelan prwhelan closed this Aug 21, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:ml Machine learning >non-issue Team:ML Meta label for the ML team v9.2.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants