Skip to content

Conversation

@wang2nd
Copy link

@wang2nd wang2nd commented Feb 26, 2025

identify inference_profile type from the foundation model list response itself

Issue #, if available:

Description of changes:

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

identify inference_profile type from the foundation model list response itself
@daixba
Copy link
Contributor

daixba commented Feb 27, 2025

Thanks for the contribution. But I don't see any bugs so far using sonnet 3.7.

Can you please describe what issue (bug) you faced and why we need this fix?

@wang2nd
Copy link
Author

wang2nd commented Mar 3, 2025

I could not see sonnet 3.7 interference profile listed in the models api without changes, even after I checked out the main and rebuilt the server again.

@daixba
Copy link
Contributor

daixba commented Mar 7, 2025

You can try to redeploy this solution and you should be able to use the Sonnet 3.7.

If you just deployed recently, try run curl -s $OPENAI_BASE_URL/models -H "Authorization: Bearer $OPENAI_API_KEY" | jq .data to refresh the model list.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants