-
Notifications
You must be signed in to change notification settings - Fork 346
Open
Labels
area: responsesThis item is related to ResponsesThis item is related to Responsesblocked: specThis issue is blocked on a needed REST API spec update.This issue is blocked on a needed REST API spec update.feature-requestCategory: A new feature or enhancement to an existing feature is being requested.Category: A new feature or enhancement to an existing feature is being requested.
Description
Describe the feature or improvement you are requesting
I would like to suggest adding prompt_cache_key as an option in the ResponseCreationOptions, to help optimize the model by using cached input. Also, the OpenAIResponse could have the prompt_cache_key used.
Additional context
https://platform.openai.com/docs/api-reference/responses/create#responses_create-prompt_cache_key
https://platform.openai.com/docs/guides/prompt-caching
Metadata
Metadata
Assignees
Labels
area: responsesThis item is related to ResponsesThis item is related to Responsesblocked: specThis issue is blocked on a needed REST API spec update.This issue is blocked on a needed REST API spec update.feature-requestCategory: A new feature or enhancement to an existing feature is being requested.Category: A new feature or enhancement to an existing feature is being requested.