Skip to content

[FEATURE REQ] Add support for prompt_cache_key in OpenAIResponse and ResponseCreationOptions #641

@andregabrielmelo

Description

@andregabrielmelo

Describe the feature or improvement you are requesting

I would like to suggest adding prompt_cache_key as an option in the ResponseCreationOptions, to help optimize the model by using cached input. Also, the OpenAIResponse could have the prompt_cache_key used.

Additional context

https://platform.openai.com/docs/api-reference/responses/create#responses_create-prompt_cache_key
https://platform.openai.com/docs/guides/prompt-caching

Metadata

Metadata

Assignees

Labels

area: responsesThis item is related to Responsesblocked: specThis issue is blocked on a needed REST API spec update.feature-requestCategory: A new feature or enhancement to an existing feature is being requested.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions