Skip to content

Conversation

ThomasVitale
Copy link
Contributor

Extend the retry configuration strategy introduced in #1040 to the rest of the OpenAI model integration.

Main aspects:

  • A RetryTemplate can be autoconfigured for each model type integration, or else a default one is used.
  • The RetryTemplate is used to wrap the call to the model service for targeted HTTP retry logic instead of wrapping the entire implementation logic.
  • The model request object is assembled in a dedicated method for improved readability and for sharing it between standard and streaming implementations.

@ThomasVitale ThomasVitale force-pushed the consolidate-retry-config-for-openai branch from fd9715f to 6c88654 Compare July 23, 2024 16:22
@tzolov tzolov self-assigned this Jul 24, 2024
@tzolov tzolov added this to the 1.0.0-M2 milestone Jul 24, 2024
@tzolov tzolov merged commit 6c88654 into spring-projects:main Jul 24, 2024
1 check passed
@tzolov
Copy link
Contributor

tzolov commented Jul 24, 2024

Thanks @ThomasVitale

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants