how I can add ConfigureHttpClientDefaults for SK Retry logic? #547
Unanswered
KSemenenko
asked this question in
1. Q&A
Replies: 4 comments
-
I see I can pass httpClient .WithAzureOpenAITextGeneration(new AzureOpenAIConfig()
{
Endpoint = azureOpenAi.GPT3SummarizationModel.Endpoint,
APIKey = azureOpenAi.GPT3SummarizationModel.ApiKey,
Deployment = azureOpenAi.GPT3SummarizationModel.DeploymentOrModelId,
Auth = AzureOpenAIConfig.AuthTypes.APIKey
},
httpClient: httpClient) and it workds fine. but any compibantion with passing IServiceCollection into Builder, or add services into build isn't work |
Beta Was this translation helpful? Give feedback.
0 replies
-
}).WithAzureOpenAITextGeneration(new AzureOpenAIConfig()
{
Endpoint = azureOpenAi.SummarizationModel.Endpoint,
APIKey = azureOpenAi.SummarizationModel.ApiKey,
Deployment = azureOpenAi.SummarizationModel.DeploymentOrModelId,
Auth = AzureOpenAIConfig.AuthTypes.APIKey,
MaxTokenTotal = 25000,
// is this retry logic?
MaxRetries = 1230
},
// custom http client with retry logic
httpClient: httpClient) |
Beta Was this translation helpful? Give feedback.
0 replies
-
i have same issues |
Beta Was this translation helpful? Give feedback.
0 replies
-
@strikene adding configured http client works. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Context / Scenario
I need retry logic for embedding requests, becse for 500 pages pdf I deffenelty will reach TooManyRequest issue, for Azure ADA2 model.
Question
in SK I can do like this:
how can I do this for KM?
Beta Was this translation helpful? Give feedback.
All reactions