Different retry logic for Validation error vs Rate limits

[samgregson]

For validation errors I would like:

• Instant retry
• max_retries of 2

Whereas for openai.RateLimitError I would like:

• exponential backoff
• max_reties of say 10

How do I make this happen?

I originally had this:

@retry(stop=stop, wait=wait, retry=retry_type)
async def generate_chat_completion(
    prompt: str, model: str, temperature: float = 0, response_model=None, max_retries=2
) -> str:
    response: ChatCompletion = await client.chat.completions.create(
        model=model,
        temperature=temperature,
        messages=[{"role": "user", "content": prompt}],
        response_model=response_model,
        max_retries=max_retries
    )
    return response

However I realise that this doesn't work as if there is a validation error and then a retry error it'll wipe the validation errors as if starting again from scratch. I don't want to keep retrying for validation errors as it will likely not recover, but for rate limits I am happy to wait until I can retry successfully.