Latency routing for AOAI in APIM #175
Description
When AOAI request takes longer than specified amount of time use 'forward request' policy to reroute to a different AOAI endpoint.
{{ message }}
When AOAI request takes longer than specified amount of time use 'forward request' policy to reroute to a different AOAI endpoint.