Conformance: Multi Pool/Gateway Tests Fail #1418
Description
What happened:
The HTTPRouteMultipleRulesDifferentPools and HTTPRouteMultipleGatewaysDifferentPools fail due to the "secondary-inference-pool" InferencePool selecting the primary model server backends.
What you expected to happen:
The "secondary-inference-pool" InferencePool selects the secondary model server backends and the test to passes.
How to reproduce it (as minimally and precisely as possible):
Follow the steps in the conformance guide and run the test.
Anything else we need to know?:
N/A