Skip to content

Conversation

@Jackmin801
Copy link
Member

@Jackmin801 Jackmin801 commented Feb 1, 2026

Note

Low Risk
Small wiring change limited to validation client selection; primary risk is validation hitting a different/updated backend than before, but no auth/data-path logic changes.

Overview
Validation rollouts now use inference_pool.clients directly instead of a cached clients variable, ensuring validation always targets the current inference pool (including newly discovered servers in elastic mode).

This also removes redundant local reassignments of clients after inference pool setup/ready checks.

Written by Cursor Bugbot for commit b6a7b28. This will update automatically on new commits. Configure here.

@Jackmin801 Jackmin801 merged commit f14c8d6 into main Feb 1, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants