[Feature] Improve Relay Stability #166
Description
Checklist
- 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang-omni/discussions/new/choose Otherwise, it will be closed.
- 2. Please use English, otherwise it will be closed.
Motivation
The relay module sometimes fails due to limited slot size or just hangs with different backends. We should check whether this can be further improved.
Related resources
No response