Simulator does not stop on Ctrl+C

[mayabar]

What happened:
When pressing Ctrl+C to interrupt the simulator, the process does not terminate as expected. The simulator keeps running instead of stopping gracefully.

What you expected to happen:
Simulator should stop when Ctrl+C pressed

Anything else we need to know?:
Double Ctrl+C stops the simulator

Environment:

• Run on Mac
• llm-d-inference-sim version: v0.4.0

[npolshakova]

I ran into this too! 😆 I think server.Serve is blocking indefinitely. I can look into this more.

[mayabar]

thanks Nina, assigning this to you

/assign @npolshakova