Web Demo audio output has breaks

[siddharth1712]

I ran the web demo on my system which has a a single A100 GPU. But the output audio is breaking after every word or so. Is this expected? How can I improve or optimize this?

[lxchtan]

Inference is currently slow (RTF > 1 on a single A100). Suggest using two GPUs or waiting for our upcoming vLLM integration for better performance.

[siddharth1712]

Okay thank you for the information, can you also tell the timeline for the vLLM integration?