Does it support batch inference and sampling multiple outputs for each input?

[hongjx175]

Great work!

I read the modeling code and example inference code. It seems that this version code does not support batch inference.

Could you provide a version for batch inference? Thank.