Commit a7347d9

authored

Make sampler less blocking (#1889)

1 parent f8c688d commit a7347d9Copy full SHA for a7347d9

2 files changed

+310

-198

lines changed

vllm/model_executor
- layers
  - sampler.py
- sampling_metadata.py

2 files changed

+310

-198

lines changed

Comments

(0)