vllm + sync support?

[XueruiSu]

System Info

I find the _ROLLOUT_REGISTRY in line81 of verl/workers/rollout/base.py only has "vllm" + "async" pair but not "vllm" and "sync".
_ROLLOUT_REGISTRY = { ("vllm", "async"): "verl.workers.rollout.vllm_rollout.vLLMAsyncRollout", ("sglang", "async"): "verl.workers.rollout.sglang_rollout.sglang_rollout.ServerAdapter", }
And the vLLMRollout class in verl/workers/rollout/vllm_rollout/vllm_rollout_spmd.py has beed removed. So is the latest verl does not support the sync version of vllm rollout method?

Information

• The official example scripts
• My own modified scripts

Tasks

• An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
• My own task or dataset (give details below)

Reproduction

I find the _ROLLOUT_REGISTRY in line81 of verl/workers/rollout/base.py only has "vllm" + "async" pair but not "vllm" and "sync".
_ROLLOUT_REGISTRY = { ("vllm", "async"): "verl.workers.rollout.vllm_rollout.vLLMAsyncRollout", ("sglang", "async"): "verl.workers.rollout.sglang_rollout.sglang_rollout.ServerAdapter", }
And the vLLMRollout class in verl/workers/rollout/vllm_rollout/vllm_rollout_spmd.py has beed removed. So is the latest verl does not support the sync version of vllm rollout method?

Expected behavior

Hope your help

[liming95]

I encountered the same issue when cloning the 'main' branch. However, switching to version v0.6.1 resolves it , as vllm + sync is supported here. I think the 'main' branch is under active development and it may be better to use a stable release for you.

[tardis-key]

The answer is yes.

Currently, all rollout backends in verl are base on Server Mode (Async Mode), controlled by AgentLoop. The spmd mode for offline LLM is no longer supported.

[XueruiSu]

Thanks for your response