_broadcast_to_vllm DOES NOT seem to update the vllm weights #6

Open

opened

on Mar 16, 2025

我看vllm更新权重的时候，只是将rank0上面的weight进行广播，但rank0上面只有部分模型权重，请问这个是怎么回事啊

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests