Skip to content

Commit f15d53e

Browse files
Update mixtral.py
1 parent 8d79007 commit f15d53e

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/model_executor/models/mixtral.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -337,7 +337,7 @@ def forward(
337337
return hidden_states
338338

339339
def load_weights(self, weights: Iterable[tuple[str,
340-
torch.Tensor]]) -> Set[str]:
340+
torch.Tensor]]) -> set[str]:
341341
if not self.split_qkv:
342342
stacked_params_mapping = [
343343
# (param_name, shard_name, shard_id)

0 commit comments

Comments
 (0)