Skip to content

Commit 81ce2a4

Browse files
authored
[Minor] Fix type annotation in Mixtral (#2036)
1 parent 5dd80d3 commit 81ce2a4

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/model_executor/models/mixtral.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -251,7 +251,7 @@ def sparse_transpose(
251251
return column_indices_t, offsets_t, block_offsets_t
252252

253253
def topology(self, x: torch.Tensor,
254-
padded_bins: torch.Tensor) -> stk.Matrix:
254+
padded_bins: torch.Tensor) -> "stk.Matrix":
255255
padded_tokens, _ = x.size()
256256
assert padded_tokens % self.blocking == 0
257257
assert self.ffn_dim_per_partition % self.blocking == 0

0 commit comments

Comments
 (0)