Skip to content

Commit 97fdef6

Browse files
committed
minor cleanup
Signed-off-by: Thomas Parnell <[email protected]>
1 parent c57d39e commit 97fdef6

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

vllm/model_executor/models/minimax_text_01.py

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -578,12 +578,13 @@ def _forward(self, hidden_states: torch.Tensor, positions: torch.Tensor,
578578
hidden = self._decode_infer(q, k, v, kv_cache,
579579
state_indices_tensor,
580580
attn_metadata)
581+
581582
hidden = self.norm._forward(hidden)
582583
gate, _ = self.output_gate(hidden_states[:num_actual_tokens])
583584
hidden = F.sigmoid(gate) * hidden
584585
hidden = hidden.to(hidden_states.dtype)
585-
output, _ = self.out_proj(hidden)
586-
return output[:num_actual_tokens]
586+
hidden, _ = self.out_proj(hidden)
587+
return hidden[:num_actual_tokens]
587588

588589

589590
class MiniMaxText01Attention(nn.Module):

0 commit comments

Comments
 (0)