Skip to content

Commit 7fe1794

Browse files
Update src/llama-hparams.cpp
Co-authored-by: Sigbjørn Skjæret <[email protected]>
1 parent d28c31a commit 7fe1794

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

src/llama-hparams.cpp

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -74,8 +74,8 @@ uint32_t llama_hparams::n_embd_r() const {
7474
// TODO: maybe support other convolution strides than 1
7575
// NOTE: since the first column of the conv_state is shifted out each time, it's not actually needed
7676
// Corresponds to Mamba's conv_states size
77-
78-
// check if the architecture is using d_ssm
77+
78+
// check if the architecture is using d_ssm
7979
return (ssm_d_conv > 0 ? ssm_d_conv - 1 : 0) * (ssm_d_inner + 2*ssm_n_group*ssm_d_state);
8080
}
8181

0 commit comments

Comments
 (0)