We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent d28c31a commit 7fe1794Copy full SHA for 7fe1794
src/llama-hparams.cpp
@@ -74,8 +74,8 @@ uint32_t llama_hparams::n_embd_r() const {
74
// TODO: maybe support other convolution strides than 1
75
// NOTE: since the first column of the conv_state is shifted out each time, it's not actually needed
76
// Corresponds to Mamba's conv_states size
77
-
78
- // check if the architecture is using d_ssm
+
+ // check if the architecture is using d_ssm
79
return (ssm_d_conv > 0 ? ssm_d_conv - 1 : 0) * (ssm_d_inner + 2*ssm_n_group*ssm_d_state);
80
}
81
0 commit comments