Skip to content

Commit 492345d

Browse files
committed
fix typo
1 parent 418a31f commit 492345d

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

src/llama-graph.cpp

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -56,8 +56,8 @@ void llm_graph_input_pos::set_input(const llama_ubatch * ubatch) {
5656
const int64_t n_tokens = ubatch->n_tokens;
5757

5858
if (ubatch->token && n_pos_per_embd == 4) {
59-
// in case we're using M-RoPE with text tokens, convert the 1D positions to 3D
60-
// the other dimensions are the same, except for 4th dim which will be all 0
59+
// in case we're using M-RoPE with text tokens, convert the 1D positions to 4D
60+
// the 3 first dims are the same, and 4th dim is all 0
6161
std::vector<llama_pos> pos_data(n_tokens*n_pos_per_embd, 0);
6262
// copy the first dimension
6363
for (int i = 0; i < n_tokens; ++i) {

0 commit comments

Comments
 (0)