Skip to content

Commit e93a6ee

Browse files
committed
context : clear sets of encoder output sequence ids before storing new values.
1 parent 0fd8487 commit e93a6ee

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

src/llama-context.cpp

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1153,6 +1153,7 @@ int llama_context::encode(llama_batch & inp_batch) {
11531153
// remember the sequence ids used during the encoding - needed for cross attention later
11541154
cross.seq_ids_enc.resize(n_tokens);
11551155
for (int32_t i = 0; i < n_tokens; i++) {
1156+
cross.seq_ids_enc[i].clear();
11561157
for (int s = 0; s < ubatch.n_seq_id[i]; s++) {
11571158
llama_seq_id seq_id = ubatch.seq_id[i][s];
11581159
cross.seq_ids_enc[i].insert(seq_id);

0 commit comments

Comments
 (0)