Skip to content

Commit 6acc681

Browse files
committed
fix
1 parent 79d2be4 commit 6acc681

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

common/speculative.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -209,7 +209,7 @@ llama_tokens common_speculative_gen_draft(
209209
prompt_tgt_draft_model = common_tokenize(ctx_dft, text, false, true);
210210

211211
// convert id_last to draft vocab. llama_detokenize is called directly to avoid an allocation
212-
const auto *model_tgt = llama_get_model(ctx_dft);
212+
const auto *model_tgt = llama_get_model(ctx_tgt);
213213
const auto *vocab_tgt = llama_model_get_vocab(model_tgt);
214214

215215
int32_t n_chars = llama_detokenize(vocab_tgt, &id_last, 1, nullptr, 0, false, false);

0 commit comments

Comments
 (0)