Skip to content

Commit e866f23

Browse files
g2mtggerganov
andauthored
Update common/speculative.cpp
Co-authored-by: Georgi Gerganov <[email protected]>
1 parent 50908f2 commit e866f23

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

common/speculative.cpp

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -209,8 +209,8 @@ llama_tokens common_speculative_gen_draft(
209209
prompt_tgt_draft_model = common_tokenize(ctx_dft, text, false, true);
210210

211211
// convert id_last to draft vocab. llama_detokenize is called directly to avoid an allocation
212-
const auto *model_tgt = llama_get_model(ctx_tgt);
213-
const auto *vocab_tgt = llama_model_get_vocab(model_tgt);
212+
const auto * model_tgt = llama_get_model(ctx_tgt);
213+
const auto * vocab_tgt = llama_model_get_vocab(model_tgt);
214214

215215
int32_t n_chars = llama_detokenize(vocab_tgt, &id_last, 1, nullptr, 0, false, false);
216216
GGML_ASSERT(n_chars < 0 && "failed to detokenize id_last");

0 commit comments

Comments
 (0)