Skip to content

Commit 810b9fc

Browse files
authored
perplexity : provide a helpful hint for has_cpl case in split_equal error. (#15304)
When attempting to do llama-perplexity on certain tasks which have coupled sequences there is a cryptic error that does not tell you what to do, which is to set the -kvu flag. This adds a hint about that fact.
1 parent 4ebd0c1 commit 810b9fc

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/llama-batch.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -477,7 +477,7 @@ llama_ubatch llama_batch_allocr::split_simple(uint32_t n_ubatch) {
477477

478478
llama_ubatch llama_batch_allocr::split_equal(uint32_t n_ubatch, bool sequential) {
479479
if (sequential && has_cpl) {
480-
LLAMA_LOG_ERROR("%s: sequential split is not supported when there are coupled sequences in the input batch\n", __func__);
480+
LLAMA_LOG_ERROR("%s: sequential split is not supported when there are coupled sequences in the input batch (you may need to use the -kvu flag)\n", __func__);
481481

482482
return {};
483483
}

0 commit comments

Comments
 (0)