Skip to content

Commit a278637

Browse files
author
ochafik
committed
make multi token not preserved warning more actionable
1 parent 3a37ae4 commit a278637

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/server/server.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -385,7 +385,7 @@ struct server_task {
385385
params.sampling.preserved_tokens.insert(ids[0]);
386386
} else {
387387
// This may happen when using a tool call style meant for a model with special tokens to preserve on a model without said tokens.
388-
LOG_DBG("Not preserved because more than 1 token: %s\n", t.get<std::string>().c_str());
388+
LOG_DBG("Not preserved because more than 1 token (wrong chat template override?): %s\n", t.get<std::string>().c_str());
389389
}
390390
}
391391
}

0 commit comments

Comments
 (0)