forked from kaust-generative-ai/local-deployment
-
Notifications
You must be signed in to change notification settings - Fork 1
Open
Labels
enhancementNew feature or requestNew feature or request
Description
llama-cli supports a number of chat templates that help organize conversations. Need a good usage example for chat templates. Here is the relevant bit from the docs.
--chat-template JINJA_TEMPLATE: This option sets a custom jinja chat template. It accepts a string, not a file name. Default: template taken from model's metadata. Llama.cpp only supports some pre-defined templates. These include the following
llama2llama3gemmamonarchchatmlorionvicunavicuna-orcadeepseekcommand-rzephyr
When --in-prefix or --in-suffix options are enabled the chat template ( --chat-template ) is disabled.
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request