Skip to content

Commit 8fbacb3

Browse files
Mention response parser parameter in doc (#3496)
1 parent e3e5404 commit 8fbacb3

File tree

2 files changed

+1
-1
lines changed

2 files changed

+1
-1
lines changed

docs/parameters.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -120,6 +120,7 @@ Task specific parameters for different tasks (text generation/image generation/e
120120
| `--dynamic_split_fuse` | `bool` | Enables dynamic split fuse algorithm. Default: true. |
121121
| `--max_prompt_len` | `integer` | Sets NPU specific property for maximum number of tokens in the prompt. |
122122
| `--kv_cache_precision` | `string` | Reduced kv cache precision to `u8` lowers the cache size consumption. Accepted values: `u8` or empty (default).|
123+
| `--response_parser` | `string` | Type of parser to use for tool calls and reasoning in model output. Currently supported: [qwen3, llama3, hermes3, phi4] |
123124

124125
### Image generation
125126
| option | Value format | Description |

src/llm/response_parsers/response_parser.hpp

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -33,7 +33,6 @@ class ResponseParser {
3333
public:
3434
ResponseParser() = delete;
3535
explicit ResponseParser(ov::genai::Tokenizer& tokenizer, std::string parserName) {
36-
// Parser name is read from tokenizer_config.json, "response_parser_name" field.
3736
if (parserName == "llama3") {
3837
parser_impl = std::make_unique<Llama3ResponseParser>(tokenizer);
3938
} else if (parserName == "qwen3") {

0 commit comments

Comments
 (0)