Skip to content

Commit 7962e7b

Browse files
fix: improve regex patterns for more precise layer targeting
- Escape literal dots and add $ anchors to prevent unintended matches - Consolidate attention/gate/up proj patterns for readability Co-authored-by: gemini-code-assist[bot] Signed-off-by: saurabhaloneai <saurabhaloney85@gmail.com>
1 parent ad3e8f6 commit 7962e7b

File tree

1 file changed

+4
-4
lines changed

1 file changed

+4
-4
lines changed

tests/e2e/vLLM/recipes/non_uniform/recipe_nvfp4_fp8_mixed.yaml

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@ quant_stage:
1616
strategy: token
1717
dynamic: true
1818
symmetric: true
19-
targets: ["re:.*down_proj.*"]
19+
targets: ["re:.*\\.down_proj$"]
2020
group_1:
2121
weights:
2222
num_bits: 4
@@ -33,6 +33,6 @@ quant_stage:
3333
dynamic: local
3434
symmetric: true
3535
group_size: 16
36-
targets: ["re:.*self_attn.k_proj.*", "re:.*self_attn.o_proj.*",
37-
"re:.*self_attn.q_proj.*", "re:.*self_attn.v_proj.*",
38-
"re:.*gate_proj.*", "re:.*up_proj.*"]
36+
targets:
37+
- "re:.*self_attn\\.(k|o|q|v)_proj$"
38+
- "re:.*\\.(gate|up)_proj$"

0 commit comments

Comments
 (0)