Skip to content

Commit bc97c9d

Browse files
Set default kv_cache_precision during tests
1 parent 4d73e51 commit bc97c9d

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tests/openvino/test_modeling.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -121,7 +121,7 @@
121121

122122
SEED = 42
123123

124-
F32_CONFIG = {"INFERENCE_PRECISION_HINT": "f32"}
124+
F32_CONFIG = {"INFERENCE_PRECISION_HINT": "f32", "KV_CACHE_PRECISION": "f16"}
125125

126126

127127
class Timer(object):

0 commit comments

Comments
 (0)