We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 0f719ca commit c608e80Copy full SHA for c608e80
cache_configs/scissor.yaml
@@ -4,6 +4,6 @@ global_tokens: 4
4
history_window_size: 400
5
drop_amount: 0.0001
6
recent_window: 10
7
-attn_thresholding: True
+attn_thresholding: False
8
prompt_compression_strategy: "snapkv"
9
attn_record_freq: 1
0 commit comments