Skip to content

Commit 12a6435

Browse files
author
Griffin Adams
committed
Update default configs.
1 parent 127773a commit 12a6435

File tree

4 files changed

+4
-8
lines changed

4 files changed

+4
-8
lines changed

cache_configs/l2.yaml

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,4 @@
11
cache_strategy: "l2"
22
prompt_compression_strategy: "l2"
3-
feed_long_prompt: True
43
global_tokens: 4
54
recent_window: 10

cache_configs/random.yaml

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,2 @@
11
cache_strategy: "random"
2-
max_cache_length: [1024]
3-
feed_long_prompt: True
42
global_tokens: 4

cache_configs/scissor.yaml

Lines changed: 3 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,9 +1,8 @@
11
cache_strategy: "scissor"
2-
max_cache_length: [1024]
2+
prompt_compression_strategy: "snapkv"
33
global_tokens: 4
4+
recent_window: 10
45
history_window_size: 400
56
drop_amount: 0
6-
recent_window: 10
77
attn_thresholding: False
8-
prompt_compression_strategy: "snapkv"
9-
attn_record_freq: 1
8+
attn_record_freq: 1

cache_configs/window.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
cache_strategy: "window"
2+
prompt_compression_strategy: "recent_global"
23
global_tokens: 4
3-
max_cache_length: [1024]

0 commit comments

Comments
 (0)