Commit e354174
Pass KvCacheRetentionConfig to torch LlmRequest
Signed-off-by: Aurelien Chartier <2567591+achartier@users.noreply.github.com>1 parent 602b059 commit e354174
1 file changed
+2
-1
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
764 | 764 | | |
765 | 765 | | |
766 | 766 | | |
767 | | - | |
| 767 | + | |
| 768 | + | |
768 | 769 | | |
769 | 770 | | |
770 | 771 | | |
| |||
0 commit comments