Commit 168ce66
authored
Update default parameters in endpoint functions (#367)
* Update default parameters in endpoint functions
Changed default values for disable_prompt_cache and disable_speculative_decoding to True.
* Add temporary default values for CLI options
Set temporary default values for no-prompt-cache and no-speculative-decoding options.
* revert cli functionality1 parent fffa141 commit 168ce66
1 file changed
+4
-4
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
56 | 56 | | |
57 | 57 | | |
58 | 58 | | |
59 | | - | |
60 | | - | |
| 59 | + | |
| 60 | + | |
61 | 61 | | |
62 | 62 | | |
63 | 63 | | |
| |||
304 | 304 | | |
305 | 305 | | |
306 | 306 | | |
307 | | - | |
308 | | - | |
| 307 | + | |
| 308 | + | |
309 | 309 | | |
310 | 310 | | |
311 | 311 | | |
| |||
0 commit comments