Skip to content

Commit f53feed

Browse files
authored
chore: disable radix cache for SGLang by default (#421)
1 parent 6edd75c commit f53feed

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

areal/api/cli_args.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -541,7 +541,7 @@ class SGLangConfig:
541541
random_seed: int = 1
542542
skip_tokenizer_init: bool = False
543543
disable_cuda_graph: bool = False
544-
disable_radix_cache: bool = False
544+
disable_radix_cache: bool = True
545545
disable_cuda_graph_padding: bool = False
546546
enable_nccl_nvls: bool = False
547547
disable_outlines_disk_cache: bool = False

docs/cli_reference.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -479,7 +479,7 @@ https://github.com/sgl-project/sglang for detailed documentation.
479479
| `random_seed` | integer | `1` | - |
480480
| `skip_tokenizer_init` | boolean | `False` | - |
481481
| `disable_cuda_graph` | boolean | `False` | - |
482-
| `disable_radix_cache` | boolean | `False` | - |
482+
| `disable_radix_cache` | boolean | `True` | - |
483483
| `disable_cuda_graph_padding` | boolean | `False` | - |
484484
| `enable_nccl_nvls` | boolean | `False` | - |
485485
| `disable_outlines_disk_cache` | boolean | `False` | - |

0 commit comments

Comments
 (0)