Skip to content

Commit 46b781c

Browse files
xiao-llmamd-xiaoyu12
authored andcommitted
Update envs.py
1 parent e518485 commit 46b781c

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

vllm/envs.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1181,8 +1181,8 @@ def get_vllm_port() -> Optional[int]:
11811181
<<<<<<< HEAD
11821182
=======
11831183
# If set, use the fp8 mfma in rocm paged attention.
1184-
"VLLM_ROCM_USE_FP8_PAGED_ATTN":
1185-
lambda: bool(int(os.getenv("VLLM_USE_FP8_MFMA", "0"))),
1184+
"VLLM_ROCM_FP8_MFMA_PAGE_ATTN":
1185+
lambda: bool(int(os.getenv("VLLM_ROCM_FP8_MFMA_PAGE_ATTN", "0"))),
11861186

11871187
>>>>>>> c588bf50e (Update vllm/envs.py)
11881188
# Whether to use pytorch symmetric memory for allreduce

0 commit comments

Comments
 (0)