Skip to content

Commit 3a49b47

Browse files
authored
[https://nvbugs/5390853][fix] Fix _test_openai_lora.py - disable cuda graph (NVIDIA#6965)
Signed-off-by: Amit Zuker <[email protected]>
1 parent cc6d763 commit 3a49b47

File tree

1 file changed

+4
-1
lines changed

1 file changed

+4
-1
lines changed

tests/unittest/llmapi/apps/_test_openai_lora.py

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -39,7 +39,10 @@ def temp_extra_llm_api_options_file():
3939
"max_lora_rank": 8,
4040
"max_loras": 4,
4141
"max_cpu_loras": 4,
42-
}
42+
},
43+
# Disable CUDA graph
44+
# TODO: remove this once we have a proper fix for CUDA graph in LoRA
45+
"cuda_graph_config": None
4346
}
4447

4548
with open(temp_file_path, 'w') as f:

0 commit comments

Comments
 (0)