Skip to content

Commit 9f8d1ff

Browse files
committed
fix trtllm-gen break by a check
1 parent 261782c commit 9f8d1ff

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

flashinfer/prefill.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2096,7 +2096,8 @@ def run(
20962096
lse=lse,
20972097
)
20982098
else:
2099-
assert self._plan_info is not None, "plan info is not initialized"
2099+
if self._backend == "cudnn":
2100+
assert self._plan_info is not None, "plan info is not initialized"
21002101
run_args = [
21012102
self._float_workspace_buffer,
21022103
self._int_workspace_buffer,

0 commit comments

Comments
 (0)