Skip to content

Commit 554df8a

Browse files
authored
Revert "[compile][startup] Disable C++ compilation of symbolic shapes" (#22122)
Signed-off-by: Xiao Liu <[email protected]>
1 parent 73e1b9b commit 554df8a

File tree

1 file changed

+2
-9
lines changed

1 file changed

+2
-9
lines changed

vllm/compilation/decorators.py

Lines changed: 2 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -267,15 +267,8 @@ def patched_inline_call(parent, func, args, kwargs):
267267
code.co_filename)
268268
return inline_call(parent, func, args, kwargs)
269269

270-
# Disable the C++ compilation of symbolic shape guards. C++-fication
271-
# of symbolic shape guards can improve guard overhead. But, since
272-
# vllm skip guards anyways, setting this flag to False can improve
273-
# compile time.
274-
with torch._dynamo.config.patch("enable_cpp_symbolic_shape_guards",
275-
False), patch.object(
276-
InliningInstructionTranslator,
277-
'inline_call',
278-
patched_inline_call):
270+
with patch.object(InliningInstructionTranslator, 'inline_call',
271+
patched_inline_call):
279272
output = self.compiled_callable(*args, **kwargs)
280273
return output
281274

0 commit comments

Comments
 (0)