Skip to content

Commit a00d625

Browse files
[compile] Disable dynamo guards check for AOT compilation. (#27288)
Signed-off-by: zhxchen17 <[email protected]> Co-authored-by: Cyrus Leung <[email protected]>
1 parent 05181cc commit a00d625

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

vllm/compilation/decorators.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -302,6 +302,7 @@ def __call__(self, *args, **kwargs):
302302
start_monitoring_torch_compile(self.vllm_config)
303303
loaded_fn = torch.compiler.load_compiled_function(f)
304304
_verify_source_unchanged(loaded_fn.source_info(), self.vllm_config)
305+
loaded_fn.disable_guard_check()
305306
self.aot_compiled_fn = loaded_fn
306307
except Exception as e:
307308
if os.path.exists(aot_compilation_path):

0 commit comments

Comments
 (0)