Skip to content

Commit 7099621

Browse files
rootroot
authored andcommitted
perf: make MSE observer compatible with torch.compile
- Replace patch_attr context manager with pre-created token_args - Replace data-dependent control flow (torch.any + early stopping) with torch.where - MSE observer now passes torch.compile fullgraph=True - Benchmark: 39x speedup with inductor backend Partial fix for #1485
1 parent 36c30ee commit 7099621

File tree

1 file changed

+234
-236
lines changed
  • src/llmcompressor/observers

1 file changed

+234
-236
lines changed

0 commit comments

Comments
 (0)