Skip to content

Commit e03f989

Browse files
authored
Fix sliding window + compile bug (#666)
1 parent 902a68c commit e03f989

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

server/lorax_server/utils/attention/common.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -49,5 +49,5 @@ def __init__(
4949
self.max_k = max_k
5050

5151
def clamp(self, max):
52-
self.input_lengths = torch.clamp(self.input_lengths, max=max)
52+
self.input_lengths.data.clamp_(max=max)
5353
return self

0 commit comments

Comments
 (0)