Skip to content

Commit e48419f

Browse files
authored
[llm] See what happens if we export with max_seq_len
See if any CI is broken by this.
1 parent e5511ce commit e48419f

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

extension/llm/export/builder.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -180,7 +180,7 @@ def _get_dynamic_shape(self) -> Any:
180180
if self.dynamic_shapes:
181181
return self.dynamic_shapes
182182

183-
dim = torch.export.Dim("token_dim", max=self.max_seq_len - 1)
183+
dim = torch.export.Dim("token_dim", max=self.max_seq_len)
184184
if self.enable_dynamic_shape:
185185
if not self.use_kv_cache:
186186
# Only one input argument: tokens

0 commit comments

Comments
 (0)