fix isssues

xadupre · xadupre · commit 2a654ea747b3 · 2025-06-25T17:45:10.000+02:00
diff --git a/onnx_diagnostic/tasks/text_generation.py b/onnx_diagnostic/tasks/text_generation.py
@@ -206,7 +206,7 @@ def get_inputs(
                         )
                         for i in range(num_hidden_layers)
                     ],
-                    max_cache_len=max(sequence_length + sequence_length2 * 2, 100),
+                    max_cache_len=max(sequence_length + sequence_length2, head_dim),
                 ),
             )
         else:

Original file line number	Diff line number	Diff line change
`@@ -206,7 +206,7 @@ def get_inputs(`
`206`	`206`	`)`
`207`	`207`	`for i in range(num_hidden_layers)`
`208`	`208`	`],`
`209`		`- max_cache_len=max(sequence_length + sequence_length2 * 2, 100),`
	`209`	`+ max_cache_len=max(sequence_length + sequence_length2, head_dim),`
`210`	`210`	`),`
`211`	`211`	`)`
`212`	`212`	`else:`