Skip to content

Commit 58183e9

Browse files
committed
Update example to remove dimensions
Signed-off-by: quic-sanising <sanising@qti.qualcomm.com>
1 parent 3e6208f commit 58183e9

File tree

1 file changed

+7
-7
lines changed

1 file changed

+7
-7
lines changed

examples/image_text_to_text/models/qwen_vl/multi_specialization_inference.py

Lines changed: 7 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -79,19 +79,19 @@
7979

8080
else:
8181
batch_size = 1
82-
ctx_len = 5120
83-
84-
## The dimensions list stores all the height × width pairs required for compilation ##
85-
dimensions = [[354, 536], [180, 320], [240, 360], [120, 360]]
82+
ctx_len = 14336
83+
heights = [360, 320, 360, 454, 536, 640, 720, 910, 720, 1280, 1920]
84+
widths = [120, 180, 240, 256, 354, 360, 480, 512, 576, 720, 1080]
8685

8786
## Vision + Text ##
8887
qeff_model.compile(
8988
batch_size=batch_size,
9089
prefill_seq_len=128,
91-
ctx_len=5120,
90+
ctx_len=ctx_len,
9291
num_cores=16,
93-
num_devices=8,
94-
dimensions=dimensions,
92+
num_devices=2,
93+
height=heights,
94+
width=widths,
9595
mxfp6_matmul=True,
9696
mxint8_kv_cache=True,
9797
aic_enable_depth_first=True,

0 commit comments

Comments
 (0)