Commit a8a008d
authored
Fix for CB incosistency for qwen2_5_vl (#765)
For Qwen2_5_vl the `decode_inputs["position_ids"][decode_batch_id]` is
of size (4,1) and the code was only updating the pos_ids of last index
of last array. Therefore, changing it to update the last idx of all
arrays of all the batches.
---------
Signed-off-by: asmigosw <asmigosw@qti.qualcomm.com>1 parent 4bd2239 commit a8a008d
1 file changed
+1
-1
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
956 | 956 | | |
957 | 957 | | |
958 | 958 | | |
959 | | - | |
| 959 | + | |
960 | 960 | | |
961 | 961 | | |
962 | 962 | | |
| |||
0 commit comments