-
Notifications
You must be signed in to change notification settings - Fork 34
Description
when I using https://github.com/showlab/UniVTG/blob/main/model.md this checkpoint (in below picture)

and run with qfvs downstream tasks
I meet the issue:
First of all, there is no batch size dimension when doing UniVTG forward, so it goes smoothly.
But at some point, it suddenly turn into 4 dimension with batch size dimension in the first, so it stuck at concat step
https://github.com/showlab/UniVTG/blob/main/model/univtg.py#L119
https://github.com/showlab/UniVTG/blob/main/main/dataset_qfvs.py#L253C6-L253C6
with this error: RuntimeError: Tensors must have same number of dimensions: got 3 and 4
I wonder if is there any wrong with my script, and I use the QFVS data in https://github.com/showlab/UniVTG/blob/main/install.md
Here is my script (rename it, otherwise it cannot be uploaded)
qfvs_pretrain.txt
Thank you for your kind support!