Which version of clip-vit-large-patch14 is used?

[attnmamba]

Does Bakllava checkpoints uses openai/clip-vit-large-patch14 or openai/clip-vit-large-patch14-336 as the vision tower?

In finetune_lora.sh, it uses --vision_tower openai/clip-vit-large-patch14.

In finetune.sh, it uses --vision_tower openai/clip-vit-large-patch14-336.

[floschne]

@pharaouk , do you have any updates here?

[pharaouk]

--vision_tower openai/clip-vit-large-patch14-336