Skip to content

Conversation

@openvino-dev-samples
Copy link
Contributor

No description provided.

return super().generate(input_name, framework, int_dtype, float_dtype)

@register_in_tasks_manager(
"qwen3_vl_text",
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the addition @openvino-dev-samples, qwen3_vl will only be available in the next release of transformers (not available in the latest release), and we will need to support this version in optimum-intel before we can merge this PR

Comment on lines 31 to 32
"optimum==1.27.*",
"transformers>=4.45,<4.56",
"optimum",
"transformers>=4.36",
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since optimum and optimum-intel do not support transformers 4.57 currently, this PR is a Draft, and it only works with my personal repo of Transformers and Optimum.
You can reproduce the model export and inference with following steps:

pip install torch torchvision --index-url https://download.pytorch.org/whl/cpu
pip install git+https://github.com/openvino-dev-samples/optimum.git@qwen3vl
pip install git+https://github.com/openvino-dev-samples/transformers.git@qwen3vl
pip install git+https://github.com/openvino-dev-samples/optimum-intel.git@qwen3vl

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants