- 
                Notifications
    You must be signed in to change notification settings 
- Fork 150
[OpenVINO][Draft]Add Qwen3VL and Qwen3VL-MOE #1452
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
[OpenVINO][Draft]Add Qwen3VL and Qwen3VL-MOE #1452
Conversation
This reverts commit 8e7cdd2.
055dd56    to
    3cb4e20      
    Compare
  
    | return super().generate(input_name, framework, int_dtype, float_dtype) | ||
|  | ||
| @register_in_tasks_manager( | ||
| "qwen3_vl_text", | 
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for the addition @openvino-dev-samples, qwen3_vl will only be available in the next release of transformers (not available in the latest release), and we will need to support this version in optimum-intel before we can merge this PR
| "optimum==1.27.*", | ||
| "transformers>=4.45,<4.56", | ||
| "optimum", | ||
| "transformers>=4.36", | 
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
why?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Since optimum and optimum-intel do not support transformers 4.57 currently, this PR is a Draft, and it only works with my personal repo of Transformers and Optimum.
You can reproduce the model export and inference with following steps:
pip install torch torchvision --index-url https://download.pytorch.org/whl/cpu
pip install git+https://github.com/openvino-dev-samples/optimum.git@qwen3vl
pip install git+https://github.com/openvino-dev-samples/transformers.git@qwen3vl
pip install git+https://github.com/openvino-dev-samples/optimum-intel.git@qwen3vl
No description provided.