Skip to content

Conversation

@tolgacangoz
Copy link

@tolgacangoz tolgacangoz commented Mar 12, 2025

I am quite new in video models and just started to read the finetrainers' codebase yesterday. So, this PR is open to all types of collabs 🤝

https://huggingface.co/docs/diffusers/main/en/api/pipelines/hunyuan_video
Tencent/HunyuanVideo-I2V#-news
Tencent/HunyuanVideo-I2V@main/train_image2video_lora.py

Copy link
Contributor

@a-r-r-o-w a-r-r-o-w left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @tolgacangoz! I believe the PR currently enables validation when an image is provided. However, it still will not work due to the transformer model for I2V task being different from T2V task.

Training support will require writing a new full model specification I believe (not sure if you had that planned and this is too early for a review 😅, so sorry if I'm being stupid)

@tolgacangoz tolgacangoz changed the title Add support for hunyuan-i2v withdrawn Mar 13, 2025
@tolgacangoz tolgacangoz deleted the hunyuan-i2v-training branch March 13, 2025 14:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants