Skip to content

[Bug]: CUDA error: device-side assert triggered with long prompts in T2I script #134

@Jaguar156

Description

@Jaguar156

Hello, and thanks for the great work on OmniGen2!

I am trying OmniGen2 example_t2i.sh with custom prompt input. However, I found that when the prompt is too long (e.g. 2k length), it would trigger CUDA error: device-side assert triggered at this line.

This issue appears to be related to a maximum token limit for the input prompts. Could you please provide some guidance on this? Is there a recommended method to handle longer prompts, or is this an inherent limitation of the current model architecture?

Thanks a lot!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions