Skip to content

Will the reference delta value harms base model's editing ability? #48

@cxzhou35

Description

@cxzhou35

Hi,
Thanks for open-sourcing this great work, I'm curious about the 3D RoPE modification to the Flux.1 Kontext model.

I noticed that you change the first dim of the image_ids to 1+delta[0], but in the pretraining stage, the model only accepted the value with 0 or 1, if you change to other value, may the model can't imagine the meaning of this value? Thus harms the base model's editing ability?

code snippets: https://github.com/Saquib764/omini-kontext/blob/main/src/pipeline_flux_omini_kontext.py#L748-L751

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions