Skip to content

LoRA loading compatibility with some Qwen Image LoRAsΒ #12159

@apolinario

Description

@apolinario

Describe the bug

Some Qwen Image LoRAs are not compatible with diffusers.

e.g.: https://huggingface.co/itspoidaman/qwenglitch

Reproduction

with load_lora_weights from https://huggingface.co/itspoidaman/qwenglitch we get:

ValueError: Target modules {'lora_unet_transformer_blocks_59_attn_to_add_out', 'lora_unet_transformer_blocks_27_attn_add_k_proj', 'lora_unet_transformer_blocks_3_txt_mod_1', 'lora_unet_transformer_blocks_26_attn_to_k', 'lora_unet_transformer_blocks_47_attn_to_q', 'lora_unet_transformer_blocks_53_attn_to_k', 'lora_unet_transformer_blocks_19_attn_to_v', 'lora_unet_transformer_blocks_31_attn_add_k_proj', 'lora_unet_transformer_blocks_11_txt_mlp_net_2', 'lora_unet_transformer_blocks_1_txt_mlp_net_2', 'lora_unet_transformer_blocks_39_txt_mlp_net_2', 'lora_unet_transformer_blocks_35_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_44_attn_to_v', 'lora_unet_transformer_blocks_55_attn_to_k', 'lora_unet_transformer_blocks_34_attn_add_q_proj', 'lora_unet_transformer_blocks_29_attn_to_q', 'lora_unet_transformer_blocks_3_attn_add_v_proj', 'lora_unet_transformer_blocks_41_attn_add_q_proj', 'lora_unet_transformer_blocks_2_attn_to_add_out', 'lora_unet_transformer_blocks_34_img_mod_1', 'lora_unet_transformer_blocks_39_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_10_attn_to_q', 'lora_unet_transformer_blocks_0_attn_to_add_out', 'lora_unet_transformer_blocks_17_attn_add_q_proj', 'lora_unet_transformer_blocks_25_attn_add_v_proj', 'lora_unet_transformer_blocks_15_txt_mlp_net_2', 'lora_unet_transformer_blocks_23_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_49_txt_mlp_net_2', 'lora_unet_transformer_blocks_40_txt_mod_1', 'lora_unet_transformer_blocks_56_txt_mlp_net_2', 'lora_unet_transformer_blocks_6_attn_to_k', 'lora_unet_transformer_blocks_15_attn_to_q', 'lora_unet_transformer_blocks_40_attn_to_out_0', 'lora_unet_transformer_blocks_12_img_mlp_net_2', 'lora_unet_transformer_blocks_56_attn_to_out_0', 'lora_unet_transformer_blocks_43_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_6_attn_add_q_proj', 'lora_unet_transformer_blocks_13_attn_add_v_proj', 'lora_unet_transformer_blocks_28_attn_add_q_proj', 'lora_unet_transformer_blocks_48_img_mod_1', 'lora_unet_transformer_blocks_3_txt_mlp_net_2', 'lora_unet_transformer_blocks_49_attn_to_add_out', 'lora_unet_transformer_blocks_56_attn_add_q_proj', 'lora_unet_transformer_blocks_37_txt_mlp_net_2', 'lora_unet_transformer_blocks_34_attn_to_add_out', 'lora_unet_transformer_blocks_23_txt_mlp_net_2', 'lora_unet_transformer_blocks_58_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_5_attn_add_q_proj', 'lora_unet_transformer_blocks_16_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_57_attn_add_q_proj', 'lora_unet_transformer_blocks_42_attn_to_k', 'lora_unet_transformer_blocks_9_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_9_attn_to_add_out', 'lora_unet_transformer_blocks_32_img_mod_1', 'lora_unet_transformer_blocks_30_txt_mod_1', 'lora_unet_transformer_blocks_45_img_mlp_net_2', 'lora_unet_transformer_blocks_5_attn_to_v', 'lora_unet_transformer_blocks_44_img_mod_1', 'lora_unet_transformer_blocks_39_attn_to_v', 'lora_unet_transformer_blocks_35_txt_mod_1', 'lora_unet_transformer_blocks_22_attn_to_v', 'lora_unet_transformer_blocks_10_img_mlp_net_2', 'lora_unet_transformer_blocks_28_attn_to_out_0', 'lora_unet_transformer_blocks_24_txt_mlp_net_2', 'lora_unet_transformer_blocks_1_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_58_img_mlp_net_2', 'lora_unet_transformer_blocks_37_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_6_attn_to_v', 'lora_unet_transformer_blocks_20_attn_add_v_proj', 'lora_unet_transformer_blocks_37_attn_add_q_proj', 'lora_unet_transformer_blocks_31_attn_to_v', 'lora_unet_transformer_blocks_49_attn_add_v_proj', 'lora_unet_transformer_blocks_5_txt_mod_1', 'lora_unet_transformer_blocks_9_img_mod_1', 'lora_unet_transformer_blocks_12_txt_mlp_net_2', 'lora_unet_transformer_blocks_6_attn_to_out_0', 'lora_unet_transformer_blocks_11_attn_to_v', 'lora_unet_transformer_blocks_20_attn_to_out_0', 'lora_unet_transformer_blocks_46_attn_to_add_out', 'lora_unet_transformer_blocks_36_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_12_attn_to_v', 'lora_unet_transformer_blocks_19_attn_to_out_0', 'lora_unet_transformer_blocks_31_txt_mod_1', 'lora_unet_transformer_blocks_51_attn_to_out_0', 'lora_unet_transformer_blocks_50_attn_to_add_out', 'lora_unet_transformer_blocks_6_attn_to_add_out', 'lora_unet_transformer_blocks_47_attn_add_v_proj', 'lora_unet_transformer_blocks_16_txt_mod_1', 'lora_unet_transformer_blocks_22_img_mlp_net_2', 'lora_unet_transformer_blocks_18_img_mlp_net_2', 'lora_unet_transformer_blocks_5_attn_to_q', 'lora_unet_transformer_blocks_0_attn_add_q_proj', 'lora_unet_transformer_blocks_3_attn_to_add_out', 'lora_unet_transformer_blocks_12_attn_add_q_proj', 'lora_unet_transformer_blocks_51_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_18_txt_mlp_net_2', 'lora_unet_transformer_blocks_57_attn_to_k', 'lora_unet_transformer_blocks_19_attn_add_q_proj', 'lora_unet_transformer_blocks_33_img_mod_1', 'lora_unet_transformer_blocks_1_attn_to_v', 'lora_unet_transformer_blocks_14_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_22_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_43_img_mlp_net_2', 'lora_unet_transformer_blocks_22_attn_add_v_proj', 'lora_unet_transformer_blocks_8_attn_add_v_proj', 'lora_unet_transformer_blocks_15_attn_to_v', 'lora_unet_transformer_blocks_16_attn_to_add_out', 'lora_unet_transformer_blocks_51_txt_mlp_net_2', 'lora_unet_transformer_blocks_1_attn_add_q_proj', 'lora_unet_transformer_blocks_43_attn_add_q_proj', 'lora_unet_transformer_blocks_13_attn_to_v', 'lora_unet_transformer_blocks_57_img_mlp_net_2', 'lora_unet_transformer_blocks_30_attn_to_q', 'lora_unet_transformer_blocks_9_attn_to_q', 'lora_unet_transformer_blocks_6_img_mod_1', 'lora_unet_transformer_blocks_3_attn_to_v', 'lora_unet_transformer_blocks_53_img_mod_1', 'lora_unet_transformer_blocks_50_attn_to_k', 'lora_unet_transformer_blocks_8_attn_to_out_0', 'lora_unet_transformer_blocks_10_img_mod_1', 'lora_unet_transformer_blocks_0_attn_to_v', 'lora_unet_transformer_blocks_4_txt_mlp_net_2', 'lora_unet_transformer_blocks_54_attn_add_v_proj', 'lora_unet_transformer_blocks_9_txt_mlp_net_2', 'lora_unet_transformer_blocks_46_attn_to_out_0', 'lora_unet_transformer_blocks_26_attn_add_q_proj', 'lora_unet_transformer_blocks_11_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_21_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_23_txt_mod_1', 'lora_unet_transformer_blocks_41_attn_to_v', 'lora_unet_transformer_blocks_42_attn_to_add_out', 'lora_unet_transformer_blocks_2_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_6_attn_add_k_proj', 'lora_unet_transformer_blocks_19_attn_add_v_proj', 'lora_unet_transformer_blocks_45_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_31_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_27_img_mod_1', 'lora_unet_transformer_blocks_2_attn_add_k_proj', 'lora_unet_transformer_blocks_37_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_18_attn_to_out_0', 'lora_unet_transformer_blocks_27_attn_to_v', 'lora_unet_transformer_blocks_36_txt_mod_1', 'lora_unet_transformer_blocks_9_attn_add_k_proj', 'lora_unet_transformer_blocks_42_attn_to_q', 'lora_unet_transformer_blocks_30_attn_add_k_proj', 'lora_unet_transformer_blocks_3_attn_to_out_0', 'lora_unet_transformer_blocks_46_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_21_img_mod_1', 'lora_unet_transformer_blocks_30_attn_add_q_proj', 'lora_unet_transformer_blocks_34_txt_mlp_net_2', 'lora_unet_transformer_blocks_28_img_mlp_net_2', 'lora_unet_transformer_blocks_50_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_5_attn_add_k_proj', 'lora_unet_transformer_blocks_52_img_mod_1', 'lora_unet_transformer_blocks_15_attn_to_out_0', 'lora_unet_transformer_blocks_2_img_mlp_net_2', 'lora_unet_transformer_blocks_38_attn_to_q', 'lora_unet_transformer_blocks_5_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_10_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_3_img_mod_1', 'lora_unet_transformer_blocks_11_attn_to_q', 'lora_unet_transformer_blocks_30_img_mod_1', 'lora_unet_transformer_blocks_31_img_mlp_net_2', 'lora_unet_transformer_blocks_25_txt_mod_1', 'lora_unet_transformer_blocks_52_attn_add_q_proj', 'lora_unet_transformer_blocks_53_attn_to_add_out', 'lora_unet_transformer_blocks_2_txt_mlp_net_2', 'lora_unet_transformer_blocks_34_txt_mod_1', 'lora_unet_transformer_blocks_48_txt_mod_1', 'lora_unet_transformer_blocks_59_attn_to_k', 'lora_unet_transformer_blocks_32_attn_to_v', 'lora_unet_transformer_blocks_32_attn_add_v_proj', 'lora_unet_transformer_blocks_10_attn_to_add_out', 'lora_unet_transformer_blocks_32_img_mlp_net_2', 'lora_unet_transformer_blocks_59_attn_to_out_0', 'lora_unet_transformer_blocks_19_img_mod_1', 'lora_unet_transformer_blocks_49_txt_mod_1', 'lora_unet_transformer_blocks_6_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_44_txt_mlp_net_2', 'lora_unet_transformer_blocks_0_txt_mlp_net_2', 'lora_unet_transformer_blocks_38_attn_to_out_0', 'lora_unet_transformer_blocks_33_attn_add_q_proj', 'lora_unet_transformer_blocks_1_attn_to_out_0', 'lora_unet_transformer_blocks_4_attn_to_out_0', 'lora_unet_transformer_blocks_46_attn_add_v_proj', 'lora_unet_transformer_blocks_22_txt_mod_1', 'lora_unet_transformer_blocks_59_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_42_attn_add_q_proj', 'lora_unet_transformer_blocks_39_attn_add_v_proj', 'lora_unet_transformer_blocks_5_attn_to_k', 'lora_unet_transformer_blocks_10_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_38_attn_add_q_proj', 'lora_unet_transformer_blocks_29_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_0_attn_to_q', 'lora_unet_transformer_blocks_19_img_mlp_net_2', 'lora_unet_transformer_blocks_41_attn_to_add_out', 'lora_unet_transformer_blocks_11_txt_mod_1', 'lora_unet_transformer_blocks_18_attn_add_k_proj', 'lora_unet_transformer_blocks_29_attn_to_add_out', 'lora_unet_transformer_blocks_2_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_57_attn_to_add_out', 'lora_unet_transformer_blocks_57_attn_to_q', 'lora_unet_transformer_blocks_58_attn_add_v_proj', 'lora_unet_transformer_blocks_55_attn_to_add_out', 'lora_unet_transformer_blocks_54_attn_to_add_out', 'lora_unet_transformer_blocks_3_attn_add_q_proj', 'lora_unet_transformer_blocks_40_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_51_attn_to_k', 'lora_unet_transformer_blocks_49_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_50_attn_add_k_proj', 'lora_unet_transformer_blocks_7_img_mlp_net_2', 'lora_unet_transformer_blocks_14_attn_add_v_proj', 'lora_unet_transformer_blocks_16_attn_to_v', 'lora_unet_transformer_blocks_33_attn_add_k_proj', 'lora_unet_transformer_blocks_48_attn_add_q_proj', 'lora_unet_transformer_blocks_48_attn_to_v', 'lora_unet_transformer_blocks_49_attn_add_k_proj', 'lora_unet_transformer_blocks_24_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_41_txt_mlp_net_2', 'lora_unet_transformer_blocks_51_attn_add_k_proj', 'lora_unet_transformer_blocks_24_attn_add_v_proj', 'lora_unet_transformer_blocks_27_attn_to_q', 'lora_unet_transformer_blocks_9_attn_add_v_proj', 'lora_unet_transformer_blocks_53_attn_to_q', 'lora_unet_transformer_blocks_44_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_54_attn_to_out_0', 'lora_unet_transformer_blocks_7_attn_add_v_proj', 'lora_unet_transformer_blocks_43_img_mod_1', 'lora_unet_transformer_blocks_4_img_mod_1', 'lora_unet_transformer_blocks_41_img_mod_1', 'lora_unet_transformer_blocks_18_attn_add_v_proj', 'lora_unet_transformer_blocks_44_attn_to_q', 'lora_unet_transformer_blocks_54_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_9_attn_to_v', 'lora_unet_transformer_blocks_21_attn_add_q_proj', 'lora_unet_transformer_blocks_57_attn_to_v', 'lora_unet_transformer_blocks_7_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_43_attn_add_v_proj', 'lora_unet_transformer_blocks_20_txt_mod_1', 'lora_unet_transformer_blocks_32_attn_add_q_proj', 'lora_unet_transformer_blocks_20_attn_add_q_proj', 'lora_unet_transformer_blocks_2_attn_to_v', 'lora_unet_transformer_blocks_21_attn_add_k_proj', 'lora_unet_transformer_blocks_2_attn_to_k', 'lora_unet_transformer_blocks_37_attn_to_add_out', 'lora_unet_transformer_blocks_16_attn_add_v_proj', 'lora_unet_transformer_blocks_19_attn_to_q', 'lora_unet_transformer_blocks_1_attn_add_k_proj', 'lora_unet_transformer_blocks_20_attn_to_q', 'lora_unet_transformer_blocks_30_attn_add_v_proj', 'lora_unet_transformer_blocks_40_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_57_txt_mlp_net_2', 'lora_unet_transformer_blocks_12_attn_to_out_0', 'lora_unet_transformer_blocks_25_attn_to_add_out', 'lora_unet_transformer_blocks_53_attn_to_out_0', 'lora_unet_transformer_blocks_5_img_mlp_net_2', 'lora_unet_transformer_blocks_24_attn_to_q', 'lora_unet_transformer_blocks_37_attn_add_k_proj', 'lora_unet_transformer_blocks_35_img_mod_1', 'lora_unet_transformer_blocks_50_attn_add_v_proj', 'lora_unet_transformer_blocks_1_img_mod_1', 'lora_unet_transformer_blocks_53_img_mlp_net_2', 'lora_unet_transformer_blocks_39_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_15_attn_add_q_proj', 'lora_unet_transformer_blocks_18_attn_add_q_proj', 'lora_unet_transformer_blocks_23_attn_to_add_out', 'lora_unet_transformer_blocks_43_attn_to_add_out', 'lora_unet_transformer_blocks_8_attn_to_add_out', 'lora_unet_transformer_blocks_58_attn_add_q_proj', 'lora_unet_transformer_blocks_3_attn_add_k_proj', 'lora_unet_transformer_blocks_21_attn_to_q', 'lora_unet_transformer_blocks_4_txt_mod_1', 'lora_unet_transformer_blocks_23_attn_add_k_proj', 'lora_unet_transformer_blocks_18_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_56_txt_mod_1', 'lora_unet_transformer_blocks_10_attn_add_q_proj', 'lora_unet_transformer_blocks_13_attn_to_add_out', 'lora_unet_transformer_blocks_27_txt_mlp_net_2', 'lora_unet_transformer_blocks_54_attn_to_k', 'lora_unet_transformer_blocks_15_attn_to_k', 'lora_unet_transformer_blocks_21_txt_mod_1', 'lora_unet_transformer_blocks_19_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_35_attn_to_q', 'lora_unet_transformer_blocks_43_attn_to_out_0', 'lora_unet_transformer_blocks_20_attn_to_v', 'lora_unet_transformer_blocks_56_attn_add_k_proj', 'lora_unet_transformer_blocks_13_attn_to_q', 'lora_unet_transformer_blocks_14_txt_mod_1', 'lora_unet_transformer_blocks_30_attn_to_v', 'lora_unet_transformer_blocks_51_attn_add_v_proj', 'lora_unet_transformer_blocks_49_img_mod_1', 'lora_unet_transformer_blocks_42_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_55_txt_mod_1', 'lora_unet_transformer_blocks_46_attn_add_q_proj', 'lora_unet_transformer_blocks_47_img_mlp_net_2', 'lora_unet_transformer_blocks_0_attn_to_out_0', 'lora_unet_transformer_blocks_18_attn_to_add_out', 'lora_unet_transformer_blocks_3_attn_to_q', 'lora_unet_transformer_blocks_0_attn_to_k', 'lora_unet_transformer_blocks_16_img_mlp_net_2', 'lora_unet_transformer_blocks_35_attn_add_k_proj', 'lora_unet_transformer_blocks_47_attn_add_q_proj', 'lora_unet_transformer_blocks_52_attn_add_v_proj', 'lora_unet_transformer_blocks_28_attn_add_k_proj', 'lora_unet_transformer_blocks_56_attn_to_q', 'lora_unet_transformer_blocks_59_attn_to_q', 'lora_unet_transformer_blocks_7_txt_mod_1', 'lora_unet_transformer_blocks_39_img_mod_1', 'lora_unet_transformer_blocks_17_img_mod_1', 'lora_unet_transformer_blocks_32_attn_add_k_proj', 'lora_unet_transformer_blocks_21_attn_to_k', 'lora_unet_transformer_blocks_5_attn_add_v_proj', 'lora_unet_transformer_blocks_36_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_38_attn_to_add_out', 'lora_unet_transformer_blocks_38_img_mlp_net_2', 'lora_unet_transformer_blocks_45_txt_mlp_net_2', 'lora_unet_transformer_blocks_27_attn_to_k', 'lora_unet_transformer_blocks_50_txt_mod_1', 'lora_unet_transformer_blocks_44_attn_add_k_proj', 'lora_unet_transformer_blocks_4_img_mlp_net_2', 'lora_unet_transformer_blocks_23_img_mod_1', 'lora_unet_transformer_blocks_50_attn_add_q_proj', 'lora_unet_transformer_blocks_25_img_mod_1', 'lora_unet_transformer_blocks_2_attn_to_q', 'lora_unet_transformer_blocks_43_attn_add_k_proj', 'lora_unet_transformer_blocks_48_attn_to_q', 'lora_unet_transformer_blocks_26_attn_to_out_0', 'lora_unet_transformer_blocks_29_attn_to_out_0', 'lora_unet_transformer_blocks_58_attn_to_v', 'lora_unet_transformer_blocks_33_attn_to_v', 'lora_unet_transformer_blocks_50_txt_mlp_net_2', 'lora_unet_transformer_blocks_7_attn_to_v', 'lora_unet_transformer_blocks_5_attn_to_add_out', 'lora_unet_transformer_blocks_30_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_50_attn_to_out_0', 'lora_unet_transformer_blocks_5_txt_mlp_net_2', 'lora_unet_transformer_blocks_51_attn_to_v', 'lora_unet_transformer_blocks_43_attn_to_v', 'lora_unet_transformer_blocks_44_img_mlp_net_2', 'lora_unet_transformer_blocks_50_attn_to_v', 'lora_unet_transformer_blocks_29_attn_add_k_proj', 'lora_unet_transformer_blocks_17_attn_to_q', 'lora_unet_transformer_blocks_33_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_46_attn_to_q', 'lora_unet_transformer_blocks_59_txt_mlp_net_2', 'lora_unet_transformer_blocks_38_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_20_img_mlp_net_2', 'lora_unet_transformer_blocks_37_attn_to_v', 'lora_unet_transformer_blocks_51_attn_to_add_out', 'lora_unet_transformer_blocks_51_img_mod_1', 'lora_unet_transformer_blocks_32_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_28_attn_to_k', 'lora_unet_transformer_blocks_3_attn_to_k', 'lora_unet_transformer_blocks_35_attn_to_v', 'lora_unet_transformer_blocks_53_attn_to_v', 'lora_unet_transformer_blocks_13_img_mlp_net_2', 'lora_unet_transformer_blocks_59_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_40_attn_add_q_proj', 'lora_unet_transformer_blocks_59_img_mlp_net_2', 'lora_unet_transformer_blocks_21_attn_add_v_proj', 'lora_unet_transformer_blocks_53_attn_add_k_proj', 'lora_unet_transformer_blocks_45_attn_to_q', 'lora_unet_transformer_blocks_6_txt_mod_1', 'lora_unet_transformer_blocks_23_attn_to_v', 'lora_unet_transformer_blocks_25_attn_to_v', 'lora_unet_transformer_blocks_1_attn_to_q', 'lora_unet_transformer_blocks_16_img_mod_1', 'lora_unet_transformer_blocks_22_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_25_attn_to_out_0', 'lora_unet_transformer_blocks_54_attn_to_v', 'lora_unet_transformer_blocks_59_txt_mod_1', 'lora_unet_transformer_blocks_41_txt_mod_1', 'lora_unet_transformer_blocks_9_img_mlp_net_2', 'lora_unet_transformer_blocks_33_img_mlp_net_2', 'lora_unet_transformer_blocks_20_img_mod_1', 'lora_unet_transformer_blocks_26_attn_add_k_proj', 'lora_unet_transformer_blocks_44_attn_add_v_proj', 'lora_unet_transformer_blocks_2_img_mod_1', 'lora_unet_transformer_blocks_11_img_mod_1', 'lora_unet_transformer_blocks_37_txt_mod_1', 'lora_unet_transformer_blocks_42_img_mlp_net_2', 'lora_unet_transformer_blocks_22_attn_to_add_out', 'lora_unet_transformer_blocks_23_attn_to_out_0', 'lora_unet_transformer_blocks_39_attn_to_add_out', 'lora_unet_transformer_blocks_36_attn_to_q', 'lora_unet_transformer_blocks_35_attn_add_q_proj', 'lora_unet_transformer_blocks_31_attn_to_q', 'lora_unet_transformer_blocks_51_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_37_attn_to_out_0', 'lora_unet_transformer_blocks_14_txt_mlp_net_2', 'lora_unet_transformer_blocks_41_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_14_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_29_attn_to_v', 'lora_unet_transformer_blocks_55_img_mlp_net_2', 'lora_unet_transformer_blocks_8_attn_to_v', 'lora_unet_transformer_blocks_15_txt_mod_1', 'lora_unet_transformer_blocks_46_img_mod_1', 'lora_unet_transformer_blocks_47_attn_to_v', 'lora_unet_transformer_blocks_6_txt_mlp_net_2', 'lora_unet_transformer_blocks_1_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_29_txt_mod_1', 'lora_unet_transformer_blocks_4_attn_to_q', 'lora_unet_transformer_blocks_10_attn_add_v_proj', 'lora_unet_transformer_blocks_14_attn_add_q_proj', 'lora_unet_transformer_blocks_31_txt_mlp_net_2', 'lora_unet_transformer_blocks_48_txt_mlp_net_2', 'lora_unet_transformer_blocks_27_attn_add_v_proj', 'lora_unet_transformer_blocks_22_attn_to_k', 'lora_unet_transformer_blocks_15_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_55_txt_mlp_net_2', 'lora_unet_transformer_blocks_31_attn_to_k', 'lora_unet_transformer_blocks_17_txt_mod_1', 'lora_unet_transformer_blocks_41_img_mlp_net_2', 'lora_unet_transformer_blocks_45_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_8_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_50_img_mlp_net_2', 'lora_unet_transformer_blocks_36_attn_add_v_proj', 'lora_unet_transformer_blocks_20_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_54_txt_mod_1', 'lora_unet_transformer_blocks_16_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_19_attn_to_k', 'lora_unet_transformer_blocks_1_attn_to_k', 'lora_unet_transformer_blocks_23_attn_to_q', 'lora_unet_transformer_blocks_45_attn_add_k_proj', 'lora_unet_transformer_blocks_56_attn_to_k', 'lora_unet_transformer_blocks_15_attn_to_add_out', 'lora_unet_transformer_blocks_39_attn_add_k_proj', 'lora_unet_transformer_blocks_16_attn_add_k_proj', 'lora_unet_transformer_blocks_25_img_mlp_net_2', 'lora_unet_transformer_blocks_39_img_mlp_net_2', 'lora_unet_transformer_blocks_53_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_54_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_54_txt_mlp_net_2', 'lora_unet_transformer_blocks_38_txt_mlp_net_2', 'lora_unet_transformer_blocks_8_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_13_attn_to_k', 'lora_unet_transformer_blocks_24_attn_to_add_out', 'lora_unet_transformer_blocks_31_img_mod_1', 'lora_unet_transformer_blocks_34_attn_to_out_0', 'lora_unet_transformer_blocks_11_img_mlp_net_2', 'lora_unet_transformer_blocks_52_attn_to_q', 'lora_unet_transformer_blocks_6_img_mlp_net_2', 'lora_unet_transformer_blocks_48_img_mlp_net_2', 'lora_unet_transformer_blocks_28_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_47_txt_mlp_net_2', 'lora_unet_transformer_blocks_59_attn_add_k_proj', 'lora_unet_transformer_blocks_57_attn_add_k_proj', 'lora_unet_transformer_blocks_28_txt_mod_1', 'lora_unet_transformer_blocks_22_attn_add_k_proj', 'lora_unet_transformer_blocks_48_attn_to_add_out', 'lora_unet_transformer_blocks_7_txt_mlp_net_2', 'lora_unet_transformer_blocks_16_txt_mlp_net_2', 'lora_unet_transformer_blocks_2_txt_mod_1', 'lora_unet_transformer_blocks_38_txt_mod_1', 'lora_unet_transformer_blocks_41_attn_to_k', 'lora_unet_transformer_blocks_49_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_55_attn_to_out_0', 'lora_unet_transformer_blocks_17_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_22_txt_mlp_net_2', 'lora_unet_transformer_blocks_26_attn_add_v_proj', 'lora_unet_transformer_blocks_45_attn_to_out_0', 'lora_unet_transformer_blocks_43_txt_mlp_net_2', 'lora_unet_transformer_blocks_36_txt_mlp_net_2', 'lora_unet_transformer_blocks_55_attn_add_q_proj', 'lora_unet_transformer_blocks_33_attn_add_v_proj', 'lora_unet_transformer_blocks_25_txt_mlp_net_2', 'lora_unet_transformer_blocks_14_attn_to_v', 'lora_unet_transformer_blocks_47_txt_mod_1', 'lora_unet_transformer_blocks_38_attn_add_v_proj', 'lora_unet_transformer_blocks_33_attn_to_k', 'lora_unet_transformer_blocks_32_attn_to_k', 'lora_unet_transformer_blocks_24_attn_to_out_0', 'lora_unet_transformer_blocks_54_img_mod_1', 'lora_unet_transformer_blocks_56_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_12_txt_mod_1', 'lora_unet_transformer_blocks_44_attn_add_q_proj', 'lora_unet_transformer_blocks_7_attn_add_k_proj', 'lora_unet_transformer_blocks_34_attn_to_q', 'lora_unet_transformer_blocks_32_txt_mlp_net_2', 'lora_unet_transformer_blocks_40_img_mod_1', 'lora_unet_transformer_blocks_24_attn_add_q_proj', 'lora_unet_transformer_blocks_14_img_mod_1', 'lora_unet_transformer_blocks_19_txt_mod_1', 'lora_unet_transformer_blocks_30_attn_to_out_0', 'lora_unet_transformer_blocks_18_txt_mod_1', 'lora_unet_transformer_blocks_21_img_mlp_net_2', 'lora_unet_transformer_blocks_24_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_34_attn_add_v_proj', 'lora_unet_transformer_blocks_33_txt_mod_1', 'lora_unet_transformer_blocks_32_attn_to_out_0', 'lora_unet_transformer_blocks_21_txt_mlp_net_2', 'lora_unet_transformer_blocks_13_attn_add_q_proj', 'lora_unet_transformer_blocks_46_txt_mod_1', 'lora_unet_transformer_blocks_9_attn_add_q_proj', 'lora_unet_transformer_blocks_28_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_10_txt_mlp_net_2', 'lora_unet_transformer_blocks_1_attn_to_add_out', 'lora_unet_transformer_blocks_47_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_15_img_mlp_net_2', 'lora_unet_transformer_blocks_32_txt_mod_1', 'lora_unet_transformer_blocks_46_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_5_attn_to_out_0', 'lora_unet_transformer_blocks_10_attn_to_out_0', 'lora_unet_transformer_blocks_24_img_mod_1', 'lora_unet_transformer_blocks_7_attn_to_add_out', 'lora_unet_transformer_blocks_14_attn_add_k_proj', 'lora_unet_transformer_blocks_57_img_mod_1', 'lora_unet_transformer_blocks_58_attn_to_add_out', 'lora_unet_transformer_blocks_0_attn_add_k_proj', 'lora_unet_transformer_blocks_29_img_mlp_net_2', 'lora_unet_transformer_blocks_36_attn_to_out_0', 'lora_unet_transformer_blocks_45_attn_to_v', 'lora_unet_transformer_blocks_37_img_mod_1', 'lora_unet_transformer_blocks_27_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_38_attn_add_k_proj', 'lora_unet_transformer_blocks_56_attn_add_v_proj', 'lora_unet_transformer_blocks_14_img_mlp_net_2', 'lora_unet_transformer_blocks_26_txt_mod_1', 'lora_unet_transformer_blocks_34_attn_to_k', 'lora_unet_transformer_blocks_3_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_28_attn_to_add_out', 'lora_unet_transformer_blocks_42_attn_to_out_0', 'lora_unet_transformer_blocks_55_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_0_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_23_attn_add_v_proj', 'lora_unet_transformer_blocks_29_attn_to_k', 'lora_unet_transformer_blocks_40_attn_add_v_proj', 'lora_unet_transformer_blocks_42_attn_add_v_proj', 'lora_unet_transformer_blocks_45_attn_to_add_out', 'lora_unet_transformer_blocks_25_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_57_attn_add_v_proj', 'lora_unet_transformer_blocks_44_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_28_attn_to_q', 'lora_unet_transformer_blocks_26_img_mlp_net_2', 'lora_unet_transformer_blocks_14_attn_to_out_0', 'lora_unet_transformer_blocks_19_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_54_attn_add_k_proj', 'lora_unet_transformer_blocks_40_attn_to_v', 'lora_unet_transformer_blocks_25_attn_add_q_proj', 'lora_unet_transformer_blocks_23_attn_to_k', 'lora_unet_transformer_blocks_42_txt_mlp_net_2', 'lora_unet_transformer_blocks_13_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_49_img_mlp_net_2', 'lora_unet_transformer_blocks_4_attn_to_v', 'lora_unet_transformer_blocks_4_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_29_attn_add_v_proj', 'lora_unet_transformer_blocks_1_txt_mod_1', 'lora_unet_transformer_blocks_28_img_mod_1', 'lora_unet_transformer_blocks_27_attn_add_q_proj', 'lora_unet_transformer_blocks_52_attn_to_v', 'lora_unet_transformer_blocks_51_attn_add_q_proj', 'lora_unet_transformer_blocks_34_attn_to_v', 'lora_unet_transformer_blocks_30_attn_to_add_out', 'lora_unet_transformer_blocks_28_txt_mlp_net_2', 'lora_unet_transformer_blocks_17_attn_to_k', 'lora_unet_transformer_blocks_49_attn_to_q', 'lora_unet_transformer_blocks_52_attn_to_out_0', 'lora_unet_transformer_blocks_10_attn_add_k_proj', 'lora_unet_transformer_blocks_8_attn_add_k_proj', 'lora_unet_transformer_blocks_33_attn_to_q', 'lora_unet_transformer_blocks_20_attn_add_k_proj', 'lora_unet_transformer_blocks_30_img_mlp_net_2', 'lora_unet_transformer_blocks_41_attn_to_q', 'lora_unet_transformer_blocks_43_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_46_attn_to_v', 'lora_unet_transformer_blocks_49_attn_to_k', 'lora_unet_transformer_blocks_32_attn_to_add_out', 'lora_unet_transformer_blocks_2_attn_add_v_proj', 'lora_unet_transformer_blocks_35_attn_add_v_proj', 'lora_unet_transformer_blocks_30_txt_mlp_net_2', 'lora_unet_transformer_blocks_10_attn_to_k', 'lora_unet_transformer_blocks_36_attn_to_k', 'lora_unet_transformer_blocks_12_attn_to_k', 'lora_unet_transformer_blocks_22_attn_to_out_0', 'lora_unet_transformer_blocks_45_attn_add_v_proj', 'lora_unet_transformer_blocks_57_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_23_attn_add_q_proj', 'lora_unet_transformer_blocks_49_attn_to_out_0', 'lora_unet_transformer_blocks_53_attn_add_v_proj', 'lora_unet_transformer_blocks_35_attn_to_add_out', 'lora_unet_transformer_blocks_44_attn_to_out_0', 'lora_unet_transformer_blocks_37_attn_to_q', 'lora_unet_transformer_blocks_19_attn_to_add_out', 'lora_unet_transformer_blocks_51_attn_to_q', 'lora_unet_transformer_blocks_3_img_mlp_net_2', 'lora_unet_transformer_blocks_35_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_33_attn_to_out_0', 'lora_unet_transformer_blocks_32_attn_to_q', 'lora_unet_transformer_blocks_56_img_mlp_net_2', 'lora_unet_transformer_blocks_13_img_mod_1', 'lora_unet_transformer_blocks_55_attn_to_q', 'lora_unet_transformer_blocks_13_txt_mod_1', 'lora_unet_transformer_blocks_56_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_47_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_26_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_52_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_4_attn_add_q_proj', 'lora_unet_transformer_blocks_17_attn_to_v', 'lora_unet_transformer_blocks_17_img_mlp_net_2', 'lora_unet_transformer_blocks_38_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_5_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_17_attn_to_out_0', 'lora_unet_transformer_blocks_21_attn_to_v', 'lora_unet_transformer_blocks_40_txt_mlp_net_2', 'lora_unet_transformer_blocks_12_attn_to_q', 'lora_unet_transformer_blocks_5_img_mod_1', 'lora_unet_transformer_blocks_4_attn_to_k', 'lora_unet_transformer_blocks_11_attn_to_out_0', 'lora_unet_transformer_blocks_57_txt_mod_1', 'lora_unet_transformer_blocks_44_txt_mod_1', 'lora_unet_transformer_blocks_44_attn_to_k', 'lora_unet_transformer_blocks_34_img_mlp_net_2', 'lora_unet_transformer_blocks_30_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_59_attn_to_v', 'lora_unet_transformer_blocks_31_attn_to_out_0', 'lora_unet_transformer_blocks_16_attn_to_q', 'lora_unet_transformer_blocks_58_attn_to_out_0', 'lora_unet_transformer_blocks_39_attn_to_q', 'lora_unet_transformer_blocks_36_attn_add_q_proj', 'lora_unet_transformer_blocks_9_attn_to_k', 'lora_unet_transformer_blocks_52_attn_add_k_proj', 'lora_unet_transformer_blocks_24_attn_to_k', 'lora_unet_transformer_blocks_3_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_55_attn_add_k_proj', 'lora_unet_transformer_blocks_41_attn_add_v_proj', 'lora_unet_transformer_blocks_6_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_12_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_52_txt_mod_1', 'lora_unet_transformer_blocks_7_attn_add_q_proj', 'lora_unet_transformer_blocks_35_attn_to_k', 'lora_unet_transformer_blocks_57_attn_to_out_0', 'lora_unet_transformer_blocks_51_img_mlp_net_2', 'lora_unet_transformer_blocks_36_img_mlp_net_2', 'lora_unet_transformer_blocks_17_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_58_txt_mlp_net_2', 'lora_unet_transformer_blocks_36_img_mod_1', 'lora_unet_transformer_blocks_27_attn_to_out_0', 'lora_unet_transformer_blocks_38_img_mod_1', 'lora_unet_transformer_blocks_16_attn_add_q_proj', 'lora_unet_transformer_blocks_18_attn_to_k', 'lora_unet_transformer_blocks_26_attn_to_add_out', 'lora_unet_transformer_blocks_42_attn_add_k_proj', 'lora_unet_transformer_blocks_47_img_mod_1', 'lora_unet_transformer_blocks_8_img_mlp_net_2', 'lora_unet_transformer_blocks_10_txt_mod_1', 'lora_unet_transformer_blocks_54_img_mlp_net_2', 'lora_unet_transformer_blocks_53_txt_mod_1', 'lora_unet_transformer_blocks_45_attn_to_k', 'lora_unet_transformer_blocks_58_attn_to_q', 'lora_unet_transformer_blocks_11_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_20_attn_to_k', 'lora_unet_transformer_blocks_20_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_34_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_31_attn_add_v_proj', 'lora_unet_transformer_blocks_21_attn_to_out_0', 'lora_unet_transformer_blocks_17_attn_add_v_proj', 'lora_unet_transformer_blocks_11_attn_add_q_proj', 'lora_unet_transformer_blocks_50_attn_to_q', 'lora_unet_transformer_blocks_41_attn_to_out_0', 'lora_unet_transformer_blocks_13_attn_add_k_proj', 'lora_unet_transformer_blocks_12_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_8_attn_to_q', 'lora_unet_transformer_blocks_1_img_mlp_net_2', 'lora_unet_transformer_blocks_52_img_mlp_net_2', 'lora_unet_transformer_blocks_47_attn_add_k_proj', 'lora_unet_transformer_blocks_18_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_0_attn_add_v_proj', 'lora_unet_transformer_blocks_17_attn_add_k_proj', 'lora_unet_transformer_blocks_24_attn_to_v', 'lora_unet_transformer_blocks_40_attn_to_add_out', 'lora_unet_transformer_blocks_2_attn_to_out_0', 'lora_unet_transformer_blocks_50_img_mod_1', 'lora_unet_transformer_blocks_39_attn_add_q_proj', 'lora_unet_transformer_blocks_25_attn_add_k_proj', 'lora_unet_transformer_blocks_18_img_mod_1', 'lora_unet_transformer_blocks_41_attn_add_k_proj', 'lora_unet_transformer_blocks_4_attn_add_v_proj', 'lora_unet_transformer_blocks_59_attn_add_v_proj', 'lora_unet_transformer_blocks_52_attn_to_k', 'lora_unet_transformer_blocks_12_attn_to_add_out', 'lora_unet_transformer_blocks_38_attn_to_v', 'lora_unet_transformer_blocks_15_img_mod_1', 'lora_unet_transformer_blocks_49_attn_to_v', 'lora_unet_transformer_blocks_0_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_52_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_48_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_24_attn_add_k_proj', 'lora_unet_transformer_blocks_35_attn_to_out_0', 'lora_unet_transformer_blocks_7_attn_to_q', 'lora_unet_transformer_blocks_15_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_9_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_30_attn_to_k', 'lora_unet_transformer_blocks_20_attn_to_add_out', 'lora_unet_transformer_blocks_50_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_22_img_mod_1', 'lora_unet_transformer_blocks_1_attn_add_v_proj', 'lora_unet_transformer_blocks_31_attn_to_add_out', 'lora_unet_transformer_blocks_53_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_19_txt_mlp_net_2', 'lora_unet_transformer_blocks_58_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_46_attn_to_k', 'lora_unet_transformer_blocks_28_attn_to_v', 'lora_unet_transformer_blocks_53_txt_mlp_net_2', 'lora_unet_transformer_blocks_24_txt_mod_1', 'lora_unet_transformer_blocks_4_attn_add_k_proj', 'lora_unet_transformer_blocks_18_attn_to_q', 'lora_unet_transformer_blocks_37_attn_add_v_proj', 'lora_unet_transformer_blocks_40_img_mlp_net_2', 'lora_unet_transformer_blocks_26_attn_to_v', 'lora_unet_transformer_blocks_15_attn_add_k_proj', 'lora_unet_transformer_blocks_23_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_12_attn_add_v_proj', 'lora_unet_transformer_blocks_7_img_mod_1', 'lora_unet_transformer_blocks_33_attn_to_add_out', 'lora_unet_transformer_blocks_47_attn_to_out_0', 'lora_unet_transformer_blocks_53_attn_add_q_proj', 'lora_unet_transformer_blocks_22_attn_to_q', 'lora_unet_transformer_blocks_49_attn_add_q_proj', 'lora_unet_transformer_blocks_13_attn_to_out_0', 'lora_unet_transformer_blocks_11_attn_add_k_proj', 'lora_unet_transformer_blocks_46_img_mlp_net_2', 'lora_unet_transformer_blocks_58_attn_add_k_proj', 'lora_unet_transformer_blocks_29_txt_mlp_net_2', 'lora_unet_transformer_blocks_39_attn_to_out_0', 'lora_unet_transformer_blocks_43_txt_mod_1', 'lora_unet_transformer_blocks_59_img_mod_1', 'lora_unet_transformer_blocks_17_attn_to_add_out', 'lora_unet_transformer_blocks_36_attn_to_add_out', 'lora_unet_transformer_blocks_27_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_24_img_mlp_net_2', 'lora_unet_transformer_blocks_37_img_mlp_net_2', 'lora_unet_transformer_blocks_45_img_mod_1', 'lora_unet_transformer_blocks_14_attn_to_k', 'lora_unet_transformer_blocks_48_attn_add_v_proj', 'lora_unet_transformer_blocks_0_img_mod_1', 'lora_unet_transformer_blocks_56_attn_to_add_out', 'lora_unet_transformer_blocks_16_attn_to_out_0', 'lora_unet_transformer_blocks_11_attn_to_add_out', 'lora_unet_transformer_blocks_47_attn_to_add_out', 'lora_unet_transformer_blocks_57_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_26_attn_to_q', 'lora_unet_transformer_blocks_29_attn_add_q_proj', 'lora_unet_transformer_blocks_29_img_mod_1', 'lora_unet_transformer_blocks_33_txt_mlp_net_2', 'lora_unet_transformer_blocks_48_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_45_attn_add_q_proj', 'lora_unet_transformer_blocks_19_attn_add_k_proj', 'lora_unet_transformer_blocks_48_attn_to_k', 'lora_unet_transformer_blocks_34_attn_add_k_proj', 'lora_unet_transformer_blocks_31_attn_add_q_proj', 'lora_unet_transformer_blocks_21_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_7_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_55_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_48_attn_add_k_proj', 'lora_unet_transformer_blocks_0_img_mlp_net_2', 'lora_unet_transformer_blocks_47_attn_to_k', 'lora_unet_transformer_blocks_16_attn_to_k', 'lora_unet_transformer_blocks_40_attn_to_q', 'lora_unet_transformer_blocks_34_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_4_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_42_attn_to_v', 'lora_unet_transformer_blocks_55_attn_to_v', 'lora_unet_transformer_blocks_26_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_37_attn_to_k', 'lora_unet_transformer_blocks_56_img_mod_1', 'lora_unet_transformer_blocks_23_img_mlp_net_2', 'lora_unet_transformer_blocks_54_attn_to_q', 'lora_unet_transformer_blocks_58_img_mod_1', 'lora_unet_transformer_blocks_4_attn_to_add_out', 'lora_unet_transformer_blocks_8_txt_mod_1', 'lora_unet_transformer_blocks_41_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_42_txt_mod_1', 'lora_unet_transformer_blocks_8_img_mod_1', 'lora_unet_transformer_blocks_54_attn_add_q_proj', 'lora_unet_transformer_blocks_56_attn_to_v', 'lora_unet_transformer_blocks_35_txt_mlp_net_2', 'lora_unet_transformer_blocks_28_attn_add_v_proj', 'lora_unet_transformer_blocks_27_txt_mod_1', 'lora_unet_transformer_blocks_27_attn_to_add_out', 'lora_unet_transformer_blocks_8_attn_to_k', 'lora_unet_transformer_blocks_2_attn_add_q_proj', 'lora_unet_transformer_blocks_52_attn_to_add_out', 'lora_unet_transformer_blocks_14_attn_to_add_out', 'lora_unet_transformer_blocks_32_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_40_attn_to_k', 'lora_unet_transformer_blocks_55_img_mod_1', 'lora_unet_transformer_blocks_46_attn_add_k_proj', 'lora_unet_transformer_blocks_8_txt_mlp_net_2', 'lora_unet_transformer_blocks_18_attn_to_v', 'lora_unet_transformer_blocks_42_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_20_txt_mlp_net_2', 'lora_unet_transformer_blocks_58_attn_to_k', 'lora_unet_transformer_blocks_39_attn_to_k', 'lora_unet_transformer_blocks_6_attn_add_v_proj', 'lora_unet_transformer_blocks_42_img_mod_1', 'lora_unet_transformer_blocks_12_img_mod_1', 'lora_unet_transformer_blocks_43_attn_to_k', 'lora_unet_transformer_blocks_9_attn_to_out_0', 'lora_unet_transformer_blocks_26_img_mod_1', 'lora_unet_transformer_blocks_33_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_29_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_44_attn_to_add_out', 'lora_unet_transformer_blocks_17_txt_mlp_net_2', 'lora_unet_transformer_blocks_0_txt_mod_1', 'lora_unet_transformer_blocks_46_txt_mlp_net_2', 'lora_unet_transformer_blocks_51_txt_mod_1', 'lora_unet_transformer_blocks_7_attn_to_out_0', 'lora_unet_transformer_blocks_13_txt_mlp_net_2', 'lora_unet_transformer_blocks_48_attn_to_out_0', 'lora_unet_transformer_blocks_22_attn_add_q_proj', 'lora_unet_transformer_blocks_25_attn_to_q', 'lora_unet_transformer_blocks_59_attn_add_q_proj', 'lora_unet_transformer_blocks_31_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_11_attn_to_k', 'lora_unet_transformer_blocks_12_attn_add_k_proj', 'lora_unet_transformer_blocks_11_attn_add_v_proj', 'lora_unet_transformer_blocks_15_attn_add_v_proj', 'lora_unet_transformer_blocks_9_txt_mod_1', 'lora_unet_transformer_blocks_21_attn_to_add_out', 'lora_unet_transformer_blocks_39_txt_mod_1', 'lora_unet_transformer_blocks_52_txt_mlp_net_2', 'lora_unet_transformer_blocks_8_attn_add_q_proj', 'lora_unet_transformer_blocks_13_img_mlp_net_0_proj', 'lora_unet_transformer_blocks_36_attn_to_v', 'lora_unet_transformer_blocks_43_attn_to_q', 'lora_unet_transformer_blocks_26_txt_mlp_net_2', 'lora_unet_transformer_blocks_14_attn_to_q', 'lora_unet_transformer_blocks_25_txt_mlp_net_0_proj', 'lora_unet_transformer_blocks_36_attn_add_k_proj', 'lora_unet_transformer_blocks_58_txt_mod_1', 'lora_unet_transformer_blocks_35_img_mlp_net_2', 'lora_unet_transformer_blocks_6_attn_to_q', 'lora_unet_transformer_blocks_7_attn_to_k', 'lora_unet_transformer_blocks_25_attn_to_k', 'lora_unet_transformer_blocks_55_attn_add_v_proj', 'lora_unet_transformer_blocks_27_img_mlp_net_2', 'lora_unet_transformer_blocks_10_attn_to_v', 'lora_unet_transformer_blocks_40_attn_add_k_proj', 'lora_unet_transformer_blocks_38_attn_to_k', 'lora_unet_transformer_blocks_45_txt_mod_1'} not found in the base model. Please check the target modules and try again.

Logs

System Info

latest main

Who can help?

cc @sayakpaul @linoytsaban

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions