[LoRA] remove full key prefix from peft.

[sayakpaul]

What does this PR do?

There's some uncertainty around huggingface/peft#2382. So, we decided to remove the full-key prefix thingy from diffusers until huggingface/peft#2382 is merged with a specific direction.

[hlky]

Thanks! Should we try to other proposed fix " storing deleted keys to ensure they aren't re-added by other iterations"

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[sayakpaul]

hould we try to other proposed fix " storing deleted keys to ensure they aren't re-added by other iterations"

Did you mean?

diffusers/src/diffusers/loaders/peft.py

Lines 89 to 91 in 363d1ab

	# remove the ambiguous key from `rank_pattern` and record it as deleted
	del config["rank_pattern"][key]
	deleted_keys.add(key)

[hlky]

Oh :) all good then!

[BenjaminBossan]

Thanks for the quick adjustments and sorry again for the inconvenience.

[sayakpaul]

No problem at all!