Does it support adding LoHa method

[llm8047]

Does it support adding LoHa method？

Where can I modify it？

[a-r-r-o-w]

We rely on huggingface/peft for this. The training scripts can be modified to use LohaConfig instead of LoraConfig. Specifically, the line that looks like this

[llm8047]

We rely on huggingface/peft for this. The training scripts can be modified to use LohaConfig instead of LoraConfig. Specifically, the line that looks like this
thank you ,Is it possible to implement it by modifying 'target_madulces'?

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.