Skip to content

Conversation

@ojh31
Copy link

@ojh31 ojh31 commented Oct 14, 2025

Fixes #2834

@BenjaminBossan
Copy link
Member

As discussed on the issue, this would break existing PEFT functionality. The recommended solution for now is to set fsdp_cpu_ram_efficient_loading: false.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

FSDP QLORA doesn't work with multiple adapters

2 participants