Feature: RandLora integration into peft#2464

Merged

BenjaminBossan merged 13 commits intohuggingface:mainfrom

PaulAlbert31:randlora

Apr 25, 2025

Commits on Apr 17, 2025

randlora integration - more work to do to conform to quantization practices
PaulAlbert31
committed
added randlora tests to test_custom_models

Paul Albert
authored and
PaulAlbert31
committed
tests passing and fixes following feedback
PaulAlbert31
committed
style changes

Paul Albert
authored and
PaulAlbert31
committed
reverting licence change

Paul Albert
authored and
PaulAlbert31
committed
reverting file permissions

Paul Albert
authored and
PaulAlbert31
committed
better hyper-parameters and comformity with new dtype casts
PaulAlbert31
committed

Commits on Apr 20, 2025

new tests for shared weights, temp multi-gpu fix, better var names and docstrings
PaulAlbert31
committed

Commits on Apr 22, 2025

Commits on Apr 23, 2025

make style
PaulAlbert31
committed

Commits on Apr 24, 2025

reduce randlora_alpha in tests
PaulAlbert31
committed

Commits on Apr 25, 2025

add instability warining for larger randlora_alpha values
PaulAlbert31
committed