mat1 and mat2 shapes cannot be multiplied

[gamingflexer]

So i followed all your steps and was stuck at this error

1. For my datasets
2. your Default dataset

TraceBack

Any help would be appreciated.
Thanks !

[leo27heady]

I have an absolutely identical problem. Did you somehow manage to solve it?

[leo27heady]

I managed to solve this problem. From what I understand, the issue lies with the peft library, specifically in earlier versions where input and output dimensions in the layers might not match correctly. On the following requirements, everything is working fine for me:
bitsandbytes-0.39.0
transformers-4.31.0.dev0
peft-0.4.0.dev0
accelerate-0.22.0.dev0
evaluate==0.4.0

Many thanks to the author of the repository for such an amazing code!