About GPUs and LORA #1
Description
Thanks for your work! I want to know how many GPUs (and the memory) did you use to train RM and PPO. I noticed in the code that you don't use Lora by default. Can you provide the settings of Lora?
{{ message }}
Thanks for your work! I want to know how many GPUs (and the memory) did you use to train RM and PPO. I noticed in the code that you don't use Lora by default. Can you provide the settings of Lora?