LoRA support GRPO training and examples

[sglucas]

May I ask whether the team plan to implement LoRA training for GRPO and provide some training examples.

Thank you very much for your support!

[Mrkkew]

When would slime support LORA+Megatron training? Is there any plan? @zhuzilin

[zhuzilin]

We will try to add lora support to megatron with megatron-bridge and there are still some bug with the megatron-bridge + moe path need to be solved, so the lora support in megatron still need a while.