[tests] Single scheduler in lora tests (#12315)

[tests] Single scheduler in lora tests (#12315) #3639