[LoRA] support musubi wan loras. (#11243) #4553

Job	Run time
Flax TPU Tests	3m 5s
ONNX CUDA Tests	4m 49s
Examples PyTorch CUDA tests on Ubuntu	32m 14s
PyTorch Compile CUDA tests	3m 5s
PyTorch xformers CUDA tests	5m 46s
Setup Torch Pipelines CUDA Slow Tests Matrix	1m 42s
Torch CUDA Tests (models)	6m 3s
Torch CUDA Tests (schedulers)	2m 53s
Torch CUDA Tests (lora)	8m 35s
Torch CUDA Tests (others)	2m 31s
Torch CUDA Tests (single_file)	5m 24s
Torch Pipelines CUDA Tests (cogvideo)	3m 44s
Torch Pipelines CUDA Tests (cogview4)	2m 52s
Torch Pipelines CUDA Tests (controlnet)	13m 30s
Torch Pipelines CUDA Tests (controlnet_flux)	1m 19s
Torch Pipelines CUDA Tests (controlnet_sd3)	3m 2s
Torch Pipelines CUDA Tests (ddpm)	2m 21s
Torch Pipelines CUDA Tests (deepfloyd_if)	4m 16s
Torch Pipelines CUDA Tests (flux)	2m 5s
Torch Pipelines CUDA Tests (hunyuandit)	1m 3s
Torch Pipelines CUDA Tests (ip_adapters)	32s
Torch Pipelines CUDA Tests (kandinsky3)	3m 50s
Torch Pipelines CUDA Tests (latent_consistency_models)	1m 18s
Torch Pipelines CUDA Tests (ltx)	3m 21s
Torch Pipelines CUDA Tests (marigold)	3m 24s
Torch Pipelines CUDA Tests (pixart_alpha)	52s
Torch Pipelines CUDA Tests (sana)	2m 35s
Torch Pipelines CUDA Tests (stable_cascade)	1m 27s
Torch Pipelines CUDA Tests (stable_diffusion)	4m 10s
Torch Pipelines CUDA Tests (stable_diffusion_2)	5m 23s
Torch Pipelines CUDA Tests (stable_diffusion_3)	1m 25s
Torch Pipelines CUDA Tests (stable_diffusion_xl)	5m 2s
Torch Pipelines CUDA Tests (stable_video_diffusion)	54s
Torch Pipelines CUDA Tests (wan)	1m 40s
	2h 26m 12s

Provide feedback