Finetune the model on custome dataset

I am wondering if it is possible to finetune the model on my own dataset? I know keras-cv has released something for finetuning stable diffusion, but I encountered installation issues (most probably because it requires tf2.11 which is not supported on native windows). I can run the model on tf2.10. It would be great if we can train the model as well. Many thanks.