Fix `torch_dtype` in Kolors text encoder with `transformers` v4.49#10816

DN6 merged 3 commits intohuggingface:mainhuggingface/diffusers:mainfrom

hlky:kolors-test-fixhlky/diffusers:kolors-test-fixCopy head branch name to clipboard