Fix device error when using cuda device other than cuda:0#216

cornzz wants to merge 3 commits intomistralai:mainmistralai/mistral-inference:mainfrom

cornzz:maincornzz/mistral-inference:mainCopy head branch name to clipboard