enable deterministic in bnb 4 bit tests#11738

sayakpaul merged 8 commits intohuggingface:mainhuggingface/diffusers:mainfrom

jiqing-feng:testjiqing-feng/diffusers:testCopy head branch name to clipboard