[ci] unify how adhoc installs are done in CI.#11773

sayakpaul wants to merge 4 commits intomainhuggingface/diffusers:mainfrom

unify-ci-installshuggingface/diffusers:unify-ci-installsCopy head branch name to clipboard