[E2E] Align env with torch-xpu-ops; uninstall `fbgemm_gpu_nightly-cpu`#5523

anmyachev wants to merge 1 commit intomainintel/intel-xpu-backend-for-triton:mainfrom

amyachev/e2e-fixesintel/intel-xpu-backend-for-triton:amyachev/e2e-fixesCopy head branch name to clipboard