It seems the Python installed by StabilityMatrix is an incomplete installation, and it lacks distutils

[shivshankar11]

Package

Python

When did the issue occur?

Installing the Package

What GPU / hardware type are you using?

4090

What happened?

woct0rdho/triton-windows#1
It seems the Python installed by StabilityMatrix is an incomplete installation, and it lacks distutils. Please ask the authors of StabilityMatrix to fix that.

Console output

est fails in my case (Python 3.10 in venv, didn't add "include_libs")

Traceback (most recent call last):
File "d:\Soft\StableDiffusion-StabilityMatrix\Data\Packages\ComfyUI\test.py", line 2, in
import triton
File "D:\Soft\StableDiffusion-StabilityMatrix\Data\Packages\ComfyUI\venv\lib\site-packages\triton_init_.py", line 8, in
from .runtime import (
File "D:\Soft\StableDiffusion-StabilityMatrix\Data\Packages\ComfyUI\venv\lib\site-packages\triton\runtime_init_.py", line 1, in
from .autotuner import (Autotuner, Config, Heuristics, autotune, heuristics)
File "D:\Soft\StableDiffusion-StabilityMatrix\Data\Packages\ComfyUI\venv\lib\site-packages\triton\runtime\autotuner.py", line 9, in
from ..testing import do_bench, do_bench_cudagraph
File "D:\Soft\StableDiffusion-StabilityMatrix\Data\Packages\ComfyUI\venv\lib\site-packages\triton\testing.py", line 7, in
from . import language as tl
File "D:\Soft\StableDiffusion-StabilityMatrix\Data\Packages\ComfyUI\venv\lib\site-packages\triton\language_init_.py", line 4, in
from . import math
File "D:\Soft\StableDiffusion-StabilityMatrix\Data\Packages\ComfyUI\venv\lib\site-packages\triton\language\math.py", line 1, in
from . import core
File "D:\Soft\StableDiffusion-StabilityMatrix\Data\Packages\ComfyUI\venv\lib\site-packages\triton\language\core.py", line 10, in
from ..runtime.jit import jit
File "D:\Soft\StableDiffusion-StabilityMatrix\Data\Packages\ComfyUI\venv\lib\site-packages\triton\runtime\jit.py", line 12, in
from ..runtime.driver import driver
File "D:\Soft\StableDiffusion-StabilityMatrix\Data\Packages\ComfyUI\venv\lib\site-packages\triton\runtime\driver.py", line 1, in
from ..backends import backends
File "D:\Soft\StableDiffusion-StabilityMatrix\Data\Packages\ComfyUI\venv\lib\site-packages\triton\backends_init_.py", line 50, in
backends = discover_backends()
File "D:\Soft\StableDiffusion-StabilityMatrix\Data\Packages\ComfyUI\venv\lib\site-packages\triton\backends_init.py", line 44, in _discover_backends
driver = load_module(name, os.path.join(root, name, 'driver.py'))
File "D:\Soft\StableDiffusion-StabilityMatrix\Data\Packages\ComfyUI\venv\lib\site-packages\triton\backends_init.py", line 12, in _load_module
spec.loader.exec_module(module)
File "D:\Soft\StableDiffusion-StabilityMatrix\Data\Packages\ComfyUI\venv\lib\site-packages\triton\backends\amd\driver.py", line 7, in
from triton.runtime.build import build
File "D:\Soft\StableDiffusion-StabilityMatrix\Data\Packages\ComfyUI\venv\lib\site-packages\triton\runtime\build.py", line 8, in
import setuptools
File "D:\Soft\StableDiffusion-StabilityMatrix\Data\Packages\ComfyUI\venv\lib\site-packages\setuptools_init.py", line 7, in
import distutils_hack.override # noqa: F401
File "D:\Soft\StableDiffusion-StabilityMatrix\Data\Packages\ComfyUI\venv\lib\site-packages_distutils_hack\override.py", line 1, in
import('distutils_hack').do_override()
File "D:\Soft\StableDiffusion-StabilityMatrix\Data\Packages\ComfyUI\venv\lib\site-packages_distutils_hack_init.py", line 77, in do_override
ensure_local_distutils()
File "D:\Soft\StableDiffusion-StabilityMatrix\Data\Packages\ComfyUI\venv\lib\site-packages_distutils_hack_init.py", line 64, in ensure_local_distutils
assert '_distutils' in core.file, core.file
AssertionError: D:\Soft\StableDiffusion-StabilityMatrix\Data\Packages\ComfyUI\venv\Scripts\python310.zip\distutils\core.py

Version

latest i guess

What Operating System are you using?

Windows

[shivshankar11]

feature request- force stablixtymatrix to use existing venv, why it must replace venv. very annoying. i want to use complete python 3.11/3.12. not incomplete python environments.

[kimnzl]

If you set the environment variable SETUPTOOLS_USE_DISTUTILS=stdlib you should be past that distutil error.

I used:

Install requirements VS and CUDA
C&P Python 3.10 include and libs folders into one of the paths listed in the error - in the venv for me. I have attached them in a zip.
I c&p include and libs folders into:
Data\Packages\ComfyUI\venv and Data\Packages\ComfyUI\venv\Scripts


run cmd.exe

set SETUPTOOLS_USE_DISTUTILS=stdlib
cd /d <StabilityMatrixFolder>\Data\Packages\ComfyUI

:: Pick one of the following
:: VS2022 build tools
call "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\Tools\VsDevCmd.bat"
:: VS2022 Community
call "C:\Program Files\Microsoft Visual Studio\2022\Community\Common7\Tools\VsDevCmd.bat"

call venv\Scripts\activate.bat

pip install --upgrade setuptools

pip install <path to where downloaded>\triton-3.1.0-cp310-cp310-win_amd64.whl

Python310_includes_libs.zip

[scruffynerf]

source venv/bin/activate
export SETUPTOOLS_USE_DISTUTILS=stdlib
StabilityMatrix/Data/Packages/ComfyUI/venv/bin/python3 StabilityMatrix/Data/Packages/ComfyUI/main.py (args as needed)

With this, you can remotely restart ComfyUI, when it's crashed, and only way to reset it is via SM (which isn't accessibly remotely)

[thiagojramos]

feature request- force stablixtymatrix to use existing venv, why it must replace venv. very annoying. i want to use complete python 3.11/3.12. not incomplete python environments.

I've tried several times to request features like this to use newer versions of python, and I've even seen several requests around here, but the devs ignore them and the posts end up being closed due to inactivity for so many days... 🤷🏼‍♂️

[extra2AB]

if you are here after trying to install sageattention 2.0.1 and it still fails after doing the above steps.

do

set SETUPTOOLS_USE_DISTUTILS=setuptools

in the above steps

[Profileiche]

Yes... I tried to install insightface over the python packeages option and it stalled on lackign Include. Is there are reason why SM runs it on Python 3.10?

[shivshankar11]

Because stabilitymatrix’s devloper dont allow to uses another python version? I don’t know why they hate other python versions or why they force embedded python version? Why can’t we use env created with standard python? Windows version of Triton never work with ComfyUI because of this. It will be not fixed because SM creator simiply doesn’t care. Its opensource afterall you can fix it.

[mohnjiles]

Yes... I tried to install insightface over the python packeages option and it stalled on lackign Include. Is there are reason why SM runs it on Python 3.10?

It was what was most compatible when we initially built the project. We do have a fix in the works for this specific issue (distutils stuff). On Windows we're currently using the embedded Python which lacks certain things from the main Python install, switching to the "regular" python is on the to-do list, along with letting people select their own versions.

Edit: workaround for insightface is installing via the prebuilt wheel: https://github.com/Gourieff/Assets/raw/main/Insightface/insightface-0.7.3-cp310-cp310-win_amd64.whl

Because stabilitymatrix’s devloper dont allow to uses another python version? I don’t know why they hate other python versions or why they force embedded python version? Why can’t we use env created with standard python? Windows version of Triton never work with ComfyUI because of this. It will be not fixed because SM creator simiply doesn’t care. Its opensource afterall you can fix it.

Every time someone complains about it we delay it two weeks. The current ETA is October 22, 2038.

[Profileiche]

Yes... I tried to install insightface over the python packeages option and it stalled on lackign Include. Is there are reason why SM runs it on Python 3.10?

It was what was most compatible when we initially built the project. We do have a fix in the works for this specific issue (distutils stuff). On Windows we're currently using the embedded Python which lacks certain things from the main Python install, switching to the "regular" python is on the to-do list, along with letting people select their own versions.

Edit: workaround for insightface is installing via the prebuilt wheel: https://github.com/Gourieff/Assets/raw/main/Insightface/insightface-0.7.3-cp310-cp310-win_amd64.whl

Because stabilitymatrix’s devloper dont allow to uses another python version? I don’t know why they hate other python versions or why they force embedded python version? Why can’t we use env created with standard python? Windows version of Triton never work with ComfyUI because of this. It will be not fixed because SM creator simiply doesn’t care. Its opensource afterall you can fix it.

Every time someone complains about it we delay it two weeks. The current ETA is October 22, 2038.

Have you tried the wheel install? As soon as you try, you might end up with the insightface install crashing into building an extension out of the face3d package. Somehow it doesn't reach the vcvarsall.bat in Visual Studio's Building Tools even when they are installed and build_ext breaks down. Another workaround:

Comfy-Org/ComfyUI#2685 (comment)