Trition JIT and code compile failing due to triton 2.1.0 deprecation/method relocation

[Qubitium]

Triton 2.1.0 moved the triton.language.libdevice code into .math. Unfortunately this is creating a problem for in writing a code that wants to support both 2.0.0 and 2.1.0+ with JIT enabled. The following code would fail JIT compile on Triton 2.1.0 (git+head) since it is still looking for .libdevice which no longer exists even though the else statement is 100% dead code.

Any suggestions? Thanks.

from distutils.version import LooseVersion
import triton
import triton.language as tl

# triton >= 2.1.0 check
triton_2_1 = LooseVersion(triton.__version__) >= LooseVersion('2.1.0')

@triton.jit
def test():
    # triton 2.1.0 moved tl.libdevice.exp to tl.math.exp
    if triton_2_1:
        freq = tl.math.exp(...)
    else:
        freq = tl.libdevice.exp(...)

[ptillet]

Can you do tl.libdevice = tl.math ? I am realizing that Triton 2.1.0 should probably be backward-compatible with 2.0.x as per semantic versioning guidelines, so maybe it's something we should hardcode into the package.

[Qubitium]

Thank you. It worked.

# triton 2.1.0[head] compat: remap .libdevice to .math
if hasattr(tl, "math"):
    tl.libdevice = tl.math

[rbrooks95]

Hey I'm trying to use openai-whisper and I'm getting an error from triton. Saying unable to find installation candidates for triton (2.0.0). Any one can can explain how do I solve this?

[Qubitium]

pip install triton==2.0.0 doesn't work?

[rbrooks95]

I'm using poetry and it's looking for triton 2.0.0.post1

[rbrooks95]

And I tried 2.0.0 and it just failed

[ptillet]

I think it's related to triton 2.0.0 not having a python 3.10 wheel. We'll add one.

[rbrooks95]

@diegomontoya So for my project I'm using poetry. Since what I know from doing it at work. Do you think I can use that and change to (python 3.10.10)? Or switch the env?

[Qubitium]

@rbrooks95 I would recommend installing conda/miniconda 3.10/3.9 and then install poetry using the python provided by conda. You can test this using a vm/docker/container to verify triton is working this way before working on your project. I have no experience with poetry so I have no idea what repository it is using to resolve & packages.

[rbrooks95]

Ok so I'm pretty confused sorry. So should I just use a venv or a container. And yea idk the reason why it's not working for me when I even changed my python version and it still pops up saying "unable to find installation candidates for triton (2.0.0) @diegomontoya. @ptillet Anything you can suggest? Sorry I'm new to this and to learn I like to dive into things

[rbrooks95]

I even tried changing my python version to 3.8 and still this error @diegomontoya @ptillet

[Qubitium]

@rbrooks95 Openai/Triton does not support MacOS, that I know of. You need to read the hardware requirements here.

https://github.com/openai/triton

At the bottom of the page on compatibility.