Skip to content

Commit 72a0356

Browse files
omrishivAlvant
authored andcommitted
[Doc][Neuron] add note to neuron documentation about resolving triton issue (vllm-project#9257)
Signed-off-by: omrishiv <[email protected]> Signed-off-by: Alvant <[email protected]>
1 parent b6696eb commit 72a0356

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

docs/source/getting_started/neuron-installation.rst

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -27,6 +27,10 @@ Installation steps:
2727

2828
.. _build_from_source_neuron:
2929

30+
.. note::
31+
32+
The currently supported version of Pytorch for Neuron installs `triton` version `2.1.0`. This is incompatible with vLLM >= 0.5.3. You may see an error `cannot import name 'default_dump_dir...`. To work around this, run a `pip install --upgrade triton==3.0.0` after installing the vLLM wheel.
33+
3034
Build from source
3135
-----------------
3236

0 commit comments

Comments
 (0)