Support vllm 0.10.2

[sfc-gh-goliaro]

No description provided.

[ggg-s]

After I pulled your branch and compiled it, why does it still require **vLLM 0.9.2**?

[sfc-gh-goliaro]

After I pulled your branch and compiled it, why does it still require vLLM 0.9.2?

This code works on my end:

git clone -b releases/v0.10.2 https://github.com/vllm-project/vllm.git
cd vllm
export VLLM_USE_PRECOMPILED=1
uv pip install --verbose .
cd ..
uv pip install flashinfer-python

git clone -b goliaro/vllm_0.10.2 https://github.com/snowflakedb/ArcticInference.git
cd ArcticInference
uv pip install --verbose -e .
cd ..

If you only need to edit Python files, you can use the code above to install. Otherwise, you will need to compile from scratch without VLLM_USE_PRECOMPILED=1. If doing so gives you the error above, try uncommenting out the code throwing the error. It may still work