sycl-ls fails with CUDA ERROR: UR_RESULT_ERROR_UNSUPPORTED_FEATURE at adapters/cuda/platform.cpp:98

[sycloid]

Describe the bug

$ ONEAPI_DEVICE_SELECTOR=cuda:* sycl-ls
INFO: Output filtered by ONEAPI_DEVICE_SELECTOR environment variable, which is set to cuda:*.
To see device ids, use the --ignore-device-selectors CLI option.

<CUDA>[ERROR]:
UR ERROR:
        Value:           UR_RESULT_ERROR_UNSUPPORTED_FEATURE
        Function:        operator()
        Source Location: /home/sycloid/sycl-builds/test_llvm/unified-runtime/source/adapters/cuda/platform.cpp:98

SYCL Exception encountered: cuda backend failed with error: 44 (UR_RESULT_ERROR_UNSUPPORTED_FEATURE)

Level-Zero device can be listed:

$ ONEAPI_DEVICE_SELECTOR=level_zero:* sycl-ls
INFO: Output filtered by ONEAPI_DEVICE_SELECTOR environment variable, which is set to level_zero:*.
To see device ids, use the --ignore-device-selectors CLI option.

[level_zero:gpu] Intel(R) oneAPI Unified Runtime over Level-Zero, Intel(R) Graphics [0x7d45] 12.70.4 [1.6.31294.120000]

Setting LD_LIBRARY_PATH does not help this time:

$ which libcuda.so
/usr/lib/wsl/lib/libcuda.so

$ ONEAPI_DEVICE_SELECTOR=cuda:* LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:/usr/lib/wsl/lib sycl-ls
INFO: Output filtered by ONEAPI_DEVICE_SELECTOR environment variable, which is set to cuda:*.
To see device ids, use the --ignore-device-selectors CLI option.

<CUDA>[ERROR]:
UR ERROR:
        Value:           UR_RESULT_ERROR_UNSUPPORTED_FEATURE
        Function:        operator()
        Source Location: /home/sycloid/sycl-builds/test_llvm/unified-runtime/source/adapters/cuda/platform.cpp:98

SYCL Exception encountered: cuda backend failed with error: 44 (UR_RESULT_ERROR_UNSUPPORTED_FEATURE)

To reproduce

Use SYCL built from source:

$ clang++ --version
clang version 22.0.0git (https://github.com/intel/llvm 82ad61d765c6ccfd38ab4627a1d2b136a6ea02cd)
Target: x86_64-unknown-linux-gnu
Thread model: posix
InstalledDir: /home/sycloid/sycl-builds/test_llvm/build_sycl/bin
Build config: +assertions

Environment

• OS: Ubuntu 24.04 on WSL under Windows 11
• NVIDIA RTX 3050
• DPC++ version: SHA: 82ad61d
• Dependencies version:

$ nvidia-smi
Mon Oct  6 07:52:16 2025
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 580.82.02              Driver Version: 581.15         CUDA Version: 13.0     |
+-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA GeForce RTX 3050 ...    On  |   00000000:02:00.0 Off |                  N/A |
| N/A   40C    P0             11W /   35W |       0MiB /   4096MiB |      0%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+

+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI              PID   Type   Process name                        GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
|  No running processes found                                                             |
+-----------------------------------------------------------------------------------------+

Additional context

No response

[sycloid]

@bratpiorka

[sycloid]

Also see similar issue I filed earlier: #19998

[sycloid]

The net effect of this bug is SYCL RT cannot make CUDA device available, hence nothing can be executed on the device as well:

#include <sycl/sycl.hpp>
#include <iostream>

int main() {
    sycl::queue q{};

    std::cout << q.get_device().get_info<sycl::info::device::name>() << std::endl;
    return 0;    
}

$ clang++ -fsycl bug.cpp -o bug
$ ./bug
<CUDA>[ERROR]:
UR ERROR:
        Value:           UR_RESULT_ERROR_UNSUPPORTED_FEATURE
        Function:        operator()
        Source Location: /home/sycloid/sycl-builds/test_llvm/unified-runtime/source/adapters/cuda/platform.cpp:98

terminate called after throwing an instance of 'sycl::_V1::exception'
  what():  cuda backend failed with error: 44 (UR_RESULT_ERROR_UNSUPPORTED_FEATURE)
Aborted (core dumped)

Compile with Debug:

$ clang++ -fsycl bug.cpp -O0 -g -o bug

Seg-fault backtrace:

terminate called after throwing an instance of 'sycl::_V1::exception'
  what():  cuda backend failed with error: 44 (UR_RESULT_ERROR_UNSUPPORTED_FEATURE)

Thread 1 "bug" received signal SIGABRT, Aborted.
Download failed: Invalid argument.  Continuing without source file ./nptl/./nptl/pthread_kill.c.
__pthread_kill_implementation (no_tid=0, signo=6, threadid=<optimized out>) at ./nptl/pthread_kill.c:44
warning: 44     ./nptl/pthread_kill.c: No such file or directory
(gdb) bt
#0  __pthread_kill_implementation (no_tid=0, signo=6, threadid=<optimized out>) at ./nptl/pthread_kill.c:44
#1  __pthread_kill_internal (signo=6, threadid=<optimized out>) at ./nptl/pthread_kill.c:78
#2  __GI___pthread_kill (threadid=<optimized out>, signo=signo@entry=6) at ./nptl/pthread_kill.c:89
#3  0x00007ffff763a27e in __GI_raise (sig=sig@entry=6) at ../sysdeps/posix/raise.c:26
#4  0x00007ffff761d8ff in __GI_abort () at ./stdlib/abort.c:79
#5  0x00007ffff7ddbff5 in __gnu_cxx::__verbose_terminate_handler () at ../../../../src/libstdc++-v3/libsupc++/vterminate.cc:95
#6  0x00007ffff7df10da in __cxxabiv1::__terminate (handler=<optimized out>) at ../../../../src/libstdc++-v3/libsupc++/eh_terminate.cc:48
#7  0x00007ffff7ddba55 in std::terminate () at ../../../../src/libstdc++-v3/libsupc++/eh_terminate.cc:58
#8  0x00007ffff7df1391 in __cxxabiv1::__cxa_throw (obj=<optimized out>, tinfo=0x7ffff7c1a930 <typeinfo for sycl::_V1::exception>,
    dest=0x7ffff7b11520 <sycl::_V1::exception::~exception()>) at ../../../../src/libstdc++-v3/libsupc++/eh_throw.cc:98
#9  0x00007ffff78b6a6b in void sycl::_V1::detail::adapter_impl::checkUrResult<(sycl::_V1::errc)1>(ur_result_t) const ()
   from /home/sycloid/sycl-builds/test_llvm/build_sycl/lib/libsycl.so.8
#10 0x00007ffff7a4ecdf in std::once_flag::_Prepare_execution::_Prepare_execution<std::call_once<sycl::_V1::detail::adapter_impl::getUrPlatforms()::{lambda()#1}>(std::once_flag&, sycl::_V1::detail::adapter_impl::getUrPlatforms()::{lambda()#1}&&)::{lambda()#1}>(sycl::_V1::detail::adapter_impl::getUrPlatforms()::{lambda()#1}&)::{lambda()#1}::_FUN() ()
   from /home/sycloid/sycl-builds/test_llvm/build_sycl/lib/libsycl.so.8
#11 0x00007ffff7696ed3 in __pthread_once_slow (once_control=0x1a03e18, init_routine=0x7ffff7e21420 <std::__once_proxy()>) at ./nptl/pthread_once.c:116
#12 0x00007ffff7a4dcb0 in sycl::_V1::detail::platform_impl::get_platforms() () from /home/sycloid/sycl-builds/test_llvm/build_sycl/lib/libsycl.so.8
#13 0x00007ffff7b5a9e1 in sycl::_V1::platform::get_platforms() () from /home/sycloid/sycl-builds/test_llvm/build_sycl/lib/libsycl.so.8
#14 0x00007ffff7b03966 in sycl::_V1::device::get_devices(sycl::_V1::info::device_type) () from /home/sycloid/sycl-builds/test_llvm/build_sycl/lib/libsycl.so.8
#15 0x00007ffff7b0f27b in sycl::_V1::detail::select_device(std::function<int (sycl::_V1::device const&)> const&) ()
   from /home/sycloid/sycl-builds/test_llvm/build_sycl/lib/libsycl.so.8
#16 0x00000000004028a4 in sycl::_V1::queue::queue<int (sycl::_V1::device const&), void>(int ( const&)(sycl::_V1::device const&), std::function<void (sycl::_V1::exception_list)> const&, sycl::_V1::property_list const&) (this=0x7fffffffdc38,
    deviceSelector=@0x402100: {int (const class sycl::_V1::device &)} 0x402100 <sycl::_V1::default_selector_v(sycl::_V1::device const&)@plt>, AsyncHandler=..., PropList=...)
    at /home/sycloid/sycl-builds/test_llvm/build_sycl/bin/../include/sycl/queue.hpp:263
#17 0x000000000040254e in sycl::_V1::queue::queue (this=0x7fffffffdc38, PropList=...) at /home/sycloid/sycl-builds/test_llvm/build_sycl/bin/../include/sycl/queue.hpp:241
#18 0x00000000004023cc in main () at bug.cpp:5

Loaded shared libraries:

(gdb) info sharedlibrary
From                To                  Syms Read   Shared Object Library
0x00007ffff7fc6000  0x00007ffff7ff0195  Yes         /lib64/ld-linux-x86-64.so.2
0x00007ffff7ddb5c0  0x00007ffff7f1ace2  Yes         /lib/x86_64-linux-gnu/libstdc++.so.6
0x00007ffff7c5d420  0x00007ffff7cdb3a6  Yes         /lib/x86_64-linux-gnu/libm.so.6
0x00007ffff7c23780  0x00007ffff7c46745  Yes         /lib/x86_64-linux-gnu/libgcc_s.so.1
0x00007ffff7885080  0x00007ffff7b6b6ac  Yes (*)     /home/sycloid/sycl-builds/test_llvm/build_sycl/lib/libsycl.so.8
0x00007ffff761d800  0x00007ffff77a4cf9  Yes         /lib/x86_64-linux-gnu/libc.so.6
0x00007ffff657a8f0  0x00007ffff7143b82  Yes (*)     /home/sycloid/sycl-builds/test_llvm/build_sycl/lib/libur_loader.so.0
0x00007ffff641e0e0  0x00007ffff64b7c14  Yes         /home/sycloid/sycl-builds/test_llvm/build_sycl/lib/libur_adapter_cuda.so.0
0x00007ffff600d6d0  0x00007ffff6023c54  Yes (*)     /usr/lib/wsl/lib/libcuda.so.1
0x00007ffff5c13920  0x00007ffff5c280f2  Yes (*)     /usr/lib/wsl/lib/libnvidia-ml.so.1
0x00007ffff63dca60  0x00007ffff63f5c9a  Yes (*)     /home/sycloid/sycl-builds/test_llvm/build_sycl/lib/libumf.so.1
0x00007ffff63d3040  0x00007ffff63d3105  Yes         /lib/x86_64-linux-gnu/libdl.so.2
0x00007ffff63ce040  0x00007ffff63ce105  Yes         /lib/x86_64-linux-gnu/libpthread.so.0
0x00007ffff63c9080  0x00007ffff63c92b1  Yes         /lib/x86_64-linux-gnu/librt.so.1
0x00007ffff5e72290  0x00007ffff5fbcf16  Yes (*)     /home/sycloid/sycl-builds/test_llvm/build_sycl/lib/libur_adapter_level_zero.so.0
0x00007ffff62af0e0  0x00007ffff6368c20  Yes (*)     /lib/x86_64-linux-gnu/libze_loader.so.1
0x00007ffff5abb190  0x00007ffff5bc3f66  Yes (*)     /home/sycloid/sycl-builds/test_llvm/build_sycl/lib/libur_adapter_level_zero_v2.so.0
0x00007ffff5a47440  0x00007ffff5a9af96  Yes (*)     /home/sycloid/sycl-builds/test_llvm/build_sycl/lib/libur_adapter_opencl.so.0
0x00007ffff625f440  0x00007ffff62690e5  Yes (*)     /home/sycloid/sycl-builds/test_llvm/build_sycl/lib/libOpenCL.so.1
0x00007ffff3e33550  0x00007ffff43e1238  Yes (*)     /lib/x86_64-linux-gnu/libze_intel_gpu.so.1
0x00007ffff3cf52c0  0x00007ffff3da8d9f  Yes (*)     /lib/x86_64-linux-gnu/libigdgmm.so.12
0x00007ffff3c4e430  0x00007ffff3cd76b3  Yes (*)     /lib/x86_64-linux-gnu/libze_tracing_layer.so.1
0x00007ffff3bbdfa0  0x00007ffff3c38e81  Yes (*)     /usr/lib/wsl/lib/libdxcore.so
0x00007ffff3ad3080  0x00007ffff3b44d0c  Yes (*)     /usr/lib/wsl/drivers/iigd_dch.inf_amd64_507e62014afcde30/libwsl_compute_helper.so
0x00007fffee715020  0x00007ffff1453152  Yes (*)     /usr/local/lib/libigc.so.1
0x00007fffec761080  0x00007fffed6c41aa  Yes (*)     /usr/lib/wsl/drivers/nvhmi.inf_amd64_4d24c367b4de1cb9/libcuda.so.1.1
0x00007fffeba009a0  0x00007fffeba0b744  Yes (*)     /usr/lib/wsl/drivers/nvhmi.inf_amd64_4d24c367b4de1cb9/libnvdxgdmal.so.1