Bug Report: ROCm 8.0 binary not found (latest ROCm is 7.1)

[Jerry-zirui]

System Info

• OS: ubuntu 25.10
• Python version: 3.13.7
• ROCm version: 7.1
• GPU: 780M aka gfx1103

Reproduction

Describe the bug
When trying to import bitsandbytes on a ROCm system, it fails to load due to a missing binary:

bitsandbytes library load error: Configured ROCm binary not found at /home/jerry/Desktop/bitsandbytes/bitsandbytes/libbitsandbytes_rocm80.so
Traceback (most recent call last):
  File "/home/jerry/Desktop/bitsandbytes/bitsandbytes/cextension.py", line 313, in <module>
    lib = get_native_library()
  File "/home/jerry/Desktop/bitsandbytes/bitsandbytes/cextension.py", line 282, in get_native_library
    raise RuntimeError(f"Configured {BNB_BACKEND} binary not found at {cuda_binary_path}")
RuntimeError: Configured ROCm binary not found at /home/jerry/Desktop/bitsandbytes/bitsandbytes/libbitsandbytes_rocm80.so

It was built with the following commands:

git clone https://github.com/ROCm/bitsandbytes.git
git checkout rocm_enabled
HIPCXX="$(rocm-sdk path --root)/llvm/bin/clang" HIP_PATH="$(rocm-sdk path --root)" HIP_PLATFORM=amd CMAKE_PREFIX_PATH="$(rocm-sdk path --root):$CMAKE_PREFIX_PATH" cmake -DCOMPUTE_BACKEND=hip -S . -DCMAKE_HIP_FLAGS:STRING="-I$(rocm-sdk path --root)/include" -DBNB_ROCM_ARCH=gfx1103
make
pip install .

pip list

Package                        Version
------------------------------ -------------------------------------
accelerate                     1.11.0
aiohappyeyeballs               2.6.1
aiohttp                        3.13.2
aiosignal                      1.4.0
anyio                          4.11.0
attrs                          25.4.0
bitsandbytes                   0.48.0.dev0
certifi                        2025.10.5
charset-normalizer             3.4.4
datasets                       4.4.0
diffusers                      0.35.2
dill                           0.4.0
docstring_parser               0.17.0
filelock                       3.20.0
frozenlist                     1.8.0
fsspec                         2025.10.0
h11                            0.16.0
hf_transfer                    0.1.9
hf-xet                         1.2.0
httpcore                       1.0.9
httpx                          0.28.1
huggingface-hub                0.36.0
idna                           3.11
importlib_metadata             8.7.0
Jinja2                         3.1.6
markdown-it-py                 4.0.0
MarkupSafe                     3.0.3
mdurl                          0.1.2
mpmath                         1.3.0
multidict                      6.7.0
multiprocess                   0.70.18
networkx                       3.5
numpy                          2.3.4
packaging                      25.0
pandas                         2.3.3
peft                           0.17.1
pillow                         12.0.0
pip                            25.3
pipdeptree                     2.29.0
propcache                      0.4.1
protobuf                       6.33.0
psutil                         7.1.3
pyarrow                        22.0.0
Pygments                       2.19.2
python-dateutil                2.9.0.post0
pytorch-triton-rocm            3.5.0+gitbfa62098.rocm7.10.0a20251031
pytz                           2025.2
PyYAML                         6.0.3
regex                          2025.11.3
requests                       2.32.5
rich                           14.2.0
rocm                           7.10.0a20251031
rocm-sdk-core                  7.10.0a20251031
rocm-sdk-devel                 7.10.0a20251031
rocm-sdk-libraries-gfx110X-all 7.10.0a20251031
safetensors                    0.6.2
sentencepiece                  0.2.1
setuptools                     80.9.0
shtab                          1.7.2
six                            1.17.0
sniffio                        1.3.1
sympy                          1.14.0
tokenizers                     0.22.1
torch                          2.10.0a0+rocm7.10.0a20251031
torchaudio                     2.10.0a0+rocm7.10.0a20251031
torchvision                    0.25.0a0+rocm7.10.0a20251031
tqdm                           4.67.1
transformers                   4.57.1
trl                            0.24.0
typeguard                      4.4.4
typing_extensions              4.15.0
tyro                           0.9.35
tzdata                         2025.2
unsloth                        2025.11.1
unsloth_zoo                    2025.11.1
urllib3                        2.5.0
wheel                          0.45.1
xxhash                         3.6.0
yarl                           1.22.0
zipp                           3.23.0

Expected behavior

Expected behavior
bitsandbytes should either:

• Detect the available ROCm version (e.g., 7.1) and load the proper binary, or
• Fall back gracefully with a clear message if no compatible ROCm build exists.

[harkgill-amd]

Hey @Jerry-zirui, we're shifting our development efforts to bitsandbytes upstream. Could you try the following steps,

#Set list of environment variables from https://github.com/ROCm/TheRock/issues/1658#issuecomment-3359869071
git clone --branch main --depth 1 https://github.com/bitsandbytes-foundation/bitsandbytes bitsandbytes
cd bitsandbytes

CMAKE_PREFIX_PATH="$(rocm-sdk path --root):$CMAKE_PREFIX_PATH" \
cmake \
  -DCMAKE_HIP_COMPILER="$(readlink -f $(rocm-sdk path --root)/llvm/bin/clang)" \
  -DCOMPUTE_BACKEND=hip \
  -S . -B build \
  -DCMAKE_HIP_FLAGS:STRING="-I$(rocm-sdk path --root)/include" \
  -DBNB_ROCM_ARCH=gfx1103

cmake --build build -j"$(nproc)"
pip install -e .

Please note that this install is done using the ROCm and torch wheels you have installed in your virtual environment - in your case 2.10.0a0+rocm7.10.0a20251031. Once the install is complete you should see the bitsandbytes package installed under pip list and have libbitsandbytes_rocm71.so at bitsandbytes/bitsandbytes/.

Package                         Version
------------------------------- -------------------------------------
bitsandbytes                    0.49.0.dev0
filelock                        3.19.1
fsspec                          2025.7.0
Jinja2                          3.1.6
MarkupSafe                      3.0.2
mpmath                          1.3.0
networkx                        3.5
numpy                           2.3.2
packaging                       25.0
pillow                          11.3.0
pip                             24.0
pytorch-triton-rocm             3.5.0+gitc79db9c3.rocm7.10.0a20251015
rocm                            7.10.0a20251015
rocm-sdk-core                   7.10.0a20251015
rocm-sdk-devel                  7.10.0a20251015
rocm-sdk-libraries-gfx110X-dgpu 7.10.0a20251015
setuptools                      80.9.0
sympy                           1.14.0
torch                           2.10.0a0+rocm7.10.0a20251015
torchaudio                      2.8.0a0+rocm7.10.0a20251015
torchvision                     0.25.0a0+rocm7.10.0a20251015
typing_extensions               4.14.1

[harkgill-amd]

RuntimeError: Configured ROCm binary not found at /home/jerry/Desktop/bitsandbytes/bitsandbytes/libbitsandbytes_rocm80.so

While the configuration (latest wheels) and steps I shared above work, this issue might still linger with the rocm7.10.0a20251031 wheels. If so, could you share the output of cat $(rocm-sdk path --root)/include/rocm-core/rocm_version.h | grep ROCM_BUILD_INFO and output of hipconfig --version?

[harkgill-amd]

Will keep this open but will shift the discussion to bitsandbytes-foundation#1799