Build jaxlib from source for rocm but cannot import

[sss441803]

I cloned AMD's xla fork and built jaxlib from source with

python build/build.py --enable_rocm --bazel_options=--override_repository=xla=path_to_xla

On my cluster, when I load PrgEnv-gnu, it complains collect2: fatal error: cannot find 'ld', which doesn't happen for the cpu build. As a result, I loaded cray as well to get ld from cray, and gcc from gnu, that builds without error. However, after I pip install jaxlib and jax, I cannot import successfully, and it complains:

  File "my_conda_env/lib/python3.12/site-packages/jaxlib/xla_client.py", line 32, in <module>
    from . import xla_extension as _xla
ImportError: /opt/rocm-5.7.0/lib/librccl.so.1: undefined symbol: bfd_close

If I load only use PrgEnv-cray

python build/build.py --enable_rocm --bazel_options=--override_repository=xla=path_to_xla

I get:

external/eigen_archive/Eigen/src/Core/arch/AVX/TypeCasting.h:81:23: error: ‘_mm256_setr_m128i’ was not declared in this scope
   __m256i abcd_efgh = _mm256_setr_m128i(aaaa_bbbb_cccc_dddd, eeee_ffff_gggg_hhhh);