Install 5.0.6 failed with AMD AOCC 5.0

[liang-cj]

Hi

when I install openMPI from source code with AMD AOCC5.0 compiler, I hit the error as below.

make[2]: Entering directory '/mnt/mydata/openmpi-5.0.6/3rd-party/libevent-2.1.12-stable-ompi'
make install-am
make[3]: Entering directory '/mnt/mydata/openmpi-5.0.6/3rd-party/libevent-2.1.12-stable-ompi'
CCLD sample/dns-example
clang: error: no such file or directory: './.libs/libevent.so'
make[3]: *** [Makefile:1542: sample/dns-example] Error 1

My install script is as below capture:

#!/bin/bash

source /opt/amd/setenv_AOCC.sh

export FC=flang
export CC=clang
export CXX=clang++

export CFLAG="-O3 -ffast-math -march=znver4"
export CXXFLAGS="-O3 -ffast-math -march=znver4 -fopenmp"
export FCFLAGS="-O3 -ffast-math -march=znver4 -fopenmp"

export OPENMPIROOT="/opt/amd/openmp5"

wget https://download.open-mpi.org/release/open-mpi/v5.0/openmpi-5.0.6.tar.gz
tar -xvf openmpi-5.0.6.tar.gz
cd openmpi-5.0.6

./configure --prefix=$OPENMPIROOT --with-libevent=internal CC="${CC}" CXX="$(CXX)" FC="$(FC)" OMPI_CC=clang OMPI_CXX=clang++ OMPI_FC=flang --enable-shared=yes --enable-static=yes --enable-mpi1-compatibility

make -j
make install

Any help is appreciated. Thanks!

[jsquyres]

Please send all the information listed in https://docs.open-mpi.org/en/v5.0.x/getting-help.html#for-problems-building-or-installing-open-mpi. Thanks!

[liang-cj]

Please send all the information listed in https://docs.open-mpi.org/en/v5.0.x/getting-help.html#for-problems-building-or-installing-open-mpi. Thanks!

Thanks for your response. Due to company policy, I have no permission to group mail to external address. so I paste the tar ball here firstly.

ompi-output.tar.gz

[ggouaillardet]

Can you please make clean and then make and then share the output?
there is more stuff to build before linking the sample/dns-example test program.

[liang-cj]

Can you please make clean and then make and then share the output? there is more stuff to build before linking the sample/dns-example test program.

Thanks for your response firstly. Looks like it hit the same issue after make clean.

[ggouaillardet]

That could be a bad libtool interaction

Can you manually remove libevent.la and run

make V=1

That will tell us how the linker was invoked.
Then confirm there is no libevent.so library in the .libs directory

[liang-cj]

That could be a bad libtool interaction

Can you manually remove libevent.la and run

make V=1

That will tell us how the linker was invoked. Then confirm there is no libevent.so library in the .libs directory

[ggouaillardet]

Meanwhile, try again but without `--enable-static'

[liang-cj]

Meanwhile, try again but without `--enable-static'

[ggouaillardet]

There is something wrong with your generated libtool and/or your environment.
I am unable to reproduce it on my box.

FWIW, here is my output for make V=1 libevent.la

/bin/sh ./libtool  --tag=CC   --mode=link clang  -g -O2 -Wall -fno-strict-aliasing  -version-info 7:1:0 -release 2.1    -o libevent.la -rpath /opt/amd/openmp5/lib buffer.lo bufferevent.lo bufferevent_filter.lo bufferevent_pair.lo bufferevent_ratelim.lo bufferevent_sock.lo event.lo evmap.lo evthread.lo evutil.lo evutil_rand.lo evutil_time.lo listener.lo log.lo strlcpy.lo select.lo poll.lo   epoll.lo  signal.lo evdns.lo event_tagging.lo evrpc.lo http.lo   
libtool: link: rm -fr  .libs/libevent-2.1.so.7 .libs/libevent-2.1.so.7.0.1 .libs/libevent.a .libs/libevent.la .libs/libevent.lai .libs/libevent.so
libtool: link: clang -shared  -fPIC -DPIC  .libs/buffer.o .libs/bufferevent.o .libs/bufferevent_filter.o .libs/bufferevent_pair.o .libs/bufferevent_ratelim.o .libs/bufferevent_sock.o .libs/event.o .libs/evmap.o .libs/evthread.o .libs/evutil.o .libs/evutil_rand.o .libs/evutil_time.o .libs/listener.o .libs/log.o .libs/strlcpy.o .libs/select.o .libs/poll.o .libs/epoll.o .libs/signal.o .libs/evdns.o .libs/event_tagging.o .libs/evrpc.o .libs/http.o    -g -O2   -Wl,-soname -Wl,libevent-2.1.so.7 -o .libs/libevent-2.1.so.7.0.1
libtool: link: (cd ".libs" && rm -f "libevent-2.1.so.7" && ln -s "libevent-2.1.so.7.0.1" "libevent-2.1.so.7")
libtool: link: (cd ".libs" && rm -f "libevent.so" && ln -s "libevent-2.1.so.7.0.1" "libevent.so")
libtool: link: ar cr .libs/libevent.a  buffer.o bufferevent.o bufferevent_filter.o bufferevent_pair.o bufferevent_ratelim.o bufferevent_sock.o event.o evmap.o evthread.o evutil.o evutil_rand.o evutil_time.o listener.o log.o strlcpy.o select.o poll.o epoll.o signal.o evdns.o event_tagging.o evrpc.o http.o
libtool: link: ranlib .libs/libevent.a
libtool: link: ( cd ".libs" && rm -f "libevent.la" && ln -s "../libevent.la" "libevent.la" )

As you can see, clang is invoked to create .libs/libevent-2.1.so.7.0.1, but that is not the case in your environment.

what OS are you running on?
what is in your /opt/amd/setenv_AOCC.sh
(upload or copy/paste it, no screenshot please)

[liang-cj]

There is something wrong with your generated libtool and/or your environment. I am unable to reproduce it on my box.

FWIW, here is my output for make V=1 libevent.la

/bin/sh ./libtool  --tag=CC   --mode=link clang  -g -O2 -Wall -fno-strict-aliasing  -version-info 7:1:0 -release 2.1    -o libevent.la -rpath /opt/amd/openmp5/lib buffer.lo bufferevent.lo bufferevent_filter.lo bufferevent_pair.lo bufferevent_ratelim.lo bufferevent_sock.lo event.lo evmap.lo evthread.lo evutil.lo evutil_rand.lo evutil_time.lo listener.lo log.lo strlcpy.lo select.lo poll.lo   epoll.lo  signal.lo evdns.lo event_tagging.lo evrpc.lo http.lo   
libtool: link: rm -fr  .libs/libevent-2.1.so.7 .libs/libevent-2.1.so.7.0.1 .libs/libevent.a .libs/libevent.la .libs/libevent.lai .libs/libevent.so
libtool: link: clang -shared  -fPIC -DPIC  .libs/buffer.o .libs/bufferevent.o .libs/bufferevent_filter.o .libs/bufferevent_pair.o .libs/bufferevent_ratelim.o .libs/bufferevent_sock.o .libs/event.o .libs/evmap.o .libs/evthread.o .libs/evutil.o .libs/evutil_rand.o .libs/evutil_time.o .libs/listener.o .libs/log.o .libs/strlcpy.o .libs/select.o .libs/poll.o .libs/epoll.o .libs/signal.o .libs/evdns.o .libs/event_tagging.o .libs/evrpc.o .libs/http.o    -g -O2   -Wl,-soname -Wl,libevent-2.1.so.7 -o .libs/libevent-2.1.so.7.0.1
libtool: link: (cd ".libs" && rm -f "libevent-2.1.so.7" && ln -s "libevent-2.1.so.7.0.1" "libevent-2.1.so.7")
libtool: link: (cd ".libs" && rm -f "libevent.so" && ln -s "libevent-2.1.so.7.0.1" "libevent.so")
libtool: link: ar cr .libs/libevent.a  buffer.o bufferevent.o bufferevent_filter.o bufferevent_pair.o bufferevent_ratelim.o bufferevent_sock.o event.o evmap.o evthread.o evutil.o evutil_rand.o evutil_time.o listener.o log.o strlcpy.o select.o poll.o epoll.o signal.o evdns.o event_tagging.o evrpc.o http.o
libtool: link: ranlib .libs/libevent.a
libtool: link: ( cd ".libs" && rm -f "libevent.la" && ln -s "../libevent.la" "libevent.la" )

As you can see, clang is invoked to create .libs/libevent-2.1.so.7.0.1, but that is not the case in your environment.

what OS are you running on? what is in your /opt/amd/setenv_AOCC.sh (upload or copy/paste it, no screenshot please)

Looks like Thank you for the reminder. I'm running on OS Rocky 9.4. It seems like I have found a clue.

[root@localhost mydata]# cat /opt/amd/setenv_AOCC.sh

export LIBRARY_PATH=/usr/lib64:/usr/lib:$LIBRARY_PATH
export LD_LIBRARY_PATH=/usr/lib64:/usr/lib:$LD_LIBRARY_PATH
export PATH=/opt/amd/aocc-compiler-5.0.0/bin:$PATH
export PATH=/opt/amd/aocc-compiler-5.0.0/share/opt-viewer:$PATH
export LIBRARY_PATH=/opt/amd/aocc-compiler-5.0.0/lib:/opt/amd/aocc-compiler-5.0.0/lib32:$LIBRARY_PATH
export LD_LIBRARY_PATH=/opt/amd/aocc-compiler-5.0.0/ompd:/opt/amd/aocc-compiler-5.0.0/lib:/opt/amd/aocc-compiler-5.0.0/lib32:$LD_LIBRARY_PATH

if [[ -z $C_INCLUDE_PATH ]];then
export C_INCLUDE_PATH=/opt/amd/aocc-compiler-5.0.0/include
else
export C_INCLUDE_PATH=$C_INCLUDE_PATH:/opt/amd/aocc-compiler-5.0.0/include
fi

if [[ -z $CPLUS_INCLUDE_PATH ]];then
export CPLUS_INCLUDE_PATH=/opt/amd/aocc-compiler-5.0.0/include
else
export CPLUS_INCLUDE_PATH=$CPLUS_INCLUDE_PATH:/opt/amd/aocc-compiler-5.0.0/include
fi

[root@localhost mydata]# ls /usr/lib64/libevent-2.1.so.7.0.1
/usr/lib64/libevent-2.1.so.7.0.1

I noticed that a libevent.so already exist there.
[root@localhost mydata]# cat /opt/amd/setenv_AOCC.sh

export LIBRARY_PATH=/usr/lib64:/usr/lib:$LIBRARY_PATH

export LD_LIBRARY_PATH=/usr/lib64:/usr/lib:$LD_LIBRARY_PATH

these are loading first. It may cause Libtool conflict with /lib64 path?

After remove those two export or export manual without this script , I can install openmpi successful now.
[root@localhost mydata]# ls -l /opt/amd/openmp5/
total 12
drwxr-xr-x. 2 root root 4096 Mar 19 14:07 bin
drwxr-xr-x. 2 root root 168 Mar 14 14:10 etc
drwxr-xr-x. 7 root root 4096 Mar 19 14:07 include
drwxr-xr-x. 4 root root 4096 Mar 19 14:07 lib
drwxr-xr-x. 2 root root 31 Mar 14 16:27 sbin
drwxr-xr-x. 9 root root 103 Mar 14 14:09 share
[root@localhost mydata]# ls -l /opt/amd/openmp5/bin/
total 2120
-rwxr-xr-x. 1 root root 54938 Mar 19 14:07 event_rpcgen.py
-rwxr-xr-x. 1 root root 114056 Mar 14 16:27 hwloc-annotate
-rwxr-xr-x. 1 root root 124664 Mar 14 16:27 hwloc-bind
-rwxr-xr-x. 1 root root 134128 Mar 14 16:27 hwloc-calc
-rwxr-xr-x. 1 root root 4360 Mar 14 16:27 hwloc-compress-dir
-rwxr-xr-x. 1 root root 22072 Mar 14 16:27 hwloc-diff
-rwxr-xr-x. 1 root root 55264 Mar 14 16:27 hwloc-distrib
-rwxr-xr-x. 1 root root 55896 Mar 14 16:27 hwloc-gather-cpuid
-rwxr-xr-x. 1 root root 11460 Mar 14 16:27 hwloc-gather-topology
-rwxr-xr-x. 1 root root 129248 Mar 14 16:27 hwloc-info
lrwxrwxrwx. 1 root root 18 Mar 14 16:27 hwloc-ls -> lstopo-no-graphics
-rwxr-xr-x. 1 root root 23264 Mar 14 16:27 hwloc-patch
-rwxr-xr-x. 1 root root 69704 Mar 14 16:27 hwloc-ps
lrwxrwxrwx. 1 root root 18 Mar 14 16:27 lstopo -> lstopo-no-graphics
-rwxr-xr-x. 1 root root 408752 Mar 14 16:27 lstopo-no-graphics
lrwxrwxrwx. 1 root root 12 Mar 19 13:28 mpic++ -> opal_wrapper
lrwxrwxrwx. 1 root root 12 Mar 19 13:28 mpicc -> opal_wrapper
lrwxrwxrwx. 1 root root 12 Mar 19 13:28 mpiCC -> opal_wrapper
lrwxrwxrwx. 1 root root 12 Mar 19 13:28 mpicxx ->

[liang-cj]

There is something wrong with your generated libtool and/or your environment. I am unable to reproduce it on my box.
FWIW, here is my output for make V=1 libevent.la

/bin/sh ./libtool  --tag=CC   --mode=link clang  -g -O2 -Wall -fno-strict-aliasing  -version-info 7:1:0 -release 2.1    -o libevent.la -rpath /opt/amd/openmp5/lib buffer.lo bufferevent.lo bufferevent_filter.lo bufferevent_pair.lo bufferevent_ratelim.lo bufferevent_sock.lo event.lo evmap.lo evthread.lo evutil.lo evutil_rand.lo evutil_time.lo listener.lo log.lo strlcpy.lo select.lo poll.lo   epoll.lo  signal.lo evdns.lo event_tagging.lo evrpc.lo http.lo   
libtool: link: rm -fr  .libs/libevent-2.1.so.7 .libs/libevent-2.1.so.7.0.1 .libs/libevent.a .libs/libevent.la .libs/libevent.lai .libs/libevent.so
libtool: link: clang -shared  -fPIC -DPIC  .libs/buffer.o .libs/bufferevent.o .libs/bufferevent_filter.o .libs/bufferevent_pair.o .libs/bufferevent_ratelim.o .libs/bufferevent_sock.o .libs/event.o .libs/evmap.o .libs/evthread.o .libs/evutil.o .libs/evutil_rand.o .libs/evutil_time.o .libs/listener.o .libs/log.o .libs/strlcpy.o .libs/select.o .libs/poll.o .libs/epoll.o .libs/signal.o .libs/evdns.o .libs/event_tagging.o .libs/evrpc.o .libs/http.o    -g -O2   -Wl,-soname -Wl,libevent-2.1.so.7 -o .libs/libevent-2.1.so.7.0.1
libtool: link: (cd ".libs" && rm -f "libevent-2.1.so.7" && ln -s "libevent-2.1.so.7.0.1" "libevent-2.1.so.7")
libtool: link: (cd ".libs" && rm -f "libevent.so" && ln -s "libevent-2.1.so.7.0.1" "libevent.so")
libtool: link: ar cr .libs/libevent.a  buffer.o bufferevent.o bufferevent_filter.o bufferevent_pair.o bufferevent_ratelim.o bufferevent_sock.o event.o evmap.o evthread.o evutil.o evutil_rand.o evutil_time.o listener.o log.o strlcpy.o select.o poll.o epoll.o signal.o evdns.o event_tagging.o evrpc.o http.o
libtool: link: ranlib .libs/libevent.a
libtool: link: ( cd ".libs" && rm -f "libevent.la" && ln -s "../libevent.la" "libevent.la" )

As you can see, clang is invoked to create .libs/libevent-2.1.so.7.0.1, but that is not the case in your environment.
what OS are you running on? what is in your /opt/amd/setenv_AOCC.sh (upload or copy/paste it, no screenshot please)

Looks like Thank you for the reminder. I'm running on OS Rocky 9.4. It seems like I have found a clue.

[root@localhost mydata]# cat /opt/amd/setenv_AOCC.sh

export LIBRARY_PATH=/usr/lib64:/usr/lib:$LIBRARY_PATH export LD_LIBRARY_PATH=/usr/lib64:/usr/lib:$LD_LIBRARY_PATH export PATH=/opt/amd/aocc-compiler-5.0.0/bin:$PATH export PATH=/opt/amd/aocc-compiler-5.0.0/share/opt-viewer:$PATH export LIBRARY_PATH=/opt/amd/aocc-compiler-5.0.0/lib:/opt/amd/aocc-compiler-5.0.0/lib32:$LIBRARY_PATH export LD_LIBRARY_PATH=/opt/amd/aocc-compiler-5.0.0/ompd:/opt/amd/aocc-compiler-5.0.0/lib:/opt/amd/aocc-compiler-5.0.0/lib32:$LD_LIBRARY_PATH

if [[ -z $C_INCLUDE_PATH ]];then export C_INCLUDE_PATH=/opt/amd/aocc-compiler-5.0.0/include else export C_INCLUDE_PATH=$C_INCLUDE_PATH:/opt/amd/aocc-compiler-5.0.0/include fi

if [[ -z $CPLUS_INCLUDE_PATH ]];then export CPLUS_INCLUDE_PATH=/opt/amd/aocc-compiler-5.0.0/include else export CPLUS_INCLUDE_PATH=$CPLUS_INCLUDE_PATH:/opt/amd/aocc-compiler-5.0.0/include fi

[root@localhost mydata]# ls /usr/lib64/libevent-2.1.so.7.0.1 /usr/lib64/libevent-2.1.so.7.0.1

I noticed that a libevent.so already exist there. [root@localhost mydata]# cat /opt/amd/setenv_AOCC.sh

export LIBRARY_PATH=/usr/lib64:/usr/lib:$LIBRARY_PATH

export LD_LIBRARY_PATH=/usr/lib64:/usr/lib:$LD_LIBRARY_PATH

these are loading first. It may cause Libtool conflict with /lib64 path?

After remove those two export or export manual without this script , I can install openmpi successful now. [root@localhost mydata]# ls -l /opt/amd/openmp5/ total 12 drwxr-xr-x. 2 root root 4096 Mar 19 14:07 bin drwxr-xr-x. 2 root root 168 Mar 14 14:10 etc drwxr-xr-x. 7 root root 4096 Mar 19 14:07 include drwxr-xr-x. 4 root root 4096 Mar 19 14:07 lib drwxr-xr-x. 2 root root 31 Mar 14 16:27 sbin drwxr-xr-x. 9 root root 103 Mar 14 14:09 share [root@localhost mydata]# ls -l /opt/amd/openmp5/bin/ total 2120 -rwxr-xr-x. 1 root root 54938 Mar 19 14:07 event_rpcgen.py -rwxr-xr-x. 1 root root 114056 Mar 14 16:27 hwloc-annotate -rwxr-xr-x. 1 root root 124664 Mar 14 16:27 hwloc-bind -rwxr-xr-x. 1 root root 134128 Mar 14 16:27 hwloc-calc -rwxr-xr-x. 1 root root 4360 Mar 14 16:27 hwloc-compress-dir -rwxr-xr-x. 1 root root 22072 Mar 14 16:27 hwloc-diff -rwxr-xr-x. 1 root root 55264 Mar 14 16:27 hwloc-distrib -rwxr-xr-x. 1 root root 55896 Mar 14 16:27 hwloc-gather-cpuid -rwxr-xr-x. 1 root root 11460 Mar 14 16:27 hwloc-gather-topology -rwxr-xr-x. 1 root root 129248 Mar 14 16:27 hwloc-info lrwxrwxrwx. 1 root root 18 Mar 14 16:27 hwloc-ls -> lstopo-no-graphics -rwxr-xr-x. 1 root root 23264 Mar 14 16:27 hwloc-patch -rwxr-xr-x. 1 root root 69704 Mar 14 16:27 hwloc-ps lrwxrwxrwx. 1 root root 18 Mar 14 16:27 lstopo -> lstopo-no-graphics -rwxr-xr-x. 1 root root 408752 Mar 14 16:27 lstopo-no-graphics lrwxrwxrwx. 1 root root 12 Mar 19 13:28 mpic++ -> opal_wrapper lrwxrwxrwx. 1 root root 12 Mar 19 13:28 mpicc -> opal_wrapper lrwxrwxrwx. 1 root root 12 Mar 19 13:28 mpiCC -> opal_wrapper lrwxrwxrwx. 1 root root 12 Mar 19 13:28 mpicxx ->

It is strange that Ubuntu22.04 does not have such a problem in the same way.

[ggouaillardet]

Glad you were able to install Open MPI!

FWIW, the recommend way is to use the distro provided libevent (and hwloc).
For that, you need to install the devel packages (e.g. libevent-devel and hwloc-devel)