building carbon with a locally built llvm

[ymolists]

Hi All.

I am trying to build carbon with an llvm binary i built locally. I think i might be missing the c++ headers.

$uname -a
$lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description:    Ubuntu 22.04 LTS
Release:        22.04
Codename:       jammy

Linux ymo 5.15.0-41-generic #44-Ubuntu SMP Wed Jun 22 14:20:53 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

Here is the error i am getting:

$bazelisk run //explorer --verbose_failures -- ./explorer/testdata/print/format_only.carbon
Starting local Bazel server and connecting to it...
INFO: Invocation ID: bf322269-a334-4b72-bfa7-3dd163e9376e
INFO: Analyzed target //explorer:explorer (67 packages loaded, 1555 targets configured).
INFO: Found 1 target...
ERROR: /home/ymo/.cache/bazel/_bazel_ymo/76b9cef4d4ed1ecf2add8692006ee2ce/external/llvm-project/llvm/BUILD.bazel:136:11: Compiling llvm/lib/Demangle/RustDemangle.cpp failed: (Exit 1): clang++ failed: error executing command 
  (cd /home/ymo/.cache/bazel/_bazel_ymo/76b9cef4d4ed1ecf2add8692006ee2ce/sandbox/linux-sandbox/10/execroot/carbon && \
  exec env - \
    LANG=en_US.UTF-8 \
    LD_LIBRARY_PATH=/home/ymo/3rdp/dev/llvm/releases/llvm-latest/lib: \
    PATH=/home/ymo/.cache/bazelisk/downloads/bazelbuild/bazel-5.1.1-linux-x86_64/bin:/home/ymo/3rdp/dev/llvm/releases/llvm-latest/bin:/home/ymo/3rdp/dev/golang/releases/golatest/bin:/home/ymo/3rdp/dev/golang/releases/golatest-packages/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/snap/bin \
    PWD=/proc/self/cwd \
  /home/ymo/3rdp/dev/llvm/releases/llvm-v13.0.1-75e33f7/bin/clang++ -no-canonical-prefixes -fcolor-diagnostics -Werror -Wall -Wextra -Wthread-safety -Wself-assign -Wimplicit-fallthrough -Wctad-maybe-unsupported -Wnon-virtual-dtor -Wno-unused-parameter -c -MD -MF bazel-out/k8-fastbuild/bin/external/llvm-project/llvm/_objs/Demangle/RustDemangle.pic.d '-frandom-seed=bazel-out/k8-fastbuild/bin/external/llvm-project/llvm/_objs/Demangle/RustDemangle.pic.o' '-std=c++17' '-stdlib=libc++' -ffunction-sections -fdata-sections -fPIC -Wno-builtin-macro-redefined '-D__DATE__="redacted"' '-D__TIMESTAMP__="redacted"' '-D__TIME__="redacted"' '-DLLVM_ON_UNIX=1' '-DHAVE_BACKTRACE=1' '-DBACKTRACE_HEADER=<execinfo.h>' '-DLTDL_SHLIB_EXT=".so"' '-DLLVM_PLUGIN_EXT=".so"' '-DLLVM_ENABLE_THREADS=1' '-DHAVE_DEREGISTER_FRAME=1' '-DHAVE_LIBPTHREAD=1' '-DHAVE_PTHREAD_GETNAME_NP=1' '-DHAVE_PTHREAD_H=1' '-DHAVE_PTHREAD_SETNAME_NP=1' '-DHAVE_REGISTER_FRAME=1' '-DHAVE_SETENV_R=1' '-DHAVE_STRERROR_R=1' '-DHAVE_SYSEXITS_H=1' '-DHAVE_UNISTD_H=1' -D_GNU_SOURCE '-DHAVE_LINK_H=1' '-DHAVE_LSEEK64=1' '-DHAVE_MALLINFO=1' '-DHAVE_SBRK=1' '-DHAVE_STRUCT_STAT_ST_MTIM_TV_NSEC=1' '-DLLVM_NATIVE_ARCH="X86"' '-DLLVM_NATIVE_ASMPARSER=LLVMInitializeX86AsmParser' '-DLLVM_NATIVE_ASMPRINTER=LLVMInitializeX86AsmPrinter' '-DLLVM_NATIVE_DISASSEMBLER=LLVMInitializeX86Disassembler' '-DLLVM_NATIVE_TARGET=LLVMInitializeX86Target' '-DLLVM_NATIVE_TARGETINFO=LLVMInitializeX86TargetInfo' '-DLLVM_NATIVE_TARGETMC=LLVMInitializeX86TargetMC' '-DLLVM_NATIVE_TARGETMCA=LLVMInitializeX86TargetMCA' '-DLLVM_HOST_TRIPLE="x86_64-unknown-linux-gnu"' '-DLLVM_DEFAULT_TARGET_TRIPLE="x86_64-unknown-linux-gnu"' -D__STDC_LIMIT_MACROS -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -iquote external/llvm-project -iquote bazel-out/k8-fastbuild/bin/external/llvm-project -isystem external/llvm-project/llvm/include -isystem bazel-out/k8-fastbuild/bin/external/llvm-project/llvm/include -O1 -mllvm -fast-isel -gmlt -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fno-optimize-sibling-calls '-fsanitize=address,undefined,nullability' -fsanitize-address-use-after-scope '-fno-sanitize-recover=undefined' '-fsanitize-undefined-strip-path-components=-1' '-fno-sanitize=vptr' '-D_LIBCPP_DEBUG=1' external/llvm-project/llvm/lib/Demangle/RustDemangle.cpp -o bazel-out/k8-fastbuild/bin/external/llvm-project/llvm/_objs/Demangle/RustDemangle.pic.o)
# Configuration: e192eea24390fb1d90f7c9a9a38d3863e781d966ea16ae7da9f363aa8d39505d
# Execution platform: @local_config_platform//:host

Use --sandbox_debug to see verbose messages from the sandbox
In file included from external/llvm-project/llvm/lib/Demangle/RustDemangle.cpp:14:
external/llvm-project/llvm/include/llvm/Demangle/Demangle.h:12:10: fatal error: 'cstddef' file not found
#include <cstddef>
         ^~~~~~~~~
1 error generated.
ERROR: /home/ymo/.cache/bazel/_bazel_ymo/76b9cef4d4ed1ecf2add8692006ee2ce/external/llvm-project/llvm/BUILD.bazel:136:11: Compiling llvm/lib/Demangle/MicrosoftDemangle.cpp failed: (Exit 1): clang++ failed: error executing command 
  (cd /home/ymo/.cache/bazel/_bazel_ymo/76b9cef4d4ed1ecf2add8692006ee2ce/sandbox/linux-sandbox/24/execroot/carbon && \
  exec env - \
    LANG=en_US.UTF-8 \
    LD_LIBRARY_PATH=/home/ymo/3rdp/dev/llvm/releases/llvm-latest/lib: \
    PATH=/home/ymo/.cache/bazelisk/downloads/bazelbuild/bazel-5.1.1-linux-x86_64/bin:/home/ymo/3rdp/dev/llvm/releases/llvm-latest/bin:/home/ymo/3rdp/dev/golang/releases/golatest/bin:/home/ymo/3rdp/dev/golang/releases/golatest-packages/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/snap/bin \
    PWD=/proc/self/cwd \
  /home/ymo/3rdp/dev/llvm/releases/llvm-v13.0.1-75e33f7/bin/clang++ -no-canonical-prefixes -fcolor-diagnostics -Werror -Wall -Wextra -Wthread-safety -Wself-assign -Wimplicit-fallthrough -Wctad-maybe-unsupported -Wnon-virtual-dtor -Wno-unused-parameter -c -MD -MF bazel-out/k8-fastbuild/bin/external/llvm-project/llvm/_objs/Demangle/MicrosoftDemangle.pic.d '-frandom-seed=bazel-out/k8-fastbuild/bin/external/llvm-project/llvm/_objs/Demangle/MicrosoftDemangle.pic.o' '-std=c++17' '-stdlib=libc++' -ffunction-sections -fdata-sections -fPIC -Wno-builtin-macro-redefined '-D__DATE__="redacted"' '-D__TIMESTAMP__="redacted"' '-D__TIME__="redacted"' '-DLLVM_ON_UNIX=1' '-DHAVE_BACKTRACE=1' '-DBACKTRACE_HEADER=<execinfo.h>' '-DLTDL_SHLIB_EXT=".so"' '-DLLVM_PLUGIN_EXT=".so"' '-DLLVM_ENABLE_THREADS=1' '-DHAVE_DEREGISTER_FRAME=1' '-DHAVE_LIBPTHREAD=1' '-DHAVE_PTHREAD_GETNAME_NP=1' '-DHAVE_PTHREAD_H=1' '-DHAVE_PTHREAD_SETNAME_NP=1' '-DHAVE_REGISTER_FRAME=1' '-DHAVE_SETENV_R=1' '-DHAVE_STRERROR_R=1' '-DHAVE_SYSEXITS_H=1' '-DHAVE_UNISTD_H=1' -D_GNU_SOURCE '-DHAVE_LINK_H=1' '-DHAVE_LSEEK64=1' '-DHAVE_MALLINFO=1' '-DHAVE_SBRK=1' '-DHAVE_STRUCT_STAT_ST_MTIM_TV_NSEC=1' '-DLLVM_NATIVE_ARCH="X86"' '-DLLVM_NATIVE_ASMPARSER=LLVMInitializeX86AsmParser' '-DLLVM_NATIVE_ASMPRINTER=LLVMInitializeX86AsmPrinter' '-DLLVM_NATIVE_DISASSEMBLER=LLVMInitializeX86Disassembler' '-DLLVM_NATIVE_TARGET=LLVMInitializeX86Target' '-DLLVM_NATIVE_TARGETINFO=LLVMInitializeX86TargetInfo' '-DLLVM_NATIVE_TARGETMC=LLVMInitializeX86TargetMC' '-DLLVM_NATIVE_TARGETMCA=LLVMInitializeX86TargetMCA' '-DLLVM_HOST_TRIPLE="x86_64-unknown-linux-gnu"' '-DLLVM_DEFAULT_TARGET_TRIPLE="x86_64-unknown-linux-gnu"' -D__STDC_LIMIT_MACROS -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -iquote external/llvm-project -iquote bazel-out/k8-fastbuild/bin/external/llvm-project -isystem external/llvm-project/llvm/include -isystem bazel-out/k8-fastbuild/bin/external/llvm-project/llvm/include -O1 -mllvm -fast-isel -gmlt -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fno-optimize-sibling-calls '-fsanitize=address,undefined,nullability' -fsanitize-address-use-after-scope '-fno-sanitize-recover=undefined' '-fsanitize-undefined-strip-path-components=-1' '-fno-sanitize=vptr' '-D_LIBCPP_DEBUG=1' external/llvm-project/llvm/lib/Demangle/MicrosoftDemangle.cpp -o bazel-out/k8-fastbuild/bin/external/llvm-project/llvm/_objs/Demangle/MicrosoftDemangle.pic.o)
# Configuration: e192eea24390fb1d90f7c9a9a38d3863e781d966ea16ae7da9f363aa8d39505d
# Execution platform: @local_config_platform//:host

Use --sandbox_debug to see verbose messages from the sandbox
In file included from external/llvm-project/llvm/lib/Demangle/MicrosoftDemangle.cpp:16:
In file included from external/llvm-project/llvm/include/llvm/Demangle/MicrosoftDemangle.h:12:
In file included from external/llvm-project/llvm/include/llvm/Demangle/MicrosoftDemangleNodes.h:16:
external/llvm-project/llvm/include/llvm/Demangle/StringView.h:20:10: fatal error: 'cassert' file not found
#include <cassert>
         ^~~~~~~~~
1 error generated.
Target //explorer:explorer failed to build
INFO: Elapsed time: 2.055s, Critical Path: 0.22s
INFO: 33 processes: 33 internal.
FAILED: Build did NOT complete successfully
FAILED: Build did NOT complete successfully

Here is how i built llvm:

  cd /home/ymo/3rdp/dev/llvm/llvm-src/llvm.devbr \
    && git co llvmorg-13.0.1 \
    && mkdir -p build && cd build \
    && cmake \
    -DCMAKE_BUILD_TYPE=Release \
    -DCMAKE_INSTALL_PREFIX=/home/ymo/3rdp/dev/llvm/releases/llvm-v13.0.1 \
    -DLLVM_ENABLE_BINDINGS=OFF \
    -DLLVM_INCLUDE_DOCS=OFF \
    -DLLVM_INCLUDE_EXAMPLES=OFF \
    -DLLVM_INCLUDE_TESTS=OFF \
    -DLLVM_ENABLE_PROJECTS="clang;lld" \
    -DLLVM_TARGETS_TO_BUILD="BPF;X86" \
    -DCLANG_BUILD_EXAMPLES=OFF \
    -DLLVM_INSTALL_TOOLCHAIN_ONLY=ON \
    -DLLVM_LINK_LLVM_DYLIB=ON \
    -DCMAKE_SKIP_RPATH=OFF \
    -DLLVM_TOOLCHAIN_TOOLS="llvm-objcopy;llvm-objdump;llvm-readelf;llvm-strip;llvm-ar;llvm-as;llvm-dis;llvm-link;llvm-nm;llvm-ranlib;llc;opt" \
    ../llvm \
    && make -j$(nproc) \
    && make install ${@} 

[geoffromer]

Is there a reason that a homebrew install of llvm won't work for you?

[ymolists]

@geoffromer thank you so much for your help.

I personally don't use homebrew on my machines. I also understand this might be the preferred way for using carbon. I hope other people are in the same boat as me ... misery likes company :-)

Here is what i had to do to solve my issue.

// make sure you do this first on ubuntu 22.04
// sudo apt install python3-distutils -y


cd /home/ymo/3rdp/dev/llvm/llvm-src/llvm.devbr \
  && git co llvmorg-13.0.1 \
  && cmake -S ./llvm -B ./build/carbon \
  -DLLVM_TARGETS_TO_BUILD="X86" \
  -DLLVM_ENABLE_PROJECTS="clang;libcxx;libcxxabi;libunwind;lldb;compiler-rt;lld" \
  -DLLVM_ENABLE_PER_TARGET_RUNTIME_DIR=OFF \
  -DCMAKE_POSITION_INDEPENDENT_CODE=ON \
  -DLIBCXX_ENABLE_STATIC_ABI_LIBRARY=ON \
  -DLIBCXX_STATICALLY_LINK_ABI_IN_SHARED_LIBRARY=OFF \
  -DLIBCXX_STATICALLY_LINK_ABI_IN_STATIC_LIBRARY=ON \
  -DLIBCXX_USE_COMPILER_RT=ON \
  -DLIBCXXABI_USE_COMPILER_RT=ON \
  -DLIBCXXABI_USE_LLVM_UNWINDER=ON \
  -DCMAKE_BUILD_TYPE=Release \
  -DLLVM_ENABLE_BINDINGS=OFF \
  -DLLVM_INCLUDE_DOCS=OFF \
  -DLLVM_INCLUDE_TESTS=OFF \
  -DCLANG_BUILD_EXAMPLES=OFF \
  -DCMAKE_SKIP_RPATH=OFF \
  -DLLVM_LINK_LLVM_DYLIB=ON \
  -DLLVM_INSTALL_TOOLCHAIN_ONLY=ON \
  -DLLVM_TOOLCHAIN_TOOLS="llvm-objcopy;llvm-objdump;llvm-readelf;llvm-strip;llvm-ar;llvm-as;llvm-dis;llvm-link;llvm-nm;llvm-ranlib;llc;opt" \
  && cmake --build build/carbon -j$(nproc) \
  && cmake --install build/carbon --prefix /home/ymo/3rdp/dev/llvm/releases/llvm-v13.0.1-carbon

[geoffromer]

I also understand this might be the preferred way for using carbon.

For now we encourage people to set up their environments as described in that document, because we don't yet have the resources to support a lot of different configurations. I'm glad you figured out a way to make it work!