Can't compile Mitsuba3 on Windows 10, Intel Core i7-3930K

[aantg]

Hello!

I want to use double precision render variants. As they are not there by default, I have to compile Mitsuba myself. Based on relevant topic in documentation I followed steps below:

1. git clone --recursive https://github.com/mitsuba-renderer/mitsuba3 --branch v3.5.2

2. cmake -G "Visual Studio 17 2022" -A x64 -B build -DMI_ENABLE_EMBREE=0

Command output

cmake -G "Visual Studio 17 2022" -A x64 -B build -DMI_ENABLE_EMBREE=0
-- Selecting Windows SDK version 10.0.22621.0 to target Windows 10.0.19045.
-- The CXX compiler identification is MSVC 19.41.34123.0
-- The C compiler identification is MSVC 19.41.34123.0
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: C:/Program Files/Microsoft Visual Studio/2022/Community/VC/Tools/MSVC/14.41.34120/bin/Hostx64/x64/cl.exe - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: C:/Program Files/Microsoft Visual Studio/2022/Community/VC/Tools/MSVC/14.41.34120/bin/Hostx64/x64/cl.exe - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Mitsuba v3.5.2
-- Mitsuba: targeting the native CPU architecture (specify MI_NATIVE_FLAGS to change this).
-- Found Python: C:/Program Files/Python311/python.exe (found version "3.11.8") found components: Interpreter Development Development.Module Development.Embed
-- Looking for C++ include pybind11/pybind11.h
-- Looking for C++ include pybind11/pybind11.h - not found
CMake Deprecation Warning at ext/pybind11/CMakeLists.txt:8 (cmake_minimum_required):
  Compatibility with CMake < 3.5 will be removed from a future version of
  CMake.

  Update the VERSION argument <min> value or use a ...<max> suffix to tell
  CMake that the project does not need compatibility with older versions.


-- pybind11 v2.10.1
-- Performing Test HAS_MSVC_GL_LTCG
-- Performing Test HAS_MSVC_GL_LTCG - Success
-- Mitsuba: building the following variants:
--  * scalar_rgb
--  * scalar_spectral
--  * cuda_ad_rgb
--  * llvm_ad_rgb
-- Dr.Jit v0.4.6
-- Dr.Jit: building the CUDA & LLVM JIT backend.
-- Dr.Jit-Core: LLVM will be loaded dynamically at runtime.
-- Dr.Jit-Core: CUDA will be loaded dynamically at runtime.
-- Dr.Jit-Core: OptiX support enabled.
-- Dr.Jit-Core: OptiX debug and validation flags disabled.
-- Dr.Jit: building the autodiff backend.
-- Dr.Jit: building the Python plugin.
CMake Deprecation Warning at ext/zlib/CMakeLists.txt:1 (cmake_minimum_required):
  Compatibility with CMake < 3.5 will be removed from a future version of
  CMake.

  Update the VERSION argument <min> value or use a ...<max> suffix to tell
  CMake that the project does not need compatibility with older versions.


-- Looking for sys/types.h
-- Looking for sys/types.h - found
-- Looking for stdint.h
-- Looking for stdint.h - found
-- Looking for stddef.h
-- Looking for stddef.h - found
-- Check size of off64_t
-- Check size of off64_t - failed
-- Looking for fseeko
-- Looking for fseeko - not found
-- Looking for unistd.h
-- Looking for unistd.h - not found
-- Configure ILMBASE Version: 2.5.5 Lib API: 25.0.4
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - not found
-- Found Threads: TRUE
-- Looking for include file ucontext.h
-- Looking for include file ucontext.h - not found
-- Configure OpenEXR Version: 2.5.5 Lib API: 25.0.4
-- Performing Test OPENEXR_IMF_HAVE_SYSCONF_NPROCESSORS_ONLN
-- Performing Test OPENEXR_IMF_HAVE_SYSCONF_NPROCESSORS_ONLN - Failed
-- Performing Test OPENEXR_IMF_HAVE_GCC_INLINE_ASM_AVX
-- Performing Test OPENEXR_IMF_HAVE_GCC_INLINE_ASM_AVX - Failed
-- The ASM compiler identification is MSVC
-- Found assembler: C:/Program Files/Microsoft Visual Studio/2022/Community/VC/Tools/MSVC/14.41.34120/bin/Hostx64/x64/cl.exe
-- Found ZLIB: zlib
-- Performing Test HAVE_LD_VERSION_SCRIPT
-- Performing Test HAVE_LD_VERSION_SCRIPT - Failed
-- Performing Test HAVE_SOLARIS_LD_VERSION_SCRIPT
-- Performing Test HAVE_SOLARIS_LD_VERSION_SCRIPT - Failed
-- Looking for stdlib.h
-- Looking for stdlib.h - found
-- Found OpenMP_C: -openmp (found version "2.0")
-- Found OpenMP_CXX: -openmp (found version "2.0")
-- Found OpenMP: TRUE (found version "2.0")
-- Tests are disabled. Set FASTFLOAT_TEST to ON to run tests.
-- No build type selected, default to Release
-- Mitsuba: using OptiX for GPU ray tracing.
-- Mitsuba: using built-in implementation for CPU ray tracing.
-- Mitsuba: OptiX debug and validation flags disabled.
-- Could NOT find Sphinx (missing: SPHINX_EXECUTABLE)
CMake Warning at CMakeLists.txt:467 (message):


  Created a default 'mitsuba.conf' configuration file.  You will probably
  want to edit this file to specify the desired configurations before
  starting to compile.


-- Configuring done (31.5s)
-- Generating done (2.1s)
-- Build files have been written to: D:/Mitsuba3_compile/mitsuba3/build

3. Modified enabled variants list in mitsuba.conf file:

Modified list

    "enabled": [
        "scalar_rgb", "scalar_rgb_double", "cuda_ad_rgb", "cuda_ad_rgb_double"
    ]

4. Opened mitsuba.sln, changed configuration to Release, pressed Build Solution and build process failed after a while with lots of warnings and link errors LNK2001:

Some Build Errors

Severity	Code	Description	Project	File	Line	Suppression State	Details
.
.
.
Error	LNK2001	unresolved external symbol "__declspec(dllimport) public: unsigned __int64 __cdecl mitsuba::VolumeGrid<struct drjit::DiffArray<struct drjit::LLVMArray<float> >,struct mitsuba::Color<struct drjit::DiffArray<struct drjit::LLVMArray<float> >,3> >::buffer_size(void)const " (__imp_?buffer_size@?$VolumeGrid@U?$DiffArray@U?$LLVMArray@M@drjit@@@drjit@@U?$Color@U?$DiffArray@U?$LLVMArray@M@drjit@@@drjit@@$02@mitsuba@@@mitsuba@@QEBA_KXZ)	mitsuba_llvm_ad_rgb_ext	D:\Mitsuba3_compile\mitsuba3\build\src\python\volumegrid_v.obj	1		
Error	LNK2001	unresolved external symbol "__declspec(dllimport) public: virtual __cdecl mitsuba::VolumeGrid<struct drjit::DiffArray<struct drjit::LLVMArray<float> >,struct mitsuba::Color<struct drjit::DiffArray<struct drjit::LLVMArray<float> >,3> >::~VolumeGrid<struct drjit::DiffArray<struct drjit::LLVMArray<float> >,struct mitsuba::Color<struct drjit::DiffArray<struct drjit::LLVMArray<float> >,3> >(void)" (__imp_??1?$VolumeGrid@U?$DiffArray@U?$LLVMArray@M@drjit@@@drjit@@U?$Color@U?$DiffArray@U?$LLVMArray@M@drjit@@@drjit@@$02@mitsuba@@@mitsuba@@UEAA@XZ)	mitsuba_llvm_ad_rgb_ext	D:\Mitsuba3_compile\mitsuba3\build\src\python\volumegrid_v.obj	1		
Error	LNK1120	335 unresolved externals	mitsuba_llvm_ad_rgb_ext	D:\Mitsuba3_compile\mitsuba3\build\Release\python\mitsuba\mitsuba_llvm_ad_rgb_ext.cp311-win_amd64.pyd	1		
Error	MSB8066	Custom build for 'D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\8230916fc3b22feb400d758a1dc26448\pytest.ini.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\2b10fb59735323edc63e47aee77a7652\__init__.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\2b10fb59735323edc63e47aee77a7652\config.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\2b10fb59735323edc63e47aee77a7652\const.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\2b10fb59735323edc63e47aee77a7652\detail.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\2b10fb59735323edc63e47aee77a7652\generic.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\2b10fb59735323edc63e47aee77a7652\matrix.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\2b10fb59735323edc63e47aee77a7652\router.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\2b10fb59735323edc63e47aee77a7652\tensor.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\2b10fb59735323edc63e47aee77a7652\traits.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\54ecdd56a919555621e6dea50d1b716e\__init__.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\54ecdd56a919555621e6dea50d1b716e\config.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\aee64a92914f3336dea67567107e20b5\__init__.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\1b03e3d2fc8f603286d0208daf1eb7de\__init__.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\1b03e3d2fc8f603286d0208daf1eb7de\guiding.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\d6cdd3d3ec7b9835e093f194e7d77bd5\__init__.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\d6cdd3d3ec7b9835e093f194e7d77bd5\common.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\d6cdd3d3ec7b9835e093f194e7d77bd5\direct_projective.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\d6cdd3d3ec7b9835e093f194e7d77bd5\prb.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\d6cdd3d3ec7b9835e093f194e7d77bd5\prb_basic.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\d6cdd3d3ec7b9835e093f194e7d77bd5\prb_projective.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\d6cdd3d3ec7b9835e093f194e7d77bd5\prbvolpath.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\1b03e3d2fc8f603286d0208daf1eb7de\largesteps.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\1b03e3d2fc8f603286d0208daf1eb7de\optimizers.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\1b03e3d2fc8f603286d0208daf1eb7de\projective.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\aee64a92914f3336dea67567107e20b5\chi2.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\aee64a92914f3336dea67567107e20b5\cli.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\aee64a92914f3336dea67567107e20b5\math.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\aee64a92914f3336dea67567107e20b5\polvis.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\aee64a92914f3336dea67567107e20b5\sys_info.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\9bfd5e162a37acf99b7c1f31468c1d1c\__init__.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\9bfd5e162a37acf99b7c1f31468c1d1c\util.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\731ac4a57fa0771e8ad6d649a09e2aac\test_largesteps.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\731ac4a57fa0771e8ad6d649a09e2aac\test_util.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\aee64a92914f3336dea67567107e20b5\tonemap.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\aee64a92914f3336dea67567107e20b5\util.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\aee64a92914f3336dea67567107e20b5\xml.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\c8316fa6e2c98a09c364bb5204742835\__init__.pyi.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\36839d715f313e74a7974d5a26e3a5f6\drjit_stub_file_generation.rule;D:\Mitsuba3_compile\mitsuba3\src\python\CMakeLists.txt' exited with code 1.	drjit_stub_file_generation	C:\Program Files\Microsoft Visual Studio\2022\Community\MSBuild\Microsoft\VC\v170\Microsoft.CppCommon.targets	254		
Error	MSB8066	Custom build for 'D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\2e0ed232f4c53c6a8f5e9231fe86fd72\__init__.pyi.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\36839d715f313e74a7974d5a26e3a5f6\mitsuba_stub_file_generation.rule;D:\Mitsuba3_compile\mitsuba3\src\python\CMakeLists.txt' exited with code 1.	mitsuba_stub_file_generation	C:\Program Files\Microsoft Visual Studio\2022\Community\MSBuild\Microsoft\VC\v170\Microsoft.CppCommon.targets	254		

I also tried steps from documentation as-is (except that I cloned with --branch v3.5.2) and had no luck.

My configuration:

• Windows 10
• Visual Studio 2022 (Community Edition) Version 17.11.5 (Classic C++ Applications development task installed)
• cmake 3.30.5 (64bit)
• git 2.44.0 (64bit)
• Python 3.11.8 (64bit)

Where is my mistake? What should I do to successfully build Mitsuba? Also after that I would like to add Mitsuba to my python virtual environment, how to do it in a better way?

[njroussel]

Hi @aantg

If you combine v3.5.2. with the default set of variants. Do you still get the error message?

I think you might have a mitsuba package already installed on your system. Uninstall it before trying to compile the project yourself.

[aantg]

Instead of building from Visual Studio, could you try something like this from the terminal?

I tried but it failed.

Here is last part of output with error:

.
.
.
Building Custom Rule D:/Mitsuba3_compile/mitsuba3/src/python/CMakeLists.txt
Generating ../../Release/python/drjit/__init__.pyi
  Illegal instruction
C:\Program Files\Microsoft Visual Studio\2022\Community\MSBuild\Microsoft\VC\v170\Microsoft.CppCommon.targets(254,5): error MSB8066: Custom build for "D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\8230916fc3b22feb400d758a1dc26448\pytest.ini.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\2b10fb59735323edc63e47aee77a7652\__init__.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\2b10fb59735323edc63e47aee77a7652\config.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\2b10fb59735323edc63e47aee77a7652\const.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\2b10fb59735323edc63e47aee77a7652\detail.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\2b10fb59735323edc63e47aee77a7652\generic.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\2b10fb59735323edc63e47aee77a7652\matrix.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\2b10fb59735323edc63e47aee77a7652\router.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\2b10fb59735323edc63e47aee77a7652\tensor.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\2b10fb59735323edc63e47aee77a7652\traits.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\54ecdd56a919555621e6dea50d1b716e\__init__.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\54ecdd56a919555621e6dea50d1b716e\config.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\aee64a92914f3336dea67567107e20b5\__init__.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\1b03e3d2fc8f603286d0208daf1eb7de\__init__.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\1b03e3d2fc8f603286d0208daf1eb7de\guiding.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\d6cdd3d3ec7b9835e093f194e7d77bd5\__init__.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\d6cdd3d3ec7b9835e093f194e7d77bd5\common.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\d6cdd3d3ec7b9835e093f194e7d77bd5\direct_projective.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\d6cdd3d3ec7b9835e093f194e7d77bd5\prb.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\d6cdd3d3ec7b9835e093f194e7d77bd5\prb_basic.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\d6cdd3d3ec7b9835e093f194e7d77bd5\prb_projective.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\d6cdd3d3ec7b9835e093f194e7d77bd5\prbvolpath.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\1b03e3d2fc8f603286d0208daf1eb7de\largesteps.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\1b03e3d2fc8f603286d0208daf1eb7de\optimizers.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\1b03e3d2fc8f603286d0208daf1eb7de\projective.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\aee64a92914f3336dea67567107e20b5\chi2.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\aee64a92914f3336dea67567107e20b5\cli.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\aee64a92914f3336dea67567107e20b5\math.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\aee64a92914f3336dea67567107e20b5\polvis.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\aee64a92914f3336dea67567107e20b5\sys_info.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\9bfd5e162a37acf99b7c1f31468c1d1c\__init__.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\9bfd5e162a37acf99b7c1f31468c1d1c\util.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\731ac4a57fa0771e8ad6d649a09e2aac\test_largesteps.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\731ac4a57fa0771e8ad6d649a09e2aac\test_util.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\aee64a92914f3336dea67567107e20b5\tonemap.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\aee64a92914f3336dea67567107e20b5\util.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\aee64a92914f3336dea67567107e20b5\xml.py.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\c8316fa6e2c98a09c364bb5204742835\__init__.pyi.rule;D:\Mitsuba3_compile\mitsuba3\build\CMakeFiles\36839d715f313e74a7974d5a26e3a5f6\drjit_stub_file_generation.rule;D:\Mitsuba3_compile\mitsuba3\src\python\CMakeLists.txt" exited with code 1. [D:\Mitsuba3_compile\mitsuba3\build\src\python\drjit_stub_file_generation.vcxproj]
  Code generation completed
  mitsuba_cuda_ad_rgb_ext.vcxproj -> D:\Mitsuba3_compile\mitsuba3\build\Release\python\mitsuba\mitsuba_cuda_ad_rgb_ext.
  cp311-win_amd64.pyd

[njroussel]

Illegal instruction

That's rather unexpected. What is your CPU? Looks like you're compiling for some architecture that doesn't actually match your platform.

[aantg]

My CPU is Intel Core i7-3930K

[njroussel]

I was able to compile Mitsuba on Linux with that CPU (through QEMU) 🙁 . Of course, there might be some OS-specific code that is actually the source of this issue.

We don't have enough time or resources to dig into this deeper at the moment. If you figure out what the issue is, please report back here !

[aantg]

It is quite possible that there's something specific as I was able to compile tekari and it works, while precompiled windows executable from here immediately crashes.