Build errors on Jetson Orin Nano

[Saichand-Samudrala]

Hi,
I am seeing the following error when compiling vk_gaussian_splatting on Jetson Orin Nano.

[ 59%] Building CXX object nvpro_core2/nvgpu_monitor/CMakeFiles/nvgpu_monitor.dir/nvml_monitor.cpp.o
/home/camsin/saichand/camsin/ar_vr/vk_gaussian_splatting/build/_deps/nvpro_core2/nvgpu_monitor/nvml_monitor.cpp: In function ‘const string brandToString(nvmlBrandType_t)’:
/home/camsin/saichand/camsin/ar_vr/vk_gaussian_splatting/build/_deps/nvpro_core2/nvgpu_monitor/nvml_monitor.cpp:91:10: error: ‘NVML_BRAND_NVIDIA_CLOUD_GAMING’ was not declared in this scope; did you mean ‘NVML_BRAND_NVIDIA_VGAMING’?
91 | case NVML_BRAND_NVIDIA_CLOUD_GAMING:
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
| NVML_BRAND_NVIDIA_VGAMING
gmake[2]: *** [nvpro_core2/nvgpu_monitor/CMakeFiles/nvgpu_monitor.dir/build.make:109: nvpro_core2/nvgpu_monitor/CMakeFiles/nvgpu_monitor.dir/nvml_monitor.cpp.o] Error 1
gmake[1]: *** [CMakeFiles/Makefile2:1183: nvpro_core2/nvgpu_monitor/CMakeFiles/nvgpu_monitor.dir/all] Error 2
gmake: *** [Makefile:156: all] Error 2

[ 65%] Building CXX object CMakeFiles/vk_gaussian_splatting.dir/src/main.cpp.o
In file included from /usr/include/c++/11/ext/alloc_traits.h:34,
from /usr/include/c++/11/bits/basic_string.h:40,
from /usr/include/c++/11/string:55,
from /usr/include/c++/11/bits/locale_classes.h:40,
from /usr/include/c++/11/bits/ios_base.h:41,
from /usr/include/c++/11/ios:42,
from /usr/include/c++/11/ostream:38,
from /usr/include/c++/11/iostream:39,
from /home/camsin/saichand/camsin/ar_vr/vk_gaussian_splatting/src/gaussian_splatting_ui.h:23,
from /home/camsin/saichand/camsin/ar_vr/vk_gaussian_splatting/src/main.cpp:20:
/usr/include/c++/11/bits/alloc_traits.h: In instantiation of ‘static constexpr void std::allocator_traits<std::allocator<_CharT> >::construct(std::allocator_traits<std::allocator<_CharT> >::allocator_type&, _Up*, _Args&& ...) [with _Up = std::function<void(const nvutils::ParameterSequencer::State&)>; _Args = {main(int, char**)::<lambda()>}; _Tp = std::function<void(const nvutils::ParameterSequencer::State&)>; std::allocator_traits<std::allocator<_CharT> >::allocator_type = std::allocator<std::function<void(const nvutils::ParameterSequencer::State&)> >]’:
/usr/include/c++/11/bits/vector.tcc:115:30: required from ‘std::vector<_Tp, _Alloc>::reference std::vector<_Tp, _Alloc>::emplace_back(_Args&& ...) [with _Args = {main(int, char**)::<lambda()>}; _Tp = std::function<void(const nvutils::ParameterSequencer::State&)>; _Alloc = std::allocator<std::function<void(const nvutils::ParameterSequencer::State&)> >; std::vector<_Tp, _Alloc>::reference = std::function<void(const nvutils::ParameterSequencer::State&)>&]’
/home/camsin/saichand/camsin/ar_vr/vk_gaussian_splatting/src/main.cpp:68:43: required from here
/usr/include/c++/11/bits/alloc_traits.h:518:28: error: no matching function for call to ‘construct_at(std::function<void(const nvutils::ParameterSequencer::State&)>&, main(int, char**)::<lambda()>)’
518 | std::construct_at(__p, std::forward<_Args>(__args)...);
| ~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
In file included from /usr/include/c++/11/bits/stl_iterator.h:85,
from /usr/include/c++/11/bits/stl_algobase.h:67,
from /usr/include/c++/11/bits/char_traits.h:39,
from /usr/include/c++/11/ios:40,
from /usr/include/c++/11/ostream:38,
from /usr/include/c++/11/iostream:39,
from /home/camsin/saichand/camsin/ar_vr/vk_gaussian_splatting/src/gaussian_splatting_ui.h:23,
from /home/camsin/saichand/camsin/ar_vr/vk_gaussian_splatting/src/main.cpp:20:
/usr/include/c++/11/bits/stl_construct.h:94:5: note: candidate: ‘template<class _Tp, class ... _Args> constexpr decltype (::new(void(0)) _Tp) std::construct_at(_Tp*, _Args&& ...)’
94 | construct_at(_Tp* __location, _Args&&... __args)
| ^~~~~~~~~~~~
/usr/include/c++/11/bits/stl_construct.h:94:5: note: template argument deduction/substitution failed:
/usr/include/c++/11/bits/stl_construct.h: In substitution of ‘template<class _Tp, class ... _Args> constexpr decltype (::new(void*(0)) _Tp) std::construct_at(_Tp*, _Args&& ...) [with _Tp = std::function<void(const nvutils::ParameterSequencer::State&)>; _Args = {main(int, char**)::<lambda()>}]’:
/usr/include/c++/11/bits/alloc_traits.h:518:21: required from ‘static constexpr void std::allocator_traits<std::allocator<_CharT> >::construct(std::allocator_traits<std::allocator<_CharT> >::allocator_type&, _Up*, _Args&& ...) [with _Up = std::function<void(const nvutils::ParameterSequencer::State&)>; _Args = {main(int, char**)::<lambda()>}; _Tp = std::function<void(const nvutils::ParameterSequencer::State&)>; std::allocator_traits<std::allocator<_CharT> >::allocator_type = std::allocator<std::function<void(const nvutils::ParameterSequencer::State&)> >]’
/usr/include/c++/11/bits/vector.tcc:115:30: required from ‘std::vector<_Tp, _Alloc>::reference std::vector<_Tp, _Alloc>::emplace_back(_Args&& ...) [with _Args = {main(int, char**)::<lambda()>}; _Tp = std::function<void(const nvutils::ParameterSequencer::State&)>; _Alloc = std::allocator<std::function<void(const nvutils::ParameterSequencer::State&)> >; std::vector<_Tp, _Alloc>::reference = std::function<void(const nvutils::ParameterSequencer::State&)>&]’
/home/camsin/saichand/camsin/ar_vr/vk_gaussian_splatting/src/main.cpp:68:43: required from here
/usr/include/c++/11/bits/stl_construct.h:96:17: error: no matching function for call to ‘std::function<void(const nvutils::ParameterSequencer::State&)>::function(main(int, char**)::<lambda()>)’
96 | -> decltype(::new((void*)0) _Tp(std::declval<_Args>()...))

Please help resolve errors.
Thanks

[Saichand-Samudrala]

Hi,
Any suggestions on the above?
Thanks

[marviej]

Hello,

Unfortunately, the Orin-Nano platform is not supported by the software.

If you would still like to experiment with making it work, you could try removing CUDA from the environment paths before generating with CMake. Since CUDA is only required for the NVML monitor, CMake will then skip this step.

That said, I expect you may run into other challenges. In particular, getting Vulkan 1.4 running on this platform may not be straightforward, and it is a strict requirement for the software.

[Saichand-Samudrala]

Hello,
Thank you for the information.
I tried compiling with the latest vk_gaussian_splatting github commits on the device. The build compilation was successful. However, it gives the error below when run the ./_bin/vk_gaussian_splatting (executable) command.

Creating Vulkan Context
| createInstance -> 104.753 ms
Requested Vulkan version (1.4) is higher than available version (1.3).
Vulkan error: VK_ERROR_INITIALIZATION_FAILED from selectPhysicalDevice(), /home/camsin/saichand/camsin/ar_vr/vk_gaussian_splatting/build/_deps/nvpro_core2/nvvk/context.cpp:75
|-> 110.400 ms
Error in Vulkan context creation

FYI: I am using Vulkan 1.4.313.0 version.

[marviej]

Hello,

That is great news, did you do any modification to get it compiled ?

Regarding the runtime issue, can you share the output of the "vulkaninfo" command in a text file (run from same environment than the sample)?

vulkaninfo > vulkaninfo.txt

When you installed Vulkan 1.4 did you fully remove previous versions? How did you get VK 1.4 installed ?

[Saichand-Samudrala]

Hello,
I compiled it with out any modifications. Please find attached vulkaninfo.txt. It throws the following warnings when running the "vulkaninfo" command.

WARNING: [Loader Message] Code 0 : Layer VK_LAYER_MESA_device_select uses API version 1.3 which is older than the application specified API version of 1.4. May cause issues.
WARNING: [Loader Message] Code 0 : terminator_CreateInstance: Received return code -3 from call to vkCreateInstance in ICD /usr/lib/aarch64-linux-gnu/libvulkan_virtio.so. Skipping this driver.

I used the following following commands from vulkanlunarg to configure the Vulkan. I did not explicitly remove previous versions.
export VULKAN_SDK=~/vulkan/
export PATH=$VULKAN_SDK/bin:$PATH
export LD_LIBRARY_PATH=$VULKAN_SDK/lib${LD_LIBRARY_PATH:+:$LD_LIBRARY_PATH}
export VK_ADD_LAYER_PATH=$VULKAN_SDK/share/vulkan/explicit_layer.d
sudo cp -r $VULKAN_SDK/include/vulkan/ /usr/local/include/
sudo cp -P $VULKAN_SDK/lib/libvulkan.so* /usr/local/lib/
sudo cp $VULKAN_SDK/lib/libVkLayer_.so /usr/local/lib/
sudo mkdir -p /usr/local/share/vulkan/explicit_layer.d
sudo cp $VULKAN_SDK/share/vulkan/explicit_layer.d/VkLayer_.json /usr/local/share/vulkan/explicit_layer.d
I compiled the vulkan using the script provided in vulkanlunarg.

vulkaninfo.txt

[marviej]

According to the info, you have the LunarG SDK that is 1.4 (the Vulkan 1.4.313.0 version you are mentioning) but the drivers are 1.3. To get updated drivers including Vulkan 1.4 you will have to install Jetpack 7.

https://docs.nvidia.com/jetson/jetpack/install-setup/index.html

[Saichand-Samudrala]

Looks like Jetpack 7 is not supported by Jetson Orin Nano. Is there are a way to use Vulkan 1.3 for vk gaussian splatting?

Thanks

[marviej]

Hello,

I am sorry for this, I thought that it was supported.

You may try the following, in file main.cpp around line 87
update the code as follows and retry.

/////////////////////////////////
// Vulkan creation context information
vkSetup.apiVersion = VK_API_VERSION_1_3; // <-- Add this
vkSetup.enableAllFeatures = true;

You will get several validation errors in the runtime log, but you may be able to get the 3DGS pipeline running.

[Saichand-Samudrala]

Hello,
No problem. I tried the above and see the following.

[ 40%] Building CXX object nvpro_core2/nvvk/CMakeFiles/nvvk.dir/cmake_pch.hxx.gch
[ 40%] Building CXX object nvpro_core2/nvvk/CMakeFiles/nvvk.dir/acceleration_structures.cpp.o
In file included from /home/camsin/vk_gaussian_splatting/nvpro_core2/nvvk/acceleration_structures.cpp:24:
/home/camsin/vk_gaussian_splatting/nvpro_core2/nvvk/acceleration_structures.cpp: In member function ‘void nvvk::AccelerationStructureHelper::blasSubmitBuildAndWait(const std::vectornvvk::AccelerationStructureGeometryInfo&, VkBuildAccelerationStructureFlagsKHR)’:
/home/camsin/vk_gaussian_splatting/nvpro_core2/nvvk/acceleration_structures.cpp:631:36: error: ‘VK_BUFFER_USAGE_2_STORAGE_BUFFER_BIT’ was not declared in this scope; did you mean ‘VK_BUFFER_USAGE_STORAGE_BUFFER_BIT’?
631 | VK_BUFFER_USAGE_2_STORAGE_BUFFER_BIT | VK_BUFFER_USAGE_2_SHADER_DEVICE_ADDRESS_BIT
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/home/camsin/vk_gaussian_splatting/nvpro_core2/nvvk/check_error.hpp:62:35: note: in definition of macro ‘NVVK_CHECK’
62 | const VkResult checkResult = (vkFnc);
| ^~~~~
/home/camsin/vk_gaussian_splatting/nvpro_core2/nvvk/acceleration_structures.cpp:631:75: error: ‘VK_BUFFER_USAGE_2_SHADER_DEVICE_ADDRESS_BIT’ was not declared in this scope; did you mean ‘VK_BUFFER_USAGE_SHADER_DEVICE_ADDRESS_BIT’?
631 | VK_BUFFER_USAGE_2_STORAGE_BUFFER_BIT | VK_BUFFER_USAGE_2_SHADER_DEVICE_ADDRESS_BIT
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/home/camsin/vk_gaussian_splatting/nvpro_core2/nvvk/check_error.hpp:62:35: note: in definition of macro ‘NVVK_CHECK’
62 | const VkResult checkResult = (vkFnc);
| ^~~~~
/home/camsin/vk_gaussian_splatting/nvpro_core2/nvvk/acceleration_structures.cpp: In member function ‘void nvvk::AccelerationStructureHelper::tlasSubmitBuildAndWait(const std::vector&, VkBuildAccelerationStructureFlagsKHR)’:
/home/camsin/vk_gaussian_splatting/nvpro_core2/nvvk/acceleration_structures.cpp:697:80: error: ‘VK_BUFFER_USAGE_2_SHADER_DEVICE_ADDRESS_BIT’ was not declared in this scope; did you mean ‘VK_BUFFER_USAGE_SHADER_DEVICE_ADDRESS_BIT’?
697 | VK_BUFFER_USAGE_2_ACCELERATION_STRUCTURE_BUILD_INPUT_READ_ONLY_BIT_KHR | VK_BUFFER_USAGE_2_SHADER_DEVICE_ADDRESS_BIT));
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/home/camsin/vk_gaussian_splatting/nvpro_core2/nvvk/check_error.hpp:62:35: note: in definition of macro ‘NVVK_CHECK’
62 | const VkResult checkResult = (vkFnc);
| ^~~~~
/home/camsin/vk_gaussian_splatting/nvpro_core2/nvvk/acceleration_structures.cpp:719:36: error: ‘VK_BUFFER_USAGE_2_SHADER_DEVICE_ADDRESS_BIT’ was not declared in this scope; did you mean ‘VK_BUFFER_USAGE_SHADER_DEVICE_ADDRESS_BIT’?
719 | VK_BUFFER_USAGE_2_SHADER_DEVICE_ADDRESS_BIT | VK_BUFFER_USAGE_2_STORAGE_BUFFER_BIT
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/home/camsin/vk_gaussian_splatting/nvpro_core2/nvvk/check_error.hpp:62:35: note: in definition of macro ‘NVVK_CHECK’
62 | const VkResult checkResult = (vkFnc);
| ^~~~~
/home/camsin/vk_gaussian_splatting/nvpro_core2/nvvk/acceleration_structures.cpp:719:82: error: ‘VK_BUFFER_USAGE_2_STORAGE_BUFFER_BIT’ was not declared in this scope; did you mean ‘VK_BUFFER_USAGE_STORAGE_BUFFER_BIT’?
719 | VK_BUFFER_USAGE_2_SHADER_DEVICE_ADDRESS_BIT | VK_BUFFER_USAGE_2_STORAGE_BUFFER_BIT
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/home/camsin/vk_gaussian_splatting/nvpro_core2/nvvk/check_error.hpp:62:35: note: in definition of macro ‘NVVK_CHECK’
62 | const VkResult checkResult = (vkFnc);
| ^~~~~
/home/camsin/vk_gaussian_splatting/nvpro_core2/nvvk/acceleration_structures.cpp: In member function ‘void nvvk::AccelerationStructureHelper::tlasSubmitUpdateAndWait(const std::vector&)’:
/home/camsin/vk_gaussian_splatting/nvpro_core2/nvvk/acceleration_structures.cpp:755:38: error: ‘VK_BUFFER_USAGE_2_SHADER_DEVICE_ADDRESS_BIT’ was not declared in this scope; did you mean ‘VK_BUFFER_USAGE_SHADER_DEVICE_ADDRESS_BIT’?
755 | VK_BUFFER_USAGE_2_SHADER_DEVICE_ADDRESS_BIT | VK_BUFFER_USAGE_2_STORAGE_BUFFER_BIT,
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/home/camsin/vk_gaussian_splatting/nvpro_core2/nvvk/check_error.hpp:62:35: note: in definition of macro ‘NVVK_CHECK’
62 | const VkResult checkResult = (vkFnc);
| ^~~~~
/home/camsin/vk_gaussian_splatting/nvpro_core2/nvvk/acceleration_structures.cpp:755:84: error: ‘VK_BUFFER_USAGE_2_STORAGE_BUFFER_BIT’ was not declared in this scope; did you mean ‘VK_BUFFER_USAGE_STORAGE_BUFFER_BIT’?
755 | VK_BUFFER_USAGE_2_SHADER_DEVICE_ADDRESS_BIT | VK_BUFFER_USAGE_2_STORAGE_BUFFER_BIT,
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/home/camsin/vk_gaussian_splatting/nvpro_core2/nvvk/check_error.hpp:62:35: note: in definition of macro ‘NVVK_CHECK’
62 | const VkResult checkResult = (vkFnc);
| ^~~~~
gmake[2]: *** [nvpro_core2/nvvk/CMakeFiles/nvvk.dir/build.make:93: nvpro_core2/nvvk/CMakeFiles/nvvk.dir/acceleration_structures.cpp.o] Error 1
gmake[1]: *** [CMakeFiles/Makefile2:1214: nvpro_core2/nvvk/CMakeFiles/nvvk.dir/all] Error 2

[marviej]

Hello,

since you were previously able to compile and execute, the only added line "vkSetup.apiVersion = VK_API_VERSION_1_3;" could not provoke this kind of compilation errors.

something might have been changed in your code somewhere else or more probably in your build environment.

[Saichand-Samudrala]

Hello,

Right. Sorry, I thought it might make sense to change the Vulkan SDK version to 1.3 as well, so did that. Now, I have reconfigured it to 1.4. and it works. BTW, will the following configuration apply to future builds in case I move to the new ones?

/////////////////////////////////
// Vulkan creation context information
vkSetup.apiVersion = VK_API_VERSION_1_3; // <-- Add this
vkSetup.enableAllFeatures = true

Thanks

[marviej]

Hello,
I am very glad to see that you got the sample running. Do you manage to activate all the pipelines, including mesh shader and raytracing ones ?

I cannot tell you if doing this API force trick will work with more recent versions of the sample. Forcing the API to 1.3 may lead to instabilities. You certainly get some validation errors in the log with your current setup. Just try and test.

[Saichand-Samudrala]

Hello,
Yes, I can activate all the pipelines, including mesh shader and raytracing ones.
I see. Thanks for the info about the API. I will keep using this setup for now.
Appreciate all the help!