Could not send the import converted instance command to host

[asishodi]

problem

Cloudstack 4.20.1
2 KVM hosts RHEL 8.10 (24 cores, 256GB)
1 management server RHEL 8.10
1 Zone - Core, networking advance share network
vCenter 7.0, ESXi 6.5

External vCenter trying to import unmanaged VM.

trying to import a VMware instance to cloudstack. Simple small VM running RHEL 8.10 on VMware imports fine and I can log into it from pulblic network. But while trying to import a VMware VM with 16 coress and 256GB RAM and 1.5TB of storage fails with below error. I can see the qcow2 images under primary storage and in logs I can see the drives were imported and converted. After that it tried to start the VM on KVM host (I am assuming) and fails after 3600sec.

2025-07-15 01:38:26,274 ERROR [o.a.c.v.UnmanagedVMsManagerImpl] (API-Job-Executor-4:[ctx-ffddfc4b, job-3247, ctx-5dd2b2a5]) (logid:c2c26803) Error importing VM: Could not send the import converted instance command to host Host {"id":17,"name":"mets.cc.pw.us.am.ericsson.se","type":"Routing","uuid":"03da42aa-22a2-451b-872a-b29b53039b06"} due to: Commands 1980739411112896484 to Host 17 timed out after 3600 com.cloud.utils.exception.CloudRuntimeException: Could not send the import converted instance command to host Host {"id":17,"name":"mets.cc.pw.us.am.ericsson.se","type":"Routing","uuid":"03da42aa-22a2-451b-872a-b29b53039b06"} due to: Commands 1980739411112896484 to Host 17 timed out after 3600
at org.apache.cloudstack.vm.UnmanagedVMsManagerImpl.convertAndImportToKVM(UnmanagedVMsManagerImpl.java:2047)
at org.apache.cloudstack.vm.UnmanagedVMsManagerImpl.convertVmwareInstanceToKVMAfterExportingOVFToConvertLocation(UnmanagedVMsManagerImpl.java:2010)
at org.apache.cloudstack.vm.UnmanagedVMsManagerImpl.importUnmanagedInstanceFromVmwareToKvm(UnmanagedVMsManagerImpl.java:1676)
at org.apache.cloudstack.vm.UnmanagedVMsManagerImpl.baseImportInstance(UnmanagedVMsManagerImpl.java:1386)
at org.apache.cloudstack.vm.UnmanagedVMsManagerImpl.importVm(UnmanagedVMsManagerImpl.java:1507)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:105)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
at com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:52)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215)
at jdk.proxy3/jdk.proxy3.$Proxy514.importVm(Unknown Source)
at org.apache.cloudstack.api.command.admin.vm.ImportVmCmd.execute(ImportVmCmd.java:269)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:173)
at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:110)
at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:652)
at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:600)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:840)

happens everytime when I try to import this big VM.

versions

Cloudstack 4.20.1
2 KVM hosts RHEL 8.10 (24 cores, 256GB)
1 management server RHEL 8.10
1 Zone - Core, networking advance share network
vCenter 7.0, ESXi 6.5

The steps to reproduce the bug

...

What to do about it?

No response

[boring-cyborg[bot]]

Thanks for opening your first issue here! Be sure to follow the issue template!

[DaanHoogland]

@asishodi ,
256GB RAM (the total memory of the host on which it is running) and 1.5TB of storage sound very big.

Check if the host on which the conversion happens has access to enough storage.
Also check the agent logs for the host doing the conversion.
Look in the MS log for any information about the copy before the timeout. (grep for job-3247 or logid:c2c26803)

good luck trouble shooting.