You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
refactor: Remove CPU pinning config and docs from nova gpu DT/VA
Isolcpus shoudl not be used on non realtime systems or on non nfv
systems. We consider that to be a bad practics and technically
unsupproted by the compute team.
Also neither edpm_tuned_isolated_cores nor isolcpus is required to use
cpu pinning. And edpm_tuned_isolated_cores is recommend but still
optional.
Omit those alltogether for a nova04delta full GPU device passthrough,
and its related nova-vfio-passthrough VA.
Co-authored-by: aider (gemini/gemini-2.5-pro) <[email protected]>
Copy file name to clipboardExpand all lines: examples/dt/nova/nova04delta/README.md
+1-8Lines changed: 1 addition & 8 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -20,11 +20,6 @@ The following parameters are crucial for host-level configuration:
20
20
*`intel_iommu=on iommu=pt`: Enables the IOMMU for device passthrough.
21
21
*`vfio-pci.ids=10de:20f1`: Instructs the `vfio-pci` driver to claim the specified GPU(s) by their vendor and product IDs at boot time. The example IDs `10de:20f1` are for an NVIDIA A100 GPU.
22
22
*`rd.driver.pre=vfio-pci`: Avoids race conditions during boot by loading vfio-pci kernel module early.
23
-
*`isolcpus=...`: Isolates a set of CPUs from the kernel scheduler to be used for dedicated vCPU workloads.
24
-
25
-
*`edpm_tuned_profile` and `edpm_tuned_isolated_cores`: These parameters configure the `tuned` service.
26
-
*`edpm_tuned_profile` is set to `cpu-partitioning-powersave` to enable CPU isolation features.
27
-
*`edpm_tuned_isolated_cores` specifies the cores to be isolated. This should match the list of CPUs provided in the `isolcpus` kernel argument.
28
23
29
24
***VFIO-PCI Binding Service**: The `vfio-pci-bind` service in `dt/nova/nova04delta/edpm/nodeset/nova_gpu.yaml` blacklists the `nouveau` and `nvidia` kernel modules to ensure they do not interfere with the `vfio-pci` driver. The service also regenerates the initramfs and grub configuration to apply these changes. A reboot is required for these changes to take effect.
30
25
@@ -66,12 +61,10 @@ That is a contrary to the legacy mode where PCI devices used to be requested thr
66
61
In addition to PCI device configuration, the `nova.compute.conf` section includes parameters for resource management on the compute node:
67
62
68
63
* `[DEFAULT]reserved_host_memory_mb`: Specifies the amount of memory (in megabytes) to reserve for the host operating system and other non-OpenStack services. This memory will not be available for allocation to virtual machines.
69
-
* `[compute]cpu_shared_set`: A list of physical CPUs that are available for host processes and for virtual machines that do not have dedicated CPUs (i.e., unpinned VMs). These should be the CPUs that are **not** isolated by `isolcpus` or `edpm_tuned_isolated_cores`.
70
-
* `[compute]cpu_dedicated_set`: A list of physical CPUs that are exclusively reserved for virtual machines with dedicated CPU pinning policies. To ensure performance isolation, this list should correspond directly to the CPUs isolated using the `isolcpus` kernel argument and `edpm_tuned_isolated_cores` parameter.
71
64
* `[DEFAULT]reserved_huge_pages`: Defines the number and size of huge pages to reserve for the host, making them unavailable for guest VMs. This configuration works in conjunction with the `hugepages` and `hugepagesz` kernel arguments, which define the total pool of huge pages on the host.
72
65
73
66
**Note**: In a full device passthrough scenario, the `[devices]enabled_vgpu_types` option in Nova's configuration is not used. This option is specific to mediated device (mdev) configurations.
74
67
75
68
## Guest VM
76
69
77
-
To use the passthrough GPU, the guest operating system inside the VM must have the appropriate native NVIDIA driver installed. You will need a standard NVIDIA driver. Do not use vGPU-enabled guest drivers. The GPU will appear as a physical PCI device within the guest.
70
+
To use the passthrough GPU, the guest operating system inside the VM must have the appropriate native NVIDIA driver installed. You will need a standard NVIDIA driver. Do not use vGPU-enabled guest drivers. The GPU will appear as a physical PCI device within the guest.
0 commit comments