Skip to content

Commit f6a1e79

Browse files
committed
Clarify PCI in placement scenario and storagemgmt use
Signed-off-by: Bohdan Dobrelia <[email protected]>
1 parent 4c1f5df commit f6a1e79

File tree

3 files changed

+35
-4
lines changed

3 files changed

+35
-4
lines changed

examples/dt/nova/nova04delta/README.md

Lines changed: 7 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
# Nova GPU Passthrough (VFIO)
22

3-
This directory contains the necessary configurations to deploy OpenStack with Nova configured for full GPU device passthrough (VFIO). This setup allows entire physical GPUs on compute nodes to be passed directly to virtual machines, providing near-native performance.
3+
This directory contains the necessary configurations to deploy OpenStack with Nova configured for full GPU device passthrough (VFIO). This setup allows entire physical GPUs on compute nodes to be passed directly to virtual machines, providing near-native performance. Nova control plane is configured for requesting PCI devices from Placement.
44

55
## Overview
66

@@ -30,6 +30,11 @@ The following parameters are crucial for host-level configuration:
3030

3131
## Nova Configuration
3232

33+
Nova control plane is configured for requesting PCI devices from Placement
34+
through `resources:VGPU=X` flavor extra specs.
35+
That is a contrary to the legacy mode where PCI devices used to be requested through
36+
`pci_passthrough:alias` flavor extra specs.
37+
3338
### Control Plane (`examples/dt/nova/nova04delta/service-values.yaml`)
3439

3540
* `[pci]alias`: Creates an alias for a specific GPU type. This allows users to request a GPU by a friendly name (e.g., `nvidia_a2`) when creating a VM.
@@ -69,6 +74,4 @@ In addition to PCI device configuration, the `nova.compute.conf` section include
6974

7075
## Guest VM
7176

72-
To use the passthrough GPU, the guest operating system inside the VM must have the appropriate native NVIDIA driver installed. You will need a standard NVIDIA driver. Do not use vGPU-enabled guest drivers. The GPU will appear as a physical PCI device within the guest.
73-
74-
// NOTE(bogdando) OSPRH-18880: keep in mind that for PCI in Nova mode, a flavor must use pci_passthrough:alias property. While for PCI in Placement mode, it must be resources:VGPU=X annotation. See https://docs.openstack.org/nova/latest/admin/pci-passthrough.html.
77+
To use the passthrough GPU, the guest operating system inside the VM must have the appropriate native NVIDIA driver installed. You will need a standard NVIDIA driver. Do not use vGPU-enabled guest drivers. The GPU will appear as a physical PCI device within the guest.

examples/va/nvidia-vfio-passthrough/README.md

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -14,6 +14,20 @@ with nested virtualization and requires real baremetal hosts.
1414

1515
## Environment
1616

17+
### Nova
18+
19+
Nova control plane is configured for requesting PCI devices from Placement
20+
by setting `resources:VGPU=X` in flavor extra specs.
21+
That is a contrary to the legacy mode where PCI devices used to be requested through
22+
`pci_passthrough:alias` flavor extra specs.
23+
24+
### Guest VM
25+
26+
To use the passthrough GPU, the guest operating system inside the VM must have
27+
the appropriate native NVIDIA driver installed. You will need a standard NVIDIA
28+
driver. Do not use vGPU-enabled guest drivers. The GPU will appear as a physical
29+
PCI device within the guest.
30+
1731
### Nodes
1832

1933
| Role | Machine Type | Count |
@@ -40,6 +54,10 @@ with nested virtualization and requires real baremetal hosts.
4054
| storagemgmt | VLAN tagged | 172.20.0.0/24 |
4155
| tenant | VLAN tagged | 172.19.0.0/24 |
4256

57+
NOTE: A network attach definition is not provided for storagemgmt because only
58+
RHEL EDPM nodes are going to use it, while control plane pods on OpenShift do
59+
not need it.
60+
4361
## Stages
4462
All stages must be executed in the order listed below. Everything is required unless otherwise indicated.
4563

examples/va/nvidia-vfio-passthrough/control-plane/nncp/values.yaml

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -123,6 +123,16 @@ data:
123123
"range_end": "172.18.0.70"
124124
}
125125
}
126+
storagemgmt: # used on RHEL, not used on OpenShift
127+
dnsDomain: storagemgmt.example.com
128+
subnets:
129+
- allocationRanges:
130+
- end: 172.20.0.250
131+
start: 172.20.0.100
132+
cidr: 172.20.0.0/24
133+
name: subnet1
134+
vlan: 23
135+
mtu: 1500
126136
tenant:
127137
dnsDomain: tenant.example.com
128138
subnets:

0 commit comments

Comments
 (0)