Create a DT and VA for GPU full device PCI pass-through for GPU workloads testing #602

bogdando · 2025-08-13T11:46:37Z

Add DT and related VA for full PCI device passthrough
for testing GPU workloads on RHOSO.

The VA is based on nvidia-mdev-passthrough, DT is based on
nova02beta, plus bmo01 DT for provisioning outside of ci-framework stages

Jira: OSPRH-18904

openshift-ci · 2025-08-13T11:46:41Z

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

examples/dt/nova/nova02beta/service-values.yaml

examples/dt/nova/nova03gamma/edpm/nodeset/values.yaml

examples/dt/nova/nova03gamma/service-values.yaml

bogdando · 2025-08-14T13:10:45Z

Naming conflicts/consolidate nova03gamma created from nova02beta with James's nova03gamma as a virtualized solution to cover gaps in Nova team CI for the component line: #486, or simply rename to nova04delta

softwarefactory-project-zuul · 2025-09-09T13:18:27Z

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/openstack-k8s-operators/architecture for 602,d4f84c5285176dbf188cbe3ed9f727085d89c9af

softwarefactory-project-zuul · 2025-09-09T14:09:56Z

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/openstack-k8s-operators/architecture for 602,9018ac6fad3c1f14c660a891e4da9c722f958315

softwarefactory-project-zuul · 2025-09-10T11:54:17Z

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/openstack-k8s-operators/architecture for 602,6e6a27ad1975aa67112042345148a7a59202c4b0

softwarefactory-project-zuul · 2025-09-10T13:02:35Z

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/openstack-k8s-operators/architecture for 602,33073bf6eb95a761b45d2ba75e44b2f59438b6ee

softwarefactory-project-zuul · 2025-09-10T13:38:39Z

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/openstack-k8s-operators/architecture for 602,eda2ae67dabd0bd4ed428ddc39942d6bbc21fc8c

softwarefactory-project-zuul · 2025-09-10T14:18:13Z

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/openstack-k8s-operators/architecture for 602,fb37ed90db9056cffb67048051bef910e75af4e6

softwarefactory-project-zuul · 2025-09-10T15:10:35Z

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/openstack-k8s-operators/architecture for 602,8ebd055983545101aa7bb90f12e3b7ffc6ea8544

softwarefactory-project-zuul · 2025-09-11T11:47:35Z

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/openstack-k8s-operators/architecture for 602,9c7ef06b8b1c0385b6f292fc9b976b67f39e94a6

softwarefactory-project-zuul · 2025-09-11T12:00:06Z

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/openstack-k8s-operators/architecture for 602,db074b59e4ab04fc9e4b2f043fecc9817db5011a

softwarefactory-project-zuul · 2025-09-11T13:47:01Z

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/openstack-k8s-operators/architecture for 602,c9994ccfe96ef7e45624a413e1ba32ceaa35005f

softwarefactory-project-zuul · 2025-09-11T13:53:20Z

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/openstack-k8s-operators/architecture for 602,74b09c5325988550926e68525f1b847e91b4d382

softwarefactory-project-zuul · 2025-09-16T08:45:06Z

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/openstack-k8s-operators/architecture for 602,99c9c74b63515abeff20d282beeb2126af23efbb

softwarefactory-project-zuul · 2025-09-16T10:15:35Z

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/openstack-k8s-operators/architecture for 602,74b09c5325988550926e68525f1b847e91b4d382

examples/va/nvidia-vfio-passthrough/README.md

examples/va/nvidia-vfio-passthrough/control-plane/README.md

abays · 2025-11-04T12:50:41Z

examples/va/nvidia-vfio-passthrough/data-plane-pre.md

+Wait for the BareMetalHosts to become available. You can monitor the status with:
+```
+oc get bmh -w
+```


As a follow-up, if you split the BMHs into their own stage, this can be improved like so:

oc wait -n openstack -l <labels added to BMH> --for jsonpath='{.status.provisioning.state}=available' # or if the generated YAML file has only BMHs in it: oc wait -f <path to generated YAML> --for jsonpath='{.status.provisioning.state}=available'

yes, I planned that for follow up pull requests, thanks

examples/va/nvidia-vfio-passthrough/edpm/nodeset/values.yaml

softwarefactory-project-zuul · 2025-11-04T13:42:41Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/3db8f13e9ed74cc9bd56d26de973478e

✔️ noop SUCCESS in 0s
❌ rhoso-architecture-validate-nova04delta FAILURE in 3m 58s
✔️ rhoso-architecture-validate-nova04delta-adoption SUCCESS in 4m 30s
✔️ rhoso-architecture-validate-nvidia-vfio-passthrough SUCCESS in 5m 03s
✔️ rhoso-architecture-validate-nvidia-vfio-passthrough-adoption SUCCESS in 4m 33s

bogdando · 2025-11-04T13:57:21Z

recheck-rdo

softwarefactory-project-zuul · 2025-11-04T14:03:30Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/2c1ad407a0214fafae8e75ec73508088

✔️ noop SUCCESS in 0s
❌ rhoso-architecture-validate-nova04delta FAILURE in 3m 49s
✔️ rhoso-architecture-validate-nova04delta-adoption SUCCESS in 3m 45s
✔️ rhoso-architecture-validate-nvidia-vfio-passthrough SUCCESS in 5m 06s
✔️ rhoso-architecture-validate-nvidia-vfio-passthrough-adoption SUCCESS in 4m 32s

fultonj · 2025-11-04T14:58:29Z

TASK [ci_gen_kustomize_values : Generate CI snippet backup=True, dest={{
  (snippet_datadir,
   '02_ci_data.yaml') | path_join
}}, src={{ _tmpl_check_path | first }}, mode=0644] ***
Tuesday 04 November 2025  14:01:35 +0000 (0:00:00.170)       0:00:43.568 ****** 
An exception occurred during task execution. To see the full traceback, use -vvv. The error was: ansible.errors.AnsibleUndefinedVariable: 'cifmw_baremetal_hosts' is undefined. 'cifmw_baremetal_hosts' is undefined
task path: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_gen_kustomize_values/tasks/generate_snippets.yml:118
fatal: [localhost]: FAILED! => 
    changed: false
    msg: 'AnsibleUndefinedVariable: ''cifmw_baremetal_hosts'' is undefined. ''cifmw_baremetal_hosts''
      is undefined'

from https://softwarefactory-project.io/zuul/t/rdoproject.org/build/061010eddb254320ac1fa7627344dca4

fultonj

This PR looks reasonable to me.

Once the CI errors are fixed I'd be fine with merging.

Add DT and related VA for full PCI device passthrough for testing GPU workloads on RHOSO. The VA is based on nvidia-mdev-passthrough, DT is based on nova02beta. Jira: #OSPRH-18904 Signed-off-by: Bohdan Dobrelia <[email protected]>

bogdando · 2025-11-05T09:31:47Z

All done.

abays

/lgtm
/approve

openshift-ci · 2025-11-05T09:40:27Z

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: abays, bogdando

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

~~OWNERS~~ [abays]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

abays · 2025-11-05T12:10:53Z

recheck-gate

softwarefactory-project-zuul · 2025-11-05T12:16:52Z

Build succeeded (gate pipeline).
https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/004a3b53b6724205b276d56ebeb3d936

✔️ noop SUCCESS in 0s
✔️ rhoso-architecture-validate-nova04delta SUCCESS in 4m 44s
✔️ rhoso-architecture-validate-nova04delta-adoption SUCCESS in 4m 16s
✔️ rhoso-architecture-validate-nvidia-vfio-passthrough SUCCESS in 4m 52s
✔️ rhoso-architecture-validate-nvidia-vfio-passthrough-adoption SUCCESS in 4m 24s

bogdando · 2025-11-05T16:50:54Z

/cherry-pick 18.0-fr4

openshift-cherrypick-robot · 2025-11-05T16:51:35Z

@bogdando: new pull request created: #649

In response to this:

/cherry-pick 18.0-fr4

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

…02-to-18.0-fr4 [18.0-fr4] Create a DT and VA for GPU full device PCI pass-through for GPU workloads testing This is an automated cherry-pick of #602 /assign bogdando Reviewed-by: Andrew Bays <[email protected]>

openshift-ci bot added the do-not-merge/work-in-progress label Aug 13, 2025

bogdando commented Aug 13, 2025

View reviewed changes

examples/dt/nova/nova02beta/service-values.yaml Show resolved Hide resolved

bogdando commented Aug 13, 2025

View reviewed changes

examples/dt/nova/nova02beta/service-values.yaml Show resolved Hide resolved

bogdando commented Aug 13, 2025

View reviewed changes

examples/dt/nova/nova03gamma/edpm/nodeset/values.yaml Outdated Show resolved Hide resolved

bogdando commented Aug 13, 2025

View reviewed changes

examples/dt/nova/nova03gamma/service-values.yaml Outdated Show resolved Hide resolved

bogdando force-pushed the OSPRH-18904 branch 3 times, most recently from 8e12ece to 6131e43 Compare August 19, 2025 15:25

bogdando force-pushed the OSPRH-18904 branch from 275d3d8 to abfd05b Compare August 28, 2025 13:18

openshift-merge-robot added the needs-rebase label Sep 9, 2025

bogdando force-pushed the OSPRH-18904 branch from d4f84c5 to 9018ac6 Compare September 9, 2025 14:09

bogdando changed the title ~~Create Nova GPU full device PCI passthrough job~~ Create Nova GPU full device PCI passthrough VA/DT Sep 9, 2025

bogdando force-pushed the OSPRH-18904 branch from 9c7ef06 to db074b5 Compare September 11, 2025 11:59

bogdando force-pushed the OSPRH-18904 branch from c9994cc to 74b09c5 Compare September 11, 2025 13:53

bogdando force-pushed the OSPRH-18904 branch from 99c9c74 to 74b09c5 Compare September 16, 2025 10:15

abays reviewed Nov 4, 2025

View reviewed changes

examples/va/nvidia-vfio-passthrough/README.md Outdated Show resolved Hide resolved

abays reviewed Nov 4, 2025

View reviewed changes

examples/va/nvidia-vfio-passthrough/control-plane/README.md Outdated Show resolved Hide resolved

abays reviewed Nov 4, 2025

View reviewed changes

examples/va/nvidia-vfio-passthrough/edpm/nodeset/values.yaml Outdated Show resolved Hide resolved

bogdando force-pushed the OSPRH-18904 branch 2 times, most recently from 14d3e36 to 1c0026c Compare November 4, 2025 13:36

bogdando requested a review from abays November 4, 2025 13:56

fultonj reviewed Nov 4, 2025

View reviewed changes

bogdando force-pushed the OSPRH-18904 branch from 1c0026c to 079fe4f Compare November 5, 2025 09:17

Add nova04delta DT and nvidia-vfio VA

0c4fa59

Add DT and related VA for full PCI device passthrough for testing GPU workloads on RHOSO. The VA is based on nvidia-mdev-passthrough, DT is based on nova02beta. Jira: #OSPRH-18904 Signed-off-by: Bohdan Dobrelia <[email protected]>

bogdando force-pushed the OSPRH-18904 branch from 079fe4f to 0c4fa59 Compare November 5, 2025 09:21

bogdando requested a review from fultonj November 5, 2025 09:33

abays approved these changes Nov 5, 2025

View reviewed changes

openshift-ci bot assigned abays Nov 5, 2025

openshift-ci bot added the lgtm label Nov 5, 2025

openshift-ci bot added the approved label Nov 5, 2025

softwarefactory-project-zuul bot merged commit 8a41ca4 into openstack-k8s-operators:main Nov 5, 2025
9 checks passed

openshift-cherrypick-robot mentioned this pull request Nov 5, 2025

[18.0-fr4] Create a DT and VA for GPU full device PCI pass-through for GPU workloads testing #649

Merged

bogdando deleted the OSPRH-18904 branch November 7, 2025 11:50

Create a DT and VA for GPU full device PCI pass-through for GPU workloads testing #602

Create a DT and VA for GPU full device PCI pass-through for GPU workloads testing #602

Conversation

bogdando commented Aug 13, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

openshift-ci bot commented Aug 13, 2025

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

bogdando commented Aug 14, 2025

Uh oh!

softwarefactory-project-zuul bot commented Sep 9, 2025

Uh oh!

softwarefactory-project-zuul bot commented Sep 9, 2025

Uh oh!

softwarefactory-project-zuul bot commented Sep 10, 2025

Uh oh!

softwarefactory-project-zuul bot commented Sep 10, 2025

Uh oh!

softwarefactory-project-zuul bot commented Sep 10, 2025

Uh oh!

softwarefactory-project-zuul bot commented Sep 10, 2025

Uh oh!

softwarefactory-project-zuul bot commented Sep 10, 2025

Uh oh!

softwarefactory-project-zuul bot commented Sep 11, 2025

Uh oh!

softwarefactory-project-zuul bot commented Sep 11, 2025

Uh oh!

softwarefactory-project-zuul bot commented Sep 11, 2025

Uh oh!

softwarefactory-project-zuul bot commented Sep 11, 2025

Uh oh!

softwarefactory-project-zuul bot commented Sep 16, 2025

Uh oh!

softwarefactory-project-zuul bot commented Sep 16, 2025

Uh oh!

Uh oh!

Uh oh!

abays Nov 4, 2025

Choose a reason for hiding this comment

Uh oh!

bogdando Nov 4, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

softwarefactory-project-zuul bot commented Nov 4, 2025

Uh oh!

bogdando commented Nov 4, 2025

Uh oh!

softwarefactory-project-zuul bot commented Nov 4, 2025

Uh oh!

fultonj commented Nov 4, 2025

Uh oh!

fultonj left a comment

Choose a reason for hiding this comment

Uh oh!

bogdando commented Nov 5, 2025

Uh oh!

abays left a comment

Choose a reason for hiding this comment

Uh oh!

openshift-ci bot commented Nov 5, 2025

Uh oh!

abays commented Nov 5, 2025

Uh oh!

softwarefactory-project-zuul bot commented Nov 5, 2025

Uh oh!

Uh oh!

bogdando commented Nov 5, 2025

Uh oh!

openshift-cherrypick-robot commented Nov 5, 2025

Uh oh!

Reviewers

Assignees

Labels

bogdando commented Aug 13, 2025 •

edited

Loading

bogdando Nov 4, 2025 •

edited

Loading