Skip to content

Conversation

@elfiesmelfie
Copy link
Contributor

@elfiesmelfie elfiesmelfie commented Jun 4, 2025

Autoscaling feature rely on heat working. Adding the heat-tempest-plugin would help to ensure this dependency is working as expected.

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Jun 4, 2025

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Jun 4, 2025

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: elfiesmelfie

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved label Jun 4, 2025
@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/5a9eb84b53f546fe892285a8c1ddeb50

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 33m 14s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 17m 30s
✔️ telemetry-operator-multinode-default-telemetry SUCCESS in 1h 00m 55s
functional-graphing-tests-osp18 FAILURE in 1h 17m 38s (non-voting)
functional-autoscaling-tests-osp18 FAILURE in 2h 13m 43s
✔️ functional-logging-tests-osp18 SUCCESS in 1h 16m 20s

@vyzigold
Copy link
Contributor

vyzigold commented Jun 5, 2025

Having a quick look. Some of the heat tests failed. This one immediately strikes my eye: heat_tempest_plugin.tests.scenario.test_aodh_alarm.AodhAlarmTest. I'm pretty sure heat tries to find gnocchi. So there either needs to be some configuration value to tell it that gnocchi isn't available and to automatically skip these tests (we have something like this in the telemetry-tempest-plugin) or tests requiring gnocchi will need to be manually excluded.

@vyzigold
Copy link
Contributor

vyzigold commented Jun 5, 2025

There is a long exclude list in the heat-operator tempest job. Maybe that could be the starting point for what to exclude: https://github.com/openstack-k8s-operators/heat-operator/blob/main/zuul.d/jobs.yaml#L29

@elfiesmelfie elfiesmelfie force-pushed the efoley/add-heat-tempest-tests branch from 5cbef08 to d3cc5f3 Compare June 11, 2025 18:00
cifmw_test_operator_tempest_exclude_list: |
telemetry_tempest_plugin.scenario.test_telemetry_integration_prometheus.PrometheusGabbiTest.test_autoscaling
heat_tempest_plugin.tests.functional.test_os_wait_condition.OSWaitCondition
heat_tempest_plugin.tests.scenario.test_aodh_alarm.AodhAlarmTest
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The error for this is that the metric endpoint is not registered in keystone.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we try to fix this? Do we expect the metrics endpoint to be in keystone?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No. "metric" endpoint means gnocchi.

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/e4e23a4b9a7041a9a221348bea03ba6c

✔️ openstack-k8s-operators-content-provider SUCCESS in 3h 31m 41s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 15m 12s
telemetry-operator-multinode-default-telemetry FAILURE in 1h 15m 02s
functional-graphing-tests-osp18 FAILURE in 1h 12m 50s (non-voting)
functional-autoscaling-tests-osp18 TIMED_OUT in 3h 13m 01s
functional-logging-tests-osp18 FAILURE in 1h 39m 48s

@elfiesmelfie
Copy link
Contributor Author

recheck

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/68f88714ddba49acbdb49e8a3da1e8b8

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 31m 20s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 11m 48s
✔️ telemetry-operator-multinode-default-telemetry SUCCESS in 1h 13m 22s
functional-graphing-tests-osp18 FAILURE in 1h 12m 02s (non-voting)
functional-autoscaling-tests-osp18 FAILURE in 2h 11m 36s
✔️ functional-logging-tests-osp18 SUCCESS in 1h 10m 15s

@elfiesmelfie
Copy link
Contributor Author

recheck

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/9948558bb25e4acbb96fc2cdc0839850

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 42m 58s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 11m 47s
✔️ telemetry-operator-multinode-default-telemetry SUCCESS in 1h 11m 59s
functional-graphing-tests-osp18 FAILURE in 1h 10m 57s (non-voting)
functional-autoscaling-tests-osp18 FAILURE in 2h 26m 24s
✔️ functional-logging-tests-osp18 SUCCESS in 1h 06m 35s

@elfiesmelfie elfiesmelfie force-pushed the efoley/add-heat-tempest-tests branch from d3cc5f3 to af940e1 Compare June 18, 2025 14:45
@elfiesmelfie
Copy link
Contributor Author

This is passing, but no tests are running.
I suspect that this will fix it: openstack-k8s-operators/ci-framework@1353fd8

@elfiesmelfie
Copy link
Contributor Author

recheck

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/10e453bd9c48483fb74d55699de6a941

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 47m 56s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 13m 29s
✔️ telemetry-operator-multinode-default-telemetry SUCCESS in 1h 14m 02s
functional-graphing-tests-osp18 FAILURE in 1h 14m 06s (non-voting)
functional-autoscaling-tests-osp18 FAILURE in 2h 27m 45s
✔️ functional-logging-tests-osp18 SUCCESS in 1h 11m 14s

Autoscaling feature rely on heat working. Adding the heat-tempest-plugin would help to ensure this dependency is working as expected.
@elfiesmelfie elfiesmelfie force-pushed the efoley/add-heat-tempest-tests branch from af940e1 to 5f44a3a Compare June 26, 2025 18:43
@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/23bc5f5154b943a6bd87347b47704278

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 38m 14s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 08m 12s
✔️ telemetry-operator-multinode-default-telemetry SUCCESS in 1h 13m 23s
functional-graphing-tests-osp18 FAILURE in 1h 10m 34s (non-voting)
functional-autoscaling-tests-osp18 FAILURE in 2h 12m 26s
✔️ functional-logging-tests-osp18 SUCCESS in 1h 09m 21s

@elfiesmelfie
Copy link
Contributor Author

recheck

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/79ca4d2fac5c428b8831c216cc47972e

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 29m 33s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 11m 39s
✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 06m 29s
✔️ telemetry-operator-multinode-default-telemetry SUCCESS in 1h 09m 09s
functional-tests-osp18 FAILURE in 1h 47m 38s

@elfiesmelfie
Copy link
Contributor Author

recheck

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/f9244d0620ae49a2b04f2193141cdd46

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 38m 50s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 13m 56s
✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 09m 08s
✔️ telemetry-operator-multinode-default-telemetry SUCCESS in 1h 11m 07s
functional-tests-osp18 FAILURE in 1h 41m 48s

@elfiesmelfie
Copy link
Contributor Author

recheck

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/cfda2eab71504c038cd758bffdaaecb3

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 45m 59s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 17m 49s
✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 3h 02m 50s
✔️ telemetry-operator-multinode-default-telemetry SUCCESS in 1h 26m 43s
functional-tests-osp18 FAILURE in 2h 41m 42s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants