[RFE] Update metrics collection

[falencastro]

Since OpenStack Stein (RHOSP 15) some ceilometer metrics were deprecated, like:

• cpu_util
• disk.read.requests.rate
• disk.write.requests.rate
• disk.read.bytes.rate
• disk.write.bytes.rate
• disk.device.read.requests.rate
• disk.device.write.requests.rate
• disk.device.read.bytes.rate
• disk.device.write.bytes.rate

cpu: (1)
disk: (2)(3)

Some of these are being collected in (4).

This prevents cpu and disk metrics from being collected and properly reported, causes the widget "Top CPU Consumers (weekly)" from the default dashboard to come back empty. Also this could be the issue behind #688.

For the disk metrics it should be only a matter of replacing disk.(read|write).bytes with disk.device.(read|write).bytes.
For the cpu_util metric that is gone, it should be replaced with gnocchi rate aggregation on the 'cpu' metric (rate:mean cpu) (5).

(5): "The cpu_util metric was deprecated and removed from Red Hat OpenStack Platform. To obtain the equivalent functionality, use the cumulative cpu metric and an archive policy that includes the rate:mean aggregation method."

1: https://docs.openstack.org/releasenotes/ceilometer/rocky.html
2: https://docs.openstack.org/releasenotes/ceilometer/stein.html
3: https://bugzilla.redhat.com/show_bug.cgi?id=1852332
4: https://github.com/ManageIQ/manageiq-providers-openstack/blob/master/app/models/manageiq/providers/openstack/cloud_manager/metrics_capture.rb
5: https://access.redhat.com/documentation/pt-br/red_hat_openstack_platform/16.1/html-single/auto_scaling_for_instances/index

@miq-bot add-label bug
@miq-bot add-label enhancement

[falencastro]

https://bugzilla.redhat.com/show_bug.cgi?id=1872312
https://bugzilla.redhat.com/show_bug.cgi?id=1891830

[Fryguy]

This is awesome detail. Thanks @falencastro !

[agrare]

Thanks so much for all of the info here @falencastro

I'm working on setting up a recent microstack version for testing but I was wondering if you'd be willing/able to help test out some of the changes as well?

[falencastro]

Hi @agrare, yeah I'll be happy to help. I have an openstack yoga environment where I can test this.

[miq-bot]

This issue has been automatically marked as stale because it has not been updated for at least 3 months.

If you can still reproduce this issue on the current release or on master, please reply with all of the information you have about it in order to keep the issue open.

[miq-bot]

This issue has been automatically marked as stale because it has not been updated for at least 3 months.

If you can still reproduce this issue on the current release or on master, please reply with all of the information you have about it in order to keep the issue open.

[miq-bot]

This issue has been automatically marked as stale because it has not been updated for at least 3 months.

If you can still reproduce this issue on the current release or on master, please reply with all of the information you have about it in order to keep the issue open.

[miq-bot]

This issue has been automatically marked as stale because it has not been updated for at least 3 months.

If you can still reproduce this issue on the current release or on master, please reply with all of the information you have about it in order to keep the issue open.