chore(metric): add per-test metric dimension for coarse grained metrics

The current metric dimensions are so that we have 13k+ different sets of
dimensions for each metric, which makes it impossible to plot in
CloudWatch.
This change adds a new set of dimensions with just the test name so that
we reduce it to a few hundreds and are able to plot them (CW limit is
500).

Signed-off-by: Riccardo Mancini <[email protected]>
Signed-off-by: Patrick Roy <[email protected]>

Author: Manciukic

tests/conftest.py

@@ -142,6 +142,13 @@ def pytest_runtest_logreport(report):
             "cpu_model": global_props.cpu_model,
             "host_kernel": "linux-" + global_props.host_linux_version,
         },
+        # per coarse-grained test name, dropping parameters and other dimensions to reduce metric count for dashboard
+        # Note: noideid is formatted as below
+        # - with parameters: "path/to/test.py::test_name[parameter0,parameter1]"
+        # - without parameters: "path/to/test.py::test_name"
+        {
+            "test_name": report.nodeid.split("[")[0],
+        },
         # per phase
         {"phase": report.when},
         # per host kernel