You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: modules/deploying-vllm-gpu-metrics-dashboard-grafana.adoc
+8-5Lines changed: 8 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -20,7 +20,9 @@ endif::[]
20
20
.Procedure
21
21
22
22
. Define a `GrafanaDashboard` object in a YAML file, similar to the following examples:
23
-
.. To monitor accelerator metrics, see link:https://github.com/rh-aiservices-bu/rhoai-uwm/tree/main/rhoai-uwm-grafana/overlays/rhoai-uwm-user-grafana-app/nvidia-vllm-dashboard.yaml[`nvidia-vllm-dashboard.yaml`].
23
+
.. To monitor NVIDIA accelerator metrics, see link:https://github.com/rh-aiservices-bu/rhoai-uwm/tree/main/rhoai-uwm-grafana/overlays/rhoai-uwm-user-grafana-app/nvidia-vllm-dashboard.yaml[`nvidia-vllm-dashboard.yaml`].
24
+
.. To monitor AMD accelerator metrics, see link:https://github.com/rh-aiservices-bu/rhoai-uwm/tree/main/rhoai-uwm-grafana/overlays/rhoai-uwm-user-grafana-app/amd-vllm-dashboard.yaml[`amd-vllm-dashboard.yaml`].
25
+
.. To monitor Intel accelerator metrics, see link:https://github.com/rh-aiservices-bu/rhoai-uwm/tree/main/rhoai-uwm-grafana/overlays/rhoai-uwm-user-grafana-app/gaudi-vllm-dashboard.yaml[`gaudi-vllm-dashboard.yaml`].
24
26
.. To monitor vLLM metrics, see link:https://github.com/rh-aiservices-bu/rhoai-uwm/tree/main/rhoai-uwm-grafana/overlays/rhoai-uwm-user-grafana-app/grafana-vllm-dashboard.yaml[`grafana-vllm-dashboard.yaml`].
25
27
26
28
. Create an `inputs.env` file similar to the following example. Replace the `NAMESPACE` and `MODEL_NAME` parameters with your own values:
@@ -33,19 +35,20 @@ MODEL_NAME=<model-name> <2>
33
35
<1> **NAMESPACE** is the target namespace where the model will be deployed.
34
36
<2> **MODEL_NAME** is the model name as defined in your InferenceService. The model name is also used to filter the pod name in the Grafana dashboard.
35
37
36
-
. Replace the `NAMESPACE` and `MODEL_NAME` parameters in your YAML file with the values from the `input.env` file by performing the following actions:
38
+
. Replace the `NAMESPACE` and `MODEL_NAME` parameters in your YAML file with the values from the `inputs.env` file by performing the following actions:
37
39
38
40
.. Export the parameters described in the `inputs.env` as environment variables:
39
41
+
40
42
[source]
41
43
----
42
44
export $(cat inputs.env | xargs)
43
45
----
44
-
.. Replace the `$NAMESPACE` and `${MODEL_NAME)` variables in the YAML file with the values of the exported environment variables:
46
+
47
+
.. Update the following YAML file, replacing the `${NAMESPACE}` and `${MODEL_NAME}` variables with the values of the exported environment variables, and `dashboard_template.yaml` with the name of the `GrafanaDashboard` object YAML file that you created earlier:
0 commit comments