Skip to content

Commit ad8fa18

Browse files
committed
update docs
1 parent 2ab2d4f commit ad8fa18

File tree

2 files changed

+23
-0
lines changed

2 files changed

+23
-0
lines changed

docs/modules/spark-k8s/pages/usage-guide/history-server.adoc

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -156,3 +156,11 @@ spark-history-node-cleaner NodePort 10.96.203.43 <none> 18080:325
156156
By setting up port forwarding on 18080 the UI can be opened by pointing your browser to `http://localhost:18080`:
157157

158158
image::history-server-ui.png[History Server Console]
159+
160+
== Metrics
161+
162+
[NOTE]
163+
====
164+
Up to version 25.3 of the Stackable Data Platform, the history server used the JMX exporter to expose metrics on a separate port.
165+
Starting with version 25.7 the JMX exporter has been removed and the history server doesn't expose metrics as of Spark version 3.5.6.
166+
====

docs/modules/spark-k8s/pages/usage-guide/operations/applications.adoc

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -8,3 +8,18 @@ As the operator creates the necessary resources, the status of the application t
88

99
NOTE: The operator never reconciles an application once it has been created.
1010
To resubmit an application, a new SparkApplication resource must be created.
11+
12+
== Metrics
13+
14+
[NOTE]
15+
====
16+
Up to version 25.3 of the Stackable Data Platform, Spark applications used the JMX exporter to expose metrics on a separate port.
17+
Starting with version 25.7, the built-in Prometheus servlet is used instead.
18+
====
19+
20+
Application driver pods expose Prometheus metrics at the following endpoints:
21+
22+
* `/metrics/prometheus` for driver instances
23+
* `/metrics/executors/prometheus` for executor instances.
24+
25+
These endpoints are available on the same port as the Spark UI, which is 4040 by default.

0 commit comments

Comments
 (0)