Skip to content
This repository was archived by the owner on Jan 9, 2020. It is now read-only.

Commit 3501160

Browse files
Bill Chamberssrowen
authored andcommitted
[DOCS][MINOR] Clarify Where AccumulatorV2s are Displayed
## What changes were proposed in this pull request? This PR clarifies where accumulators will be displayed. ## How was this patch tested? No testing. Please review http://spark.apache.org/contributing.html before opening a pull request. Author: Bill Chambers <[email protected]> Author: anabranch <[email protected]> Author: Bill Chambers <[email protected]> Closes apache#16180 from anabranch/improve-acc-docs. (cherry picked from commit 70ffff2) Signed-off-by: Sean Owen <[email protected]>
1 parent 63693c1 commit 3501160

File tree

1 file changed

+4
-3
lines changed

1 file changed

+4
-3
lines changed

docs/programming-guide.md

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1345,14 +1345,15 @@ therefore be efficiently supported in parallel. They can be used to implement co
13451345
MapReduce) or sums. Spark natively supports accumulators of numeric types, and programmers
13461346
can add support for new types.
13471347

1348-
If accumulators are created with a name, they will be
1349-
displayed in Spark's UI. This can be useful for understanding the progress of
1350-
running stages (NOTE: this is not yet supported in Python).
1348+
As a user, you can create named or unnamed accumulators. As seen in the image below, a named accumulator (in this instance `counter`) will display in the web UI for the stage that modifies that accumulator. Spark displays the value for each accumulator modified by a task in the "Tasks" table.
13511349

13521350
<p style="text-align: center;">
13531351
<img src="img/spark-webui-accumulators.png" title="Accumulators in the Spark UI" alt="Accumulators in the Spark UI" />
13541352
</p>
13551353

1354+
Tracking accumulators in the UI can be useful for understanding the progress of
1355+
running stages (NOTE: this is not yet supported in Python).
1356+
13561357
<div class="codetabs">
13571358

13581359
<div data-lang="scala" markdown="1">

0 commit comments

Comments
 (0)