Skip to content

Conversation

@dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Oct 29, 2025

What changes were proposed in this pull request?

This PR aims to add word-count-preview.yaml Example.

Why are the changes needed?

To provide a Spark Job shuffle example.

Screenshot 2025-10-29 at 21 14 08

Does this PR introduce any user-facing change?

No behavior change because this is a new example.

How was this patch tested?

Manual review.

$ kubectl apply -f examples/word-count-preview.yaml
$ kubectl logs -f word-count-0-driver
...
25/10/29 23:48:04 INFO DAGScheduler: Job 0 finished: collect at JavaWordCount.java:53, took 3544.885793 ms
-Psparkr: 1
-B: 1
Spark: 1
-Pkubernetes: 1
-Pyarn: 1
revision: 1
Build: 1
built: 1
c5ff48cc2b2): 1
(git: 1
-Phadoop-3: 1
4.1.0-preview2: 1
flags:: 1
-Phive-thriftserver: 1
for: 1
-Phive: 1
3.4.2: 1
Hadoop: 1
$ k get sparkapp
NAME         CURRENT STATE      AGE
word-count   ResourceReleased   2m35s

Was this patch authored or co-authored using generative AI tooling?

No.

Copy link
Member

@viirya viirya left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

To provide a Spark Job shuffle example.

Is this shuffle example?

@dongjoon-hyun
Copy link
Member Author

Thank you, @viirya . Yes,

Screenshot 2025-10-29 at 21 14 08

@dongjoon-hyun
Copy link
Member Author

Merged to main.

@dongjoon-hyun dongjoon-hyun deleted the SPARK-54081 branch October 30, 2025 04:15
Copy link
Contributor

@peter-toth peter-toth left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Late LGTM.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants