[SPARK-51481] Add RuntimeConf actor

[dongjoon-hyun]

What changes were proposed in this pull request?

This PR aims to add RuntimeConf actor.

classDiagram
    class RuntimeConf {
        -client: SparkConnectClient
        +init(client: SparkConnectClient)
        +set(key: String, value: String) void
        +unset(key: String) void
        +get(key: String) String
        +getAll() [String: String]
    }

Loading

Why are the changes needed?

This is required before adding SparkSession.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Pass the CIs.

Was this patch authored or co-authored using generative AI tooling?

No.

[dongjoon-hyun]

Could you review this PR, @yaooqinn ?

[yaooqinn]

LGTM

[yaooqinn]

By the way, can we unbind the version tracker of this project to the Spark main repo? It might be inconvenient for the RM of v4.1.0 to generate the release note.

FYI,
https://issues.apache.org/jira/projects/SPARK/versions/12354567

[dongjoon-hyun]

Thank you for review, @yaooqinn .

Sure, for now, I didn't change it, but I'm also think to follow spark-kubernetes-operator repository style.

[dongjoon-hyun]

This will have an independent release cadence (and version pattern and tags).

[dongjoon-hyun]

Please wait for a while until I finish the first migration~ 4.1.0 will be replaced properly in a week.

[dongjoon-hyun]

Merged to main.

[dongjoon-hyun]

To @yaooqinn , I applied new version scheme for all.

By the way, can we unbind the version tracker of this project to the Spark main repo? It might be inconvenient for the RM of v4.1.0 to generate the release note.

[yaooqinn]

Thank you @dongjoon-hyun