Support spark3.4

[comnetwork]

What problem does this PR solve?

support Spark3.4

What is changed and how it works?

add Spark3.4 Support

Check List

Tests

• Unit test
• Integration test
• Manual test (add detailed scripts or steps below)
• No code

Code changes

Side effects

Related changes

[sre-bot]

All committers have signed the CLA.

[ti-chi-bot]

Welcome @comnetwork! It looks like this is your first PR to pingcap/tispark 🎉

[comnetwork]

/run-all-tests tidb=release-6.5 tikv=release-6.5 pd=release-6.5

[ti-chi-bot]

@iamxy: You cannot manually add or delete the reviewing state labels, only I and the tursted members have permission to do so.

Details

In response to adding label named lgtm.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the ti-community-infra/tichi repository.

[ti-chi-bot]

@iamxy: You cannot manually add or delete the reviewing state labels, only I and the tursted members have permission to do so.

Details

In response to adding label named approved.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the ti-community-infra/tichi repository.

[ti-chi-bot]

@iamxy: You cannot manually add or delete the reviewing state labels, only I and the tursted members have permission to do so.

Details

In response to adding label named lgtm.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the ti-community-infra/tichi repository.

[ti-chi-bot]

@iamxy: You cannot manually add or delete the reviewing state labels, only I and the tursted members have permission to do so.

Details

In response to adding label named approved.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the ti-community-infra/tichi repository.

[iamxy]

/lgtm
/approve

[ti-chi-bot]

@iamxy: adding LGTM is restricted to approvers and reviewers in OWNERS files.

Details

In response to this:

/lgtm
/approve

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

[wuhuizuo]

/run-all-tests

[comnetwork]

/run-all-tests tidb=release-6.5 tikv=release-6.5 pd=release-6.5

[shiyuhang0]

/run-all-tests tidb=release-6.5 tikv=release-6.5 pd=release-6.5 profile=spark-3.1

[comnetwork]

/run-all-tests tidb=release-6.5 tikv=release-6.5 pd=release-6.5

[shiyuhang0]

/run-all-tests tidb=release-6.5 tikv=release-6.5 pd=release-6.5 profile=spark-3.2

[shiyuhang0]

/run-all-tests tidb=release-6.5 tikv=release-6.5 pd=release-6.5

[shiyuhang0]

/run-all-tests tidb=release-6.5 tikv=release-6.5 pd=release-6.5

[ti-chi-bot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: iamxy, shiyuhang0, zhangyangyu

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details

Needs approval from an approver in each of these files:

• OWNERS [shiyuhang0]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[ti-chi-bot]

[LGTM Timeline notifier]

Timeline:

• 2025-02-27 07:36:32.395991053 +0000 UTC m=+514140.349149317: ☑️ agreed by shiyuhang0.
• 2025-02-27 08:44:33.746477784 +0000 UTC m=+518221.699636050: ☑️ agreed by zhangyangyu.