[SPARK-52479] Upgrade the minimum K8s version to v1.31

### What changes were proposed in this pull request?

This PR aims to upgrade the minimum K8s version to v1.31 in K8s test environment.

### Why are the changes needed?

https://kubernetes.io/releases/patch-releases/#1-30

> Kubernetes 1.30 entered maintenance mode on Apr 28, 2025.
> The End of Life date for Kubernetes 1.30 is Jun 28, 2025.

### Does this PR introduce _any_ user-facing change?

No because this is a test infra change.

### How was this patch tested?

Pass the CIs.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes apache#247 from dongjoon-hyun/SPARK-52479.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>

Author: dongjoon-hyun

.github/workflows/build_and_test.yml

@@ -73,7 +73,7 @@ jobs:
       fail-fast: false
       matrix:
         kubernetes-version:
-          - "1.30.0"
+          - "1.31.0"
           - "1.33.0"
         mode:
           - dynamic