Skip to content

Commit 2d9e112

Browse files
committed
[SPARK-52343] Download Apache Spark distributions via ASF Mirrors site
### What changes were proposed in this pull request? This PR aims to download Apache Spark distributions via ASF Mirrors site. ### Why are the changes needed? To speed up the download. ### Does this PR introduce _any_ user-facing change? No, this is a test infra PR. ### How was this patch tested? Pass the CIs. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #184 from dongjoon-hyun/SPARK-52343. Authored-by: Dongjoon Hyun <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>
1 parent 82ebbdf commit 2d9e112

File tree

1 file changed

+4
-4
lines changed

1 file changed

+4
-4
lines changed

.github/workflows/build_and_test.yml

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -87,7 +87,7 @@ jobs:
8787
swift-version: "6.1"
8888
- name: Test
8989
run: |
90-
curl -LO https://dist.apache.org/repos/dist/release/spark/spark-4.0.0/spark-4.0.0-bin-hadoop3.tgz
90+
curl -LO https://www.apache.org/dyn/closer.lua/spark/spark-4.0.0/spark-4.0.0-bin-hadoop3.tgz?action=download
9191
tar xvfz spark-4.0.0-bin-hadoop3.tgz
9292
mv spark-4.0.0-bin-hadoop3 /tmp/spark
9393
cd /tmp/spark/sbin
@@ -106,7 +106,7 @@ jobs:
106106
swift-version: "6.1"
107107
- name: Test
108108
run: |
109-
curl -LO https://dist.apache.org/repos/dist/release/spark/spark-4.0.0/spark-4.0.0-bin-hadoop3.tgz
109+
curl -LO https://www.apache.org/dyn/closer.lua/spark/spark-4.0.0/spark-4.0.0-bin-hadoop3.tgz?action=download
110110
tar xvfz spark-4.0.0-bin-hadoop3.tgz
111111
mv spark-4.0.0-bin-hadoop3 /tmp/spark
112112
cd /tmp/spark/sbin
@@ -128,7 +128,7 @@ jobs:
128128
java-version: 17
129129
- name: Test
130130
run: |
131-
curl -LO https://downloads.apache.org/spark/spark-3.5.5/spark-3.5.5-bin-hadoop3.tgz
131+
curl -LO https://www.apache.org/dyn/closer.lua/spark/spark-3.5.5/spark-3.5.5-bin-hadoop3.tgz?action=download
132132
tar xvfz spark-3.5.5-bin-hadoop3.tgz
133133
mv spark-3.5.5-bin-hadoop3 /tmp/spark
134134
cd /tmp/spark/sbin
@@ -152,7 +152,7 @@ jobs:
152152
java-version: 17
153153
- name: Test
154154
run: |
155-
curl -LO https://downloads.apache.org/spark/spark-3.5.5/spark-3.5.5-bin-hadoop3.tgz
155+
curl -LO https://www.apache.org/dyn/closer.lua/spark/spark-3.5.5/spark-3.5.5-bin-hadoop3.tgz?action=download
156156
tar xvfz spark-3.5.5-bin-hadoop3.tgz
157157
mv spark-3.5.5-bin-hadoop3 /tmp/spark
158158
cd /tmp/spark/sbin

0 commit comments

Comments
 (0)