Skip to content

Commit e8cd5e5

Browse files
committed
[SPARK-53375] Remove downloaded tgz files
### What changes were proposed in this pull request? This PR aims to remove downloaded tgz files to save disk spaces. ### Why are the changes needed? Due to the limitation on disk space, Xcode compilation fails currently. https://github.com/apache/spark-connect-swift/actions/runs/17217952618/job/48847747900 ``` warning: input verification failed note: while processing /Users/runner/work/spark-connect-swift/spark-connect-swift/.build/arm64-apple-macosx/release/SparkConnect.build/ArrowArray.swift.o ``` ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Pass the CIs. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #221 from dongjoon-hyun/SPARK-53375. Authored-by: Dongjoon Hyun <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>
1 parent 784d0e2 commit e8cd5e5

File tree

1 file changed

+5
-5
lines changed

1 file changed

+5
-5
lines changed

.github/workflows/build_and_test.yml

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -104,7 +104,7 @@ jobs:
104104
- name: Test
105105
run: |
106106
curl -LO https://dist.apache.org/repos/dist/dev/spark/v4.1.0-preview1-rc1-bin/spark-4.1.0-preview1-bin-hadoop3.tgz
107-
tar xvfz spark-4.1.0-preview1-bin-hadoop3.tgz
107+
tar xvfz spark-4.1.0-preview1-bin-hadoop3.tgz && rm spark-4.1.0-preview1-bin-hadoop3.tgz
108108
mv spark-4.1.0-preview1-bin-hadoop3 /tmp/spark
109109
cd /tmp/spark/sbin
110110
./start-connect-server.sh
@@ -122,7 +122,7 @@ jobs:
122122
- name: Test
123123
run: |
124124
curl -LO https://www.apache.org/dyn/closer.lua/spark/spark-4.0.0/spark-4.0.0-bin-hadoop3.tgz?action=download
125-
tar xvfz spark-4.0.0-bin-hadoop3.tgz
125+
tar xvfz spark-4.0.0-bin-hadoop3.tgz && rm spark-4.0.0-bin-hadoop3.tgz
126126
mv spark-4.0.0-bin-hadoop3 /tmp/spark
127127
cd /tmp/spark/sbin
128128
./start-connect-server.sh
@@ -142,7 +142,7 @@ jobs:
142142
- name: Test
143143
run: |
144144
curl -LO https://www.apache.org/dyn/closer.lua/spark/spark-4.0.0/spark-4.0.0-bin-hadoop3.tgz?action=download
145-
tar xvfz spark-4.0.0-bin-hadoop3.tgz
145+
tar xvfz spark-4.0.0-bin-hadoop3.tgz && rm spark-4.0.0-bin-hadoop3.tgz
146146
mv spark-4.0.0-bin-hadoop3 /tmp/spark
147147
cd /tmp/spark/sbin
148148
./start-connect-server.sh
@@ -165,7 +165,7 @@ jobs:
165165
- name: Test
166166
run: |
167167
curl -LO https://www.apache.org/dyn/closer.lua/spark/spark-3.5.6/spark-3.5.6-bin-hadoop3.tgz?action=download
168-
tar xvfz spark-3.5.6-bin-hadoop3.tgz
168+
tar xvfz spark-3.5.6-bin-hadoop3.tgz && rm spark-3.5.6-bin-hadoop3.tgz
169169
mv spark-3.5.6-bin-hadoop3 /tmp/spark
170170
cd /tmp/spark/sbin
171171
./start-connect-server.sh --packages org.apache.spark:spark-connect_2.12:3.5.6
@@ -190,7 +190,7 @@ jobs:
190190
- name: Test
191191
run: |
192192
curl -LO https://www.apache.org/dyn/closer.lua/spark/spark-3.5.6/spark-3.5.6-bin-hadoop3.tgz?action=download
193-
tar xvfz spark-3.5.6-bin-hadoop3.tgz
193+
tar xvfz spark-3.5.6-bin-hadoop3.tgz && rm spark-3.5.6-bin-hadoop3.tgz
194194
mv spark-3.5.6-bin-hadoop3 /tmp/spark
195195
cd /tmp/spark/sbin
196196
./start-connect-server.sh --packages org.apache.spark:spark-connect_2.12:3.5.6,org.apache.iceberg:iceberg-spark-runtime-3.5_2.12:1.9.0 -c spark.sql.catalog.local=org.apache.iceberg.spark.SparkCatalog -c spark.sql.catalog.local.type=hadoop -c spark.sql.catalog.local.warehouse=/tmp/spark/warehouse -c spark.sql.defaultCatalog=local

0 commit comments

Comments
 (0)