Skip to content

Commit cd2ed4f

Browse files
committed
[SPARK-53379] Add integration-test-ubuntu GitHub Action job
### What changes were proposed in this pull request? This PR aims to add `integration-test-ubuntu` GitHub Action job. ### Why are the changes needed? We had `integration-test-linux` before and moved it to daily job due to the flakiness. - #146 This is the current daily linux integration test coverage. - https://github.com/apache/spark-connect-swift/actions/workflows/integration_test_linux.yml Since all `integration test (on MacOS)` jobs are failing currently, this PR aims to bring `Linux` integration test job back to `main` CI to have an integration test coverage. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Newly added linux integration test job should pass. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #228 from dongjoon-hyun/SPARK-53379. Authored-by: Dongjoon Hyun <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>
1 parent 1116bfa commit cd2ed4f

File tree

1 file changed

+19
-0
lines changed

1 file changed

+19
-0
lines changed

.github/workflows/build_and_test.yml

Lines changed: 19 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -93,6 +93,25 @@ jobs:
9393
docker run swiftlang/swift:nightly-6.2-amazonlinux2 uname -a
9494
docker run -v $PWD:/spark -w /spark swiftlang/swift:nightly-6.2-amazonlinux2 swift build
9595
96+
integration-test-ubuntu:
97+
runs-on: ubuntu-latest
98+
env:
99+
SPARK_REMOTE: "sc://localhost:15003"
100+
services:
101+
spark:
102+
image: apache/spark:4.0.0
103+
env:
104+
SPARK_NO_DAEMONIZE: 1
105+
ports:
106+
- 15003:15002
107+
options: --entrypoint /opt/spark/sbin/start-connect-server.sh
108+
steps:
109+
- uses: actions/checkout@v4
110+
- name: Build
111+
run: |
112+
docker run swift:6.1 uname -a
113+
docker run --add-host=host.docker.internal:host-gateway -v $PWD:/spark -w /spark -e SPARK_REMOTE='sc://host.docker.internal:15003' swift:6.1 swift test --no-parallel -c release
114+
96115
integration-test-mac-spark41:
97116
runs-on: macos-15
98117
timeout-minutes: 20

0 commit comments

Comments
 (0)