Apache Spark™ Connect Client for Swift language is a subproject of Apache Spark and aims to provide Swift implementation of Spark Connect. 0.4.0 is the fourth release of Apache Spark Connect for Swift client. This is still experimental.
Website
https://apache.github.io/spark-connect-swift/
Swift Package Index
https://swiftpackageindex.com/apache/spark-connect-swift
Documentation
https://swiftpackageindex.com/apache/spark-connect-swift/0.4.0/documentation/sparkconnect
Full Changelog
Resolved Issues
- [SPARK-52390] Upgrade
gRPC Swiftlibraries togrpc-swift-2-based ones - [SPARK-52436] Update CIs to use
actions/checkout@v4consistently - [SPARK-52465] Update
.asf.yamlwith newREADME.mdlink - [SPARK-52472] Regenerate
Spark Connect-generated Swift source code withprotoc-gen-grpc-swift-2 - [SPARK-52473] Limit GHA job execution time to up to 20 minutes
- [SPARK-52522] Reapply
swift format - [SPARK-52523] Update
arrow-swiftcode for Timestamp - [SPARK-52524] Support
Timestamptype - [SPARK-52627] Improve
SQLTeststo handleuserName - [SPARK-52629] Remove
ArrowReaderHelper.isNestedType - [SPARK-52631] Update
Spark Connect-generated Swift source code - [SPARK-52658] Add
Swift 6.2build test CI - [SPARK-52678] Update
ArrowReader.swiftwith GH-54 - [SPARK-52742] Support
createDataflowGraph - [SPARK-52743] Support
startRun - [SPARK-52744] Add
MacOSintegration test with Apache Spark4.1.0-preview1RC1 - [SPARK-52748] Support
defineDataset - [SPARK-52756] Support
defineFlow - [SPARK-52758] Support
defineSqlGraphElements - [SPARK-52775] Add
timeSQL test and answer file - [SPARK-52847] Add
ConstraintTests - [SPARK-52913] Upgrade
grpc-swift-2to 2.1.0 - [SPARK-53370] Upgrade
gRPC Swift Protobufto 2.1.1 - [SPARK-53371] Upgrade
gRPC Swift NIO Transportto 2.1.0 - [SPARK-53373] Use
nightly-6.2-amazonlinux2for Swift 6.2 CI - [SPARK-53374] Use
releasebuild in Apache Spark4.1.0-preview1testing - [SPARK-53375] Remove downloaded tgz files
- [SPARK-53376] Run Swift
buildfirst before runningtest - [SPARK-53379] Add
integration-test-ubuntuGitHub Action job - [SPARK-53380] Add
SPARK_LOCAL_IPenv variable to MacOS-based integration test jobs - [SPARK-53404] Make
Buildstep to verify test compilation too - [SPARK-53463] Upgrade
actions/checkoutto v5 - [SPARK-53465] Use
4.1.0-preview1instead ofRC1 - [SPARK-53466] Use Spark
4.0.1instead of4.0.0 - [SPARK-53467] Improve
merge_spark_pr.pyto accept PR numbers as a CLI argument - [SPARK-53477] Add
integration-test-ubuntu-spark41GitHub Action job - [SPARK-53569] Use
Iceberg1.10 forSpark 3-based Iceberg integration test - [SPARK-53570] Update
integration-test-tokento use Spark4.1.0-preview1 - [SPARK-53571] Add
integration-test-mac-spark4-icebergGitHub Action job - [SPARK-53683] Use
Spark 3.5.7for Spark 3 integration tests - [SPARK-53685] Upgrade
gRPC Swift NIO Transportto 2.1.1 - [SPARK-53697] Use
4.1.0-preview2forintegration-test-(mac-spark41|token)GitHub Action jobs - [SPARK-53698] Support
Swift 6.2 - [SPARK-53699] Add
MacOS 26GitHub Action job - [SPARK-53724] Update
Examplesand documentations to use4.0.1 - [MINOR] Update
gRPC Swift-related library links inREADME.md