Skip to content

Commit 5ec61d3

Browse files
xinlian12annie-mac
xinlian12
and
annie-mac
authored
release of spark 4.39.0, fabric spark auth version 1.0.0 (#46617)
Co-authored-by: annie-mac <[email protected]>
1 parent 348c25f commit 5ec61d3

File tree

14 files changed

+35
-50
lines changed

14 files changed

+35
-50
lines changed

‎eng/versioning/version_client.txt‎

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -106,11 +106,11 @@ com.azure:azure-cosmos;4.73.1;4.74.0
106106
com.azure:azure-cosmos-benchmark;4.0.1-beta.1;4.0.1-beta.1
107107
com.azure.cosmos.spark:azure-cosmos-spark_3_2-12;1.0.0-beta.1;1.0.0-beta.1
108108
com.azure:azure-cosmos-encryption;2.22.0;2.23.0
109-
com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;4.38.0;4.39.0-beta.1
110-
com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12;4.38.0;4.39.0-beta.1
111-
com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12;4.38.0;4.39.0-beta.1
109+
com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;4.38.0;4.39.0
110+
com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12;4.38.0;4.39.0
111+
com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12;4.38.0;4.39.0
112112
com.azure.cosmos.spark:azure-cosmos-spark-account-data-resolver-sample;1.0.0-beta.1;1.0.0-beta.1
113-
com.azure.cosmos.spark:fabric-cosmos-spark-auth_3;1.0.0-beta.1;1.0.0-beta.2
113+
com.azure.cosmos.spark:fabric-cosmos-spark-auth_3;1.0.0-beta.1;1.0.0
114114
com.azure:azure-cosmos-test;1.0.0-beta.13;1.0.0-beta.14
115115
com.azure:azure-cosmos-tests;1.0.0-beta.1;1.0.0-beta.1
116116
com.azure:azure-data-appconfiguration;1.8.3;1.9.0-beta.1

‎sdk/cosmos/azure-cosmos-spark-account-data-resolver-sample/pom.xml‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -97,7 +97,7 @@
9797
<dependency>
9898
<groupId>com.azure.cosmos.spark</groupId>
9999
<artifactId>azure-cosmos-spark_3-5_2-12</artifactId>
100-
<version>4.39.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12;current} -->
100+
<version>4.39.0</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12;current} -->
101101
<scope>provided</scope>
102102
</dependency>
103103
<dependency>
@@ -292,7 +292,7 @@
292292
<include>com.fasterxml.jackson.core:jackson-databind:[2.15.2]</include> <!-- {x-include-update;cosmos_com.fasterxml.jackson.core:jackson-databind;external_dependency} -->
293293
<include>com.fasterxml.jackson.module:jackson-module-scala_2.12:[2.15.2]</include> <!-- {x-include-update;cosmos_com.fasterxml.jackson.module:jackson-module-scala_2.12;external_dependency} -->
294294
<include>com.globalmentor:hadoop-bare-naked-local-fs:[0.1.0]</include> <!-- {x-include-update;cosmos_com.globalmentor:hadoop-bare-naked-local-fs;external_dependency} -->
295-
<include>com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12:[4.39.0-beta.1]</include> <!-- {x-include-update;com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12;current} -->
295+
<include>com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12:[4.39.0]</include> <!-- {x-include-update;com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12;current} -->
296296
</includes>
297297
</bannedDependencies>
298298
</rules>

‎sdk/cosmos/azure-cosmos-spark_3-3_2-12/CHANGELOG.md‎

Lines changed: 1 addition & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1,18 +1,12 @@
11
## Release History
22

3-
### 4.39.0-beta.1 (Unreleased)
4-
5-
#### Features Added
6-
7-
#### Breaking Changes
3+
### 4.39.0 (2025-09-05)
84

95
#### Bugs Fixed
106
* Reverted known issue due to shading log4j (which was introduced in 4.38.1). - See [PR 46546](https://github.com/Azure/azure-sdk-for-java/pull/46546) and [PR 46608](https://github.com/Azure/azure-sdk-for-java/pull/46608)
117
* Added change feed performance monitoring which is used to improve end lsn calculation in `CosmosPartitionPlanner`. - See [PR 46320](https://github.com/Azure/azure-sdk-for-java/pull/46320)
128
* Added `spark.cosmos.auth.aad.audience` as a valid configuration option to allow using AAD tokens with custom audiences. - See [PR 46554](https://github.com/Azure/azure-sdk-for-java/pull/46554)
139

14-
#### Other Changes
15-
1610
### 4.38.1 (2025-08-22)
1711

1812
**NOTE: This version has a known issue due to shading log4j - Please use more recent versions >= 4.38.2 or 4.38.0 instead**

‎sdk/cosmos/azure-cosmos-spark_3-3_2-12/README.md‎

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -28,6 +28,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
2828
#### azure-cosmos-spark_3-3_2-12
2929
| Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
3030
|-----------|--------------------------|------------------------|--------------------------|-------------------------------|
31+
| 4.39.0 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
3132
| 4.38.0 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
3233
| 4.37.2 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
3334
| 4.37.1 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
@@ -73,6 +74,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
7374
#### azure-cosmos-spark_3-4_2-12
7475
| Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
7576
|-----------|--------------------------|------------------------|--------------------------|-------------------------------|
77+
| 4.39.0 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
7678
| 4.38.0 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
7779
| 4.37.2 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
7880
| 4.37.1 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
@@ -109,6 +111,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
109111
#### azure-cosmos-spark_3-5_2-12
110112
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
111113
|-----------|--------------------------|----------------------|----------------------------|-------------------------------|
114+
| 4.39.0 | 3.5.0 | [8, 11] | 2.12 | 14.*, 15.\* |
112115
| 4.38.0 | 3.5.0 | [8, 11] | 2.12 | 14.*, 15.\* |
113116
| 4.37.2 | 3.5.0 | [8, 11] | 2.12 | 14.*, 15.\* |
114117
| 4.37.1 | 3.5.0 | [8, 11] | 2.12 | 14.*, 15.\* |
@@ -131,11 +134,11 @@ to use the same version of Scala that Spark was compiled for.
131134
### Download
132135

133136
You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 11 from Maven:
134-
`com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12:4.38.0`
137+
`com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12:4.39.0`
135138

136139
You can also integrate against Cosmos DB Spark Connector in your SBT project:
137140
```scala
138-
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-3_2-12" % "4.38.0"
141+
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-3_2-12" % "4.39.0"
139142
```
140143

141144
Cosmos DB Spark Connector is available on [Maven Central Repo](https://central.sonatype.com/search?namespace=com.azure.cosmos.spark).

‎sdk/cosmos/azure-cosmos-spark_3-3_2-12/pom.xml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@
1111
</parent>
1212
<groupId>com.azure.cosmos.spark</groupId>
1313
<artifactId>azure-cosmos-spark_3-3_2-12</artifactId>
14-
<version>4.39.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;current} -->
14+
<version>4.39.0</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;current} -->
1515
<packaging>jar</packaging>
1616
<url>https://github.com/Azure/azure-sdk-for-java/tree/main/sdk/cosmos/azure-cosmos-spark_3-3_2-12</url>
1717
<name>OLTP Spark 3.3 Connector for Azure Cosmos DB SQL API</name>

‎sdk/cosmos/azure-cosmos-spark_3-4_2-12/CHANGELOG.md‎

Lines changed: 1 addition & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1,18 +1,12 @@
11
## Release History
22

3-
### 4.39.0-beta.1 (Unreleased)
4-
5-
#### Features Added
6-
7-
#### Breaking Changes
3+
### 4.39.0 (2025-09-05)
84

95
#### Bugs Fixed
106
* Reverted known issue due to shading log4j (which was introduced in 4.38.1). - See [PR 46546](https://github.com/Azure/azure-sdk-for-java/pull/46546) and [PR 46608](https://github.com/Azure/azure-sdk-for-java/pull/46608)
117
* Added change feed performance monitoring which is used to improve end lsn calculation in `CosmosPartitionPlanner`. - See [PR 46320](https://github.com/Azure/azure-sdk-for-java/pull/46320)
128
* Added `spark.cosmos.auth.aad.audience` as a valid configuration option to allow using AAD tokens with custom audiences. - See [PR 46554](https://github.com/Azure/azure-sdk-for-java/pull/46554)
139

14-
#### Other Changes
15-
1610
### 4.38.1 (2025-08-22)
1711

1812
**NOTE: This version has a known issue due to shading log4j - Please use more recent versions >= 4.38.2 or 4.38.0 instead**

‎sdk/cosmos/azure-cosmos-spark_3-4_2-12/README.md‎

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -28,6 +28,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
2828
#### azure-cosmos-spark_3-4_2-12
2929
| Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
3030
|-----------|--------------------------|------------------------|--------------------------|-------------------------------|
31+
| 4.39.0 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
3132
| 4.38.0 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
3233
| 4.37.2 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
3334
| 4.37.1 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
@@ -64,6 +65,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
6465
#### azure-cosmos-spark_3-3_2-12
6566
| Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
6667
|-----------|--------------------------|------------------------|--------------------------|-------------------------------|
68+
| 4.39.0 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
6769
| 4.38.0 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
6870
| 4.37.2 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
6971
| 4.37.1 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
@@ -109,6 +111,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
109111
#### azure-cosmos-spark_3-5_2-12
110112
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
111113
|-----------|--------------------------|------------------------|--------------------------|-------------------------------|
114+
| 4.39.0 | 3.5.0 | [8, 11] | 2.12 | 14.*, 15.\* |
112115
| 4.38.0 | 3.5.0 | [8, 11] | 2.12 | 14.*, 15.\* |
113116
| 4.37.2 | 3.5.0 | [8, 11] | 2.12 | 14.*, 15.\* |
114117
| 4.37.1 | 3.5.0 | [8, 11] | 2.12 | 14.*, 15.\* |
@@ -131,11 +134,11 @@ to use the same version of Scala that Spark was compiled for.
131134
### Download
132135

133136
You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 11 from Maven:
134-
`com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12:4.38.0`
137+
`com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12:4.39.0`
135138

136139
You can also integrate against Cosmos DB Spark Connector in your SBT project:
137140
```scala
138-
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-4_2-12" % "4.38.0"
141+
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-4_2-12" % "4.39.0"
139142
```
140143

141144
Cosmos DB Spark Connector is available on [Maven Central Repo](https://central.sonatype.com/search?namespace=com.azure.cosmos.spark).

‎sdk/cosmos/azure-cosmos-spark_3-4_2-12/pom.xml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@
1111
</parent>
1212
<groupId>com.azure.cosmos.spark</groupId>
1313
<artifactId>azure-cosmos-spark_3-4_2-12</artifactId>
14-
<version>4.39.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12;current} -->
14+
<version>4.39.0</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12;current} -->
1515
<packaging>jar</packaging>
1616
<url>https://github.com/Azure/azure-sdk-for-java/tree/main/sdk/cosmos/azure-cosmos-spark_3-4_2-12</url>
1717
<name>OLTP Spark 3.4 Connector for Azure Cosmos DB SQL API</name>

‎sdk/cosmos/azure-cosmos-spark_3-5_2-12/CHANGELOG.md‎

Lines changed: 1 addition & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1,18 +1,12 @@
11
## Release History
22

3-
### 4.39.0-beta.1 (Unreleased)
4-
5-
#### Features Added
6-
7-
#### Breaking Changes
3+
### 4.39.0 (2025-09-05)
84

95
#### Bugs Fixed
106
* Reverted known issue due to shading log4j (which was introduced in 4.38.1). - See [PR 46546](https://github.com/Azure/azure-sdk-for-java/pull/46546) and [PR 46608](https://github.com/Azure/azure-sdk-for-java/pull/46608)
117
* Added change feed performance monitoring which is used to improve end lsn calculation in `CosmosPartitionPlanner`. - See [PR 46320](https://github.com/Azure/azure-sdk-for-java/pull/46320)
128
* Added `spark.cosmos.auth.aad.audience` as a valid configuration option to allow using AAD tokens with custom audiences. - See [PR 46554](https://github.com/Azure/azure-sdk-for-java/pull/46554)
139

14-
#### Other Changes
15-
1610
### 4.38.1 (2025-08-22)
1711

1812
**NOTE: This version has a known issue due to shading log4j - Please use more recent versions >= 4.38.2 or 4.38.0 instead**

‎sdk/cosmos/azure-cosmos-spark_3-5_2-12/README.md‎

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -28,6 +28,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
2828
#### azure-cosmos-spark_3-5_2-12
2929
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
3030
|-----------|--------------------------|-----------------------|---------------------------|-------------------------------|
31+
| 4.39.0 | 3.5.0 | [8, 11] | 2.12 | 14.\*, 15.\* |
3132
| 4.38.0 | 3.5.0 | [8, 11] | 2.12 | 14.\*, 15.\* |
3233
| 4.37.2 | 3.5.0 | [8, 11] | 2.12 | 14.\*, 15.\* |
3334
| 4.37.1 | 3.5.0 | [8, 11] | 2.12 | 14.\*, 15.\* |
@@ -50,6 +51,7 @@ to use the same version of Scala that Spark was compiled for.
5051
#### azure-cosmos-spark_3-4_2-12
5152
| Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
5253
|-----------|--------------------------|------------------------|--------------------------|-------------------------------|
54+
| 4.39.0 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
5355
| 4.38.0 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
5456
| 4.37.2 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
5557
| 4.37.1 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
@@ -86,6 +88,7 @@ to use the same version of Scala that Spark was compiled for.
8688
#### azure-cosmos-spark_3-3_2-12
8789
| Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
8890
|-----------|--------------------------|------------------------|--------------------------|-------------------------------|
91+
| 4.39.0 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
8992
| 4.38.0 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
9093
| 4.37.2 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
9194
| 4.37.1 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
@@ -131,11 +134,11 @@ to use the same version of Scala that Spark was compiled for.
131134
### Download
132135

133136
You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 14 from Maven:
134-
`com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12:4.38.0`
137+
`com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12:4.39.0`
135138

136139
You can also integrate against Cosmos DB Spark Connector in your SBT project:
137140
```scala
138-
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-5_2-12" % "4.38.0"
141+
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-5_2-12" % "4.39.0"
139142
```
140143

141144
Cosmos DB Spark Connector is available on [Maven Central Repo](https://central.sonatype.com/search?namespace=com.azure.cosmos.spark).

0 commit comments

Comments
 (0)