Skip to content

Commit 2423a28

Browse files
Scala 2.13 skeleton
1 parent 2199eb0 commit 2423a28

File tree

21 files changed

+846
-36
lines changed

21 files changed

+846
-36
lines changed

.vscode/cspell.json

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -105,6 +105,7 @@
105105
"sdk/cosmos/azure-cosmos-spark_3-4_2-12/**",
106106
"sdk/cosmos/azure-cosmos-spark_3-5/**",
107107
"sdk/cosmos/azure-cosmos-spark_3-5_2-12/**",
108+
"sdk/cosmos/azure-cosmos-spark_3-5_2-13/**",
108109
"sdk/cosmos/azure-cosmos-spark-account-data-resolver-sample/**",
109110
"sdk/cosmos/fabric-cosmos-spark-auth_3/**",
110111
"sdk/cosmos/azure-cosmos-encryption/**",

eng/.docsettings.yml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -80,6 +80,7 @@ known_content_issues:
8080
- ['sdk/cosmos/azure-cosmos-spark_3-3_2-12/README.md', '#3113']
8181
- ['sdk/cosmos/azure-cosmos-spark_3-4_2-12/README.md', '#3113']
8282
- ['sdk/cosmos/azure-cosmos-spark_3-5_2-12/README.md', '#3113']
83+
- ['sdk/cosmos/azure-cosmos-spark_3-5_2-13/README.md', '#3113']
8384
- ['sdk/cosmos/azure-cosmos-spark-account-data-resolver-sample/README.md', '#3113']
8485
- ['sdk/cosmos/fabric-cosmos-spark-auth_3/README.md', '#3113']
8586
- ['sdk/cosmos/azure-cosmos-spark_3_2-12/dev/README.md', '#3113']

eng/pipelines/aggregate-reports.yml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -48,7 +48,7 @@ extends:
4848
displayName: 'Build all libraries that support Java $(JavaBuildVersion)'
4949
inputs:
5050
mavenPomFile: pom.xml
51-
options: '$(DefaultOptions) -T 2C -DskipTests -Dgpg.skip -Dmaven.javadoc.skip=true -Dcodesnippet.skip=true -Dcheckstyle.skip=true -Dspotbugs.skip=true -Djacoco.skip=true -Drevapi.skip=true -Dshade.skip=true -Dspotless.skip=true -pl !com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12,!com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12,!com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12,!com.azure.cosmos.spark:azure-cosmos-spark-account-data-resolver-sample,!com.azure.cosmos.kafka:azure-cosmos-kafka-connect,!com.microsoft.azure:azure-batch,!com.microsoft.azure:azure-media'
51+
options: '$(DefaultOptions) -T 2C -DskipTests -Dgpg.skip -Dmaven.javadoc.skip=true -Dcodesnippet.skip=true -Dcheckstyle.skip=true -Dspotbugs.skip=true -Djacoco.skip=true -Drevapi.skip=true -Dshade.skip=true -Dspotless.skip=true -pl !com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12,!com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12,!com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-13,!com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12,!com.azure.cosmos.spark:azure-cosmos-spark-account-data-resolver-sample,!com.azure.cosmos.kafka:azure-cosmos-kafka-connect,!com.microsoft.azure:azure-batch,!com.microsoft.azure:azure-media'
5252
mavenOptions: '$(MemoryOptions) $(LoggingOptions)'
5353
javaHomeOption: 'JDKVersion'
5454
jdkVersionOption: $(JavaBuildVersion)
@@ -60,7 +60,7 @@ extends:
6060
displayName: 'Build remaining libraries with Java $(FallbackJavaBuildVersion)'
6161
inputs:
6262
mavenPomFile: pom.xml
63-
options: '$(DefaultOptions) -T 2C -DskipTests -Dgpg.skip -Dmaven.javadoc.skip=true -Dcodesnippet.skip=true -Dcheckstyle.skip=true -Dspotbugs.skip=true -Djacoco.skip=true -Drevapi.skip=true -Dspotless.skip=true -pl com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12,com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12,com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12,com.azure.cosmos.spark:azure-cosmos-spark-account-data-resolver-sample,com.azure.cosmos.kafka:azure-cosmos-kafka-connect,com.microsoft.azure:azure-batch,com.microsoft.azure:azure-media'
63+
options: '$(DefaultOptions) -T 2C -DskipTests -Dgpg.skip -Dmaven.javadoc.skip=true -Dcodesnippet.skip=true -Dcheckstyle.skip=true -Dspotbugs.skip=true -Djacoco.skip=true -Drevapi.skip=true -Dspotless.skip=true -pl com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12,com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12,com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12,com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-13,com.azure.cosmos.spark:azure-cosmos-spark-account-data-resolver-sample,com.azure.cosmos.kafka:azure-cosmos-kafka-connect,com.microsoft.azure:azure-batch,com.microsoft.azure:azure-media'
6464
mavenOptions: '$(MemoryOptions) $(LoggingOptions)'
6565
javaHomeOption: 'JDKVersion'
6666
jdkVersionOption: $(FallbackJavaBuildVersion)

eng/versioning/external_dependencies.txt

Lines changed: 15 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -254,15 +254,25 @@ cosmos_com.microsoft.azure.synapse:synapseutils_2.12;1.5.4
254254

255255
## Cosmos Spark connector under sdk\cosmos\azure-cosmos-spark_3-<version>_2-12\pom.xml
256256
# Cosmos Spark connector runtime dependencies - provided by Spark runtime/host
257+
cosmos-scala213-com.fasterxml.jackson.module:jackson-module-scala_2.13;2.18.4
257258
cosmos-spark_3-3_org.apache.spark:spark-sql_2.12;3.3.0
259+
cosmos-scala213-spark_3-3_org.apache.spark:spark-sql_2.13;3.3.0
258260
cosmos-spark_3-4_org.apache.spark:spark-sql_2.12;3.4.0
261+
cosmos-scala213-spark_3-4_org.apache.spark:spark-sql_2.13;3.4.0
259262
cosmos-spark_3-5_org.apache.spark:spark-sql_2.12;3.5.0
263+
cosmos-scala213-spark_3-5_org.apache.spark:spark-sql_2.13;3.5.0
260264
cosmos-spark_3-3_org.apache.spark:spark-hive_2.12;3.3.0
265+
cosmos-scala213-spark_3-3_org.apache.spark:spark-hive_2.13;3.3.0
261266
cosmos-spark_3-4_org.apache.spark:spark-hive_2.12;3.4.0
267+
cosmos-scala213-spark_3-4_org.apache.spark:spark-hive_2.13;3.4.0
262268
cosmos-spark_3-5_org.apache.spark:spark-hive_2.12;3.5.0
269+
cosmos-scala213-spark_3-5_org.apache.spark:spark-hive_2.13;3.5.0
263270
cosmos_org.scala-lang:scala-library;2.12.19
264-
cosmos_org.scala-lang.modules:scala-java8-compat_2.12;0.8.0
271+
cosmos-scala213_org.scala-lang:scala-library;2.13.17
272+
cosmos_org.scala-lang.modules:scala-java8-compat_2.12;0.9.1
273+
cosmos-scala213_org.scala-lang.modules:scala-java8-compat_2.13;0.9.1
265274
cosmos_io.projectreactor:reactor-scala-extensions_2.12;0.8.0
275+
cosmos-scala213_io.projectreactor:reactor-scala-extensions_2.13;0.8.0
266276
cosmos_commons-io:commons-io;2.4
267277
cosmos_com.microsoft.azure:applicationinsights-core;2.6.4
268278
cosmos_io.micrometer:micrometer-core;1.15.1
@@ -271,9 +281,13 @@ cosmos_io.micrometer:micrometer-registry-graphite;1.15.1
271281

272282
# Cosmos Spark connector tests only
273283
cosmos_org.scalatest:scalatest_2.12;3.2.2
284+
cosmos-scala213_org.scalatest:scalatest_2.13;3.2.2
274285
cosmos_org.scalatest:scalatest-flatspec_2.12;3.2.3
286+
cosmos-scala213_org.scalatest:scalatest-flatspec_2.13;3.2.3
275287
cosmos_org.scalactic:scalactic_2.12;3.2.3
288+
cosmos-scala213_org.scalactic:scalactic_2.13;3.2.3
276289
cosmos_org.scalamock:scalamock_2.12;5.0.0
290+
cosmos-scala213_org.scalamock:scalamock_2.13;5.0.0
277291
cosmos_com.globalmentor:hadoop-bare-naked-local-fs;0.1.0
278292
cosmos_org.mockito:mockito-core;4.8.1
279293

eng/versioning/version_client.txt

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -112,6 +112,7 @@ com.azure:azure-cosmos-test;1.0.0-beta.15;1.0.0-beta.16
112112
com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;4.41.0;4.42.0-beta.1
113113
com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12;4.41.0;4.42.0-beta.1
114114
com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12;4.41.0;4.42.0-beta.1
115+
com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-13;4.41.0;4.42.0-beta.1
115116
com.azure.cosmos.spark:fabric-cosmos-spark-auth_3;1.1.0;1.2.0-beta.1
116117
com.azure:azure-cosmos-tests;1.0.0-beta.1;1.0.0-beta.1
117118
com.azure:azure-data-appconfiguration;1.8.4;1.9.0-beta.1

sdk/cosmos/azure-cosmos-spark_3-5/pom.xml

Lines changed: 10 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -24,6 +24,10 @@
2424
<maven.main.skip>${cosmos.spark.skip}</maven.main.skip>
2525
<maven.test.skip>${cosmos.spark.skip}</maven.test.skip>
2626
<cosmos-spark-version>3.5</cosmos-spark-version>
27+
<scala.binary.version>2.12</scala.binary.version>
28+
<spark35.version>3.5.0</spark35.version> <!-- {x-version-update;cosmos-spark_3-5_org.apache.spark:spark-sql_2.12;external_dependency} -->
29+
<spark-hive-version>3.5.0</spark-hive-version> <!-- {x-version-update;cosmos-spark_3-5_org.apache.spark:spark-hive_2.12;external_dependency} -->
30+
<scala-jackson.version>2.18.4</scala-jackson.version> <!-- {x-version-update;com.fasterxml.jackson.module:jackson-module-scala_2.12;external_dependency} -->
2731
</properties>
2832
<profiles>
2933
<profile>
@@ -93,8 +97,8 @@
9397
<dependencies>
9498
<dependency>
9599
<groupId>org.apache.spark</groupId>
96-
<artifactId>spark-sql_2.12</artifactId>
97-
<version>3.5.0</version> <!-- {x-version-update;cosmos-spark_3-5_org.apache.spark:spark-sql_2.12;external_dependency} -->
100+
<artifactId>spark-sql_${scala.binary.version}</artifactId>
101+
<version>${spark35.version}</version>
98102
<exclusions>
99103
<exclusion>
100104
<groupId>io.netty</groupId>
@@ -109,8 +113,8 @@
109113
</dependency>
110114
<dependency>
111115
<groupId>org.apache.spark</groupId>
112-
<artifactId>spark-hive_2.12</artifactId>
113-
<version>3.5.0</version> <!-- {x-version-update;cosmos-spark_3-5_org.apache.spark:spark-hive_2.12;external_dependency} -->
116+
<artifactId>spark-hive_${scala.binary.version}</artifactId>
117+
<version>${spark-hive-version}</version>
114118
<exclusions>
115119
<exclusion>
116120
<groupId>io.netty</groupId>
@@ -130,8 +134,8 @@
130134
</dependency>
131135
<dependency>
132136
<groupId>com.fasterxml.jackson.module</groupId>
133-
<artifactId>jackson-module-scala_2.12</artifactId>
134-
<version>2.18.4</version> <!-- {x-version-update;com.fasterxml.jackson.module:jackson-module-scala_2.12;external_dependency} -->
137+
<artifactId>jackson-module-scala_${scala.binary.version}</artifactId>
138+
<version>${scala-jackson.version}</version>
135139
</dependency>
136140
</dependencies>
137141
</project>

sdk/cosmos/azure-cosmos-spark_3-5_2-12/pom.xml

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -40,6 +40,18 @@
4040
</developers>
4141
<properties>
4242
<cosmos.spark.skip>false</cosmos.spark.skip>
43+
<scala.binary.version>2.12</scala.binary.version>
44+
<scala.version>2.12.19</scala.version> <!-- {x-version-update;cosmos_org.scala-lang:scala-library;external_dependency} -->
45+
<spark33.version>3.3.0</spark33.version> <!-- {x-version-update;cosmos-spark_3-3_org.apache.spark:spark-sql_2.12;external_dependency} -->
46+
<spark34.version>3.4.0</spark34.version> <!-- {x-version-update;cosmos-spark_3-4_org.apache.spark:spark-sql_2.12;external_dependency} -->
47+
<spark35.version>3.5.0</spark35.version> <!-- {x-version-update;cosmos-spark_3-5_org.apache.spark:spark-sql_2.12;external_dependency} -->
48+
<scala-java8-compat.version>0.9.1</scala-java8-compat.version> <!-- {x-version-update;cosmos_org.scala-lang.modules:scala-java8-compat_2.12;external_dependency} -->
49+
<reactor-scala-extensions.version>0.8.0</reactor-scala-extensions.version> <!-- {x-version-update;cosmos_io.projectreactor:reactor-scala-extensions_2.12;external_dependency} -->
50+
<scalatest.version>3.2.2</scalatest.version> <!-- {x-version-update;cosmos_org.scalatest:scalatest_2.12;external_dependency} -->
51+
<scalatest-flatspec.version>3.2.3</scalatest-flatspec.version> <!-- {x-version-update;cosmos_org.scalatest:scalatest-flatspec_2.12;external_dependency} -->
52+
<scalactic.version>3.2.3</scalactic.version> <!-- {x-version-update;cosmos_org.scalactic:scalactic_2.12;external_dependency} -->
53+
<scalamock.version>5.0.0</scalamock.version> <!-- {x-version-update;cosmos_org.scalamock:scalamock_2.12;external_dependency} -->
54+
<scala-jackson.version>2.18.4</scala-jackson.version> <!-- {x-version-update;com.fasterxml.jackson.module:jackson-module-scala_2.12;external_dependency} -->
4355
</properties>
4456
<build>
4557
<plugins>
Lines changed: 154 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,154 @@
1+
## Release History
2+
3+
### 4.42.0-beta.1 (Unreleased)
4+
5+
#### Features Added
6+
7+
#### Breaking Changes
8+
9+
#### Bugs Fixed
10+
11+
#### Other Changes
12+
13+
### 4.41.0 (2025-10-21)
14+
15+
#### Features Added
16+
* Added support `spark.cosmos.write.strategy` value `ItemPatchIfExists` which allows gracefully ignoring documents/patch-instructions when the document does not exist (anymore). - See [47034](https://github.com/Azure/azure-sdk-for-java/pull/47034)
17+
* Added support to optionally omit info about spark environment and/or machine-info for driver/executors from `UserAgent` header via new config `spark.cosmos.userAgent.format` (allowed values are `SparkEnvAndWorkers` (default value), `OnlySparkEnv` and `NoSparkEnv`. - See [47047](https://github.com/Azure/azure-sdk-for-java/pull/47047)
18+
19+
### 4.40.0 (2025-09-27)
20+
21+
#### Features Added
22+
* Added support for feed range cache refresh interval config. - See [46759](https://github.com/Azure/azure-sdk-for-java/pull/46759)
23+
24+
#### Other Changes
25+
* Added improvement to reduce partition planning time for large containers. - See [46727](https://github.com/Azure/azure-sdk-for-java/pull/46727)
26+
27+
### 4.39.0 (2025-09-05)
28+
29+
#### Bugs Fixed
30+
* Reverted known issue due to shading log4j (which was introduced in 4.38.1). - See [PR 46546](https://github.com/Azure/azure-sdk-for-java/pull/46546) and [PR 46608](https://github.com/Azure/azure-sdk-for-java/pull/46608)
31+
* Added change feed performance monitoring which is used to improve end lsn calculation in `CosmosPartitionPlanner`. - See [PR 46320](https://github.com/Azure/azure-sdk-for-java/pull/46320)
32+
* Added `spark.cosmos.auth.aad.audience` as a valid configuration option to allow using AAD tokens with custom audiences. - See [PR 46554](https://github.com/Azure/azure-sdk-for-java/pull/46554)
33+
34+
### 4.38.1 (2025-08-22)
35+
36+
**NOTE: This version has a known issue due to shading log4j - Please use more recent versions >= 4.38.2 or 4.38.0 instead**
37+
38+
#### Other Changes
39+
* Added log4j-core to the list of shaded packages to avoid conflicts when customers use log4j in a different version. **NOTE: This change caused known issue - Please use a more recent version instead** - See [PR 45924](https://github.com/Azure/azure-sdk-for-java/pull/46451)
40+
41+
### 4.38.0 (2025-07-31)
42+
43+
#### Features Added
44+
* Added telemetry support by adding OTEL span attribute naming schemes, introducing Azure Monitor integration, and sampled diagnostics. - See [PR 45924](https://github.com/Azure/azure-sdk-for-java/pull/45924)
45+
46+
#### Other Changes
47+
* Added compatibility with CosmosDB Fabric Native Accounts using the `FabricAccountDataResolver` for authentication. - See [PR 45890](https://github.com/Azure/azure-sdk-for-java/pull/45890)
48+
49+
### 4.37.2 (2025-05-14)
50+
51+
#### Features Added
52+
* Added option to use the connector in non-public Azure clouds. - See [PR 45310](https://github.com/Azure/azure-sdk-for-java/pull/45310)
53+
54+
#### Bugs Fixed
55+
* Fixed an issue during bulk write operations that could result in failing the Spark job in `BulkWriter.flushAndClose` too eagerly in certain cases. - See [PR 44992](https://github.com/Azure/azure-sdk-for-java/pull/44992)
56+
* Fixed hang issue in `CosmosPagedIterable#handle` by preventing race conditions in underlying subscription of `Flux<FeedResponse>`. - [PR 45290](https://github.com/Azure/azure-sdk-for-java/pull/45290)
57+
58+
### 4.37.1 (2025-03-04)
59+
60+
#### Features Added
61+
* Added config option `spark.cosmos.read.responseContinuationTokenLimitInKb` to reduce query continuation token size. - See [PR 44480](https://github.com/Azure/azure-sdk-for-java/pull/44480)
62+
63+
### 4.37.0 (2025-02-20)
64+
65+
#### Other Changes
66+
* Updated netty dependency
67+
68+
### 4.36.1 (2025-02-08)
69+
70+
#### Bugs Fixed
71+
* Fixed an issue in change feed where under certain rare race conditions records could be skipped and excessive requests are prefetched. - See [PR 43788](https://github.com/Azure/azure-sdk-for-java/pull/43788)
72+
73+
### 4.36.0 (2025-01-14)
74+
> [!IMPORTANT]
75+
> We strongly recommend our customers to use version 4.36.0 and above especially if using all versions and deletes change feed.
76+
77+
#### Features Added
78+
* Added the udfs `GetFeedRangesForContainer` and `GetOverlappingFeedRange` to ease mapping of cosmos partition key to databricks table partition key. - See [PR 43092](https://github.com/Azure/azure-sdk-for-java/pull/43092)
79+
80+
#### Bugs Fixed
81+
* Added null checking for previous images for deletes in full fidelity change feed. - See [PR 43483](https://github.com/Azure/azure-sdk-for-java/pull/43483)
82+
83+
#### Other Changes
84+
* Added options to fine-tune settings for bulk operations. - [PR 43509](https://github.com/Azure/azure-sdk-for-java/pull/43509)
85+
86+
### 4.35.0 (2024-11-27)
87+
88+
#### Bugs Fixed
89+
* Fixed an issue when using `ChangeFeed` causing some cosmos partitions to not be fully processed in some cases. - See [PR 42553](https://github.com/Azure/azure-sdk-for-java/pull/42553)
90+
91+
### 4.34.0 (2024-10-10)
92+
#### Bugs Fixed
93+
* Fixed an issue to avoid transient `IllegalArgumentException` due to duplicate json properties for the `uniqueKeyPolicy` property in `DocumentCollection`. - See [PR 41608](https://github.com/Azure/azure-sdk-for-java/pull/41608) and [PR 42244](https://github.com/Azure/azure-sdk-for-java/pull/42244)
94+
95+
### 4.33.1 (2024-08-23)
96+
97+
#### Bugs Fixed
98+
* Fixed an issue to avoid transient `IllegalArgumentException` due to duplicate json properties for the `uniqueKeyPolicy` property. - See [PR 41608](https://github.com/Azure/azure-sdk-for-java/pull/41608)
99+
100+
#### Other Changes
101+
* Added retries on a new `BulkWriter` instance when first attempt to commit times out for bulk write jobs. - See [PR 41553](https://github.com/Azure/azure-sdk-for-java/pull/41553)
102+
103+
### 4.33.0 (2024-06-22)
104+
105+
#### Features Added
106+
* Added a service trait `CosmosClientBuilderInterceptor` to allow intercepting and customizing the CosmosClient creation. - See [PR 40714](https://github.com/Azure/azure-sdk-for-java/pull/40714)
107+
108+
#### Bugs Fixed
109+
* Fixed a race condition resulting in not always re-enqueueing retries for bulk writes. - See [PR 40714](https://github.com/Azure/azure-sdk-for-java/pull/40714)
110+
111+
### 4.32.1 (2024-06-07)
112+
113+
#### Other Changes
114+
* Added retries when retrieving new pages for query or readMany operations are timing out to avoid unbounded awaits. - See [PR 40506](https://github.com/Azure/azure-sdk-for-java/pull/40506)
115+
* Ensured that no statistics are reported when custom queries via `spark.cosmos.read.customQuery` are used. - See [PR 40506](https://github.com/Azure/azure-sdk-for-java/pull/40506)
116+
117+
### 4.32.0 (2024-05-24)
118+
119+
#### Features Added
120+
* Added config option `spark.cosmos.auth.aad.clientCertPemBase64` to allow using SPN (ServicePrincipal name) authentication with certificate instead of client secret. - See [PR 40325](https://github.com/Azure/azure-sdk-for-java/pull/40325)
121+
* Added config option `spark.cosmos.accountDataResolverServiceName` to allow specifying which `AccountDataResolver` trait implementation to use if there are multiple on the class path. - See [PR 40325](https://github.com/Azure/azure-sdk-for-java/pull/40325)
122+
123+
#### Bugs Fixed
124+
* Fixed an issue where `SHOW DATABASES IN` only return one database even though multiple databases exist. - See [PR 40277](https://github.com/Azure/azure-sdk-for-java/pull/40277)
125+
* Fixed an issue where `SHOW TABLES FROM` only return one container even though multiple containers exist. - See [PR 40277](https://github.com/Azure/azure-sdk-for-java/pull/40277)
126+
* Fixed UserAgent encoding when the suffix contains non-ASCII characters. - See[PR 40293](https://github.com/Azure/azure-sdk-for-java/pull/40293)
127+
128+
#### Other Changes
129+
* Added robustness improvement to avoid client-side parsing errors `java.lang.IllegalArgumentException: Unable to parse JSON` when Gateway returns duplicate `unqiueKeyPolicy` in IndexPolicy (invalid json) - See[PR 40306](https://github.com/Azure/azure-sdk-for-java/pull/40306)
130+
131+
### 4.31.0 (2024-05-20)
132+
133+
#### Features Added
134+
* Added capability in azure-cosmos-spark to allow the spark environment to support access tokens via AccountDataResolver. - See [PR 40079](https://github.com/Azure/azure-sdk-for-java/pull/40079)
135+
136+
### 4.30.0 (2024-04-27)
137+
138+
#### Features Added
139+
* Added capability to use (and enforce) native netty transport. The native transport is more efficient - esepcially when the number of TCP connections being used is high. - See [PR 39834](https://github.com/Azure/azure-sdk-for-java/pull/39834)
140+
* Added ManagedIdentity authentication support for azure-cosmos-spark in Databricks. - See [PR 39870](https://github.com/Azure/azure-sdk-for-java/pull/39870)
141+
142+
### 4.29.0 (2024-04-16)
143+
144+
#### Features Added
145+
* Spark 3.5 support: - See [PR 39395](https://github.com/Azure/azure-sdk-for-java/pull/39395).
146+
147+
#### Bugs Fixed
148+
* Fixed an issue causing failures when using change feed in batch mode with a batch location and `ChangeFeedBatch.planInputPartitions` is called multiple times (for example because physcial query plan gets retrieved) and some changes have been made in the monitored container between those calls). - See [PR 39635](https://github.com/Azure/azure-sdk-for-java/pull/39635)
149+
* Made `AccountDataResolver` trait public again. - See [PR 39736](https://github.com/Azure/azure-sdk-for-java/pull/39736)
150+
151+
#### Other Changes
152+
* Optimized the partitioning strategy implementation details to avoid unnecessarily high RU usage. - See [PR 39438](https://github.com/Azure/azure-sdk-for-java/pull/39438)
153+
154+
### NOTE: See CHANGELOG.md in 3.1, 3.2, 3.3 and 3.4 projects for changes prior to 4.29.0

0 commit comments

Comments
 (0)