Skip to content

Adding Spark 3.5 with Scala 2.13 module #47492

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
FabianMeiswinkel merged 41 commits into from
Jan 8, 2026

Update SparkE2EChangeFeedITest.scala

1ae02f7
Select commit
Loading
Failed to load commit list.
Merged

Adding Spark 3.5 with Scala 2.13 module #47492

Update SparkE2EChangeFeedITest.scala
1ae02f7
Select commit
Loading
Failed to load commit list.
Azure Pipelines / java - cosmos - ci succeeded Jan 7, 2026 in 1h 22m 38s

Build #20260107.8 had test failures

2 errors / 7,332 warnings

Details

Tests

  • Failed: 5 (0.01%)
  • Passed: 71,307 (98.99%)
  • Other: 721 (1.00%)
  • Total: 72,033
Code coverage

  • 2392 of 80551 lines covered (2.97%)

Annotations

Check failure on line 25 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / java - cosmos - ci

Build log #L25 

PowerShell exited with code '1'.

Check failure on line 25 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / java - cosmos - ci

Build log #L25 

PowerShell exited with code '1'.

Check failure on line 1 in c.a.c.s.SparkE2EWriteITest.should support upserts with bulkEnabled = false itemWriteStrategy = ItemOverwrite hasId = true initialBatchSize = None, maxBatchSize = None, minTargetBatchSize = None

See this annotation in the file changed.

@azure-pipelines azure-pipelines / java - cosmos - ci

c.a.c.s.SparkE2EWriteITest.should support upserts with bulkEnabled = false itemWriteStrategy = ItemOverwrite hasId = true initialBatchSize = None, maxBatchSize = None, minTargetBatchSize = None 

0 did not equal 1
Raw output 
      org.scalatest.exceptions.TestFailedException: 0 did not equal 1
      at org.scalatest.matchers.MatchersHelper$.indicateFailure(MatchersHelper.scala:344)
      at org.scalatest.matchers.should.Matchers$AnyShouldWrapper.shouldEqual(Matchers.scala:6860)
      at com.azure.cosmos.spark.SparkE2EWriteITest.$anonfun$new$3(SparkE2EWriteITest.scala:169)
      at org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85)
      at org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83)
      at org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104)
      at org.scalatest.Transformer.apply(Transformer.scala:22)
      at org.scalatest.Transformer.apply(Transformer.scala:20)
      at org.scalatest.flatspec.AnyFlatSpecLike$$anon$5.apply(AnyFlatSpecLike.scala:1684)
      at org.scalatest.TestSuite.withFixture(TestSuite.scala:196)
      at org.scalatest.TestSuite.withFixture$(TestSuite.scala:195)
      at org.scalatest.flatspec.AnyFlatSpec.withFixture(AnyFlatSpec.scala:1685)
      at org.scalatest.flatspec.AnyFlatSpecLike.invokeWithFixture$1(AnyFlatSpecLike.scala:1682)
      at org.scalatest.flatspec.AnyFlatSpecLike.$anonfun$runTest$1(AnyFlatSpecLike.scala:1694)
      at org.scalatest.SuperEngine.runTestImpl(Engine.scala:306)
      at org.scalatest.flatspec.AnyFlatSpecLike.runTest(AnyFlatSpecLike.scala:1694)
      at org.scalatest.flatspec.AnyFlatSpecLike.runTest$(AnyFlatSpecLike.scala:1676)
      at com.azure.cosmos.spark.IntegrationSpec.org$scalatest$BeforeAndAfterEach$$super$runTest(IntegrationSpec.scala:10)
      at org.scalatest.BeforeAndAfterEach.runTest(BeforeAndAfterEach.scala:234)
      at org.scalatest.BeforeAndAfterEach.runTest$(BeforeAndAfterEach.scala:227)
      at com.azure.cosmos.spark.IntegrationSpec.runTest(IntegrationSpec.scala:10)
      at org.scalatest.flatspec.AnyFlatSpecLike.$anonfun$runTests$1(AnyFlatSpecLike.scala:1752)
      at org.scalatest.SuperEngine.$anonfun$runTestsInBranch$1(Engine.scala:413)
      at scala.collection.immutable.List.foreach(List.scala:431)
      at org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:401)
      at org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:396)
      at org.scalatest.SuperEngine.runTestsImpl(Engine.scala:475)
      at org.scalatest.flatspec.AnyFlatSpecLike.runTests(AnyFlatSpecLike.scala:1752)
      at org.scalatest.flatspec.AnyFlatSpecLike.runTests$(AnyFlatSpecLike.scala:1751)
      at org.scalatest.flatspec.AnyFlatSpec.runTests(AnyFlatSpec.scala:1685)
      at org.scalatest.Suite.run(Suite.scala:1112)
      at org.scalatest.Suite.run$(Suite.scala:1094)
      at org.scalatest.flatspec.AnyFlatSpec.org$scalatest$flatspec$AnyFlatSpecLike$$super$run(AnyFlatSpec.scala:1685)
      at org.scalatest.flatspec.AnyFlatSpecLike.$anonfun$run$1(AnyFlatSpecLike.scala:1797)
      at org.scalatest.SuperEngine.runImpl(Engine.scala:535)
      at org.scalatest.flatspec.AnyFlatSpecLike.run(AnyFlatSpecLike.scala:1797)
      at org.scalatest.flatspec.AnyFlatSpecLike.run$(AnyFlatSpecLike.scala:1795)
      at com.azure.cosmos.spark.IntegrationSpec.org$scalatest$BeforeAndAfterAll$$super$run(IntegrationSpec.scala:10)
      at org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:213)
      at org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:210)
      at org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:208)
      at com.azure.cosmos.spark.IntegrationSpec.run(IntegrationSpec.scala:10)
      at org.scalatest.Suite.callExecuteOnSuite$1(Suite.scala:1175)
      at org.scalatest.Suite.$anonfun$runNestedSuites$1(Suite.scala:1222)
      at scala.collection.IndexedSeqOptimized.foreach(IndexedSeqOptimized.scala:36)
      at scala.collection.IndexedSeqOptimized.foreach$(IndexedSeqOptimized.scala:33)
      at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:198)
      at org.scalatest.Suite.runNestedSuites(Suite.scala:1220)
      at org.scalatest.Suite.runNestedSuites$(Suite.scala:1154)
      at org.scalatest.tools.DiscoverySuite.runNestedSuites

Check failure on line 1 in c.a.c.i.t.ThroughputControlTests.ThroughputControlTests::throughputLocalControl_createItem[Gateway with Session consistency]

See this annotation in the file changed.

@azure-pipelines azure-pipelines / java - cosmos - ci

c.a.c.i.t.ThroughputControlTests.ThroughputControlTests::throughputLocalControl_createItem[Gateway with Session consistency] 

Completed! (latch = 0, values = 1, errors = 0, completions = 1)
Raw output 
java.lang.AssertionError: Completed! (latch = 0, values = 1, errors = 0, completions = 1)
	at io.reactivex.observers.BaseTestConsumer.fail(BaseTestConsumer.java:189)
	at io.reactivex.observers.BaseTestConsumer.assertNotComplete(BaseTestConsumer.java:258)
	at com.azure.cosmos.rx.TestSuiteBase.validateItemFailure(TestSuiteBase.java:1037)
	at com.azure.cosmos.implementation.throughputControl.ThroughputControlTests.throughputLocalControl_createItem(ThroughputControlTests.java:574)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.testng.internal.invokers.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:136)
	at org.testng.internal.invokers.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:44)
	at org.testng.internal.invokers.InvokeMethodRunnable.call(InvokeMethodRunnable.java:72)
	at org.testng.internal.invokers.InvokeMethodRunnable.call(InvokeMethodRunnable.java:10)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:750)

Check failure on line 1 in c.a.c.r.ContainerCreateDeleteWithSameNameTest.ContainerCreateDeleteWithSameNameTest::bulk[Gateway with Session consistency][10100, /mypk, com.azure.cosmos.rx.ContainerCreateDeleteWithSameNameTest$2@1c8cacce, 400, /id, com.azure.cosmos.rx.ContainerCreateDeleteWithSameNameTest$1@8c29e75](4)

See this annotation in the file changed.

@azure-pipelines azure-pipelines / java - cosmos - ci

c.a.c.r.ContainerCreateDeleteWithSameNameTest.ContainerCreateDeleteWithSameNameTest::bulk[Gateway with Session consistency][10100, /mypk, com.azure.cosmos.rx.ContainerCreateDeleteWithSameNameTest$2@1c8cacce, 400, /id, com.azure.cosmos.rx.ContainerCreateDeleteWithSameNameTest$1@8c29e75](4) 

[total number of results] 
expected: 10
 but was: 9
Raw output 
java.lang.AssertionError: 
[total number of results] 
expected: 10
 but was: 9
	at com.azure.cosmos.implementation.FeedResponseListValidator$Builder$2.validate(FeedResponseListValidator.java:56)
	at com.azure.cosmos.implementation.FeedResponseListValidator$Builder$1.validate(FeedResponseListValidator.java:44)
	at com.azure.cosmos.rx.TestSuiteBase.validateQuerySuccess(TestSuiteBase.java:1057)
	at com.azure.cosmos.rx.TestSuiteBase.validateQuerySuccess(TestSuiteBase.java:1045)
	at com.azure.cosmos.rx.ContainerCreateDeleteWithSameNameTest.lambda$bulk$10(ContainerCreateDeleteWithSameNameTest.java:640)
	at com.azure.cosmos.rx.ContainerCreateDeleteWithSameNameTest.createDeleteContainerWithSameName(ContainerCreateDeleteWithSameNameTest.java:873)
	at com.azure.cosmos.rx.ContainerCreateDeleteWithSameNameTest.bulk(ContainerCreateDeleteWithSameNameTest.java:644)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.testng.internal.invokers.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:136)
	at org.testng.internal.invokers.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:44)
	at org.testng.internal.invokers.InvokeMethodRunnable.call(InvokeMethodRunnable.java:72)
	at org.testng.internal.invokers.InvokeMethodRunnable.call(InvokeMethodRunnable.java:10)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:750)

Check failure on line 1 in c.a.c.i.t.ThroughputControlTests.throughputLocalControl_createItem

See this annotation in the file changed.

@azure-pipelines azure-pipelines / java - cosmos - ci

c.a.c.i.t.ThroughputControlTests.throughputLocalControl_createItem 

Completed! (latch = 0, values = 1, errors = 0, completions = 1)
Raw output 
java.lang.AssertionError: Completed! (latch = 0, values = 1, errors = 0, completions = 1)
at io.reactivex.observers.BaseTestConsumer.fail(BaseTestConsumer.java:189)
at io.reactivex.observers.BaseTestConsumer.assertNotComplete(BaseTestConsumer.java:258)
at com.azure.cosmos.rx.TestSuiteBase.validateItemFailure(TestSuiteBase.java:1037)
at com.azure.cosmos.implementation.throughputControl.ThroughputControlTests.throughputLocalControl_createItem(ThroughputControlTests.java:574)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.testng.internal.invokers.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:136)
at org.testng.internal.invokers.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:44)
at org.testng.internal.invokers.InvokeMethodRunnable.call(InvokeMethodRunnable.java:72)
at org.testng.internal.invokers.InvokeMethodRunnable.call(InvokeMethodRunnable.java:10)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
View more details on Azure Pipelines