Skip to content
PR Build (Linux)

feat: add shuffle benchmark variants with native write config support #4329

Sign in to view logs

feat: add shuffle benchmark variants with native write config support

feat: add shuffle benchmark variants with native write config support #4329

Triggered via pull request January 20, 2026 22:39
@andygroveandygrove
synchronize #3226
andygrove:pyspark-benchmark-config-variants
Status Success
Total duration 53m 7s
Artifacts 36

pr_build_linux.yml

on: pull_request
Matrix: linux-test-rust
Matrix: linux-test
Fit to window
Zoom out
Zoom in

Artifacts

Produced during runtime
Name Size Digest
java-test-reports-ubuntu-latest-Spark 3.4, JDK 11, Scala 2.12-exec-21189891981-4329-1 Expired
6.9 KB
sha256:f38d134693a7c6a77ef5368d8e2a0a4fd73268e4c4a7f26c72031ed559754fef
java-test-reports-ubuntu-latest-Spark 3.4, JDK 11, Scala 2.12-expressions-21189891981-4329-1 Expired
5.32 KB
sha256:f1d2d272270580c76e5bd95fda4789428d96c7503ef9826a51e8e50bafe42fb0
java-test-reports-ubuntu-latest-Spark 3.4, JDK 11, Scala 2.12-fuzz-21189891981-4329-1 Expired
3.22 KB
sha256:39069147326fb09b075940cf5add9e392288137b0a59c3aa97110705d9c9c7cb
java-test-reports-ubuntu-latest-Spark 3.4, JDK 11, Scala 2.12-parquet-21189891981-4329-1 Expired
4.46 KB
sha256:1dd074f4f5e748349614ba8f1e615cbbc49a9a43e29f95407ee59466c2b70070
java-test-reports-ubuntu-latest-Spark 3.4, JDK 11, Scala 2.12-shuffle-21189891981-4329-1 Expired
2.88 KB
sha256:23ce09c25ac2fbc399656a050e8315ec68379dcf16ad25d29c2984a534a73946
java-test-reports-ubuntu-latest-Spark 3.4, JDK 11, Scala 2.12-sql-21189891981-4329-1 Expired
1.8 KB
sha256:c76e61212cacc1cecb441f6f48b0415e2036c1d7e01b5330c4170d8debb37549
java-test-reports-ubuntu-latest-Spark 3.5, JDK 17, Scala 2.12 native_datafusion-exec-21189891981-4329-1 Expired
6.86 KB
sha256:209765f4bab15f409e149535fa3756669ee6b6772950a22a2fa349f35e7cfd5f
java-test-reports-ubuntu-latest-Spark 3.5, JDK 17, Scala 2.12 native_datafusion-expressions-21189891981-4329-1 Expired
5.24 KB
sha256:26b35fdc99dcc76c9dc5bbdd1ad37de3732995a5feafa876fc23dfc8ed5e6d3e
java-test-reports-ubuntu-latest-Spark 3.5, JDK 17, Scala 2.12 native_datafusion-fuzz-21189891981-4329-1 Expired
3.22 KB
sha256:ef06b2cbd9e99bf20da1cf9d1dadb8ba2f186277335d4fd634c6849b5e67428e
java-test-reports-ubuntu-latest-Spark 3.5, JDK 17, Scala 2.12 native_datafusion-parquet-21189891981-4329-1 Expired
4.62 KB
sha256:563944b952977b14a2eb17fa896f5d33e7d752fd90ba2f6b5d13f916789ee326
java-test-reports-ubuntu-latest-Spark 3.5, JDK 17, Scala 2.12 native_datafusion-shuffle-21189891981-4329-1 Expired
3.17 KB
sha256:fcba846c682e74d636eb91fae7df4c7e352a8a56e145cc14900edcac5676cbc5
java-test-reports-ubuntu-latest-Spark 3.5, JDK 17, Scala 2.12 native_datafusion-sql-21189891981-4329-1 Expired
1.89 KB
sha256:be6da191b6e9b8af055a927875d29cda723602a37e95fb4d6fe769a1b3ec26f8
java-test-reports-ubuntu-latest-Spark 3.5, JDK 17, Scala 2.12 native_iceberg_compat-exec-21189891981-4329-1 Expired
6.86 KB
sha256:3e77cd30ca5d1bca7eaff00624286142f161c5c8d1c15a92e216a92834527bf3
java-test-reports-ubuntu-latest-Spark 3.5, JDK 17, Scala 2.12 native_iceberg_compat-expressions-21189891981-4329-1 Expired
5.24 KB
sha256:094a95783110f3cf583712e159b0ba13a10a9efae081a8809394a84b404b276c
java-test-reports-ubuntu-latest-Spark 3.5, JDK 17, Scala 2.12 native_iceberg_compat-fuzz-21189891981-4329-1 Expired
3.22 KB
sha256:b2d8dd6cd995268b90c58a0aef276e8885071100e9ba6e6e456d05f39b1a2665
java-test-reports-ubuntu-latest-Spark 3.5, JDK 17, Scala 2.12 native_iceberg_compat-parquet-21189891981-4329-1 Expired
4.62 KB
sha256:903ee856dd1486850f94baf49f6df660779d274209235e995922fc010d40bfae
java-test-reports-ubuntu-latest-Spark 3.5, JDK 17, Scala 2.12 native_iceberg_compat-shuffle-21189891981-4329-1 Expired
2.95 KB
sha256:5341ac8ac434ec44d82183e5988a7575aabcfac1c862367cd291b889774ef69b
java-test-reports-ubuntu-latest-Spark 3.5, JDK 17, Scala 2.12 native_iceberg_compat-sql-21189891981-4329-1 Expired
1.89 KB
sha256:939017f7bc1344ff80b56608697403c7b8ea6ec358603acccd7918548170e637
java-test-reports-ubuntu-latest-Spark 3.5.5, JDK 17, Scala 2.13-exec-21189891981-4329-1 Expired
6.81 KB
sha256:602ad9729056ffc0cb6b2c5a73750a6150d849734b8a64ee14b1de2d4b02e9f5
java-test-reports-ubuntu-latest-Spark 3.5.5, JDK 17, Scala 2.13-expressions-21189891981-4329-1 Expired
5.26 KB
sha256:a68ffb5eb77aa942abc008c38d8222afdc093bd8f12af158f6f5252f4c279635
java-test-reports-ubuntu-latest-Spark 3.5.5, JDK 17, Scala 2.13-fuzz-21189891981-4329-1 Expired
3.22 KB
sha256:72c56382aad639c000ba216d7959d4e1e34be476b97d7299f4de5b0f0e8590fb
java-test-reports-ubuntu-latest-Spark 3.5.5, JDK 17, Scala 2.13-parquet-21189891981-4329-1 Expired
4.46 KB
sha256:86e33d8efd504b16150d9c8f297df17f1e25afa4c729719bb96c8782b425f596
java-test-reports-ubuntu-latest-Spark 3.5.5, JDK 17, Scala 2.13-shuffle-21189891981-4329-1 Expired
2.87 KB
sha256:10b298544f815e095bc813cf9116d52ee900f63ee33c0563bd8be9883f1d2da5
java-test-reports-ubuntu-latest-Spark 3.5.5, JDK 17, Scala 2.13-sql-21189891981-4329-1 Expired
1.89 KB
sha256:9e7e4c88d051a13ada96ca4f939d7c81aa079e15746b48b93df6fc480e9f3b05
java-test-reports-ubuntu-latest-Spark 3.5.6, JDK 17, Scala 2.13-exec-21189891981-4329-1 Expired
6.81 KB
sha256:f3613bf68db8711e26d00273e841093480364100c30fd948085bb0761b3eb7f7
java-test-reports-ubuntu-latest-Spark 3.5.6, JDK 17, Scala 2.13-expressions-21189891981-4329-1 Expired
5.26 KB
sha256:a58906d9f92b9e9a0487bf2f759cf46535628cf03917d49eeeae305220cb7902
java-test-reports-ubuntu-latest-Spark 3.5.6, JDK 17, Scala 2.13-fuzz-21189891981-4329-1 Expired
3.22 KB
sha256:96edf1887a595584a0c64b405426c19e62cac58c090025e4d7f7f53a74c90be6
java-test-reports-ubuntu-latest-Spark 3.5.6, JDK 17, Scala 2.13-parquet-21189891981-4329-1 Expired
4.46 KB
sha256:7440df92505bea2cd05d39d8cbdd79a023426286f8c26d80a3372aea49a59194
java-test-reports-ubuntu-latest-Spark 3.5.6, JDK 17, Scala 2.13-shuffle-21189891981-4329-1 Expired
2.87 KB
sha256:2ae9b8eb8ca76115335ec9fa51e9904e5c317f496f22e744b5f33e3b0777a1d2
java-test-reports-ubuntu-latest-Spark 3.5.6, JDK 17, Scala 2.13-sql-21189891981-4329-1 Expired
1.9 KB
sha256:494e3619ce13ca2f05777f72d11144f76f2b325330d90137998bfc773f22ed57
java-test-reports-ubuntu-latest-Spark 4.0, JDK 17-exec-21189891981-4329-1 Expired
6.88 KB
sha256:55999b5663e78c8d26e927b770083f40cc1b51176f8657a158e526b9163b0fca
java-test-reports-ubuntu-latest-Spark 4.0, JDK 17-expressions-21189891981-4329-1 Expired
5.44 KB
sha256:03247f9b8be59fd2fac9098ff8ae69a9e1e88d1c3be853e7bb78c5fc2162eb01
java-test-reports-ubuntu-latest-Spark 4.0, JDK 17-fuzz-21189891981-4329-1 Expired
3.22 KB
sha256:049e9d283ab82eef1dbf025b1d40992903255d171d6e0861b86e1e0bf92d0088
java-test-reports-ubuntu-latest-Spark 4.0, JDK 17-parquet-21189891981-4329-1 Expired
4.55 KB
sha256:1f19b8762550c62fec58ac45490b8bfbf3edb801bc7b1c823d7546a9f47f608d
java-test-reports-ubuntu-latest-Spark 4.0, JDK 17-shuffle-21189891981-4329-1 Expired
3.11 KB
sha256:29c5f73d88c5b9cf9da7b4aa68c239ed4ab2c92fb460d4f54ddc4424ed462706
java-test-reports-ubuntu-latest-Spark 4.0, JDK 17-sql-21189891981-4329-1 Expired
1.9 KB
sha256:224838b8cf65cad6ab2315c96a39db380c053f2df36ff23a4ea06151dda96677