Skip to content
PR Build (Linux)

perf: optimize shuffle array element iteration with slice-based append #4317

Sign in to view logs

perf: optimize shuffle array element iteration with slice-based append

perf: optimize shuffle array element iteration with slice-based append #4317

Triggered via pull request January 20, 2026 18:41
@andygroveandygrove
synchronize #3222
andygrove:shuffle-optimization
Status Success
Total duration 54m 12s
Artifacts 36

pr_build_linux.yml

on: pull_request
Matrix: linux-test-rust
Matrix: linux-test
Fit to window
Zoom out
Zoom in

Artifacts

Produced during runtime
Name Size Digest
java-test-reports-ubuntu-latest-Spark 3.4, JDK 11, Scala 2.12-exec-21183244678-4317-1 Expired
6.89 KB
sha256:c4be8caabe81fed6bb6ef622a256dc4f5067b7ebc62e138e164266ec951920a6
java-test-reports-ubuntu-latest-Spark 3.4, JDK 11, Scala 2.12-expressions-21183244678-4317-1 Expired
5.32 KB
sha256:d9679213703bdf9d293924791ee51a3b9f34ac260fbba3512c4e6ffec0241fa1
java-test-reports-ubuntu-latest-Spark 3.4, JDK 11, Scala 2.12-fuzz-21183244678-4317-1 Expired
3.21 KB
sha256:fcf895440005f5a5efe20c7bbffb3188a195f07d38598e5fbcf389f43f8e161a
java-test-reports-ubuntu-latest-Spark 3.4, JDK 11, Scala 2.12-parquet-21183244678-4317-1 Expired
4.46 KB
sha256:2a41516b01b3ecd19ec0e0a50599fa46a73981ff990c5739c04f42e6b905ff3e
java-test-reports-ubuntu-latest-Spark 3.4, JDK 11, Scala 2.12-shuffle-21183244678-4317-1 Expired
2.88 KB
sha256:e90208113b16453294f09fbdaaab0d1f584899c30788e4a338b1adb5f22d09f7
java-test-reports-ubuntu-latest-Spark 3.4, JDK 11, Scala 2.12-sql-21183244678-4317-1 Expired
1.81 KB
sha256:e80d64e552d10815d224b59685b68c3ebc207e26a1d8e323b9ccbac235f5d880
java-test-reports-ubuntu-latest-Spark 3.5, JDK 17, Scala 2.12 native_datafusion-exec-21183244678-4317-1 Expired
6.86 KB
sha256:7b9d8ad645b929b68f4271ea354cd704a582e83c310524fbbd24a05c0c0ebb5b
java-test-reports-ubuntu-latest-Spark 3.5, JDK 17, Scala 2.12 native_datafusion-expressions-21183244678-4317-1 Expired
5.24 KB
sha256:a72dce8770f3e627311d3f5509c2ac296040c67d547ed0c8c612f958588dc8e1
java-test-reports-ubuntu-latest-Spark 3.5, JDK 17, Scala 2.12 native_datafusion-fuzz-21183244678-4317-1 Expired
3.22 KB
sha256:0f6a238bfc16e6599e7e52d7c62a6cd646c296b983fd9d6a340580abfd7291e9
java-test-reports-ubuntu-latest-Spark 3.5, JDK 17, Scala 2.12 native_datafusion-parquet-21183244678-4317-1 Expired
4.62 KB
sha256:b89334ef3c021628afa906a1dc1b41ab3349b9d1af13eb01ab6c08de3ca5bcbf
java-test-reports-ubuntu-latest-Spark 3.5, JDK 17, Scala 2.12 native_datafusion-shuffle-21183244678-4317-1 Expired
3.17 KB
sha256:b29a9a0ff8ca40edd3f5551b80943a35dfdee16231e1e0d778b8ce6396bdda5c
java-test-reports-ubuntu-latest-Spark 3.5, JDK 17, Scala 2.12 native_datafusion-sql-21183244678-4317-1 Expired
1.9 KB
sha256:bca5d84e5511d1d7e832245613178200967076aa942aa485e02f528220b71e8d
java-test-reports-ubuntu-latest-Spark 3.5, JDK 17, Scala 2.12 native_iceberg_compat-exec-21183244678-4317-1 Expired
6.86 KB
sha256:68e5be1cafb039f9af5bc144b7d70d6262bf84f331ffbda71c1ea28bc41783ec
java-test-reports-ubuntu-latest-Spark 3.5, JDK 17, Scala 2.12 native_iceberg_compat-expressions-21183244678-4317-1 Expired
5.23 KB
sha256:e982f976c4d9973f26644a3be8171d141350f205b41530916ab19e086da208e6
java-test-reports-ubuntu-latest-Spark 3.5, JDK 17, Scala 2.12 native_iceberg_compat-fuzz-21183244678-4317-1 Expired
3.22 KB
sha256:d8188151eefc7b0e5355c70890434b9d4d7284daa0c9b750ce68a4c71f18feca
java-test-reports-ubuntu-latest-Spark 3.5, JDK 17, Scala 2.12 native_iceberg_compat-parquet-21183244678-4317-1 Expired
4.62 KB
sha256:bccafbef5bcbde56fbda1703744fd66ef7dc9a140677f371a470c93bcdafd235
java-test-reports-ubuntu-latest-Spark 3.5, JDK 17, Scala 2.12 native_iceberg_compat-shuffle-21183244678-4317-1 Expired
2.95 KB
sha256:4b162b5f25a800ca300afef811cb7b72f9f3372cd52cd9fa610e5b4b31dfb0bd
java-test-reports-ubuntu-latest-Spark 3.5, JDK 17, Scala 2.12 native_iceberg_compat-sql-21183244678-4317-1 Expired
1.89 KB
sha256:0796b7f72576d7bd641d081d9484691b730b01f7ef0d5a3828d05158d1b73477
java-test-reports-ubuntu-latest-Spark 3.5.5, JDK 17, Scala 2.13-exec-21183244678-4317-1 Expired
6.81 KB
sha256:aa1930c57b166af0ab05f7f5d921429536990ee9bc3270daa68ce9b393e4d994
java-test-reports-ubuntu-latest-Spark 3.5.5, JDK 17, Scala 2.13-expressions-21183244678-4317-1 Expired
5.26 KB
sha256:a2515d85470e1a3774f11c1c6d72aeb39c050f4ba0e5cbb805266b5cd6a070eb
java-test-reports-ubuntu-latest-Spark 3.5.5, JDK 17, Scala 2.13-fuzz-21183244678-4317-1 Expired
3.22 KB
sha256:8fd227a7d765ccc2e3776e1c6becc909fd0a9f2ff9d10ee5ef08257ba7888877
java-test-reports-ubuntu-latest-Spark 3.5.5, JDK 17, Scala 2.13-parquet-21183244678-4317-1 Expired
4.46 KB
sha256:7808323f427e1490924c9836175e5147f2b68fb800fbb17e445a858e9130dc29
java-test-reports-ubuntu-latest-Spark 3.5.5, JDK 17, Scala 2.13-shuffle-21183244678-4317-1 Expired
2.87 KB
sha256:dce66ac530eae259ba0561508f87e9a068181020e5b4944ccac455f48dc02341
java-test-reports-ubuntu-latest-Spark 3.5.5, JDK 17, Scala 2.13-sql-21183244678-4317-1 Expired
1.89 KB
sha256:937b0b40cd72843b3bc8a64febd925ee8cfb9ac3af03c14d0f72eddd2386d938
java-test-reports-ubuntu-latest-Spark 3.5.6, JDK 17, Scala 2.13-exec-21183244678-4317-1 Expired
6.82 KB
sha256:1c416c1ffb94abab51704370e85d0931fd284feb7ba1f2efc1c693dbc7831208
java-test-reports-ubuntu-latest-Spark 3.5.6, JDK 17, Scala 2.13-expressions-21183244678-4317-1 Expired
5.26 KB
sha256:9ab91f9236aa73db867a8428a49a64097b05ba6050f28f989b00644045505858
java-test-reports-ubuntu-latest-Spark 3.5.6, JDK 17, Scala 2.13-fuzz-21183244678-4317-1 Expired
3.22 KB
sha256:a70b80c7dd4bbce3d840eeb0eca92dbd9ee64691ab918b850569b5ad87132ca5
java-test-reports-ubuntu-latest-Spark 3.5.6, JDK 17, Scala 2.13-parquet-21183244678-4317-1 Expired
4.46 KB
sha256:a512a8e75e53f979f42bf9792ea68a7d89df6904ec5f1f89124a98a6e047951f
java-test-reports-ubuntu-latest-Spark 3.5.6, JDK 17, Scala 2.13-shuffle-21183244678-4317-1 Expired
2.88 KB
sha256:d14883a3459be035fcf31aae8d31237845070c976088f00b8649ee36839b0f8c
java-test-reports-ubuntu-latest-Spark 3.5.6, JDK 17, Scala 2.13-sql-21183244678-4317-1 Expired
1.89 KB
sha256:76e820b8b925cc05bc3830db0d5ffe40c855a840b78385854c16e9e3257be617
java-test-reports-ubuntu-latest-Spark 4.0, JDK 17-exec-21183244678-4317-1 Expired
6.88 KB
sha256:8b31e5a20e53da79bce6d22e5bacbf93082fb39471b3f29d7ae8678c88a3580c
java-test-reports-ubuntu-latest-Spark 4.0, JDK 17-expressions-21183244678-4317-1 Expired
5.43 KB
sha256:491c0d78b90f10f539ce33a41101732d2faaafc96a39475c2245403da2891b81
java-test-reports-ubuntu-latest-Spark 4.0, JDK 17-fuzz-21183244678-4317-1 Expired
3.22 KB
sha256:dd6f6e5a5d0fa7eeb7673b262c65dddab0b3e68431e41edabc18e0bb25381b91
java-test-reports-ubuntu-latest-Spark 4.0, JDK 17-parquet-21183244678-4317-1 Expired
4.55 KB
sha256:e24136d433b79de463e0fd2be09c244704e05a5b74960ce1596fe77719e5168c
java-test-reports-ubuntu-latest-Spark 4.0, JDK 17-shuffle-21183244678-4317-1 Expired
3.1 KB
sha256:b86e1e92efe29b5162218427dced4fdb0d36fdd30c7f4a20b674089b83af05ef
java-test-reports-ubuntu-latest-Spark 4.0, JDK 17-sql-21183244678-4317-1 Expired
1.89 KB
sha256:f47e406fd79a0774d411edab221a70aaadb84f78578cb32c21f910420636e704