🌪 0.48.0

Changes

✨ Features

• feat: teach Vortex how to implement a Ray Datasource (#4339) @danking
• feat: teach VortexDataset get_fragments (#4340) @danking
• feat: vortex-python/check.sh (#4338) @danking
• feat: teach VortexDataset to filter & document vortex.expr.* (#4336) @danking

🐛 Bug Fixes

• fix: Remove ScalarValue::is_instance_of (#4341) @robert3005

🧰 Maintenance

4 changes

• fix: Java builds with GLIBC 2.31+ compatibility (#4331) @a10y
• chore(deps): update rust crate url to v2.5.7 (#4343) @renovate[bot]
• chore(deps): update actions/upload-pages-artifact action to v4 (#4329) @renovate[bot]
• fix: Buffer Clone bound (#4337) @a10y

🌪 0.47.0

Changes

✨ Features

• feat[vortex-array]: add stepped pipeline execution (#4312) @joseph-isaacs
• feat[dtype]: ptype visitor (#4307) @joseph-isaacs

🚀 Performance

• feat[vortex-array]: add stepped pipeline execution (#4312) @joseph-isaacs

🐛 Bug Fixes

• fix(java): Spark writer properly handles string and array data (#4335) @a10y
• fix: Spawn datafusion write tasks (#4316) @AdamGS
• fix: vortex-cxx examples macos build (#4308) @0ax1
• fix: Remove conversion from usize to scalar (#4304) @robert3005
• fix: downscale FSST offsets (#4301) @a10y
• feat[vortex-array]: support converting to timestamp arrow arrays with tz (#4285) @asubiotto

🧰 Maintenance

28 changes

• chore: pyright (#4289) @danking
• Clean up match statements and misc (#4332) @connortsui20
• chore: vortex-ffi testing & build improvements (#4218) @lwwmanning
• chore[bench]: have --skip-generate option and only create iterators for tpch when needed (#4328) @joseph-isaacs
• Add local .claude folder to .gitignore (#4325) @connortsui20
• chore: configure codecov comments to be more useful (#4326) @lwwmanning
• chore(deps): update all patch updates (patch) (#4323) @renovate[bot]
• chore: return lvalue ref for cxx's scanbuilder functions (#4306) @XinyuZeng
• chore(deps): update rust crate zip to v4.5.0 (#4320) @renovate[bot]
• Add the missing copyright profile file (#4318) @gatesn
• chore: Don't prune uv caches in CI (#4314) @robert3005
• chore: vortex-scalar cleanup (#4313) @connortsui20
• chore(deps): update actions/setup-java action to v5 (#4305) @renovate[bot]
• chore: Make downscale_integer_array a method on PrimitiveArray (#4303) @robert3005
• chore(deps): update rust crate url to v2.5.6 (#4309) @renovate[bot]
• chore(deps): update spiraldb/actions action to v0.15.0 (#4311) @renovate[bot]
• chore(deps): update rust crate zip to v4.4.0 (#4310) @renovate[bot]
• Chore: Add list of list tests (#4298) @connortsui20
• chore: move field_names tests to field_names.rs (#4300) @connortsui20
• Add test coverage badge to README (#4299) @AdamGS
• Report coverage to codecov (#4296) @AdamGS
• chore(deps): update rust crate inventory to v0.3.21 (#4297) @renovate[bot]
• chore(deps): update rust crate taffy to v0.9.1 (#4295) @renovate[bot]
• Improve test coverage for conversion between DataFusion and Vortex objects (#4294) @AdamGS
• chore(deps): update rust crate thiserror to v2.0.16 (#4293) @renovate[bot]
• chore(deps): update rust crate tempfile to v3.21.0 (#4292) @renovate[bot]
• chore: DType documentation (#4291) @connortsui20
• chore(deps): update rust crate cfg-if to v1.0.3 (#4290) @renovate[bot]

🌪 0.46.1

Changes

🧰 Maintenance

• fix: timeout crates publish after 1hr (#4288) @a10y

🌪 0.46.0

Changes

✨ Features

• feat: ArrayOperations infallible, eager validation + new_unchecked (#4177) @a10y
• feat: teach VortexDataset how to limit the batch_size (#4275) @danking
• chore[vortex-duckdb]: duckdb explain custom display (#4272) @joseph-isaacs

🚀 Performance

• Add more non copying stats operations; replace stats replace with inherit_from (#4279) @robert3005

🐛 Bug Fixes

• Fix: converting from duckdb_string_t requires looking at length (#4277) @robert3005
• fix[duckdb]: set max cardinality in duckdb (#4270) @joseph-isaacs

🧰 Maintenance

14 changes

• chore: infinite publish timeout (#4286) @a10y
• chore(deps): update polarsignals/gh-actions-ps-profiling action to v0.6.0 (#4284) @renovate[bot]
• chore: monad vs. monoid (#4283) @connortsui20
• Add Display impl for FieldNames (#4282) @AdamGS
• chore(deps): update rust crate serde_json to v1.0.143 (#4280) @renovate[bot]
• Chore: Cleanup in take (#4278) @connortsui20
• docs: Add documentation to take function (#4274) @connortsui20
• chore: hide aliases from docs (#4273) @danking
• chore: Add rust-analyzer to the rust-toolchain.tom file (#4271) @connortsui20
• Enable TPC-DS benchmarks for datafusion (#4269) @AdamGS
• Remove old dead test code (#4265) @AdamGS
• chore(deps): update datafusion and friends to v49.0.1 (patch) (#4267) @renovate[bot]
• chore(deps): lock file maintenance (#4264) @renovate[bot]
• chore(deps): update rust crate thiserror to v2.0.15 (#4262) @renovate[bot]

🌪 0.45.0

Changes

✨ Features

• feat[spark]: write support in VortexDataSourceV2 (#4246) @lwwmanning
• feat: implement Display for StructFields (#4255) @blaginin
• feat: Support more datafusion features (#4180) @AdamGS
• Support converting TimestampTZ to and from duckdb (#4226) @robert3005
• Use perfetto tracing (#4250) @gatesn
• feat: Remove 'parquet' feature and some other dependency bloat (#4251) @AdamGS
• feat: Make FieldNames comparison more ergonomic (#4239) @AdamGS
• feat(c++): support passing filter and projection expression in scan (#4224) @XinyuZeng
• feat[expr]: add back the expression folder, implemented over Node (#4230) @joseph-isaacs
• feature: Add TryFrom impls for owned scalars to values (#4234) @AdamGS
• docs: add javadoc to docs.vortex.dev (#4229) @a10y
• feat: Expose various expr transformations directly instead of through module (#4212) @AdamGS
• feat[duckdb]: support more operators (#4170) @joseph-isaacs
• feat: teach Vortex how to export list arrays to duckdb (#4169) @danking
• feat(python): Write PyArrow types directly to Vortex (#4161) @a10y
• Inline the logic of the filter layout reader (#4089) @gatesn
• Support exporting Arrow RunArray to Vortex (#4162) @robert3005
• feature: Support converting Arrow DictArray into vortex (#4157) @robert3005
• refactor the LayoutStrategy (#4149) @a10y

🚀 Performance

• perf: Use sum compute function (#4207) @viirya

🐛 Bug Fixes

20 changes

• fix: Validity export using shifted u64 copy (#4244) @robert3005
• fix[bench]: better bench input size (#4243) @joseph-isaacs
• fix[bench-site]: Compression Size group missing charts (#4236) @lwwmanning
• Fix: Return currect field names in SelectExpr::as_include (#4232) @AdamGS
• fix: javadoc workflow (#4231) @a10y
• fix: Correctly convert arrow temporal arrays with timezone (#4227) @robert3005
• fix: runend decompress benchmarks (#4225) @0ax1
• fix: Avoid running projection evaluation for all false masks (#4209) @robert3005
• fix: small resource leak in vortex-io, plus test improvements (#4201) @lwwmanning
• fix: race condition in vortex-layout, plus test improvements (#4198) @lwwmanning
• fix[bench-website]: add tpc-ds to bench website (#4199) @joseph-isaacs
• shared waker in struct writer (#4193) @onursatici
• fix: duckdb dyn expr race on filter constant (#4168) @0ax1
• fix[scan]: don't convert filter to cnf just extract conjunct list (#4174) @joseph-isaacs
• fix: Fix some minor typos and remove the "single-file" feature from clickbench (#4182) @AdamGS
• fix: incorrect decimal scalar nbytes (#4176) @lwwmanning
• fix(pyvortex): encoding-specific dispatch (#4171) @a10y
• fix[duckdb]: validity ref u64 not u8 (#4172) @joseph-isaacs
• ScalarValue operations must go via Scalar (#4152) @robert3005
• Only coerce scalar values when necessary (#4135) @robert3005

🧰 Maintenance

55 changes

• chore: Fix all rustdoc warnings and enforce no warning in CI (#4261) @AdamGS
• fix(deps): update dependency org.junit.jupiter:junit-jupiter to v5.13.4 (#4260) @renovate[bot]
• chore[vortex-expr]: folder docs (#4238) @joseph-isaacs
• fix(deps): update dependency ch.qos.logback:logback-classic to v1.5.18 (#4259) @renovate[bot]
• fix(deps): update slf4j monorepo to v2.0.17 (patch) (#4258) @renovate[bot]
• fix(deps): update dependency org.junit.jupiter:junit-jupiter to v5.10.5 (#4257) @renovate[bot]
• chore: Add docs to vortex-expr (#4253) @AdamGS
• chore(deps): update rust crate cc to v1.2.33 (#4256) @renovate[bot]
• chore[fastlanes]: remove FoR unsigned transmute (#4252) @joseph-isaacs
• chore(deps): update plugin com.gradleup.shadow to v9.0.2 (#4249) @renovate[bot]
• fix(deps): update protobuf monorepo to v4.32.0 (minor) (#4248) @renovate[bot]
• chore(deps): update rust crate arbitrary to v1.4.2 (#4247) @renovate[bot]
• chore(deps): update rust crate async-trait to v0.1.89 (#4245) @renovate[bot]
• chore[vortex-array]: facilitate third-party ToArrowKernel implementations (#4237) @asubiotto
• chore: Allow coveralls step to fail in CI without failing the job (#4240) @AdamGS
• chore: speed up the benchmark page loading (#4235) @a10y
• docs: fill in missing javadoc (#4233) @a10y
• chore: expand runend decompress benchmarks (#4228) @0ax1
• fix(deps): update dependency org.immutables:value to v2.11.3 (#4222) @renovate[bot]
• chore(deps): update rust crate rayon to v1.11.0 (#4223) @renovate[bot]
• chore(deps): update all patch updates (patch) (#4211) @renovate[bot]
• chore: sequential consistency in vortex-scan (#4217) @lwwmanning
• chore: add vortex-ffi example to coverage (#4210) @lwwmanning
• chore: improve test coverage in vortex-scan (#4206) @lwwmanning
• chore: Fix random-access series colours and delete dead code from benchmarking website (#4213) @robert3005
• chore: improve vortex-dtype test coverage (#4204) @lwwmanning
• chore(deps): update all patch updates (patch) (#4205) @renovate[bot]
• chore(deps): update rust crate clap to v4.5.44 (#4202) @renovate[bot]
• Improve BoolArray::from_indices (#4200) @viirya
• chore[bench]: enable tpcds on label and merge (#4196) @joseph-isaacs
• chore(deps): update actions/checkout action to v5 (#4195) @renovate[bot]
• chore[bench]: enable tpcds on label and merge (#4187) @joseph-isaacs
• Remove for whom argument from SegmentSource (#4190) @gatesn
• chore(deps): update rust crate uuid to v1.18.0 (#4192) @renovate[bot]
• chore(deps): update rust crate glob to v0.3.3 (#4189) @renovate[bot]
• chore(deps): lock file maintenance (#4186) @renovate[bot]
• chore(deps): update rust crate sysinfo to 0.37.0 (#4185) @renovate[bot]
• fix(deps): update all patch updates to v1.0.168 (patch) (#4184) @renovate[bot]
• fix(deps): update all patch updates to v1.0.166 (patch) (#4183) @renovate[bot]
• chore(deps): update plugin com.gradleup.shadow to v9.0.1 (#4181) @renovate[bot]
• chore: improve vortex-mask testing (#4178) @lwwmanning
• chore(deps): update rust crate rustversion to v1.0.22 (#4179) @renovate[bot]
• build: Use Create cc to link to libc++ (#4173) @ssmccoy
• chore[bench-website]: add back tpc-ds to query_bench (#4155) @joseph-isaacs
• chore: clippy allow unreachable function (#4167) @0ax1
• chore(deps): update rust crate cc to v1.2.32 (#4166) @renovate[bot]
• fix(deps): update rust crate cxx to v1.0.165 (#4164) @renovate[bot]
• chore(deps): update all patch updates (patch) (#4163) @renovate[bot]
• chore: Bump msrv to 1.89 (#4159) @AdamGS
• chore: add CastKernel implementations for remaining array encodings (#4131) @lwwmanning
• chore: improve vortex-scalar tests, reorganize module structure (#4145) @lwwmanning
• chore: check out ddb version in ext build based on env var (#4153) @0ax1
• chore(deps): update rust crate taffy to 0.9.0 (#4154) @renovate[bot]
• chore(deps): update plugin com.gradleup.shadow to v9 (#4150) @renovate[bot]
• fix(deps): update all patch updates to v1.0.164 (patch) (#4151) @renovate[bot]

🌪 0.44.1

Changes

🐛 Bug Fixes

• Revert "fix: pr benchmark results (#4141)" (#4142) @0ax1
• fix: pr benchmark results (#4141) @0ax1

🧰 Maintenance

• tests: test writing empty file in PyVortex (#4147) @a10y
• chore(deps): update rust crate clap to v4.5.43 (#4143) @renovate[bot]

🌪 0.44.0

Changes

✨ Features

• feat: Require expressions to be Eq (#4139) @AdamGS

🐛 Bug Fixes

• single threaded duckdb copy (#4140) @onursatici
• wake wakers on all branches (#4136) @onursatici
• fix: error-prone f16 Scalar serde (#4113) @lwwmanning
• fix: Correctly handle sum of chunked float array with all null chunks (#4125) @robert3005

🧰 Maintenance

9 changes

• chore: Improve perf and make the sidebar not force full re-render of page (#4128) @AdamGS
• chore(deps): update actions/download-artifact action to v5 (#4134) @renovate[bot]
• fix(deps): update all patch updates to v1.0.163 (patch) (#4133) @renovate[bot]
• chore: Reapply "feat: implement Cast Kernel everywhere" (#4110) @lwwmanning
• chore: improve consistency tests (#4114) @lwwmanning
• chore: fuzz only uploads new corpus if it hasn't been updated in the meantime (#4124) @robert3005
• chore: playing around with the benchmark website own perf (#4126) @AdamGS
• chore[bench-website]: search hide empty sections (#4122) @joseph-isaacs
• chore: move clippy cpp.rs allow list to build.rs (#4123) @0ax1

🌪 0.43.0

Changes

⚠️ Breaks

• Remove scan async API (#4005) @gatesn

✨ Features

• feat: duckdb:vortex s3 support (#4100) @0ax1
• feat: implement Cast Kernel everywhere (#4086) @lwwmanning
• feat: Make all built-in expressions Eq + replace dyn-eq with our trait (#4091) @AdamGS
• feat: Add serialization support for Select expression (#4077) @AdamGS
• zip compute function (#4031) @onursatici
• feat: teach SparseArray to canonicalize lists (#3992) @danking
• feature: Add From implementation to the vtable in addition to dedicated trait (#4037) @AdamGS
• Remove scan async API (#4005) @gatesn

🚀 Performance

• perf[vortex-array]: use all_valid instead of invalid_count() == 0 (#4108) @joseph-isaacs
• perf[duckdb]: add file footer caching (#4104) @joseph-isaacs
• varbinview zip kernel (#4054) @onursatici
• varbinview builder buffer deduplication (#4036) @onursatici
• perf[bench]: dont delete duckdb.db between db runs (#4017) @joseph-isaacs

🐛 Bug Fixes

16 changes

• fix[duckdb]: glob expansion canonicalize input path (#4121) @joseph-isaacs
• fix[duckdb]: use executor in ddb writer (#4117) @joseph-isaacs
• TransposedStream in struct writer to wake other potentially waiting streams (#4107) @onursatici
• fix[duckdb]: make batch number unique over all threads (#4095) @joseph-isaacs
• fix: mobile benchmark rendering (#4096) @lwwmanning
• fix: Add select-expr deserialization (#4082) @AdamGS
• Fix prefetch accounting (#4072) @gatesn
• fix: compress benchmarks opts doesnt conflict with output (#4070) @robert3005
• fix: benchmark compress hang (#4051) @0ax1
• fix tui segment display for auxiliary children (#4044) @robert3005
• fix: Correctly calculate the size of FlatLayouts array flatbuffer size (#4049) @robert3005
• fix: Forbid SequenceScheme for String and Float dictionary codes as well as Integer (#4048) @robert3005
• fix: duckdb ext symbol visibility (#4046) @0ax1
• fix: Implement compact for ListArray (#4002) @robert3005
• fix: fix sql benchmarks option (#4023) @danking
• Empty chunks don't affect arrays validity, empty Mask is always both all true and all false (#4018) @robert3005

🧰 Maintenance

57 changes

• IO Fuzzer uses single threaded reader and writer (#4119) @robert3005
• chore: Add workflow to minimize fuzz corpuses (#4120) @robert3005
• chore(deps): update plugin com.gradleup.shadow to v8.3.9 (#4115) @renovate[bot]
• fix(deps): update dependency org.immutables:value to v2.11.2 (#4112) @renovate[bot]
• chore[bench]: nightly s3 vortex tpc-h(sf=100) (#4111) @joseph-isaacs
• Revert "feat: implement Cast Kernel everywhere" (#4109) @joseph-isaacs
• chore: ArbitraryArray::arbitrary_with (#4105) @blaginin
• chore(deps): lock file maintenance (#4103) @renovate[bot]
• chore[bench-site]: more mobile fixes (#4102) @lwwmanning
• chore[bench-site]: bench site CSS cleanup (#4099) @lwwmanning
• chore[bench-website]: adjust benchmark size and usability features (#4097) @joseph-isaacs
• chore[bench-site]: add aggregates of each group to bench site (#4098) @lwwmanning
• chore: fix some typos (#4088) @XinyuZeng
• chore[bench]: update vortex bench color (#4094) @joseph-isaacs
• chore(deps): update plugin com.palantir.consistent-versions to v2.37.0 (#4093) @renovate[bot]
• chore(deps): update all patch updates (patch) (#4092) @renovate[bot]
• chore: C++ API improvement (#4050) @XinyuZeng
• chore(deps): update rust crate serde_json to v1.0.142 (#4087) @renovate[bot]
• chore: make bench site both responsive and faster (#4084) @lwwmanning
• chore: stricter yaml validation (#4078) @robert3005
• chore: Add roundtrip serialization tests to vortex-expr (#4083) @AdamGS
• chore: rewrite the benchmark website (#4079) @lwwmanning
• chore: Enable polarsignals diffs on benchmarks (#4067) @AdamGS
• chore: Make vortex pretty (#4081) @AdamGS
• chore: No longer need to mount debugfs and tracefs (#4080) @robert3005
• chore: Manually mount tracefs and debugfs until we bump ami (#4076) @robert3005
• chore(deps): update rust crate divan to v3.0.5 (#4073) @renovate[bot]
• [chore] improve binary_numeric conformance (#4069) @lwwmanning
• Clean up decompress benchmarks (#4068) @gatesn
• [chore] cross-operation consistency tests (#4055) @lwwmanning
• chore: cleanup commented-out code in vortex-expr (#4066) @AdamGS
• chore: add into_cpu_stream (#4053) @blaginin
• test: block_in_place (#4059) @0ax1
• chore(deps): update rust crate clap to v4.5.42 (#4060) @renovate[bot]
• chore(deps): update rust crate crossterm to 0.29 (#2925) @renovate[bot]
• chore: reject warnings on clippy but not on check (#4052) @blaginin
• Clean up stats propagation for slicing (#3356) @gatesn
• [chore] conformance testing for TakeFn (#4043) @lwwmanning
• [chore] use rstest for filter & mask conformance test harnesses (#4045) @lwwmanning
• chore: add missing {doctest} (#4042) @blaginin
• [chore] add filter conformance test & fill existing conformance testing gaps (#4041) @lwwmanning
• chore: cleanup COMPUTE_FN definitions (#4040) @a10y
• docs: Document all canonical array types (#4039) @a10y
• chore: Timeout data downloads in benchmarks (#4038) @AdamGS
• use arc slice for buffers in varbinview (#4035) @onursatici
• chore: bump datafusion to 49 (#4006) @AdamGS
• chore(deps): lock file maintenance (#4030) @renovate[bot]
• chore(deps): update rust crate rstest to v0.26.1 (#4029) @renovate[bot]
• chore(deps): update rust crate rstest to 0.26 (#4026) @renovate[bot]
• chore(deps): update rust crate tokio to v1.47.0 (#4025) @renovate[bot]
• chore(deps): update rust crate roaring to v0.11.2 (#4024) @renovate[bot]
• chore: benchmark individual encoding throughputs (#4014) @lwwmanning
• chore: optionally delete the duckdb database on engine creation. (#4022) @danking
• chore: Install llvm in fuzzer for slightly better logging and remove submodules from checkout (#4015) @robert3005
• Remove segment source factory (#4016) @gatesn
• Add Claude Code GitHub Workflow (#4009) @robert3005
• chore: unit tests for Arrow conversion (#4007) @a10y

🌪 0.42.1

Changes

🐛 Bug Fixes

• fix[ci]: use cargo +nightly in publish (#4011) @joseph-isaacs

🌪 0.42.0

Changes

⚠️ Breaks

• chore: Add new_expr to all built-in expressions in the name of consistency (#3847) @AdamGS

✨ Features

• feat[duckdb]: impl get_partition_data (#4008) @joseph-isaacs
• feat: teach SparseArray to canonicalize Binary arrays (#3993) @danking
• Add rayon parallel iterators for scanning (#3983) @gatesn
• feat[duckdb]: add file pruning and fix scanner (#3986) @joseph-isaacs
• Add a work-stealing ArrayIterator to drive scans (#3982) @gatesn
• feature: Add IsConstant for DecimalBytePartsArray (#3972) @robert3005
• feat: Add traversal logic for more containers (#3970) @AdamGS
• feat: Refactor traversal logic (#3926) @AdamGS
• DuckDB Table Filters (#3951) @gatesn
• feat: duckdb workstealing (#3927) @0ax1
• feat: use VarBinViewBuilder internally (#3925) @a10y
• Vortex - C++ API (#3792) @XinyuZeng
• feat: display as table (#3906) @blaginin
• propagate spans in dispatcher (#3916) @onursatici
• feat: duckdb global conversion cache (#3901) @0ax1
• feat: impl optimize for more arrays (#3909) @a10y
• feat: call optimize in compressor (#3852) @a10y
• feat: build with stable rust (#3881) @a10y
• feature: multi-file-scan thread-safe iterator (#3863) @0ax1
• Compact Compression (#3765) @mwlon
• Arrow iterator conversions (#3875) @gatesn
• feat: display (#3866) @danking
• feat[bench]: inter-query memory tracking (#3861) @joseph-isaacs
• feat: Minimal support for extension array casting (#3851) @AdamGS
• feat[compressor]: wire up sequence array into the compressor (#3844) @joseph-isaacs
• feat: teach utf8-type SparseArray to canonicalize (#3848) @danking
• feat: teach SparseArray to canonicalize Null & Decimal (#3662) @danking
• feat: Add optimize ArrayOp with VBView implementation (#3825) @a10y
• Row idx layout reader (#3819) @gatesn
• feature: Support overriding layout verification settings via environment variables (#3794) @robert3005
• Add expression transformation to replace all occurrences of a node (#3795) @gatesn
• VortexExpr VTables (#3713) @gatesn

🚀 Performance

• DuckDB Dynamic Expressions (#3966) @gatesn
• Add cardinality callback to DuckDB TableFunction (#3941) @gatesn
• perf: fine tune workstealing (#3938) @0ax1
• perf[vortex-duckdb]: set dictionary id to allow hash value once opt (#3621) @joseph-isaacs

🐛 Bug Fixes

35 changes

• fix: unify duckdb timestamps on i64 (#4004) @0ax1
• fix: Decimal256 from arrow casts the array to Decimal256Type (#4003) @robert3005
• fix: increment num_factories_constructed on error (#4001) @0ax1
• fix: Pruning expressions check NanCount where appropriate (#3973) @a10y
• fix: Make NotExpr display more explicit (#3998) @AdamGS
• fix[duckdb]: handle empty file globs (#3994) @joseph-isaacs
• fix: list array builder respects sliced list arrays (#3991) @danking
• feat[duckdb]: add file pruning and fix scanner (#3986) @joseph-isaacs
• fix: correctly expose gen_test_data cxx ffi (#3969) @XinyuZeng
• prevent double stealing (#3984) @onursatici
• fix: Prevent compressor from choosing SequenceArray for dictionary codes (#3979) @robert3005
• Fix DuckDB timestamp values (#3965) @gatesn
• Fix data_wrapper pointer (#3955) @gatesn
• fix: remove optimize Op, replace with compact_buffers function (#3931) @a10y
• fix: nbytes returns a u64 (#3924) @robert3005
• fix: duckdb multithreaded scan (#3920) @0ax1
• fix: duckdb scan cleanup (#3912) @0ax1
• fix: Fix NNF nested negation rewriting (#3905) @AdamGS
• fix: DictMaskEvaluation to respect validity (#3894) @blaginin
• fix: StructArray with empty fields is considered constant (#3895) @robert3005
• fix[layout]: row id layout reader cannot stop if inner layout registering its splits (#3867) @joseph-isaacs
• fix: Drain prefetch buffer (#3856) @a10y
• fix: teach SparseArray to account for null values when the fill is null (#3846) @danking
• fix[bench-website]: allow sf1000 and missing results (#3849) @joseph-isaacs
• fix[bench]: website render data with scale factor as string (#3838) @joseph-isaacs
• fix[bench]: correct s3 path to run benchmarks (#3837) @joseph-isaacs
• fix[bench]: nightly config that doesn't fail (#3830) @joseph-isaacs
• Fix empty take for ChunkedArray (#3823) @blaginin
• fix: Propagate executor to scan tasks (#3815) @AdamGS
• fix: Add test for using correct self._dataset variable for scanner schema (#3812) @NeejWeej
• fix: Remove redundant copy from delta compression (#3797) @robert3005
• fix: make Java test gradle self-contained (#3791) @a10y
• fix: DecimalByteParts compare with overflow and nullable elements (#3789) @a10y
• fix: STRIDE for u8/i32 AVX2 take kernel (#3771) @a10y
• fix: Correct Iterator::size_hint and ExactSizeIterator implementation for FieldNames (#3768) @AdamGS

🧰 Maintenance

110 changes

• docs: StructFields behavior (#4000) @a10y
• chore: Add some tests and docs to layouts and duckdb (#3999) @AdamGS
• chore[duckdb]: scan log info -> trace (#3989) @joseph-isaacs
• chore: RunEndArray ends must be unsigned so only enumerate unsigned ptypes for decompression (#3985) @robert3005
• chore: duckdb decimal to arrow conversion (#3980) @0ax1
• Extract work queue logic (#3978) @gatesn
• chore: check Struct Scalar dtype on creation (#3974) @blaginin
• chore: Convert cases of Buffer::extend to using extend_trusted (#3971) @robert3005
• chore(deps): update plugin com.diffplug.spotless to v7.2.1 (#3961) @renovate[bot]
• chore[bench]: assert partial taxi take result correctness (#3948) @joseph-isaacs
• chore: Implement FileSource::fmt_extra for VortexSource to display predicates in query plans (#3959) @robert3005
• Setup JDK in CI (#3967) @gatesn
• Use c-unwrap ABI for duckdb extension (#3956) @gatesn
• chore: All runs-on workflows have unique tags (#3957) @robert3005
• Improve work stealing loop (#3946) @gatesn
• chore(deps): update rust crate divan to v3.0.4 (#3950) @renovate[bot]
• chore: Propagate traces to task executor and a bunch of other places (#3947) @AdamGS
• chore(deps): update junit-framework monorepo to v5.13.4 (patch) (#3945) @renovate[bot]
• chore(deps): lock file maintenance (#3944) @renovate[bot]
• chore(deps): update rust crate rand to v0.9.2 (#3942) @renovate[bot]
• chore(deps): update plugin com.diffplug.spotless to v7.2.0 (#3943) @renovate[bot]
• chore(deps): update rust crate strum to v0.27.2 (#3939) @renovate[bot]
• fix(deps): update all patch updates to v1.0.161 (patch) (#3933) @renovate[bot]
• chore(deps): update rust crate serde_json to v1.0.141 (#3932) @renovate[bot]
• chore: fix type bound on Scalar::binary (#3930) @a10y
• chore: Fix c++ ci after it's a required check (#3928) @robert3005
• chore(deps): update all patch updates (patch) (#3910) @renovate[bot]
• chore: Enable workspace lints on vortex-scan (#3923) @robert3005
• Add BtrBlocksCompressor decision tree (#3921) @robert3005
• chore: Disable yamlint warnings (#3915) @AdamGS
• chore: Disable code coverage for arbitrary-related code (#3913) @AdamGS
• chore: Migrate NNF doctests to actual tests (#3911) @AdamGS
• chore: Fix fmt-failing duckdb code (#3914) @AdamGS
• chore: exclude arbitrary from coverage (#3908) @lwwmanning
• chore[docs]: deny missing_docs on vortex-scalar, vortex-utils, & vortex-flatbuffers (#3907) @lwwmanning
• feat[bench-vortex]: benchmark vortex compact format (#3886) @joseph-isaacs
• Use ptr::default in Rust 1.88 (#3896) @gatesn
• [chore] Update README.md (#3893) @lwwmanning
• chore[vortex-duckdb]: allow C++ 20 ext syntax (#3884) @joseph-isaacs
• duckdb build script http timeout (#3888) @onursatici
• chore[vortex-scan]: clippy default MultiScan (#3889) @joseph-isaacs
• chore(deps): update all patch updates (patch) (#3887) @renovate[bot]
• chore(config): migrate renovate config (#3883) @renovate[bot]
• chore: Don't generate compare expressions for lists when fuzzing (#3882) @robert3005
• fix(deps): update dependency org.immutables:value to v2.11.1 (#3880) @renovate[bot]
• chore: Consitent naming for display functions (#3871) @robert3005
• chore(deps): update rust crate fastlanes to 0.2.0 (#3878) @renovate[bot]
• chore[bench]: move tpcds into new benchmark format (#3870) @joseph-isaacs
• fix: Fuzzer does not generate filter on struct (#3873) @a10y
• chore(deps): update plugin com.palantir.consistent-versions to v2.36.0 (#3872) @renovate[bot]
• Fix intra-doc links (#3869) @gatesn
• chore[layout]: empty pack round trip scan (#3868) @joseph-isaacs
• chore: Replace dependency on top level arrow create with individual modules now that pyarrow is a standalone crate (#3864) @robert3005
• chore: Bump prost dependency (#3862) @AdamGS
• chore(deps): update plugin com.vanniktech.maven.publish to v0.34.0 (#3860) @renovate[bot]
• chore(deps): lock file maintenance (#3857) @renovate[bot]
• chore(deps): update rust crate memmap2 to v0.9.7 (#3855) @renovate[bot]
• Move array context inside FlatLayout (#3854) @gatesn
• chore: better naming for SendableLayoutFuture (#3843) @a10y
• chore: pull struct case of sparse to_canonical into function (#3850) @danking
• chore(deps): update rust crate divan to v3.0.3 (#3845) @renovate[bot]
• chore[fuzz]: smaller machine to save run cost m8g.2xlarge (#3842) @joseph-...