Commit df1bfd5
authored
chore(deps): update arrow to v53.3.0 (minor) (#1415)
This PR contains the following updates:
| Package | Type | Update | Change |
|---|---|---|---|
| [arrow](https://redirect.github.com/apache/arrow-rs) |
workspace.dependencies | minor | `53.2.0` -> `53.3.0` |
| [arrow-arith](https://redirect.github.com/apache/arrow-rs) |
workspace.dependencies | minor | `53.2.0` -> `53.3.0` |
| [arrow-array](https://redirect.github.com/apache/arrow-rs) |
workspace.dependencies | minor | `53.2.0` -> `53.3.0` |
| [arrow-buffer](https://redirect.github.com/apache/arrow-rs) |
workspace.dependencies | minor | `53.2.0` -> `53.3.0` |
| [arrow-cast](https://redirect.github.com/apache/arrow-rs) |
workspace.dependencies | minor | `53.2.0` -> `53.3.0` |
| [arrow-csv](https://redirect.github.com/apache/arrow-rs) |
workspace.dependencies | minor | `53.2.0` -> `53.3.0` |
| [arrow-data](https://redirect.github.com/apache/arrow-rs) |
workspace.dependencies | minor | `53.2.0` -> `53.3.0` |
| [arrow-ipc](https://redirect.github.com/apache/arrow-rs) |
workspace.dependencies | minor | `53.2.0` -> `53.3.0` |
| [arrow-schema](https://redirect.github.com/apache/arrow-rs) |
workspace.dependencies | minor | `53.2.0` -> `53.3.0` |
| [arrow-select](https://redirect.github.com/apache/arrow-rs) |
workspace.dependencies | minor | `53.2.0` -> `53.3.0` |
| [parquet](https://redirect.github.com/apache/arrow-rs) |
workspace.dependencies | minor | `53.2.0` -> `53.3.0` |
---
### Release Notes
<details>
<summary>apache/arrow-rs (arrow)</summary>
###
[`v53.3.0`](https://redirect.github.com/apache/arrow-rs/blob/HEAD/CHANGELOG.md#5330-2024-11-17)
[Compare
Source](https://redirect.github.com/apache/arrow-rs/compare/53.2.0...53.3.0)
[Full
Changelog](https://redirect.github.com/apache/arrow-rs/compare/53.2.0...53.3.0)
**Implemented enhancements:**
- `PartialEq` of GenericByteViewArray (StringViewArray / ByteViewArray)
that compares on equality rather than logical value
[#​6679](https://redirect.github.com/apache/arrow-rs/issues/6679)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
- Need a mechanism to handle schema changes due to dictionary hydration
in FlightSQL server implementations
[#​6672](https://redirect.github.com/apache/arrow-rs/issues/6672)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight)]
- Support encoding Utf8View columns to JSON
[#​6642](https://redirect.github.com/apache/arrow-rs/issues/6642)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
- Implement `append_n` for `BooleanBuilder`
[#​6634](https://redirect.github.com/apache/arrow-rs/issues/6634)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
- Some take optimizations
[#​6621](https://redirect.github.com/apache/arrow-rs/issues/6621)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
- Error Instead of Panic On Attempting to Write More Than 32769 Row
Groups
[#​6591](https://redirect.github.com/apache/arrow-rs/issues/6591)
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet)]
- Make casting from a timestamp without timezone to a timestamp with
timezone configurable
[#​6555](https://redirect.github.com/apache/arrow-rs/issues/6555)
- Add `record_batch!` macro for easy record batch creation
[#​6553](https://redirect.github.com/apache/arrow-rs/issues/6553)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
- Support `Binary` --> `Utf8View` casting
[#​6531](https://redirect.github.com/apache/arrow-rs/issues/6531)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
- `downcast_primitive_array` and `downcast_dictionary_array` are not
hygienic wrt imports
[#​6400](https://redirect.github.com/apache/arrow-rs/issues/6400)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
- Implement interleave_record_batch
[#​6731](https://redirect.github.com/apache/arrow-rs/pull/6731)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([waynexia](https://redirect.github.com/waynexia))
- feat: `record_batch!` macro
[#​6588](https://redirect.github.com/apache/arrow-rs/pull/6588)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([ByteBaker](https://redirect.github.com/ByteBaker))
**Fixed bugs:**
- Signed decimal e-notation parsing bug
[#​6728](https://redirect.github.com/apache/arrow-rs/issues/6728)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
- Add support for Utf8View -> numeric in can_cast_types
[#​6715](https://redirect.github.com/apache/arrow-rs/issues/6715)
- IPC file writer produces incorrect footer when not preserving dict ID
[#​6710](https://redirect.github.com/apache/arrow-rs/issues/6710)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
- parquet from_thrift_helper incorrectly checks index
[#​6693](https://redirect.github.com/apache/arrow-rs/issues/6693)
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet)]
- Primitive REPEATED fields not contained in LIST annotated groups
aren't read as lists by record reader
[#​6648](https://redirect.github.com/apache/arrow-rs/issues/6648)
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet)]
- DictionaryHandling does not recurse into Map fields
[#​6644](https://redirect.github.com/apache/arrow-rs/issues/6644)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight)]
- Array writer output empty when no record is written
[#​6613](https://redirect.github.com/apache/arrow-rs/issues/6613)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
- Archery Integration Test with c# failing on main
[#​6577](https://redirect.github.com/apache/arrow-rs/issues/6577)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
- Potential unsoundness in `filter_run_end_array`
[#​6569](https://redirect.github.com/apache/arrow-rs/issues/6569)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
- Parquet reader can generate incorrect validity buffer information for
nested structures
[#​6510](https://redirect.github.com/apache/arrow-rs/issues/6510)
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet)]
- arrow-array ffi: FFI_ArrowArray.null_count is always interpreted as
unsigned and initialized during conversion from C to Rust.
[#​6497](https://redirect.github.com/apache/arrow-rs/issues/6497)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
**Documentation updates:**
- Minor: Document pattern for accessing views in StringView
[#​6673](https://redirect.github.com/apache/arrow-rs/pull/6673)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://redirect.github.com/alamb))
- Improve Array::is_nullable documentation
[#​6615](https://redirect.github.com/apache/arrow-rs/pull/6615)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([findepi](https://redirect.github.com/findepi))
- Minor: improve docs for ByteViewArray->ByteArray From impl
[#​6610](https://redirect.github.com/apache/arrow-rs/pull/6610)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://redirect.github.com/alamb))
**Performance improvements:**
- Speed up `filter_run_end_array`
[#​6712](https://redirect.github.com/apache/arrow-rs/pull/6712)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([Dandandan](https://redirect.github.com/Dandandan))
**Closed issues:**
- Incorrect like results for pattern starting/ending with `%` percent
and containing escape characters
[#​6702](https://redirect.github.com/apache/arrow-rs/issues/6702)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
**Merged pull requests:**
- Fix signed decimal e-notation parsing
[#​6729](https://redirect.github.com/apache/arrow-rs/pull/6729)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([gruuya](https://redirect.github.com/gruuya))
- Clean up some arrow-flight tests and duplicated code
[#​6725](https://redirect.github.com/apache/arrow-rs/pull/6725)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight)]
([itsjunetime](https://redirect.github.com/itsjunetime))
- Update PR template section about API breaking changes
[#​6723](https://redirect.github.com/apache/arrow-rs/pull/6723)
([findepi](https://redirect.github.com/findepi))
- Support for casting `StringViewArray` to `DecimalArray`
[#​6720](https://redirect.github.com/apache/arrow-rs/pull/6720)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([tlm365](https://redirect.github.com/tlm365))
- File writer preserve dict bug
[#​6711](https://redirect.github.com/apache/arrow-rs/pull/6711)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([brancz](https://redirect.github.com/brancz))
- Add filter_kernel benchmark for run array
[#​6706](https://redirect.github.com/apache/arrow-rs/pull/6706)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([delamarch3](https://redirect.github.com/delamarch3))
- Fix string view ILIKE checks with NULL values
[#​6705](https://redirect.github.com/apache/arrow-rs/pull/6705)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([findepi](https://redirect.github.com/findepi))
- Implement logical_null_count for more array types
[#​6704](https://redirect.github.com/apache/arrow-rs/pull/6704)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([findepi](https://redirect.github.com/findepi))
- Fix LIKE with escapes
[#​6703](https://redirect.github.com/apache/arrow-rs/pull/6703)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([findepi](https://redirect.github.com/findepi))
- Speed up `filter_bytes`
[#​6699](https://redirect.github.com/apache/arrow-rs/pull/6699)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([Dandandan](https://redirect.github.com/Dandandan))
- Minor: fix misleading comment in byte view
[#​6695](https://redirect.github.com/apache/arrow-rs/pull/6695)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([jayzhan211](https://redirect.github.com/jayzhan211))
- minor fix on checking index
[#​6694](https://redirect.github.com/apache/arrow-rs/pull/6694)
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet)]
([jp0317](https://redirect.github.com/jp0317))
- Undo run end filter performance regression
[#​6691](https://redirect.github.com/apache/arrow-rs/pull/6691)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([delamarch3](https://redirect.github.com/delamarch3))
- Reimplement `PartialEq` of `GenericByteViewArray` compares by logical
value
[#​6689](https://redirect.github.com/apache/arrow-rs/pull/6689)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([tlm365](https://redirect.github.com/tlm365))
- feat: expose known_schema from FlightDataEncoder
[#​6688](https://redirect.github.com/apache/arrow-rs/pull/6688)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight)]
([nathanielc](https://redirect.github.com/nathanielc))
- Update hashbrown requirement from 0.14.2 to 0.15.1
[#​6684](https://redirect.github.com/apache/arrow-rs/pull/6684)
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet)]
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([dependabot\[bot\]](https://redirect.github.com/apps/dependabot))
- Support Duration in JSON Reader
[#​6683](https://redirect.github.com/apache/arrow-rs/pull/6683)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([simonvandel](https://redirect.github.com/simonvandel))
- Check predicate and values are the same length for run end array
filter safety
[#​6675](https://redirect.github.com/apache/arrow-rs/pull/6675)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([delamarch3](https://redirect.github.com/delamarch3))
- \[ffi] Fix arrow-array null_count error during conversion from C to
Rust
[#​6674](https://redirect.github.com/apache/arrow-rs/pull/6674)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([adbmal](https://redirect.github.com/adbmal))
- Support `Utf8View` for `bit_length` kernel
[#​6671](https://redirect.github.com/apache/arrow-rs/pull/6671)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([austin362667](https://redirect.github.com/austin362667))
- Fix string view LIKE checks with NULL values
[#​6662](https://redirect.github.com/apache/arrow-rs/pull/6662)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([findepi](https://redirect.github.com/findepi))
- Improve documentation for `nullif` kernel
[#​6658](https://redirect.github.com/apache/arrow-rs/pull/6658)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://redirect.github.com/alamb))
- Improve test_auth error message when contains() fails
[#​6657](https://redirect.github.com/apache/arrow-rs/pull/6657)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight)]
([findepi](https://redirect.github.com/findepi))
- Let std::fmt::Debug for StructArray output Null/Validity info
[#​6655](https://redirect.github.com/apache/arrow-rs/pull/6655)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([XinyuZeng](https://redirect.github.com/XinyuZeng))
- Include offending line number when processing CSV file fails
[#​6653](https://redirect.github.com/apache/arrow-rs/pull/6653)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([findepi](https://redirect.github.com/findepi))
- feat: add write_bytes for GenericBinaryBuilder
[#​6652](https://redirect.github.com/apache/arrow-rs/pull/6652)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([tisonkun](https://redirect.github.com/tisonkun))
- feat: Support Utf8View in JSON serialization
[#​6651](https://redirect.github.com/apache/arrow-rs/pull/6651)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([jonmmease](https://redirect.github.com/jonmmease))
- fix: include chrono-tz in flight sql cli
[#​6650](https://redirect.github.com/apache/arrow-rs/pull/6650)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight)]
([crepererum](https://redirect.github.com/crepererum))
- Handle primitive REPEATED field not contained in LIST annotated group
[#​6649](https://redirect.github.com/apache/arrow-rs/pull/6649)
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet)]
([zeevm](https://redirect.github.com/zeevm))
- Implement `append_n` for `BooleanBuilder`
[#​6646](https://redirect.github.com/apache/arrow-rs/pull/6646)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([delamarch3](https://redirect.github.com/delamarch3))
- fix: recurse into Map datatype when hydrating dictionaries
[#​6645](https://redirect.github.com/apache/arrow-rs/pull/6645)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight)]
([nathanielc](https://redirect.github.com/nathanielc))
- fix: enable TLS roots for flight CLI client
[#​6640](https://redirect.github.com/apache/arrow-rs/pull/6640)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight)]
([crepererum](https://redirect.github.com/crepererum))
- doc: Clarify take kernel semantics
[#​6632](https://redirect.github.com/apache/arrow-rs/pull/6632)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([viirya](https://redirect.github.com/viirya))
- Return error rather than panic when too many row groups are written
[#​6629](https://redirect.github.com/apache/arrow-rs/pull/6629)
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet)]
([etseidl](https://redirect.github.com/etseidl))
- Fix test feature selection so all feature combinations work as
expected
[#​6626](https://redirect.github.com/apache/arrow-rs/pull/6626)
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet)]
([itsjunetime](https://redirect.github.com/itsjunetime))
- Add Parquet RowSelection benchmark
[#​6623](https://redirect.github.com/apache/arrow-rs/pull/6623)
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet)]
([XiangpengHao](https://redirect.github.com/XiangpengHao))
- Optimize `take_bits` to optimize `take_boolean` / `take_primitive` /
`take_byte_view`: up to -25%
[#​6622](https://redirect.github.com/apache/arrow-rs/pull/6622)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([Dandandan](https://redirect.github.com/Dandandan))
- Make downcast macros hygenic
([#​6400](https://redirect.github.com/apache/arrow-rs/issues/6400))
[#​6620](https://redirect.github.com/apache/arrow-rs/pull/6620)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([tustvold](https://redirect.github.com/tustvold))
- Update proc-macro2 requirement from =1.0.88 to =1.0.89
[#​6618](https://redirect.github.com/apache/arrow-rs/pull/6618)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
\[[arrow-flight](https://redirect.github.com/apache/arrow-rs/labels/arrow-flight)]
([dependabot\[bot\]](https://redirect.github.com/apps/dependabot))
- Fix arrow-json writer empty
[#​6614](https://redirect.github.com/apache/arrow-rs/pull/6614)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([gwik](https://redirect.github.com/gwik))
- Add `ParquetObjectReader::with_runtime`
[#​6612](https://redirect.github.com/apache/arrow-rs/pull/6612)
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet)]
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([itsjunetime](https://redirect.github.com/itsjunetime))
- Re-enable `C#` arrow flight integration test
[#​6611](https://redirect.github.com/apache/arrow-rs/pull/6611)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([alamb](https://redirect.github.com/alamb))
- Add Array::logical_null_count for inspecting number of null values
[#​6608](https://redirect.github.com/apache/arrow-rs/pull/6608)
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet)]
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([findepi](https://redirect.github.com/findepi))
- Added casting from Binary/LargeBinary to Utf8View
[#​6592](https://redirect.github.com/apache/arrow-rs/pull/6592)
\[[arrow](https://redirect.github.com/apache/arrow-rs/labels/arrow)]
([ngli-me](https://redirect.github.com/ngli-me))
- Parquet AsyncReader: Don't panic when empty offset_index is Some(\[])
[#​6582](https://redirect.github.com/apache/arrow-rs/pull/6582)
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet)]
([jroddev](https://redirect.github.com/jroddev))
- Skip writing down null buffers for non-nullable primitive arrays
[#​6524](https://redirect.github.com/apache/arrow-rs/pull/6524)
\[[parquet](https://redirect.github.com/apache/arrow-rs/labels/parquet)]
([bkirwi](https://redirect.github.com/bkirwi))
\* *This Changelog was automatically generated by
[github_changelog_generator](https://redirect.github.com/github-changelog-generator/github-changelog-generator)*
</details>
---
### Configuration
📅 **Schedule**: Branch creation - At any time (no schedule defined),
Automerge - At any time (no schedule defined).
🚦 **Automerge**: Enabled.
♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.
🔕 **Ignore**: Close this PR and you won't be reminded about these
updates again.
---
- [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check
this box
---
This PR was generated by [Mend Renovate](https://mend.io/renovate/).
View the [repository job
log](https://developer.mend.io/github/spiraldb/vortex).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzOS4xOS4wIiwidXBkYXRlZEluVmVyIjoiMzkuMTkuMCIsInRhcmdldEJyYW5jaCI6ImRldmVsb3AiLCJsYWJlbHMiOltdfQ==-->
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>1 parent c09295c commit df1bfd5
1 file changed
+34
-34
lines changedSome generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
0 commit comments