Skip to content

Remove direct arrow2 exposure#698

Merged
mlafeldt merged 4 commits intomainfrom
remove-arrow2
Mar 19, 2026
Merged

Remove direct arrow2 exposure#698
mlafeldt merged 4 commits intomainfrom
remove-arrow2

Conversation

@mlafeldt
Copy link
Copy Markdown
Member

@mlafeldt mlafeldt commented Mar 6, 2026

arrow2 is deprecated: jorgecarleitao/arrow2#1429

Breaking change:

  • Still supported: batch-by-batch processing as DataFrames via query_polars(). That preserves the common Polars flow, including streaming over batches without collecting everything first.
  • Still supported: raw Arrow-rs access via step().
  • No longer supported: "give me the raw Polars-arrow/arrow2 batch and let me do my own low-level conversion or array operations on that type". That was the unique role of step2().

@mlafeldt mlafeldt self-assigned this Mar 6, 2026
@mlafeldt mlafeldt marked this pull request as ready for review March 18, 2026 12:04
@mlafeldt mlafeldt merged commit bcadfeb into main Mar 19, 2026
4 checks passed
@mlafeldt mlafeldt deleted the remove-arrow2 branch March 19, 2026 14:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant