Skip to content

Commit 8ecebec

Browse files
[skip ci] pip(deps): Bump pyarrow from 8.0.0 to 10.0.0 (#1731)
* [skip ci] pip(deps): Bump pyarrow from 8.0.0 to 10.0.0 Bumps [pyarrow](https://github.com/apache/arrow) from 8.0.0 to 10.0.0. - [Release notes](https://github.com/apache/arrow/releases) - [Commits](apache/arrow@go/v8.0.0...go/v10.0.0) --- updated-dependencies: - dependency-name: pyarrow dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <[email protected]> * Use 1.0 parquet logical type set to maximize compatibility * Update lock file Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Anton Kukushkin <[email protected]>
1 parent 691a050 commit 8ecebec

File tree

3 files changed

+264
-274
lines changed

3 files changed

+264
-274
lines changed

awswrangler/s3/_write_parquet.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -52,6 +52,9 @@ def _new_writer(
5252
pyarrow_additional_kwargs["coerce_timestamps"] = "ms"
5353
if "flavor" not in pyarrow_additional_kwargs:
5454
pyarrow_additional_kwargs["flavor"] = "spark"
55+
if "version" not in pyarrow_additional_kwargs:
56+
# By default, use version 1.0 logical type set to maximize compatibility
57+
pyarrow_additional_kwargs["version"] = "1.0"
5558

5659
with open_s3_object(
5760
path=file_path,

0 commit comments

Comments
 (0)