-
Notifications
You must be signed in to change notification settings - Fork 1.6k
Open
Description
Follow up task to #16649
Working with encrypted Parquet files is a fairly niche feature in my opinion, so it seems like this feature should not be enabled by default.
That said, it looks like DataFusion already depends on the ring
crate, which is the main extra dependency required for this feature, via object_store
and aws-config
. So disabling this by default might not make a huge difference to compile times and binary sizes.
Notes from @alamb on what would be required to make this non-default:
- Don't add it to the default features
- Update the docs to mention the config setting requires the
parquet_encryption
feature --datafusion/datafusion/common/src/config.rs
Line 1839 in d66d6b9
/// Options for configuring Parquet modular encryption - Enable it in datafusion-cli (add
parquet_encryption
in https://github.com/apache/datafusion/blob/ca16255e725bf6676a8ddd4b9948496d99b5bd88/datafusion-cli/Cargo.toml#L45-L44)
alamb
Metadata
Metadata
Assignees
Labels
No labels