Skip to content

Make parquet_encryption a non-default feature #16777

@adamreeve

Description

@adamreeve

Follow up task to #16649

Working with encrypted Parquet files is a fairly niche feature in my opinion, so it seems like this feature should not be enabled by default.

That said, it looks like DataFusion already depends on the ring crate, which is the main extra dependency required for this feature, via object_store and aws-config. So disabling this by default might not make a huge difference to compile times and binary sizes.

Notes from @alamb on what would be required to make this non-default:

  1. Don't add it to the default features
  2. Update the docs to mention the config setting requires the parquet_encryption feature --
    /// Options for configuring Parquet modular encryption
  3. Enable it in datafusion-cli (add parquet_encryption in https://github.com/apache/datafusion/blob/ca16255e725bf6676a8ddd4b9948496d99b5bd88/datafusion-cli/Cargo.toml#L45-L44)

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions