Skip to content

Support Reading Parquet Modular Encryption (PME) Files #9

@shefeek-jinnah

Description

@shefeek-jinnah

Description
Add support for reading Parquet files encrypted using Parquet Modular Encryption (PME) in DataFusion–DuckLake. This change enables decryption of footer- and column-level encrypted Parquet files by configuring Parquet execution with appropriate decryption properties. Encryption keys can be sourced from catalog metadata or external key providers, enabling secure access to encrypted datasets while preserving existing query behavior.

Current behavior: encryption_key field exists but unused
Desired behavior: Decrypt files using keys from catalog metadata or external key store

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions