Skip to content
Merged
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
34 changes: 32 additions & 2 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,16 @@ request adding CHANGELOG notes for breaking (!) changes and possibly other secti

### Highlights

- **HMS Federation Support**: Added support for Hive Metastore (HMS) federation, enabling integration with existing Hive metastores.

- **Generic Table Federation**: Introduced modularized federation architecture to support multiple catalog types and improve extensibility.

- **External Authentication**: Added comprehensive support for external identity providers including Keycloak integration and Helm chart configuration options.

- **Python Client Distribution**: The Python client is now packaged and distributed as a proper Python package for easier installation and usage.

- **Catalog Federation CLI**: Extended the CLI with support for managing federated catalogs, making it easier to configure and operate catalog federation.

### Upgrade notes

### Breaking changes
Expand All @@ -41,12 +51,32 @@ request adding CHANGELOG notes for breaking (!) changes and possibly other secti
- Added Catalog configuration for S3 and STS endpoints. This also allows using non-AWS S3 implementations.

- The `IMPLICIT` authentication type enables users to create federated catalogs without explicitly
providing authentication parameters to Polaris. When the authentication type is set to `IMPLICIT`,
the authentication parameters are picked from the environment or configuration files.
providing authentication parameters to Polaris. When the authentication type is set to `IMPLICIT`,
the authentication parameters are picked from the environment or configuration files.

- The `DEFAULT_LOCATION_OBJECT_STORAGE_PREFIX_ENABLED` feature was added to support placing tables
at locations that better optimize for object storage.

- Added support for generic table `baseLocation` field in both server and client implementations.

- Introduced S3 path-style access support for improved compatibility with S3-compatible storage systems.

- Added MinIO integration support with comprehensive getting started documentation.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we put this in the highlight section? I think this is a big thing for people using s3-compatible storage.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm ok to move this to highlights, but s3-compatible support is not yet complete because of #2207... ATM, MinIO works, but systems without STS are not easy to use 🤷


- Enhanced Python client with integration tests and improved error handling.

- Added ability to override active roles provider configuration per realm for more flexible authentication setups.

- Introduced extensible pagination token implementation for better API performance.

- Added support for `s3a` scheme in addition to existing S3 schemes.

- Enhanced Helm chart with support for external authentication configuration and relational JDBC backend options.

- Added comprehensive diagnostics and monitoring capabilities throughout the system.

- Introduced bootstrap command options to specify custom schema files for database initialization.

### Changes

- Polaris Management API clients must be prepared to deal with new attributes in `AwsStorageConfigInfo` objects.
Expand Down