Skip to content

Commit a7afe49

Browse files
zxqfd555Manul from Pathway
authored andcommitted
iceberg catalogs refactoring (#9470)
GitOrigin-RevId: 3c1dac6e1eb4a17aaa433e462f711b3005abc57f
1 parent 89cc3ce commit a7afe49

File tree

14 files changed

+916
-535
lines changed

14 files changed

+916
-535
lines changed

CHANGELOG.md

Lines changed: 5 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -5,11 +5,13 @@ All notable changes to this project will be documented in this file.
55
This project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
66
## [Unreleased]
77

8-
### Changed
9-
- `pw.xpacks.llm.question_answering.BaseRAGQuestionAnswerer` now supports document reranking. This enables two-stage retrieval where initial vector similarity search is followed by reranking to improve document relevance ordering.
10-
118
### Added
129
- JetStream extension is now supported in both NATS read and write connectors.
10+
- The Iceberg connectors now support Glue as a catalog backend.
11+
12+
### Changed
13+
- **BREAKING** The API for the Iceberg connectors has changed. The `catalog` parameter is now required in both `pw.io.iceberg.read` and `pw.io.iceberg.write`. This parameter can be either of type `pw.io.iceberg.RestCatalog` or `pw.io.iceberg.GlueCatalog`, and it must contain the connection parameters.
14+
- `pw.xpacks.llm.question_answering.BaseRAGQuestionAnswerer` now supports document reranking. This enables two-stage retrieval where initial vector similarity search is followed by reranking to improve document relevance ordering.
1315

1416
### Fixed
1517
- Endpoints created by `pw.io.http.rest_connector` now accept requests both with and without a trailing slash. For example, `/endpoint/` and `/endpoint` are now treated equivalently.

0 commit comments

Comments
 (0)