Incremental with multiple cursors: SQL server -> Postgres #35345
Unanswered
fboCadran
asked this question in
Connector Questions
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Hi guys! My team and I are working with Airbyte in order to extract some tables from Microsoft SQL server to Postgres. Since we have quite some large tables, we would like to load data incrementally. However, our tables have multiple (composite) primary keys and a updated_at split over a day and time column. As we understand from other discussions, multiple cursors seems currently not possible out of the box for this source/destination combination. Before we modify any connections ourselves, as we do not have a way to alter the source tables, and CDC seems also not possible, we were wondering if any of you ever found a way around this composite keys for incremental loads issue? Thanks!
Beta Was this translation helpful? Give feedback.
All reactions