Support True Multicast: Single Source to Multiple Destinations in a Single Connection #34722
glevineLeap
started this conversation in
Connector Ideas and Features
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Tell us about the problem you're trying to solve
Currently, if I need to sync the same data from a source to multiple destinations, I have to define multiple Connections. For example, I might need to sync Salesforce data to BigQuery for analysis and Postgres for application access. I can reuse the Source configuration but each Connection entails a separate request to the Source API for the same data. This results in higher load on my Airbyte cluster and an unnecessary depletion of my API quota leading to higher costs.
Describe the solution you’d like
The Airbyte protocol already supports the standard exchange of information between a Source and Destination and Sources and Destinations are run independent of one another. Provide the ability to specify multiple destinations for a single Connection and run them with a single Source instance that passes the same data to both (or N) Destinations.
This is a discussion of this issue: #18129
Beta Was this translation helpful? Give feedback.
All reactions