Is there a way to specify a custom Python transformation stage on the way from Source to Destination? #46539
Unanswered
EgorKraevTransferwise
asked this question in
Connector Questions
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Airbyte looks like an awesome tool; however one thing I couldn't find is a way to specify a custom transform while loading data. For example, I would want to apply a custom chunking algorithm to incoming Confluence pages, eg calling LLMs to do it, whatever, and then load the resulting chunks rather than the raw pages (so one-to-many transform).
Is there a graceful way to do this right now? Seems this would multiply the power of Airbyte by a lot.
Beta Was this translation helpful? Give feedback.
All reactions