airflow #145
bb-dmelcone
started this conversation in
Ideas
airflow
#145
Replies: 1 comment
-
|
I have never used Airflow myself, but given that Airflow nowadays uses svcs themselves, I would assume it's possible! I would love if we had more obvious uses and what you're describing sounds like a perfect svcs use case. Not sure how to help you here tho – I don't have the bandwidth to learn Airflow just to write integration. 😅 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
support use in Apache Airflow?
its an interesting domain because the distributed workers design gives high performance impact to top level imports. this has led to some weird designs like passing a dict of module to module instances. and in general handling dependencies is a big gap in airflow.
let me know if this belongs elsewhere! also, i am happy to try to draft something for this!
Beta Was this translation helpful? Give feedback.
All reactions