MLFlow Operator

[felipemoz]

Description
Helping MLOps team to tigger ML jobs after Airflow steps (new operator)

Use case / motivation
You can trigger mlflow jobs like sagemaker operator

[boring-cyborg[bot]]

Thanks for opening your first issue here! Be sure to follow the issue template!

[turbaszek]

Hi @felipemoz would you like to work on it? This sounds like an interesting feature. I am happy to help if you decide to implement those operators :)

[subkanthi]

Hi @turbaszek , @felipemoz , Is this something I can tackle, please let me know.

[turbaszek]

@subkanthi feel free to open a PR :)

[subkanthi]

@felipemoz for this task, were u thinking of using the Mlflow REST API to create runs? I see it very similar to the databricks REST API to start jobs. Im still trying to figure out how to pass the python file location or the model in REST API.

[rd16395p]

Was there any movement on this? I can help code this feature.

[subkanthi]

Hi @rd16395p ,I wasnt clear on what needs to be added, since there is already a MLflow operator, please proceed if u have clarity.

[rd16395p]

@subkanthi Sure! I can try. I was thinking a few functions, such as the one commented above with sagemaker integration. I can see that being useful from my own experience. What do you think?

[subkanthi]

Hey @rd16395p , I have some time now, I can work on this, please let me know.
@turbaszek can you please assign this back to me if @rd16395p didnt get started.

[rd16395p]

@subkanthi Why don't we work together on it?

[vijaya-lakshmi-venkatraman]

Hello,
Is this still available?

[rd16395p]

Hello! Sorry about the very long delay - yes! Lets work together on this during the weekend.

…

On Feb 2, 2022, at 8:17 AM, Vijaya Lakshmi Venkatraman ***@***.***> wrote:  Hello, Is this still available? — Reply to this email directly, view it on GitHub, or unsubscribe. Triage notifications on the go with GitHub Mobile for iOS or Android. You are receiving this because you were mentioned.

[Superskyyy]

Hello, is there any new progress on this?

[potiuk]

@Superskyyy - I think the easiest way is to get it done is to work on it. For now I will move it discussion (where it belongs) but if you would like to contribute (as one of > 2000 contributors) and male a PR to get it implemented, that would be cooll

[adamwrobel-ext-gd]

Hey guys, any progress on this topic? Are you looking for contributors?

[Taragolis]

Still the same, no one create a PR ¯\_(ツ)_/¯

[timonviola]

There is a provider package by Astronomer https://github.com/astronomer/airflow-provider-mlflow/