You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-deploy-mlflow-models-online-endpoints.md
+25-24Lines changed: 25 additions & 24 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -332,7 +332,7 @@ version = registered_model.version
332
332
}
333
333
```
334
334
335
-
Write this configuration information to a `JSON`file:
335
+
Use the following code to write this configuration information to a `JSON`file:
336
336
337
337
```python
338
338
endpoint_config_path ="endpoint_config.json"
@@ -420,7 +420,7 @@ version = registered_model.version
420
420
> [!NOTE]
421
421
> For details about the full specification of this configuration, see [Managed online deployment schema (v2)](reference-yaml-deployment-managed-online.md).
422
422
423
-
Write the configuration to a file:
423
+
Use the following code to write the configuration to a file:
424
424
425
425
```python
426
426
deployment_config_path = "deployment_config.json"
@@ -468,20 +468,20 @@ version = registered_model.version
468
468
469
469
# [Studio](#tab/studio)
470
470
471
-
1. Select __Endpoints__. Go to the **Real-time endpoints** tab, and then select **Create**.
471
+
1. Select __Endpoints__. Go to the __Real-time endpoints__ tab, and then select __Create__.
472
472
473
473
:::image type="content"source="media/how-to-deploy-mlflow-models-online-endpoints/create-from-endpoints.png"lightbox="media/how-to-deploy-mlflow-models-online-endpoints/create-from-endpoints.png" alt-text="Screenshot showing create option on the Endpoints UI page.":::
474
474
475
-
1. Select the MLflow model that you registered previously, and then select **Select**.
475
+
1. Select the MLflow model that you registered previously, and then select __Select__.
476
476
477
477
> [!NOTE]
478
478
> The configuration page includes a note to inform you that the scoring script and environment are automatically generated for your selected MLflow model.
479
479
480
-
1. Under **Endpoint**, select **New** to deploy to a new endpoint.
480
+
1. Under __Endpoint__, select __New__ to deploy to a new endpoint.
481
481
482
-
1. Under **Endpoint name**, enter a name for the endpoint or keep the default name.
482
+
1. Under __Endpoint name__, enter a name for the endpoint or keep the default name.
483
483
484
-
1. Under **Deployment name**, enter a name for the deployment or keep the default name.
484
+
1. Under __Deployment name__, enter a name for the deployment or keep the default name.
485
485
486
486
1. Select __Deploy__ to deploy the model to the endpoint.
487
487
@@ -645,7 +645,7 @@ The response should be similar to the following text:
645
645
---
646
646
647
647
> [!IMPORTANT]
648
-
> For MLflow no-code-deployment, **[testing via local endpoints](how-to-deploy-online-endpoints.md#deploy-and-debug-locally-by-using-a-local-endpoint)** is currently not supported.
648
+
> For MLflow no-code-deployment, __[testing via local endpoints](how-to-deploy-online-endpoints.md#deploy-and-debug-locally-by-using-a-local-endpoint)__ is currently not supported.
649
649
650
650
651
651
## Customize MLflow model deployments
@@ -712,12 +712,12 @@ To deploy an MLflow model with a custom scoring script:
712
712
# [Studio](#tab/studio)
713
713
714
714
1. On the side menu, select __Environments__.
715
-
1. Select __Custom environments__ > __Create__.
716
-
1. Enter the name of the environment, in this case`sklearn-mlflow-online-py37`.
717
-
1. For __Select environment source__, select __Use existing docker image with optional conda file__.
718
-
1. For __Container registry image path__, enter `mcr.microsoft.com/azureml/openmpi4.1.0-ubuntu22.04`.
715
+
1. Go to the __Custom environments__ tab, and then select __Create__.
716
+
1. Under __Name__, enter the name of the environment. In this case, enter **sklearn-mlflow-online-py37**.
717
+
1. Under __Select environment source__, select __Use existing docker image with optional conda file__.
718
+
1. Under __Container registry image path__, enter **mcr.microsoft.com/azureml/openmpi4.1.0-ubuntu22.04**.
719
719
1. Select __Next__ to go to the __Customize__ section.
720
-
1. Copy the content of the `sklearn-diabetes/environment/conda.yml`fileand paste it in the text box.
720
+
1. Copy the contents of the sklearn-diabetes/environment/conda.yamlfileand paste it in the text box.
721
721
1. Select __Next__ to go to the __Tags__ page, and then select __Next__ again.
722
722
1. On the __Review__ page, select __Create__. The environment is ready for use.
723
723
---
@@ -775,23 +775,24 @@ To deploy an MLflow model with a custom scoring script:
775
775
776
776
# [Studio](#tab/studio)
777
777
778
-
1. On the __Endpoints__ page, Select **+Create**.
779
-
1. Select the MLflow model that you registered previously.
778
+
1. On the __Endpoints__ page, Select __Create__.
779
+
1. Select the MLflow model that you registered previously, and then select __Select__.
780
780
1. In the endpoint creation wizard, select __More options__ to open up advanced options.
781
781
782
782
:::image type="content"source="media/how-to-deploy-mlflow-models-online-endpoints/select-advanced-deployment-options.png"lightbox="media/how-to-deploy-mlflow-models-online-endpoints/select-advanced-deployment-options.png" alt-text="Screenshot showing how to select advanced deployment options when creating an endpoint.":::
783
783
784
-
1. Provide a name and authentication typefor the endpoint, and then select __Next__ to see that the model you selected is being used for your deployment.
785
-
1. Select __Next__ to continue to the ___Deployment__ page.
786
-
1. Select __Next__ to go to the __Code + environment__ page.
787
-
1. Select the slider next to __Customize environment and scoring script__.
784
+
1. Enter a name and authentication typefor the endpoint, and then select __Next__.
785
+
1. Check to see that the model you selected is being used for your deployment, and then select __Next__ to continue to the ___Deployment__ page.
786
+
1. Select __Next__.
787
+
1. On the __Code and environment for inferencing__ page, next to __Customize environment and scoring script__, select the slider. When you select a model that's registered in MLflow format, you don't need to specify a scoring script or an environment. But in this case, you want to specify both.
788
788
789
789
:::image type="content"source="media/how-to-deploy-mlflow-models-online-endpoints/configure-scoring-script-mlflow.png"lightbox="media/how-to-deploy-mlflow-models-online-endpoints/configure-scoring-script-mlflow.png" alt-text="Screenshot showing how to indicate an environment and scoring script for MLflow models.":::
790
790
791
-
1. Browse to select the scoring script you created previously.
792
-
1. For the environment type, select __Custom environments__.
791
+
1. Under __Select a scoring script for inferencing__, select __Browse__ to select the scoring script you created previously.
792
+
1. Under __Select environment type__, select __Custom environments__.
793
793
1. Select the custom environment you created previously, and then select __Next__.
794
-
1. Complete the wizard to deploy the model to the endpoint.
794
+
1. On the __Compute__ and __Live Traffic__ pages, select __Next__.
795
+
1. On the __Review__ page, select __Create__ to deploy the model to the endpoint.
0 commit comments